Assignment task:
A. Was there adequate statistical power? Did the manner in which the independent variable was operationalized create strong contrast that enhanced statistical power? Was precision enhanced by controlling confounding variables? If hypothesis were not supported, is it possible that statistical conclusion validity was compromised and the results are wrong?
B. In Intervention studies, did the researchers attend to intervention Fidelity? For example, or staff trained? Was the implementation of the intervention monitored? What attention paid to both the delivery and receipt of the intervention?
C. What evidence does the report provide that selection biases were eliminated or minimized? What steps were taken to control confounding participant characteristics that could affect the equivalent of groups being compared? Were the steps adequate?
D. To what extent did the research design rule out the plausibility of other threats to internal validity, such as history, attrition, maturation, and so on? What are your overall conclusions about the internal validity of the study?
E. Were there any major threats to the construct validity of the study in intervention studies? Was there a good match between the underlying conceptualization of the intervention and its operationalization? Was the intervention confounded with extraneous content, such as researcher expectation? With the setting or site a good exemplar of the type of setting vision in the conceptualization?
F. Was the contacts of the study sufficiently described to enhance its capacity for external validity?
G. Were the settings or participants representative of the types to which results were designed to be generalized?
H. Overall, did the researcher appropriately balanced validity, concerns? Was attention paid to certain types of threats (e.g., Internal validity) at the expense of others (e.g., external validity)?