Homework: Evaluate a Quantitative Study
Length: 2100 to 2800 words.
The following questions may help you in evaluating your articles, though you do not have to follow this format exactly.
I. Evaluate the Introduction and Literature Review.
i. Do the researchers present an adequate rationale for conducting the study? Explain.
ii. What is the significance of the study? What difference will it make to the field?
iii. Is the literature review thorough and comprehensive?
iv. Do the researchers demonstrate any potential biases in the literature review?
v. Are all-important concepts clearly defined by the researchers?
vi. Do the researchers clearly describe previous methods that are relevant to understanding the purpose for conducting this study?
II. Evaluate the Purpose Statement and Hypothesis.
i. Does the article clearly state the purpose statement?
ii. What is the purpose statement as expressed in the article?
iii. Is the purpose statement clearly based on the argument developed in the literature review?
iv. Are the variables of interest (i.e. independent and dependent) clearly identified in the purpose statement?
v. What type of hypothesis is presented (alternative nondirectional, alternative directional, or null hypothesis)?
vi. Do the investigators provide a clear rationale for the direction of their hypothesis, based on the literature review?
vii. Is the hypothesis testable and falsifiable?
viii. Is the hypothesis stated with brevity and clarity?
III. Evaluate the Methods Section.
i. What type of sampling method is used? Is that appropriate?
ii. Are relevant demographic characteristics of the sample clearly identified?
iii. Do the methods of sample selection used by the researchers provide a good representative sample, based on the population?
iv. Are there any apparent biases in selection of the sample?
v. Is the sample size large enough for the study proposed?
vi. Is a particular quantitative research design used (e.g. true experimental, quasi-experimental, etc.)? If so, what is it?
vii. Is the research design consistent with the purpose and hypothesis presented in the introduction?
viii. Are the independent variables clearly defined so that they can be replicated using the information provided in the procedures section?
ix. What are some of the potential threats to internal validity? How are they threats?
x. What are some of the potential threats to external validity? How are they threats?
xi. Is there a clear and adequate description of the instrument (data collection measures) used?
xii. What types of measures were used in the study (direct observation, behavioral measures, self-report, etc.)?
xiii. What are some of the potential problems or limitations with the types of measures used?
xiv. To what extent are the instruments standardized, and what types of standardized scoring were used?
xv. Does the instrument appear to be appropriate for the sample?
xvi. Is the reliability of the instrument reported? Is the reliability adequate?
xvii. What types of validity are reported for the instrument used? Is the validity adequate?
IV. Evaluate the Results Section.
i. What descriptive statistics were used? Do the researchers adequately describe the sample?
ii. What types of inferential statistics were used? Are the inferential statistics used adequate to answer the research hypotheses or questions?
iii. Is the analysis method clearly described?
V. Evaluate the Discussion Section.
i. Do the researchers clearly restate the purpose and research questions?
ii. Do the researchers clearly discuss the implications of the findings and how they relate to theories, other findings, and actual practice?
iii. Do the researchers identify potential limitations of the study and the results?
iv. Do the researchers identify possible directions for future research?
VI. Remaining Questions.
i. What aspects of quantitative methods do you still find challenging?
ii. Was there any information in the above list that you were not able to find in the article you chose?
Format your homework according to the following formatting requirements:
i) The answer should be typed, using Times New Roman font (size 12), double spaced, with one-inch margins on all sides.
ii) The response also includes a cover page containing the title of the homework, the student's name, the course title, and the date. The cover page is not included in the required page length.
iii) Also include a reference page. The Citations and references must follow APA format. The reference page is not included in the required page length.