Part introduces you to a debate in the field of education between those who support Null Hypothesis Significance Testing (NHST) and those who argue that NHST is poorly suited to most of the questions educators are interested in. Jackson (2012) and Trochim and Donnelly (2006) pretty much follow this model. Northcentral follows it. But, as the authors of the readings for Part argue, using statistical analyses based on this model may yield very misleading results. You may or may not propose a study that uses alternative models of data analysis and presentation of findings (e.g., confidence intervals and effect sizes) or supplements NHST with another model. In any case, by learning about alternatives to NHST, you will better understand it and the culture of the field of education.
Answer the following questions:
1. What does p = .05 mean? What are some misconceptions about the meaning of p =.05? Why are they wrong? Should all research adhere to the p = .05 standard for significance? Why or why not?
2. Compare and contrast the concepts of effect size and statistical significance.
3. What is the difference between a statistically significant result and a clinically or "real world" significant result? Give examples of both.
4. What is NHST? Describe the assumptions of the model.
5. Describe and explain three criticisms of NHST.
6. Describe and explain two alternatives to NHST. What do their proponents consider to be their advantages?
7. Which type of analysis would best answer the research question you stated in activity? Justify your answer.