When researchers set their alpha level at .05, they reject the null hypothesis (and conclude that the independent variable has an effect) only if there is less than a 5% chance that the differences among the means are due to error variance.
Does this mean that 5% of all results reported in the research literature are, in fact, Type I errors rather than real effects of the independent variables?