The Role of Statistical Significance Testing In Educational Research

The research methodology literature in recent years has included a full frontal assault on statistical significance testing.The purpose of this paper is to promote the position that, while significance testing as the sole basis for resultinterpretation is a fundamentally flawed practice, significance tests can be useful as one of several elements in acomprehensive interpretation of data. Specifically, statistical significance is but one of three criteria that must bedemonstrated to establish a position empirically. Statistical significance merely provides evidence that an event did nothappen by chance. However, it provides no information about the meaningfulness (practical significance) of an eventor if the result is replicable. Thus, we support other researchers who recommend that statistical sign ificance testing mustbe accompanied by judgments of the event’s practical significance and replicability.