Abstract
In null hypothesis significance testing (NHST), p values are judged relative to an arbitrary threshold for significance (.05). The present work examined whether that standard influences the distribution of p values reported in the psychology literature. We examined a large subset of papers from three highly regarded journals. Distributions of p were found to be similar across the different journals. Moreover, p values were much more common immediately below .05 than would be expected based on the number of p values occurring in other ranges. This prevalence of p values just below the arbitrary criterion for significance was observed in all three journals. We discuss potential sources of this pattern, including publication bias and researcher degrees of freedom.
Keywords
Statistical significanceNull hypothesisSignificance testingStatisticsPsychologyStatistical hypothesis testingMathematicsSocial psychology
Affiliated Institutions
Related Publications
Testing a Point Null Hypothesis: The Irreconcilability of<i>P</i>Values and Evidence
Abstract The problem of testing a point null hypothesis (or a "small interval" null hypothesis) is considered. Of interest is the relationship between the P value (or observed s...
Statistics: Reasoning on Uncertainty, and the Insignificance of Testing Null
The practice of statistical analysis and inference in ecology is critically reviewed. The dominant doctrine of null hypothesis significance testing (NHST) continues to be applie...
Inference on the Order of a Normal Mixture
Finite normal mixture models are used in a wide range of applications. Hypothesis testing on the order of the normal mixture is an important yet unsolved problem. Existing proce...
Effect size, confidence interval and statistical significance: a practical guide for biologists
Abstract Null hypothesis significance testing (NHST) is the dominant statistical approach in biology, although it has many, frequently unappreciated, problems. Most importantly,...
The Fifth edition of the Apa Publication Manual: Why its Statistics Recommendations are so Controversial
The fifth edition of the Publication Manual of the American Psychological Association (APA) draws on recommendations for improving statistical practices made by the APA Task For...
Publication Info
- Year
- 2012
- Type
- article
- Volume
- 65
- Issue
- 11
- Pages
- 2271-2279
- Citations
- 267
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
267
OpenAlex
Cite This
E. J. Masicampo,
Daniel Lalande
(2012).
A peculiar prevalence of <i>p</i> values just below .05.
Quarterly Journal of Experimental Psychology
, 65
(11)
, 2271-2279.
https://doi.org/10.1080/17470218.2012.711335
Identifiers
- DOI
- 10.1080/17470218.2012.711335