Abstract
Significance The lack of reproducibility of scientific research undermines public confidence in science and leads to the misuse of resources when researchers attempt to replicate and extend fallacious research findings. Using recent developments in Bayesian hypothesis testing, a root cause of nonreproducibility is traced to the conduct of significance tests at inappropriately high levels of significance. Modifications of common standards of evidence are proposed to reduce the rate of nonreproducibility of scientific research by a factor of 5 or greater.
Keywords
Statistical hypothesis testingBayesian probabilityBayes factorBayes' theoremDeclarationStatistical significanceEconometricsAlternative hypothesisStatistical evidenceSignificance testingStatisticsPsychologyCognitive psychologyMathematicsComputer scienceNull hypothesis
MeSH Terms
Bayes TheoremModelsStatisticalReproducibility of ResultsStatistics as Topic
Affiliated Institutions
Related Publications
Bayes Factors
Abstract In a 1935 paper and in his book Theory of Probability, Jeffreys developed a methodology for quantifying the evidence in favor of a scientific theory. The centerpiece wa...
Testing a Point Null Hypothesis: The Irreconcilability of<i>P</i>Values and Evidence
Abstract The problem of testing a point null hypothesis (or a "small interval" null hypothesis) is considered. Of interest is the relationship between the P value (or observed s...
Testing Precise Hypotheses
Testing of precise (point or small interval) hypotheses is reviewed, with special emphasis placed on exploring the dramatic conflict between conditional measures (Bayes factors ...
A comparison of several approximations to the power function of the likelihood ratio test in covariance structure analysis*
In this paper we compare alternative asymptotic approximations to the power of the likelihood ratio test used in covariance structure analysis for testing the fit of a model. Al...
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Improving the reproducibility of biomedical research is a major challenge. Transparent and accurate reporting is vital to this process; it allows readers to assess the reliabili...
Publication Info
- Year
- 2013
- Type
- article
- Volume
- 110
- Issue
- 48
- Pages
- 19313-19317
- Citations
- 804
- Access
- Closed
External Links
Social Impact
Altmetric
PlumX Metrics
Social media, news, blog, policy document mentions
Citation Metrics
804
OpenAlex
118
Influential
Cite This
Valen E. Johnson
(2013).
Revised standards for statistical evidence.
Proceedings of the National Academy of Sciences
, 110
(48)
, 19313-19317.
https://doi.org/10.1073/pnas.1313476110
Identifiers
- DOI
- 10.1073/pnas.1313476110
- PMID
- 24218581
- PMCID
- PMC3845140