Skip to main content
Top
Published in: European Journal of Nuclear Medicine and Molecular Imaging 12/2019

01-11-2019 | Editorial

The p value wars (again)

Author: Ulrich Dirnagl

Published in: European Journal of Nuclear Medicine and Molecular Imaging | Issue 12/2019

Login to get access

Excerpt

More than 800 researchers, many of them prominent biostatisticians, called to “raise up against the p-value.” [1] This recent battle cry was just the climax of a growing insurrection, which prominently surfaced in 2018 when another group of biostatisticians demanded that we should “redefine statistical significance,” [2] and proposed to change the default p value threshold for statistical significance from 0.05 to 0.005 for claims of new discoveries. For many researchers and experts, this demand did not go far enough; in a follow-up statement, they demanded to “remove rather than redefine statistical significance.” [3] This apparent upheaval even made it into the lay press. The Financial Times, for example, analyzed that “Scientists strike back against statistical tyranny.” [4] What’s all the fuzz about? …
Literature
1.
go back to reference Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature. 2019;567:305–7.CrossRef Amrhein V, Greenland S, McShane B. Scientists rise up against statistical significance. Nature. 2019;567:305–7.CrossRef
2.
go back to reference Benjamin DJ, Berger JO, Johannesson M, Nosek BA, Wagenmakers E-J, Berk R, et al. Redefine statistical significance. Nat Hum Behav. 2018;2:6–10.CrossRef Benjamin DJ, Berger JO, Johannesson M, Nosek BA, Wagenmakers E-J, Berk R, et al. Redefine statistical significance. Nat Hum Behav. 2018;2:6–10.CrossRef
3.
go back to reference Amrhein V, Greenland S. Remove, rather than redefine, statistical significance. Nat Hum Behav. 2018;2:4.CrossRef Amrhein V, Greenland S. Remove, rather than redefine, statistical significance. Nat Hum Behav. 2018;2:4.CrossRef
4.
go back to reference Anjana A. Scientists strike back against statistical tyranny | Financial Times. Financial Times; 2019. Anjana A. Scientists strike back against statistical tyranny | Financial Times. Financial Times; 2019.
5.
go back to reference Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533:452–4.CrossRef Baker M. 1,500 scientists lift the lid on reproducibility. Nature. 2016;533:452–4.CrossRef
6.
go back to reference Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2:0696–701. Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2:0696–701.
7.
go back to reference Ioannidis JPA, Fanelli D, Dunne DD, Goodman SN. Meta-research: evaluation and improvement of research methods and practices. PLoS Biol. 2015;13:e1002264.CrossRef Ioannidis JPA, Fanelli D, Dunne DD, Goodman SN. Meta-research: evaluation and improvement of research methods and practices. PLoS Biol. 2015;13:e1002264.CrossRef
8.
go back to reference Henderson VC, Demko N, Hakala A, MacKinnon N, Federico CA, Fergusson D, et al. A meta-analysis of threats to valid clinical inference in preclinical research of sunitinib. Elife. 2015;4:1–13.CrossRef Henderson VC, Demko N, Hakala A, MacKinnon N, Federico CA, Fergusson D, et al. A meta-analysis of threats to valid clinical inference in preclinical research of sunitinib. Elife. 2015;4:1–13.CrossRef
9.
go back to reference Nissen SB, Magidson T, Gross K, Bergstrom CT. Publication bias and the canonization of false facts. 2016.CrossRef Nissen SB, Magidson T, Gross K, Bergstrom CT. Publication bias and the canonization of false facts. 2016.CrossRef
10.
go back to reference Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, et al. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14:365–76.CrossRef Button KS, Ioannidis JPA, Mokrysz C, Nosek BA, Flint J, Robinson ESJ, et al. Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci. 2013;14:365–76.CrossRef
11.
go back to reference Colquhoun D. The reproducibility of research and the misinterpretation of p-values. R Soc Open Sci. 2017;4:171085.CrossRef Colquhoun D. The reproducibility of research and the misinterpretation of p-values. R Soc Open Sci. 2017;4:171085.CrossRef
13.
go back to reference Bennett CM, Baird AA, Miller MB, Wolford GL. Neural correlates of interspecies perspective taking in the post-mortem Atlantic salmon: an argument for proper multiple comparisons correction. J Serendipitous Unexpected Results. 2011;1:1–5. Bennett CM, Baird AA, Miller MB, Wolford GL. Neural correlates of interspecies perspective taking in the post-mortem Atlantic salmon: an argument for proper multiple comparisons correction. J Serendipitous Unexpected Results. 2011;1:1–5.
14.
go back to reference Mudge JF, Martyniuk CJ, Houlahan JE. Optimal alpha reduces error rates in gene expression studies: a meta-analysis approach. BMC Bioinformatics. 2017;18:312.CrossRef Mudge JF, Martyniuk CJ, Houlahan JE. Optimal alpha reduces error rates in gene expression studies: a meta-analysis approach. BMC Bioinformatics. 2017;18:312.CrossRef
16.
go back to reference Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K. A comprehensive review of genetic association studies. Genet Med. 2002;4:45–61.CrossRef Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K. A comprehensive review of genetic association studies. Genet Med. 2002;4:45–61.CrossRef
17.
go back to reference Lew MJ. Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don’t know P. Br J Pharmacol. 2012;166:1559–67.CrossRef Lew MJ. Bad statistical practice in pharmacology (and other basic biomedical disciplines): you probably don’t know P. Br J Pharmacol. 2012;166:1559–67.CrossRef
18.
go back to reference Diong J, Butler AA, Gandevia SC, Héroux ME. Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice. PLoS One. 2018;13:e0202121.CrossRef Diong J, Butler AA, Gandevia SC, Héroux ME. Poor statistical reporting, inadequate data presentation and spin persist despite editorial advice. PLoS One. 2018;13:e0202121.CrossRef
19.
go back to reference Nickerson RS. Null hypothesis significance testing: a review of an old and continuing controversy. Psychol Methods. 2000;5:241–301.CrossRef Nickerson RS. Null hypothesis significance testing: a review of an old and continuing controversy. Psychol Methods. 2000;5:241–301.CrossRef
21.
go back to reference Bialik C. How to be sure you’ve found a Higgs boson. Wall Street J. 2012. Bialik C. How to be sure you’ve found a Higgs boson. Wall Street J. 2012.
22.
go back to reference Overbye D. Tiny neutrinos may have broken cosmic speed limit: The New York Times; 2011. Overbye D. Tiny neutrinos may have broken cosmic speed limit: The New York Times; 2011.
24.
go back to reference Ioannidis JP, The A. Importance of predefined rules and prespecified statistical analyses. JAMA. 2019;321:2067.CrossRef Ioannidis JP, The A. Importance of predefined rules and prespecified statistical analyses. JAMA. 2019;321:2067.CrossRef
25.
go back to reference Ioannidis JPA. Retiring statistical significance would give bias a free pass. Nature. 2019;567:461–1. Ioannidis JPA. Retiring statistical significance would give bias a free pass. Nature. 2019;567:461–1.
26.
go back to reference Kimmelman J, Mogil JS, Dirnagl U. Distinguishing between exploratory and confirmatory preclinical research will improve translation. PLoS Biol. 2014;12:e1001863.CrossRef Kimmelman J, Mogil JS, Dirnagl U. Distinguishing between exploratory and confirmatory preclinical research will improve translation. PLoS Biol. 2014;12:e1001863.CrossRef
27.
go back to reference Harlow, L. L., Mulaik, S. A. & Steiger, J. H. What if there were no significance tests? (1997). Harlow, L. L., Mulaik, S. A. & Steiger, J. H. What if there were no significance tests? (1997).
28.
29.
go back to reference Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond ‘p<0.05’. Am Stat. 2019;73:1–19.CrossRef Wasserstein RL, Schirm AL, Lazar NA. Moving to a world beyond ‘p<0.05’. Am Stat. 2019;73:1–19.CrossRef
Metadata
Title
The p value wars (again)
Author
Ulrich Dirnagl
Publication date
01-11-2019
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Nuclear Medicine and Molecular Imaging / Issue 12/2019
Print ISSN: 1619-7070
Electronic ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-019-04467-5

Other articles of this Issue 12/2019

European Journal of Nuclear Medicine and Molecular Imaging 12/2019 Go to the issue