Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

A nomogram for Pvalues

Author: Leonhard Held

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

P values are the most commonly used tool to measure evidence against a hypothesis. Several attempts have been made to transform P values to minimum Bayes factors and minimum posterior probabilities of the hypothesis under consideration. However, the acceptance of such calibrations in clinical fields is low due to inexperience in interpreting Bayes factors and the need to specify a prior probability to derive a lower bound on the posterior probability.

Methods

I propose a graphical approach which easily translates any prior probability and P value to minimum posterior probabilities. The approach allows to visually inspect the dependence of the minimum posterior probability on the prior probability of the null hypothesis. Likewise, the tool can be used to read off, for fixed posterior probability, the maximum prior probability compatible with a given P value. The maximum P value compatible with a given prior and posterior probability is also available.

Results

Use of the nomogram is illustrated based on results from a randomized trial for lung cancer patients comparing a new radiotherapy technique with conventional radiotherapy.

Conclusion

The graphical device proposed in this paper will enhance the understanding of P values as measures of evidence among non-specialists.
Appendix
Available only for authorised users
Literature
1.
go back to reference Goodman SN: P Value. Encyclopedia of Biostatistics. 2005, Chichester: Wiley, 3921-3925. 2 Goodman SN: P Value. Encyclopedia of Biostatistics. 2005, Chichester: Wiley, 3921-3925. 2
2.
go back to reference Cohan J: The Earth is Round (p < .05). Am Psychol. 1994, 49: 997-1003. 10.1037/0003-066X.49.12.997.CrossRef Cohan J: The Earth is Round (p < .05). Am Psychol. 1994, 49: 997-1003. 10.1037/0003-066X.49.12.997.CrossRef
3.
go back to reference Goodman SN: Towards Evidence-Based Medical Statistics. 1: The P Value Fallacy. Ann Int Med. 1999, 130: 995-1004.CrossRefPubMed Goodman SN: Towards Evidence-Based Medical Statistics. 1: The P Value Fallacy. Ann Int Med. 1999, 130: 995-1004.CrossRefPubMed
4.
go back to reference Hubbard R, Bayarri MJ: Confusion over measures of evidence (p 's) versus errors (α's) in classical statistical testing (with discussion). Am Stat. 2003, 57: 171-182. 10.1198/0003130031856.CrossRef Hubbard R, Bayarri MJ: Confusion over measures of evidence (p 's) versus errors (α's) in classical statistical testing (with discussion). Am Stat. 2003, 57: 171-182. 10.1198/0003130031856.CrossRef
5.
go back to reference Spiegelhalter DJ, Abrams KR, Myles JP: Bayesian Approaches to Clinical Trials and Health-Care Evaluation. 2004, New York: Wiley Spiegelhalter DJ, Abrams KR, Myles JP: Bayesian Approaches to Clinical Trials and Health-Care Evaluation. 2004, New York: Wiley
6.
go back to reference Goodman SN: Introduction to Bayesian methods I: measuring the strength of evidence. Clin Trials. 2005, 2: 282-290. 10.1191/1740774505cn098oa.CrossRefPubMed Goodman SN: Introduction to Bayesian methods I: measuring the strength of evidence. Clin Trials. 2005, 2: 282-290. 10.1191/1740774505cn098oa.CrossRefPubMed
7.
go back to reference Edwards W, Lindman H, Savage LJ: Bayesian Statistical Inference in Psychological Research. Psych Rev. 1963, 70: 193-242. 10.1037/h0044139.CrossRef Edwards W, Lindman H, Savage LJ: Bayesian Statistical Inference in Psychological Research. Psych Rev. 1963, 70: 193-242. 10.1037/h0044139.CrossRef
8.
go back to reference Berger JO, Sellke T: Testing a point null hypothesis: Irreconcilability of P values and evidence (with discussion). J Am Stat Assoc. 1987, 82: 112-139. 10.2307/2289131. Berger JO, Sellke T: Testing a point null hypothesis: Irreconcilability of P values and evidence (with discussion). J Am Stat Assoc. 1987, 82: 112-139. 10.2307/2289131.
9.
go back to reference Goodman SN: Towards Evidence-Based Medical Statistics. 2: The Bayes Factor. Ann Int Med. 1999, 130: 1005-1013.CrossRefPubMed Goodman SN: Towards Evidence-Based Medical Statistics. 2: The Bayes Factor. Ann Int Med. 1999, 130: 1005-1013.CrossRefPubMed
10.
go back to reference Sellke T, Bayarri MJ, Berger JO: Calibration of p Values for Testing Precise Null Hypotheses. Am Stat. 2001, 55: 62-71. 10.1198/000313001300339950.CrossRef Sellke T, Bayarri MJ, Berger JO: Calibration of p Values for Testing Precise Null Hypotheses. Am Stat. 2001, 55: 62-71. 10.1198/000313001300339950.CrossRef
11.
go back to reference Johnson VE: Bayes factors based on test statistics. J Roy Stat Soc B. 2005, 67: 689-701. 10.1111/j.1467-9868.2005.00521.x.CrossRef Johnson VE: Bayes factors based on test statistics. J Roy Stat Soc B. 2005, 67: 689-701. 10.1111/j.1467-9868.2005.00521.x.CrossRef
13.
go back to reference Fagan TJ: Letter: Nomogram for Bayes theorem. N Engl J Med. 1975, 293: 257-PubMed Fagan TJ: Letter: Nomogram for Bayes theorem. N Engl J Med. 1975, 293: 257-PubMed
14.
go back to reference Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR: Bayesian Methods in Health Technology Assessment: A Review. Health Technol Assess. 2000, 4 (38): Spiegelhalter DJ, Myles JP, Jones DR, Abrams KR: Bayesian Methods in Health Technology Assessment: A Review. Health Technol Assess. 2000, 4 (38):
15.
go back to reference Hooper R: The Bayesian interpretation of a P-value depends only weakly on statistical power in realistic situations. J Clin Epidemiol. 2009, 62: 1242-1247. 10.1016/j.jclinepi.2009.02.004.CrossRefPubMed Hooper R: The Bayesian interpretation of a P-value depends only weakly on statistical power in realistic situations. J Clin Epidemiol. 2009, 62: 1242-1247. 10.1016/j.jclinepi.2009.02.004.CrossRefPubMed
16.
go back to reference Cox DR: Principles of Statistical Inference. 2005, Cambridge: Cambridge University Press Cox DR: Principles of Statistical Inference. 2005, Cambridge: Cambridge University Press
Metadata
Title
A nomogram for Pvalues
Author
Leonhard Held
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-21

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue