Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2009

Open Access 01-12-2009 | Research article

Calculation of NNTs in RCTs with time-to-event outcomes: A literature review

Authors: Mandy Hildebrandt, Elke Vervölgyi, Ralf Bender

Published in: BMC Medical Research Methodology | Issue 1/2009

Login to get access

Abstract

Background

The number needed to treat (NNT) is a well-known effect measure for reporting the results of clinical trials. In the case of time-to-event outcomes, the calculation of NNTs is more difficult than in the case of binary data. The frequency of using NNTs to report results of randomised controlled trials (RCT) investigating time-to-event outcomes and the adequacy of the applied calculation methods are unknown.

Methods

We searched in PubMed for RCTs with parallel group design and individual randomisation, published in four frequently cited journals between 2003 and 2005. We evaluated the type of outcome, the frequency of reporting NNTs with corresponding confidence intervals, and assessed the adequacy of the methods used to calculate NNTs in the case of time-to-event outcomes.

Results

The search resulted in 734 eligible RCTs. Of these, 373 RCTs investigated time-to-event outcomes and 361 analyzed binary data. In total, 62 articles reported NNTs (34 articles with time-to-event outcomes, 28 articles with binary outcomes). Of the 34 articles reporting NNTs derived from time-to-event outcomes, only 17 applied an appropriate calculation method. Of the 62 articles reporting NNTs, only 21 articles presented corresponding confidence intervals.

Conclusion

The NNT is used as effect measure to present the results from RCTs with binary and time-to-event outcomes in the current medical literature. In the case of time-to-event data incorrect methods were frequently applied. Confidence intervals for NNTs were given in one third of the NNT reporting articles only. In summary, there is much room for improvement in the application of NNTs to present results of RCTs, especially where the outcome is time to an event.
Appendix
Available only for authorised users
Literature
1.
go back to reference Laupacis A, Sackett DL, Roberts RS: An assessment of clinically useful measures of the consequences of treatment. N Engl J Med. 1988, 318: 1728-1733.CrossRefPubMed Laupacis A, Sackett DL, Roberts RS: An assessment of clinically useful measures of the consequences of treatment. N Engl J Med. 1988, 318: 1728-1733.CrossRefPubMed
3.
go back to reference Walter SD: Choice of effect measure for epidemiological data. J Clin Epidemiol. 2000, 53: 931-939. 10.1016/S0895-4356(00)00210-9.CrossRefPubMed Walter SD: Choice of effect measure for epidemiological data. J Clin Epidemiol. 2000, 53: 931-939. 10.1016/S0895-4356(00)00210-9.CrossRefPubMed
4.
go back to reference Hutton JL: Number needed to treat: Properties and problems. J R Stat Soc A. 2000, 163: 403-415.CrossRef Hutton JL: Number needed to treat: Properties and problems. J R Stat Soc A. 2000, 163: 403-415.CrossRef
5.
go back to reference Altman DG, Deeks JJ: Comments on the paper by Hutton. J R Stat Soc A. 2000, 163: 415-416. Altman DG, Deeks JJ: Comments on the paper by Hutton. J R Stat Soc A. 2000, 163: 415-416.
6.
go back to reference Lesaffre E, Pledger G: Comments on the paper by Hutton. J R Stat Soc A. 2000, 163: 417- Lesaffre E, Pledger G: Comments on the paper by Hutton. J R Stat Soc A. 2000, 163: 417-
7.
go back to reference Kristiansen IS, Gyrd-Hansen D, Nexøe J, Nielsen JB: Number needed to treat: Easily understood and intuitively meaningful? Theoretical considerations and a randomized trial. J Clin Epidemiol. 2002, 55: 888-892. 10.1016/S0895-4356(02)00432-8.CrossRefPubMed Kristiansen IS, Gyrd-Hansen D, Nexøe J, Nielsen JB: Number needed to treat: Easily understood and intuitively meaningful? Theoretical considerations and a randomized trial. J Clin Epidemiol. 2002, 55: 888-892. 10.1016/S0895-4356(02)00432-8.CrossRefPubMed
8.
go back to reference Grieve AP: The number needed to treat: A useful clinical measure or a case of the Emperor's new clothes?. Pharmaceut Stat. 2003, 2: 87-102. 10.1002/pst.33.CrossRef Grieve AP: The number needed to treat: A useful clinical measure or a case of the Emperor's new clothes?. Pharmaceut Stat. 2003, 2: 87-102. 10.1002/pst.33.CrossRef
9.
go back to reference Halvorsen PA, Kristiansen IS: Decisions on drug therapies by numbers needed to treat: A randomized trial. Arch Intern Med. 2005, 165: 1140-1146. 10.1001/archinte.165.10.1140.CrossRefPubMed Halvorsen PA, Kristiansen IS: Decisions on drug therapies by numbers needed to treat: A randomized trial. Arch Intern Med. 2005, 165: 1140-1146. 10.1001/archinte.165.10.1140.CrossRefPubMed
10.
go back to reference Nexøe J, Kristiansen IS, Gyrd-Hansen D, Nielsen JB: Influence of number needed to treat, costs and outcome on preferences for a preventive drug. Fam Pract. 2005, 22: 126-131. 10.1093/fampra/cmh706.CrossRefPubMed Nexøe J, Kristiansen IS, Gyrd-Hansen D, Nielsen JB: Influence of number needed to treat, costs and outcome on preferences for a preventive drug. Fam Pract. 2005, 22: 126-131. 10.1093/fampra/cmh706.CrossRefPubMed
11.
go back to reference Halvorsen PA, Selmer R, Kristiansen IS: Different ways to describe the benefits of risk-reducing treatments: A randomized trial. Ann Intern Med. 2007, 146: 848-856.CrossRefPubMed Halvorsen PA, Selmer R, Kristiansen IS: Different ways to describe the benefits of risk-reducing treatments: A randomized trial. Ann Intern Med. 2007, 146: 848-856.CrossRefPubMed
12.
go back to reference Bender R: Number needed to treat (NNT). Encyclopedia of Biostatistics. Edited by: Armitage P, Colton T. 2005, Chichester: Wiley, 3752-3761. Bender R: Number needed to treat (NNT). Encyclopedia of Biostatistics. Edited by: Armitage P, Colton T. 2005, Chichester: Wiley, 3752-3761.
13.
go back to reference Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne DR, Gøtzsche PC, Lang T, for the CONSORT Group: The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed Altman DG, Schulz KF, Moher D, Egger M, Davidoff F, Elbourne DR, Gøtzsche PC, Lang T, for the CONSORT Group: The revised CONSORT statement for reporting randomized trials: Explanation and elaboration. Ann Intern Med. 2001, 134: 663-694.CrossRefPubMed
15.
go back to reference Lubsen J, Hoes A, Grobbee D: Implications of trial results: The potentially misleading notations of number needed to treat and average duration life gained. Lancet. 2000, 356: 1757-1759. 10.1016/S0140-6736(00)03215-3.CrossRefPubMed Lubsen J, Hoes A, Grobbee D: Implications of trial results: The potentially misleading notations of number needed to treat and average duration life gained. Lancet. 2000, 356: 1757-1759. 10.1016/S0140-6736(00)03215-3.CrossRefPubMed
16.
go back to reference Mayne TJ, Whalen E, Vu A: Annualized was found better than absolute risk reduction in the calculation of number needed to treat in chronic conditions. J Clin Epidemiol. 2006, 59: 217-223. 10.1016/j.jclinepi.2005.07.006.CrossRefPubMed Mayne TJ, Whalen E, Vu A: Annualized was found better than absolute risk reduction in the calculation of number needed to treat in chronic conditions. J Clin Epidemiol. 2006, 59: 217-223. 10.1016/j.jclinepi.2005.07.006.CrossRefPubMed
17.
go back to reference Lin C-T, Wu SJS, Balakrishnan N: Parameter estimation for the linear hazard rate distribution based on records and inter-record times. Commun Stat A. 2003, 32: 729-748.CrossRef Lin C-T, Wu SJS, Balakrishnan N: Parameter estimation for the linear hazard rate distribution based on records and inter-record times. Commun Stat A. 2003, 32: 729-748.CrossRef
18.
go back to reference Liu GF, Wang J, Liu K, Snavely DB: Confidence intervals for an exposure adjusted incidence rate difference with applications to clinical trials. Stat Med. 2006, 25: 1275-1286. 10.1002/sim.2335.CrossRefPubMed Liu GF, Wang J, Liu K, Snavely DB: Confidence intervals for an exposure adjusted incidence rate difference with applications to clinical trials. Stat Med. 2006, 25: 1275-1286. 10.1002/sim.2335.CrossRefPubMed
19.
go back to reference Nuovo J, Melnikow J, Chang D: Reporting number needed to treat and absolute risk reduction in randomized controlled trials. JAMA. 2002, 287: 2813-2814. 10.1001/jama.287.21.2813.CrossRefPubMed Nuovo J, Melnikow J, Chang D: Reporting number needed to treat and absolute risk reduction in randomized controlled trials. JAMA. 2002, 287: 2813-2814. 10.1001/jama.287.21.2813.CrossRefPubMed
21.
go back to reference Moher D, Schulz KF, Altman DG, for the CONSORT Group: The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001, 134: 657-662.CrossRefPubMed Moher D, Schulz KF, Altman DG, for the CONSORT Group: The CONSORT statement: Revised recommendations for improving the quality of reports of parallel-group randomized trials. Ann Intern Med. 2001, 134: 657-662.CrossRefPubMed
23.
go back to reference Lesaffre E, Pledger G: A note on the number needed to treat. Control Clin Trials. 1999, 20: 439-447. 10.1016/S0197-2456(99)00018-5.CrossRefPubMed Lesaffre E, Pledger G: A note on the number needed to treat. Control Clin Trials. 1999, 20: 439-447. 10.1016/S0197-2456(99)00018-5.CrossRefPubMed
24.
go back to reference Bender R: Calculating confidence intervals for the number needed to treat. Control Clin Trials. 2001, 22: 102-110. 10.1016/S0197-2456(00)00134-3.CrossRefPubMed Bender R: Calculating confidence intervals for the number needed to treat. Control Clin Trials. 2001, 22: 102-110. 10.1016/S0197-2456(00)00134-3.CrossRefPubMed
25.
go back to reference Barrowman NJ: Missing the point (estimate)? Confidence intervals for the number needed to treat. CMAJ. 2002, 166: 1676-1677.PubMedPubMedCentral Barrowman NJ: Missing the point (estimate)? Confidence intervals for the number needed to treat. CMAJ. 2002, 166: 1676-1677.PubMedPubMedCentral
26.
go back to reference Hildebrandt M, Bender R, Gehrmann U, Blettner M: Calculating confidence intervals for impact numbers. BMC Med Res Methodol. 2006, 6: 32-10.1186/1471-2288-6-32.CrossRefPubMedPubMedCentral Hildebrandt M, Bender R, Gehrmann U, Blettner M: Calculating confidence intervals for impact numbers. BMC Med Res Methodol. 2006, 6: 32-10.1186/1471-2288-6-32.CrossRefPubMedPubMedCentral
27.
go back to reference Bender R, Kuss O, Hildebrandt M, Gehrmann U: Estimating adjusted NNT measures in logistic regression analysis. Stat Med. 2007, 26: 5586-5595. 10.1002/sim.3061.CrossRefPubMed Bender R, Kuss O, Hildebrandt M, Gehrmann U: Estimating adjusted NNT measures in logistic regression analysis. Stat Med. 2007, 26: 5586-5595. 10.1002/sim.3061.CrossRefPubMed
Metadata
Title
Calculation of NNTs in RCTs with time-to-event outcomes: A literature review
Authors
Mandy Hildebrandt
Elke Vervölgyi
Ralf Bender
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2009
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-9-21

Other articles of this Issue 1/2009

BMC Medical Research Methodology 1/2009 Go to the issue