Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Medicine
Published in: BMC Medicine 1/2017

Open Access 01-12-2017 | Research article

Number needed to treat (NNT) in clinical literature: an appraisal

Authors: Diogo Mendes, Carlos Alves, Francisco Batel-Marques

Published in: BMC Medicine | Issue 1/2017

Login to get access

Abstract

Background

The number needed to treat (NNT) is an absolute effect measure that has been used to assess beneficial and harmful effects of medical interventions. Several methods can be used to calculate NNTs, and they should be applied depending on the different study characteristics, such as the design and type of variable used to measure outcomes. Whether or not the most recommended methods have been applied to calculate NNTs in studies published in the medical literature is yet to be determined. The aim of this study is to assess whether the methods used to calculate NNTs in studies published in medical journals are in line with basic methodological recommendations.

Methods

The top 25 high-impact factor journals in the “General and/or Internal Medicine” category were screened to identify studies assessing pharmacological interventions and reporting NNTs. Studies were categorized according to their design and the type of variables. NNTs were assessed for completeness (baseline risk, time horizon, and confidence intervals [CIs]). The methods used for calculating NNTs in selected studies were compared to basic methodological recommendations published in the literature. Data were analyzed using descriptive statistics.

Results

The search returned 138 citations, of which 51 were selected. Most were meta-analyses (n = 23, 45.1%), followed by clinical trials (n = 17, 33.3%), cohort (n = 9, 17.6%), and case–control studies (n = 2, 3.9%). Binary variables were more common (n = 41, 80.4%) than time-to-event (n = 10, 19.6%) outcomes. Twenty-six studies (51.0%) reported only NNT to benefit (NNTB), 14 (27.5%) reported both NNTB and NNT to harm (NNTH), and 11 (21.6%) reported only NNTH. Baseline risk (n = 37, 72.5%), time horizon (n = 38, 74.5%), and CI (n = 32, 62.7%) for NNTs were not always reported. Basic methodological recommendations to calculate NNTs were not followed in 15 studies (29.4%). The proportion of studies applying non-recommended methods was particularly high for meta-analyses (n = 13, 56.5%).

Conclusions

A considerable proportion of studies, particularly meta-analyses, applied methods that are not in line with basic methodological recommendations. Despite their usefulness in assisting clinical decisions, NNTs are uninterpretable if incompletely reported, and they may be misleading if calculating methods are inadequate to study designs and variables under evaluation. Further research is needed to confirm the present findings.
Appendix
Available only for authorised users
Literature
1.
Laupacis A, Sackett DL, Roberts RS. An assessment of clinically useful measures of the consequences of treatment. N Engl J Med. 1988;318(26):1728–33.CrossRefPubMed
2.
3.
4.
Straus SE, Glasziou P, Richardson WS, Haynes RB. Evidence-based medicine: how to practice and teach it. London: Churchill Livingstone; 2011.
5.
Citrome L, Ketter TA. When does a difference make a difference? Interpretation of number needed to treat, number needed to harm, and likelihood to be helped or harmed. Int J Clin Pract. 2013;67(5):407–11.CrossRefPubMed
6.
Mt-Isa S, Hallgreen CE, Wang N, et al. IMI-PROTECT benefit-risk participants. Balancing benefit and risk of medicines: a systematic review and classification of available methodologies. Pharmacoepidemiol Drug Saf. 2014;23(7):667–78.CrossRefPubMed
7.
Mendes D, Alves C, Batel-Marques F. Number needed to harm in the post-marketing safety evaluation: results for rosiglitazone and pioglitazone. Pharmacoepidemiol Drug Saf. 2015;24(12):1259–70.CrossRefPubMed
8.
Mendes D, Alves C, Batel MF. Testing the usefulness of the number needed to treat to be harmed (NNTH) in benefit-risk evaluations: case study with medicines withdrawn from the European market due to safety reasons. Expert Opin Drug Saf. 2016;15(10):1301–12.CrossRefPubMed
9.
Altman DG, Schulz KF, Moher D, CONSORT GROUP (Consolidated Standards of Reporting Trials), et al. The revised CONSORT statement for reporting randomized trials: explanation and elaboration. Ann Intern Med. 2001;134(8):663–94.CrossRefPubMed
10.
Moher D, Hopewell S, Schulz KF, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010;340:c869.CrossRefPubMedPubMedCentral
11.
12.
13.
Nuovo J, Melnikow J, Chang D. Reporting number needed to treat and absolute risk reduction in randomized controlled trials. JAMA. 2002;287(21):2813–4.CrossRefPubMed
14.
Alonso-Coello P, Carrasco-Labra A, Brignardello-Petersen R, et al. Systematic reviews experience major limitations in reporting absolute effects. J Clin Epidemiol. 2016;72:16–26.CrossRefPubMed
15.
Citrome L. Relative vs. absolute measures of benefit and risk: what’s the difference? Acta Psychiatr Scand. 2010;121(2):94–102.CrossRefPubMed
16.
Klawiter EC, Cross AH, Naismith RT. The present efficacy of multiple sclerosis therapeutics: is the new 66% just the old 33%? Neurology. 2009;73(12):984–90.CrossRefPubMedPubMedCentral
17.
Mendes D, Alves C, Batel-Marques F. Benefit-risk of therapies for relapsing-remitting multiple sclerosis: testing the number needed to treat to benefit (NNTB), number needed to treat to harm (NNTH) and the likelihood to be helped or harmed (LHH): a systematic review and meta-analysis. CNS Drugs. 2016;30(10):909–29.CrossRefPubMed
18.
McQuay HJ, Moore RA. Using numerical results from systematic reviews in clinical practice. Ann Intern Med. 1997;126(9):712–20.CrossRefPubMed
19.
Furukawa TA, Guyatt GH, Griffith LE. Can we individualize the ‘number needed to treat’? An empirical study of summary effect measures in meta-analyses. Int J Epidemiol. 2002;31:72–6.CrossRefPubMed
20.
21.
Austin PC, Laupacis A. A tutorial on methods to estimating clinically and policy-meaningful measures of treatment effects in prospective observational studies: a review. Int J Biostat. 2011;7(1):6.CrossRefPubMedPubMedCentral
22.
Bender R, Blettner M. Calculating the “number needed to be exposed” with adjustment for confounding variables in epidemiological studies. J Clin Epidemiol. 2002;55(5):525–30.CrossRefPubMed
23.
Bender R, Kuss O, Hildebrandt M, Gehrmann U. Estimating adjusted NNT measures in logistic regression analysis. Stat Med. 2007;26(30):5586–95.CrossRefPubMed
24.
25.
Bender R. Number needed to treat (NNT). In: Armitage P, Colton T, editors. Encyclopedia of biostatistics. Chichester: Wiley; 2005. p. 3752–61.
26.
27.
Bjerre LM, LeLorier J. Expressing the magnitude of adverse effects in case–control studies: “the number of patients needed to be treated for one additional patient to be harmed”. BMJ. 2000;320(7233):503–6.CrossRefPubMedPubMedCentral
28.
Bender R, Kromp M, Kiefer C, Sturtz S. Absolute risks rather than incidence rates should be used to estimate the number needed to treat from time-to-event data. J Clin Epidemiol. 2013;66(9):1038–44.CrossRefPubMed
29.
Suissa D, Brassard P, Smiechowski B, Suissa S. Number needed to treat is incorrect without proper time-related considerations. J Clin Epidemiol. 2012;65(1):42–6.CrossRefPubMed
30.
Suissa S. The number needed to treat: 25 years of trials and tribulations in clinical research. Rambam Maimonides Med J. 2015;30:6(3).
31.
Deeks JJ, Higgins JPT, Altman DG. Chapter 9: Analysing data and undertaking meta-analyses. In: Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions version 5.1.0. Oxford: The Cochrane Collaboration; 2011.
32.
da Costa BR, Rutjes AW, Johnston BC, et al. Methods to convert continuous outcomes into odds ratios of treatment response and numbers needed to treat: meta-epidemiological study. Int J Epidemiol. 2012;41(5):1445–59.CrossRefPubMed
33.
34.
Stang A, Poole C, Bender R. Common problems related to the use of number needed to treat. J Clin Epidemiol. 2010;63(8):820–5.CrossRefPubMed
35.
36.
Smeeth L, Haines A, Ebrahim S. Numbers needed to treat derived from meta-analyses — sometimes informative, usually misleading. BMJ. 1999;318:1548–51.CrossRefPubMedPubMedCentral
37.
38.
Alves C, Batel-Marques F, Macedo AF. Data sources on drug safety evaluation: a review of recent published meta-analyses. Pharmacoepidemiol Drug Saf. 2012;21(1):21–33.CrossRefPubMed
39.
Brown EG, Wood L, Wood S. The medical dictionary for regulatory activities (MedDRA). Drug Saf. 1999;20(2):109–17.CrossRefPubMed
40.
Schmid CH, Lau J, McIntosh MW, Cappelleri JC. An empirical study of the effect of the control rate as a predictor of treatment efficacy in meta-analysis of clinical trials. Stat Med. 1998;17(17):1923–42.CrossRefPubMed
41.
Engels EA, Schmid CH, Terrin N, et al. Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses. Stat Med. 2000;19(13):1707–28.CrossRefPubMed
42.
Austin PC. Absolute risk reductions and numbers needed to treat can be obtained from adjusted survival models for time-to-event outcomes. J Clin Epidemiol. 2010;63(1):46–55.CrossRefPubMed
43.
Laubender RP, Bender R. Estimating adjusted risk difference (RD) and number needed to treat (NNT) measures in the Cox regression model. Stat Med. 2010;29(7–8):851–9.CrossRefPubMed
44.
Laubender RP, Bender R. A note on calculating asymptotic confidence intervals for the adjusted risk difference and number needed to treat in the Cox regression model. Stat Med. 2014;33(5):798–810. Correction: Stat Med. 2014;33(5):810–1.
45.
Heller RF, Dobson AJ, Attia J, Page J. Impact numbers: measures of risk factor impact on the whole population from case–control and cohort studies. J Epidemiol Community Health. 2002;56(8):606–10.CrossRefPubMedPubMedCentral
46.
47.
48.
Heller RF, Buchan I, Edwards R, et al. Communicating risks at the population level: application of population impact numbers. BMJ. 2003;327(7424):1162–5.CrossRefPubMedPubMedCentral
49.
Hutton JL. Number needed to treat: properties and problems. J R Stat Soc A Stat Soc. 2000;163(3):403–19.CrossRef
50.
51.
Marx A, Bucher HC. Numbers needed to treat derived from meta-analysis: a word of caution. ACP J Club. 2003;138(2):A11–2.PubMed
52.
Shepherd J, Kastelein JP, Bittner VA, et al. Intensive lipid lowering with atorvastatin in patients with coronary artery disease, diabetes, and chronic kidney disease. Mayo Clin Proc. 2008;83(8):870–9.CrossRefPubMed
53.
Lubsen J, Hoes A, Grobbee D. Implications of trial results: the potentially misleading notions of number needed to treat and average duration of life gained. Lancet. 2000;356(9243):1757–9.CrossRefPubMed
54.
Mayne TJ, Whalen E, Vu A. Annualized was found better than absolute risk reduction in the calculation of number needed to treat in chronic conditions. J Clin Epidemiol. 2006;59(3):217–23.CrossRefPubMed
55.
Girerd N, Rabilloud M, Duarte K, Roy P. Number needed to treat from absolute risk and incidence rate: how to make apples and oranges comparable? J Clin Epidemiol. 2014;67(2):236–8.CrossRefPubMed
56.
Bender R, Kromp M, Kiefer C, Sturtz S. Estimation of numbers needed to treat should be based on absolute risks. J Clin Epidemiol. 2014;67(2):238–9.CrossRefPubMed
57.
Suissa S. Number needed to treat in COPD: exacerbations versus pneumonias. Thorax. 2013;68(6):540–3.CrossRefPubMed
58.
Graham DJ, Ouellet-Hellstrom R, MaCurdy TE, et al. Risk of acute myocardial infarction, stroke, heart failure, and death in elderly Medicare patients treated with rosiglitazone or pioglitazone. JAMA. 2010;304(4):411–8.CrossRefPubMed
Metadata
Title
Number needed to treat (NNT) in clinical literature: an appraisal
Authors
Diogo Mendes
Carlos Alves
Francisco Batel-Marques
Publication date
01-12-2017
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2017
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-017-0875-8

Other articles of this Issue 1/2017

BMC Medicine 1/2017 Go to the issue

Research article

The clinical utility of the urine-based lateral flow lipoarabinomannan assay in HIV-infected adults in Myanmar: an observational study

Minireview

Systemic treatment in advanced soft tissue sarcoma: what is standard, what is new

Research article

Recent household transmission of tuberculosis in England, 2010–2012: retrospective national cohort study combining epidemiological and molecular strain typing data

Research article

Depression comorbid with tuberculosis and its impact on health status: cross-sectional analysis of community-based data from 48 low- and middle-income countries

Research article

Effects of long-term weekly iron and folic acid supplementation on lower genital tract infection – a double blind, randomised controlled trial in Burkina Faso

Commentary

Micronutrient powders to combat anemia in young children: does it work?