Skip to main content
Top
Published in: BMC Medicine 1/2011

Open Access 01-12-2011 | Commentary

Network meta-analysis-highly attractive but more methodological research is needed

Authors: Tianjing Li, Milo A Puhan, Swaroop S Vedula, Sonal Singh, Kay Dickersin, The Ad Hoc Network Meta-analysis Methods Meeting Working Group

Published in: BMC Medicine | Issue 1/2011

Login to get access

Abstract

Network meta-analysis, in the context of a systematic review, is a meta-analysis in which multiple treatments (that is, three or more) are being compared using both direct comparisons of interventions within randomized controlled trials and indirect comparisons across trials based on a common comparator. To ensure validity of findings from network meta-analyses, the systematic review must be designed rigorously and conducted carefully. Aspects of designing and conducting a systematic review for network meta-analysis include defining the review question, specifying eligibility criteria, searching for and selecting studies, assessing risk of bias and quality of evidence, conducting a network meta-analysis, interpreting and reporting findings. This commentary summarizes the methodologic challenges and research opportunities for network meta-analysis relevant to each aspect of the systematic review process based on discussions at a network meta-analysis methodology meeting we hosted in May 2010 at the Johns Hopkins Bloomberg School of Public Health. Since this commentary reflects the discussion at that meeting, it is not intended to provide an overview of the field.
Appendix
Available only for authorised users
Literature
1.
go back to reference Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D'Amico R, et al: Indirect comparisons of competing interventions. Health Technol Assess. 2005, 9 (26): 1-134.CrossRefPubMed Glenny AM, Altman DG, Song F, Sakarovitch C, Deeks JJ, D'Amico R, et al: Indirect comparisons of competing interventions. Health Technol Assess. 2005, 9 (26): 1-134.CrossRefPubMed
2.
go back to reference Caldwell DM, Ades AE, Higgins JP: Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005, 331 (7521): 897-900. 10.1136/bmj.331.7521.897.CrossRefPubMedPubMedCentral Caldwell DM, Ades AE, Higgins JP: Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005, 331 (7521): 897-900. 10.1136/bmj.331.7521.897.CrossRefPubMedPubMedCentral
3.
go back to reference Lu G, Ades AE: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23 (20): 3105-24. 10.1002/sim.1875.CrossRefPubMed Lu G, Ades AE: Combination of direct and indirect evidence in mixed treatment comparisons. Stat Med. 2004, 23 (20): 3105-24. 10.1002/sim.1875.CrossRefPubMed
4.
go back to reference Higgins JP, Whitehead A: Borrowing strength from external trials in a meta-analysis. Stat Med. 1996, 15 (24): 2733-49. 10.1002/(SICI)1097-0258(19961230)15:24<2733::AID-SIM562>3.0.CO;2-0.CrossRefPubMed Higgins JP, Whitehead A: Borrowing strength from external trials in a meta-analysis. Stat Med. 1996, 15 (24): 2733-49. 10.1002/(SICI)1097-0258(19961230)15:24<2733::AID-SIM562>3.0.CO;2-0.CrossRefPubMed
5.
go back to reference Lumley T: Network meta-analysis for indirect treatment comparisons. Stat Med. 2002, 21 (16): 2313-24. 10.1002/sim.1201.CrossRefPubMed Lumley T: Network meta-analysis for indirect treatment comparisons. Stat Med. 2002, 21 (16): 2313-24. 10.1002/sim.1201.CrossRefPubMed
7.
go back to reference Song F, Loke YK, Walsh T, Glenny AM, Eastwood AJ, Altman DG: Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ. 2009, 338: b1147-10.1136/bmj.b1147.CrossRefPubMedPubMedCentral Song F, Loke YK, Walsh T, Glenny AM, Eastwood AJ, Altman DG: Methodological problems in the use of indirect comparisons for evaluating healthcare interventions: survey of published systematic reviews. BMJ. 2009, 338: b1147-10.1136/bmj.b1147.CrossRefPubMedPubMedCentral
8.
go back to reference Ades AE: A chain of evidence with mixed comparisons: models for multi-parameter synthesis and consistency of evidence. Stat Med. 2003, 22 (19): 2995-3016. 10.1002/sim.1566.CrossRefPubMed Ades AE: A chain of evidence with mixed comparisons: models for multi-parameter synthesis and consistency of evidence. Stat Med. 2003, 22 (19): 2995-3016. 10.1002/sim.1566.CrossRefPubMed
9.
go back to reference Caldwell DM, Welton NJ, Ades AE: Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. J Clin Epidemiol. 2010, 63 (8): 875-82. 10.1016/j.jclinepi.2009.08.025.CrossRefPubMed Caldwell DM, Welton NJ, Ades AE: Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. J Clin Epidemiol. 2010, 63 (8): 875-82. 10.1016/j.jclinepi.2009.08.025.CrossRefPubMed
10.
go back to reference Dias S, Welton NJ, Ades AE: Study designs to detect sponsorship and other biases in systematic reviews. J Clin Epidemiol. 2010, 63 (6): 587-8. 10.1016/j.jclinepi.2010.01.005.CrossRefPubMed Dias S, Welton NJ, Ades AE: Study designs to detect sponsorship and other biases in systematic reviews. J Clin Epidemiol. 2010, 63 (6): 587-8. 10.1016/j.jclinepi.2010.01.005.CrossRefPubMed
11.
go back to reference Dias S, Welton NJ, Caldwell DM, Ades AE: Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010, 29 (7-8): 932-44. 10.1002/sim.3767.CrossRefPubMed Dias S, Welton NJ, Caldwell DM, Ades AE: Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010, 29 (7-8): 932-44. 10.1002/sim.3767.CrossRefPubMed
12.
go back to reference Lu G, Ades AE: Assessing evidence inconsistency in mixed treatment comparisons. J Am Stat Assoc. 2006, 101 (474): 447-59. 10.1198/016214505000001302.CrossRef Lu G, Ades AE: Assessing evidence inconsistency in mixed treatment comparisons. J Am Stat Assoc. 2006, 101 (474): 447-59. 10.1198/016214505000001302.CrossRef
13.
go back to reference Lu G, Ades AE, Sutton AJ, Cooper NJ, Briggs AH, Caldwell DM: Meta-analysis of mixed treatment comparisons at multiple follow-up times. Stat Med. 2007, 26 (20): 3681-99. 10.1002/sim.2831.CrossRefPubMed Lu G, Ades AE, Sutton AJ, Cooper NJ, Briggs AH, Caldwell DM: Meta-analysis of mixed treatment comparisons at multiple follow-up times. Stat Med. 2007, 26 (20): 3681-99. 10.1002/sim.2831.CrossRefPubMed
14.
go back to reference Hasselblad V: Meta-analysis of multitreatment studies. Med Decis Making. 1998, 18 (1): 37-43. 10.1177/0272989X9801800110.CrossRefPubMed Hasselblad V: Meta-analysis of multitreatment studies. Med Decis Making. 1998, 18 (1): 37-43. 10.1177/0272989X9801800110.CrossRefPubMed
15.
go back to reference Salanti G, Higgins JP, Ades AE, Ioannidis JP: Evaluation of networks of randomized trials. Stat Methods Med Res. 2008, 17 (3): 279-301.CrossRefPubMed Salanti G, Higgins JP, Ades AE, Ioannidis JP: Evaluation of networks of randomized trials. Stat Methods Med Res. 2008, 17 (3): 279-301.CrossRefPubMed
16.
go back to reference Salanti G, Marinho V, Higgins JP: A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. J Clin Epidemiol. 2009, 62 (8): 857-64. 10.1016/j.jclinepi.2008.10.001.CrossRefPubMed Salanti G, Marinho V, Higgins JP: A case study of multiple-treatments meta-analysis demonstrates that covariates should be considered. J Clin Epidemiol. 2009, 62 (8): 857-64. 10.1016/j.jclinepi.2008.10.001.CrossRefPubMed
17.
go back to reference Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JP, Churchill R, et al: Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet. 2009, 373 (9665): 746-58. 10.1016/S0140-6736(09)60046-5.CrossRefPubMed Cipriani A, Furukawa TA, Salanti G, Geddes JR, Higgins JP, Churchill R, et al: Comparative efficacy and acceptability of 12 new-generation antidepressants: a multiple-treatments meta-analysis. Lancet. 2009, 373 (9665): 746-58. 10.1016/S0140-6736(09)60046-5.CrossRefPubMed
18.
go back to reference Gartlehner G, Gaynes BN, Hansen RA, Thieda P, DeVeaugh-Geiss A, Krebs EE, et al: Comparative benefits and harms of second-generation antidepressants: background paper for the American College of Physicians. Ann Intern Med. 2008, 149 (10): 734-50.CrossRefPubMed Gartlehner G, Gaynes BN, Hansen RA, Thieda P, DeVeaugh-Geiss A, Krebs EE, et al: Comparative benefits and harms of second-generation antidepressants: background paper for the American College of Physicians. Ann Intern Med. 2008, 149 (10): 734-50.CrossRefPubMed
20.
go back to reference Chou R, Aronson N, Atkins D, Ismaila AS, Santaguida P, Smith DH, et al: AHRQ series paper 4: assessing harms when comparing medical interventions: AHRQ and the effective health-care program. J Clin Epidemiol. 2010, 63 (5): 502-12. 10.1016/j.jclinepi.2008.06.007.CrossRefPubMed Chou R, Aronson N, Atkins D, Ismaila AS, Santaguida P, Smith DH, et al: AHRQ series paper 4: assessing harms when comparing medical interventions: AHRQ and the effective health-care program. J Clin Epidemiol. 2010, 63 (5): 502-12. 10.1016/j.jclinepi.2008.06.007.CrossRefPubMed
21.
go back to reference Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al: Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010, 14 (8): 1-193.CrossRef Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al: Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010, 14 (8): 1-193.CrossRef
22.
go back to reference Rising K, Bacchetti P, Bero L: Reporting bias in drug trials submitted to the Food and Drug Administration: review of publication and presentation. PLoS Med. 2008, 5 (11): e217-10.1371/journal.pmed.0050217. discussion e217. Erratum in: PLoS Med. 2009;6(1)CrossRefPubMedPubMedCentral Rising K, Bacchetti P, Bero L: Reporting bias in drug trials submitted to the Food and Drug Administration: review of publication and presentation. PLoS Med. 2008, 5 (11): e217-10.1371/journal.pmed.0050217. discussion e217. Erratum in: PLoS Med. 2009;6(1)CrossRefPubMedPubMedCentral
23.
go back to reference Song F, Harvey I, Lilford R: Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. J Clin Epidemiol. 2008, 61 (5): 455-63. 10.1016/j.jclinepi.2007.06.006.CrossRefPubMed Song F, Harvey I, Lilford R: Adjusted indirect comparison may be less biased than direct comparison for evaluating new pharmaceutical interventions. J Clin Epidemiol. 2008, 61 (5): 455-63. 10.1016/j.jclinepi.2007.06.006.CrossRefPubMed
24.
go back to reference Salanti G, Ades AE, Ioannidis JP: Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011, 64 (2): 163-71. 10.1016/j.jclinepi.2010.03.016.CrossRefPubMed Salanti G, Ades AE, Ioannidis JP: Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011, 64 (2): 163-71. 10.1016/j.jclinepi.2010.03.016.CrossRefPubMed
Metadata
Title
Network meta-analysis-highly attractive but more methodological research is needed
Authors
Tianjing Li
Milo A Puhan
Swaroop S Vedula
Sonal Singh
Kay Dickersin
The Ad Hoc Network Meta-analysis Methods Meeting Working Group
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2011
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/1741-7015-9-79

Other articles of this Issue 1/2011

BMC Medicine 1/2011 Go to the issue