Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
BMC Pediatrics
Published in: BMC Pediatrics 1/2018

Open Access 01-12-2018 | Debate

Network meta-analysis: users’ guide for pediatricians

Authors: Reem Al Khalifah, Ivan D. Florez, Gordon Guyatt, Lehana Thabane

Published in: BMC Pediatrics | Issue 1/2018

Login to get access

Abstract

Background

Network meta-analysis (NMA) is a powerful analytic tool that allows simultaneous comparison between several management/treatment alternatives even when direct comparisons of the alternatives (such as the case in which treatments are compared against placebo and have not been compared against each other) are unavailable. Though there are still a limited number of pediatric NMAs published, the rapid increase in NMAs in other areas suggests pediatricians will soon be frequently facing this new form of evidence summary.

Discussion

Evaluating the NMA evidence requires serial judgments on the creditability of the process of NMA conduct, and evidence quality assessment. First clinicians need to evaluate the basic standards applicable to any meta-analysis (e.g. comprehensive search, duplicate assessment of eligibility, risk of bias, and data abstraction). Then evaluate specific issues related to NMA including precision, transitivity, coherence, and rankings.

Conclusions

In this article we discuss how clinicians can evaluate the credibility of NMA methods, and how they can make judgments regarding the quality (certainty) of the evidence. We illustrate the concepts using recent pediatric NMA publications.
Literature
1.
Guyatt G, Rennie D, Meade MO, Cook DJ. Chapter 22: the process of a systematic review and meta-analysis. In: Users’ guides to the medical literature: a manual for evidence-based clinical practice. 3rd ed. New York: McGraw-Hill Education; 2015. p. 459–69.
2.
Stegeman BH, de Bastos M, Rosendaal FR, van Hylckama Vlieg A, Helmerhorst FM, Stijnen T, Dekkers OM. Different combined oral contraceptives and the risk of venous thrombosis: systematic review and network meta-analysis. BMJ. 2013;347:f5298.CrossRefPubMedPubMedCentral
3.
Sundaresh V, Brito JP, Wang Z, Prokop LJ, Stan MN, Murad MH, Bahn RS. Comparative effectiveness of therapies for graves’ hyperthyroidism: a systematic review and network meta-analysis. J Clin Endocrinol Metab. 2013;98(9):3671–7.CrossRefPubMedPubMedCentral
4.
5.
Jones LJ, Craven PD, Attia J, Thakkinstian A, Wright I. Network meta-analysis of indomethacin versus ibuprofen versus placebo for PDA in preterm infants. Arch Dis Child Fetal Neonatal Ed. 2011;96(1):F45–52.CrossRefPubMed
6.
Chinnadurai S, Fonnesbeck C, Snyder KM, Sathe NA, Morad A, Likis FE, McPheeters ML. Pharmacologic interventions for infantile hemangioma: a meta-analysis. Pediatrics. 2016;137(2):1–10.CrossRef
7.
Huang J, Wen D, Wang Q, McAlinden C, Flitcroft I, Chen H, Saw SM, Chen H, Bao F, Zhao Y, et al. Efficacy comparison of 16 interventions for myopia control in children: a network meta-analysis. Ophthalmology. 2016;123(4):697–708.CrossRefPubMed
8.
Littlewood KJ, Higashi K, Jansen JP, Capkun-Niggli G, Balp MM, Doering G, Tiddens HA, Angyalosi G. A network meta-analysis of the efficacy of inhaled antibiotics for chronic Pseudomonas infections in cystic fibrosis. J Cyst Fibros. 2012;11(5):419–26.CrossRefPubMed
9.
Wang C, Guo L, Chi C, Wang X, Guo L, Wang W, Zhao N, Wang Y, Zhang Z, Li E. Mechanical ventilation modes for respiratory distress syndrome in infants: a systematic review and network meta-analysis. Critical Care. 2015;19:108.CrossRefPubMedPubMedCentral
10.
Zhou X, Hetrick SE, Cuijpers P, Qin B, Barth J, Whittington CJ, Cohen D, Del Giovane C, Liu Y, Michael KD, et al. Comparative efficacy and acceptability of psychotherapies for depression in children and adolescents: a systematic review and network meta-analysis. World Psychiat. 2015;14(2):207–22.CrossRef
11.
Knottnerus BJ, Grigoryan L, Geerlings SE, Moll van Charante EP, Verheij TJ, Kessels AG, ter Riet G. Comparative effectiveness of antibiotics for uncomplicated urinary tract infections: network meta-analysis of randomized trials. Fam Pract. 2012;29(6):659–70.CrossRefPubMed
12.
Zhao Y, Han S, Shang J, Zhao X, Pu R, Shi L. Effectiveness of drug treatment strategies to prevent asthma exacerbations and increase symptom-free days in asthmatic children: a network meta-analysis. J Asthma. 2015;52(8):846–57.
13.
Caldwell DM, Welton NJ, Dias S, Ades AE. Selecting the best scale for measuring treatment effect in a network meta-analysis: a case study in childhood nocturnal enuresis. Res Synthesis Methods. 2012;3(2):126–41.CrossRef
14.
Fang XZ, Gao J, Ge YL, Zhou LJ, Zhang Y. Network meta-analysis on the efficacy of Dexmedetomidine, midazolam, ketamine, Propofol, and fentanyl for the prevention of sevoflurane-related emergence agitation in children. Am J Ther. 2015;23:e1032–42.
15.
Huang X, Xu B. Efficacy and safety of tacrolimus versus Pimecrolimus for the treatment of atopic dermatitis in children: a network meta-analysis. Dermatology. 2015;231(1):41–9.CrossRefPubMed
16.
Achana FA, Sutton AJ, Kendrick D, Wynn P, Young B, Jones DR, Hubbard SJ, Cooper NJ. The effectiveness of different interventions to promote poison prevention behaviours in households with children: a network meta-analysis. PLoS One. 2015;10(3):e0121122.CrossRefPubMedPubMedCentral
17.
Hubbard S, Cooper N, Kendrick D, Young B, Wynn PM, He Z, Miller P, Achana F, Sutton A. Network meta-analysis to evaluate the effectiveness of interventions to prevent falls in children under age 5 years. Inj Prevent. 2015;21(2):98–108.CrossRef
18.
van der Mark LB, Lyklema PH, Geskus RB, Mohrs J, Bindels PJ, van Aalderen WM, Ter Riet G. A systematic review with attempted network meta-analysis of asthma therapy recommended for five to eighteen year olds in GINA steps three and four. BMC Pulmonary Med. 2012;12:63.CrossRef
19.
Guo C, Sun X, Wang X, Guo Q, Chen D. Network meta-analysis comparing the efficacy of therapeutic treatments for bronchiolitis in children. JPEN J Parenter Enteral Nutr. 2018;42(1):186–95.PubMed
20.
21.
22.
Fu H-D, Qian G-L, Jiang Z-Y. Comparison of second-line immunosuppressants for childhood refractory nephrotic syndrome: a systematic review and network meta-analysis. J Investig Med. 2017;65(1):65–71.CrossRefPubMed
23.
Gutierrez-Castrellon P, Indrio F, Bolio-Galvis A, Jimenez-Gutierrez C, Jimenez-Escobar I, Lopez-Velazquez G. Efficacy of lactobacillus reuteri DSM 17938 for infantile colic: systematic review with network meta-analysis. Medicine. 2017;96(51):e9375.CrossRefPubMedPubMedCentral
24.
Murad MH, Montori VM, Ioannidis JP, Jaeschke R, Devereaux PJ, Prasad K, Neumann I, Carrasco-Labra A, Agoritsas T, Hatala R, et al. How to read a systematic review and meta-analysis and apply the results to patient care: users’ guides to the medical literature. JAMA. 2014;312(2):171–9.CrossRefPubMed
25.
Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, Lee K, Boersma C, Annemans L, Cappelleri JC. Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR task force on indirect treatment comparisons good research practices: part 1. Value Health. 2011;14(4):417–28.CrossRefPubMed
26.
Cipriani A, Higgins JP, Geddes JR, Salanti G. Conceptual and technical challenges in network meta-analysis. Ann Intern Med. 2013;159(2):130–7.CrossRefPubMed
27.
Salanti G. Indirect and mixed-treatment comparison, network, or multiple-treatments meta-analysis: many names, many benefits, many concerns for the next generation evidence synthesis tool. Res Synthesis Methods. 2012;3(2):80–97.CrossRef
28.
Hoaglin DC, Hawkins N, Jansen JP, Scott DA, Itzler R, Cappelleri JC, Boersma C, Thompson D, Larholt KM, Diaz M, et al. Conducting indirect-treatment-comparison and network-meta-analysis studies: report of the ISPOR task force on indirect treatment comparisons good research practices: part 2. Value Health. 2011;14(4):429–37.CrossRefPubMed
29.
Thabane L, Thomas T, Ye C, Paul J. Posing the research question: not so simple. Can J Anaesth. 2009;56(1):71–9.CrossRefPubMed
30.
Salanti G, Del Giovane C, Chaimani A, Caldwell DM, Higgins JP. Evaluating the quality of evidence from a network meta-analysis. PLoS One. 2014;9(7):e99682.CrossRefPubMedPubMedCentral
31.
Puhan MA, Schunemann HJ, Murad MH, Li T, Brignardello-Petersen R, Singh JA, Kessels AG, Guyatt GH. A GRADE working group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ. 2014;349:g5630.CrossRefPubMed
32.
Reddel HK, Levy ML. The GINA asthma strategy report: what's new for primary care? NPJ Prim Care Resp Med. 2015;25:15050.CrossRef
33.
Expert Panel Report 3 (EPR-3). Guidelines for the diagnosis and Management of Asthma-Summary Report 2007. J Allergy Clin Immunol. 2007;120(5 Suppl):S94–138.
34.
Jansen JP, Naci H. Is network meta-analysis as valid as standard pairwise meta-analysis? It all depends on the distribution of effect modifiers. BMC Med. 2013;11:159.CrossRefPubMedPubMedCentral
35.
Betran AP, Say L, Gulmezoglu AM, Allen T, Hampson L. Effectiveness of different databases in identifying studies for systematic reviews: experience from the WHO systematic review of maternal morbidity and mortality. BMC Med Res Methodol. 2005;5(1):6.CrossRefPubMedPubMedCentral
36.
Kwon Y, Powelson SE, Wong H, Ghali WA, Conly JM. An assessment of the efficacy of searching in biomedical databases beyond MEDLINE in identifying studies for a systematic review on ward closures as an infection control intervention to control outbreaks. Systematic Rev. 2014;3:135.CrossRef
37.
Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ. Br Med J. 1994;309(6964):1286–91.CrossRef
38.
Higgins JPT, Green S (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available from www.​cochrane-handbook.​org.
39.
Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, Ioannidis JP, Straus S, Thorlund K, Jansen JP, et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: checklist and explanations. Ann Intern Med. 2015;162(11):777–84.CrossRefPubMed
40.
Jansen JP, Trikalinos T, Cappelleri JC, Daw J, Andes S, Eldessouki R, Salanti G. Indirect treatment comparison/network meta-analysis study questionnaire to assess relevance and credibility to inform health care decision making: an ISPOR-AMCP-NPC good practice task force report. Value Health. 2014;17(2):157–73.CrossRefPubMed
41.
Cipriani A, Zhou X, Del Giovane C, Hetrick SE, Qin B, Whittington C, Coghill D, Zhang Y, Hazell P, Leucht S, et al. Comparative efficacy and tolerability of antidepressants for major depressive disorder in children and adolescents: a network meta-analysis. Lancet. 2016;388:881–90.
42.
Windecker S, Stortecky S, Stefanini GG, da Costa BR, Rutjes AW, Di Nisio M, Silletta MG, Maione A, Alfonso F, Clemmensen PM, et al. Revascularisation versus medical treatment in patients with stable coronary artery disease: network meta-analysis. BMJ Clin Res ed. 2014;348:g3859.
43.
Lumley T. Network meta-analysis for indirect treatment comparisons. Stat Med. 2002;21(16):2313–24.CrossRefPubMed
44.
Friedrich JO, Adhikari NK, Beyene J. Ratio of means for analyzing continuous outcomes in meta-analysis performed as well as mean difference methods. J Clin Epidemiol. 2011;64(5):556–64.CrossRefPubMed
45.
Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, Tugwell P, Klassen TP. Does quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses? Lancet. 1998;352(9128):609–13.CrossRefPubMed
46.
Chaimani A, Vasiliadis HS, Pandis N, Schmid CH, Welton NJ, Salanti G. Effects of study precision and risk of bias in networks of interventions: a network meta-epidemiological study. Int J Epidemiol. 2013;42(4):1120–31.CrossRefPubMed
47.
Guyatt GH, Oxman AD, Kunz R, Brozek J, Alonso-Coello P, Rind D, Devereaux PJ, Montori VM, Freyschuss B, Vist G, et al. GRADE guidelines 6. Rating the quality of evidence--imprecision. J Clin Epidemiol. 2011;64(12):1283–93.CrossRefPubMed
48.
49.
Counseling parents before high-risk delivery. In: Lacy GT, Eyal FG, Zenk KE, editors. Neonatology: management, procedures, on-call problems, diseases, and drugs. Edn. Stamford: Appleton & Lange; 1999. p. 223.
50.
Ancel PY, Goffinet F, Kuhn P, Langer B, Matis J, Hernandorena X, Chabanier P, Joly-Pedespan L, Lecomte B, Vendittelli F, et al. Survival and morbidity of preterm children born at 22 through 34 weeks’ gestation in France in 2011: results of the EPIPAGE-2 cohort study. JAMA Pediatr. 2015;169(3):230–8.CrossRefPubMed
51.
Sun H, Cheng R, Kang W, Xiong H, Zhou C, Zhang Y, Wang X, Zhu C. High-frequency oscillatory ventilation versus synchronized intermittent mandatory ventilation plus pressure support in preterm infants with severe respiratory distress syndrome. Respir Care. 2014;59(2):159–69.CrossRefPubMed
52.
Guyatt GH, Oxman AD, Kunz R, Woodcock J, Brozek J, Helfand M, Alonso-Coello P, Falck-Ytter Y, Jaeschke R, Vist G, et al. GRADE guidelines: 8. Rating the quality of evidence--indirectness. J Clin Epidemiol. 2011;64(12):1303–10.CrossRefPubMed
53.
Higgins J. Identifying and addressing inconsistency in network meta-analysis. In: Cochrane comparing multiple interventions methods group Oxford training event, vol. 2013: Cochrane Collaboration; 2013.
54.
Song F, Xiong T, Parekh-Bhurke S, Loke YK, Sutton AJ, Eastwood AJ, Holland R, Chen Y-F, Glenny A-M, Deeks JJ, et al. Inconsistency between direct and indirect comparisons of competing interventions: meta-epidemiological study. BMJ. 2011;343:d4909.CrossRefPubMedPubMedCentral
55.
Dias S, Welton NJ, Caldwell DM, Ades AE. Checking consistency in mixed treatment comparison meta-analysis. Stat Med. 2010;29(7–8):932–44.CrossRefPubMed
56.
Dias S, Welton NJ, Sutton AJ, Caldwell DM, Lu G, Ades AE. Evidence synthesis for decision making 4: inconsistency in networks of evidence based on randomized controlled trials. Med Decis Mak. 2013;33(5):641–56.CrossRef
57.
58.
Sun X, Ioannidis JP, Agoritsas T, Alba AC, Guyatt G. How to use a subgroup analysis: users’ guide to the medical literature. JAMA. 2014;311(4):405–11.CrossRefPubMed
59.
Guyatt GH, Oxman AD, Montori V, Vist G, Kunz R, Brozek J, Alonso-Coello P, Djulbegovic B, Atkins D, Falck-Ytter Y, et al. GRADE guidelines: 5. Rating the quality of evidence--publication bias. J Clin Epidemiol. 2011;64(12):1277–82.CrossRefPubMed
60.
Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. J Clin Epidemiol. 2011;64(2):163–71.CrossRefPubMed
61.
Mbuagbaw L, Rochwerg B, Jaeschke R, Heels-Andsell D, Alhazzani W, Thabane L, Guyatt GH. Approaches to interpreting and choosing the best treatments in network meta-analyses. Systematic Rev. 2017;6(1):79.CrossRef
62.
63.
Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, McQuay HJ. Assessing the quality of reports of randomized clinical trials: is blinding necessary? Control Clin Trials. 1996;17(1):1–12.CrossRefPubMed
Metadata
Title
Network meta-analysis: users’ guide for pediatricians
Authors
Reem Al Khalifah
Ivan D. Florez
Gordon Guyatt
Lehana Thabane
Publication date
01-12-2018
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2018
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/s12887-018-1132-9

Other articles of this Issue 1/2018

BMC Pediatrics 1/2018 Go to the issue

Research article

Clinical and genetic characteristics of patients with fatty acid oxidation disorders identified by newborn screening

Research article

Review of guidelines on expression, storage and transport of breast milk for infants in hospital, to guide formulation of such recommendations in Sri Lanka

Research article

Assessment of peripheral blood lymphocyte subsets in children with iron deficiency anemia

Case report

Cardiac, bone and growth plate manifestations in hypocalcemic infants: revealing the hidden body of the vitamin D deficiency iceberg

Study protocol

The protocol for the Cannabidiol in children with refractory epileptic encephalopathy (CARE-E) study: a phase 1 dosage escalation study

Research article

Maternal thyroid disorder in pregnancy and risk of cerebral palsy in the child: a population-based cohort study