Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2010

Open Access 01-12-2010 | Research article

Network meta-analysis on the log-hazard scale, combining count and hazard ratio statistics accounting for multi-arm trials: A tutorial

Authors: Beth S Woods, Neil Hawkins, David A Scott

Published in: BMC Medical Research Methodology | Issue 1/2010

Login to get access

Abstract

Background

Data on survival endpoints are usually summarised using either hazard ratio, cumulative number of events, or median survival statistics. Network meta-analysis, an extension of traditional pairwise meta-analysis, is typically based on a single statistic. In this case, studies which do not report the chosen statistic are excluded from the analysis which may introduce bias.

Methods

In this paper we present a tutorial illustrating how network meta-analyses of survival endpoints can combine count and hazard ratio statistics in a single analysis on the hazard ratio scale. We also describe methods for accounting for the correlations in relative treatment effects (such as hazard ratios) that arise in trials with more than two arms. Combination of count and hazard ratio data in a single analysis is achieved by estimating the cumulative hazard for each trial arm reporting count data. Correlation in relative treatment effects in multi-arm trials is preserved by converting the relative treatment effect estimates (the hazard ratios) to arm-specific outcomes (hazards).

Results

A worked example of an analysis of mortality data in chronic obstructive pulmonary disease (COPD) is used to illustrate the methods. The data set and WinBUGS code for fixed and random effects models are provided.

Conclusions

By incorporating all data presentations in a single analysis, we avoid the potential selection bias associated with conducting an analysis for a single statistic and the potential difficulties of interpretation, misleading results and loss of available treatment comparisons associated with conducting separate analyses for different summary statistics.
Appendix
Available only for authorised users
Literature
1.
go back to reference Caldwell DM, Ades AE, Higgins JPT: Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005, 331: 897-900. 10.1136/bmj.331.7521.897.CrossRefPubMedPubMedCentral Caldwell DM, Ades AE, Higgins JPT: Simultaneous comparison of multiple treatments: combining direct and indirect evidence. BMJ. 2005, 331: 897-900. 10.1136/bmj.331.7521.897.CrossRefPubMedPubMedCentral
2.
go back to reference Ades AE: A chain of evidence with mixed comparisons: model for multi-parameter synthesis and consistency of evidence. Stat Med. 2003, 22 (19): 2995-3016. 10.1002/sim.1566.CrossRefPubMed Ades AE: A chain of evidence with mixed comparisons: model for multi-parameter synthesis and consistency of evidence. Stat Med. 2003, 22 (19): 2995-3016. 10.1002/sim.1566.CrossRefPubMed
3.
go back to reference Hasselblad V: Meta-analysis of multitreatment studies. Med Decis Making. 1998, 18: 37-43. 10.1177/0272989X9801800110.CrossRefPubMed Hasselblad V: Meta-analysis of multitreatment studies. Med Decis Making. 1998, 18: 37-43. 10.1177/0272989X9801800110.CrossRefPubMed
4.
go back to reference Collett D: Modelling survival data in medical research. 2003, Chapman & Hall/CRC, Second Collett D: Modelling survival data in medical research. 2003, Chapman & Hall/CRC, Second
5.
go back to reference Kleinbaum DG, Klein M: Survival analysis: a self-learning text. 2005, Springer, U.S, Second Kleinbaum DG, Klein M: Survival analysis: a self-learning text. 2005, Springer, U.S, Second
6.
go back to reference Ades A, Sculpher M, Sutton AJ, Cooper NJ, Abrams KR, Welton N, Lu G: Bayesian Methods for Evidence Synthesis in Cost-Effectiveness Analysis. Pharmacoeconomics. 2006, 24: 1-19. 10.2165/00019053-200624010-00001.CrossRefPubMed Ades A, Sculpher M, Sutton AJ, Cooper NJ, Abrams KR, Welton N, Lu G: Bayesian Methods for Evidence Synthesis in Cost-Effectiveness Analysis. Pharmacoeconomics. 2006, 24: 1-19. 10.2165/00019053-200624010-00001.CrossRefPubMed
7.
go back to reference Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004, 291 (20): 2457-65. 10.1001/jama.291.20.2457.CrossRefPubMed Chan AW, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004, 291 (20): 2457-65. 10.1001/jama.291.20.2457.CrossRefPubMed
8.
go back to reference Parmar MKB, Torri V, Stewart L: Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med. 1998, 17: 2815-34. 10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8.CrossRefPubMed Parmar MKB, Torri V, Stewart L: Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med. 1998, 17: 2815-34. 10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8.CrossRefPubMed
9.
go back to reference Whitehead A: Meta-Analysis of Controlled Clinical Trials. 2002, John Wiley and Sons: ChichesterCrossRef Whitehead A: Meta-Analysis of Controlled Clinical Trials. 2002, John Wiley and Sons: ChichesterCrossRef
10.
go back to reference Salanti G, Higgins JP, Ades AE, Ioannidis JP: Evaluation of networks of randomised trials. Stat Methods Med Res. 2008, 17 (3): 279-301. 10.1177/0962280207080643.CrossRefPubMed Salanti G, Higgins JP, Ades AE, Ioannidis JP: Evaluation of networks of randomised trials. Stat Methods Med Res. 2008, 17 (3): 279-301. 10.1177/0962280207080643.CrossRefPubMed
11.
go back to reference Baker WL, Baker EL, Coleman C: Pharmacologic treatments for chronic obstructive pulmonary disease: a mixed-treatment comparison meta-analysis. Pharmacotherapy. 2009, 29 (8): 891-905. 10.1592/phco.29.8.891.CrossRefPubMed Baker WL, Baker EL, Coleman C: Pharmacologic treatments for chronic obstructive pulmonary disease: a mixed-treatment comparison meta-analysis. Pharmacotherapy. 2009, 29 (8): 891-905. 10.1592/phco.29.8.891.CrossRefPubMed
12.
go back to reference Boyd G, Morice AH, Pounsford JC, Siebert M, Peslis N, Crawford C: An evaluation of salmeterol in the treatment of chronic obstructive pulmonary disease (COPD). Eur Respir J. 1997, 10: 815-21.PubMed Boyd G, Morice AH, Pounsford JC, Siebert M, Peslis N, Crawford C: An evaluation of salmeterol in the treatment of chronic obstructive pulmonary disease (COPD). Eur Respir J. 1997, 10: 815-21.PubMed
13.
go back to reference Calverley P, Pauwels R, Vestbo J, Jones P, Pride N, Gulsvik A, Anderson J, Maden C, Trial of Inhaled Steroids and Long-Acting β2-Agonists (TRISTAN) Study Group: Combined salmeterol and fluticasone in the treatment of chronic obstructive pulmonary disease: a randomized controlled trial. Lancet. 2003, 361: 449-56. 10.1016/S0140-6736(03)12459-2.CrossRefPubMed Calverley P, Pauwels R, Vestbo J, Jones P, Pride N, Gulsvik A, Anderson J, Maden C, Trial of Inhaled Steroids and Long-Acting β2-Agonists (TRISTAN) Study Group: Combined salmeterol and fluticasone in the treatment of chronic obstructive pulmonary disease: a randomized controlled trial. Lancet. 2003, 361: 449-56. 10.1016/S0140-6736(03)12459-2.CrossRefPubMed
14.
go back to reference Celli B, Halpin D, Hepburn R, Byrne N, Keating ET, Goldman M: Symptoms are an important outcome in chronic obstructive pulmonary disease clinical trials: results of a 3-month comparative study using the breathlessness, cough, and sputum scale (BCSS). Resp Med. 2003, 97 (suppl A): S35-43.CrossRef Celli B, Halpin D, Hepburn R, Byrne N, Keating ET, Goldman M: Symptoms are an important outcome in chronic obstructive pulmonary disease clinical trials: results of a 3-month comparative study using the breathlessness, cough, and sputum scale (BCSS). Resp Med. 2003, 97 (suppl A): S35-43.CrossRef
15.
go back to reference Burge PS, Calverley PMA, Spencer S, Anderson JA, Maslen TK, on behalf of the ISOLDE Study Investigators: Randomised, double-blind, placebo-controlled study of fluticasone propionate in patients with moderate to severe chronic obstructive pulmonary disease: the ISOLDE trial. BMJ. 2000, 320: 1297-303. 10.1136/bmj.320.7245.1297.CrossRefPubMedPubMedCentral Burge PS, Calverley PMA, Spencer S, Anderson JA, Maslen TK, on behalf of the ISOLDE Study Investigators: Randomised, double-blind, placebo-controlled study of fluticasone propionate in patients with moderate to severe chronic obstructive pulmonary disease: the ISOLDE trial. BMJ. 2000, 320: 1297-303. 10.1136/bmj.320.7245.1297.CrossRefPubMedPubMedCentral
16.
go back to reference Calverley PMA, Anderson JA, Celli B, Ferguson GT, Jenkins C, Jones PW, Yates JC, Vestbo J, for the TORCH Investigators: Salmeterol and fluticasone propionate and survival in chronic obstructive pulmonary disease. N Engl J Med. 2007, 356: 775-89. 10.1056/NEJMoa063070.CrossRefPubMed Calverley PMA, Anderson JA, Celli B, Ferguson GT, Jenkins C, Jones PW, Yates JC, Vestbo J, for the TORCH Investigators: Salmeterol and fluticasone propionate and survival in chronic obstructive pulmonary disease. N Engl J Med. 2007, 356: 775-89. 10.1056/NEJMoa063070.CrossRefPubMed
17.
go back to reference Sin DD, Wu L, Anderson JA: Inhaled corticosteroids and mortality in chronic obstructive pulmonary disease. Thorax. 2005, 60: 992-7. 10.1136/thx.2005.045385.CrossRefPubMedPubMedCentral Sin DD, Wu L, Anderson JA: Inhaled corticosteroids and mortality in chronic obstructive pulmonary disease. Thorax. 2005, 60: 992-7. 10.1136/thx.2005.045385.CrossRefPubMedPubMedCentral
18.
go back to reference Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS - a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325-337. 10.1023/A:1008929526011.CrossRef Lunn DJ, Thomas A, Best N, Spiegelhalter D: WinBUGS - a Bayesian modelling framework: concepts, structure, and extensibility. Stat Comput. 2000, 10: 325-337. 10.1023/A:1008929526011.CrossRef
19.
go back to reference Spiegelhalter DJ, Best NJ, Carlin BP, Van der Linde A: Bayesian measures of model complexity and fit (with discussion). J R Stat Soc. 2002, 64: 1-34. 10.1111/1467-9868.00353.CrossRef Spiegelhalter DJ, Best NJ, Carlin BP, Van der Linde A: Bayesian measures of model complexity and fit (with discussion). J R Stat Soc. 2002, 64: 1-34. 10.1111/1467-9868.00353.CrossRef
21.
go back to reference Welton NJ: Mixed treatment comparisons: outcome measures. Lecture notes from Indirect and Multiple Comparisons course. 2008, Leicester University Welton NJ: Mixed treatment comparisons: outcome measures. Lecture notes from Indirect and Multiple Comparisons course. 2008, Leicester University
22.
go back to reference Welton NJ, Cooper NJ, Ades AE, Lu G, Sutton AJ: Mixed treatment comparison with multiple outcomes reported inconsistently across trials: Evaluation of antivirals for treatment of influenza A and B. Stat Med. 2008, 27: 5620-39. 10.1002/sim.3377.CrossRefPubMed Welton NJ, Cooper NJ, Ades AE, Lu G, Sutton AJ: Mixed treatment comparison with multiple outcomes reported inconsistently across trials: Evaluation of antivirals for treatment of influenza A and B. Stat Med. 2008, 27: 5620-39. 10.1002/sim.3377.CrossRefPubMed
23.
go back to reference Ma J, Liu W, Hunter A, Zhang W: Performing meta-analysis with incomplete statistical information in clinical trials. BMC Med Res Methodol. 2008, 8 (1): 56-10.1186/1471-2288-8-56.CrossRefPubMedPubMedCentral Ma J, Liu W, Hunter A, Zhang W: Performing meta-analysis with incomplete statistical information in clinical trials. BMC Med Res Methodol. 2008, 8 (1): 56-10.1186/1471-2288-8-56.CrossRefPubMedPubMedCentral
24.
go back to reference Michiels S, Piedbois P, Burdett S, Syz N, Stewart L, Pignon JP: Meta-analysis when only the median survival times are known: a comparison with individual patient data results. Int J Technol Assess. 2005, 21 (1): 119-25.CrossRef Michiels S, Piedbois P, Burdett S, Syz N, Stewart L, Pignon JP: Meta-analysis when only the median survival times are known: a comparison with individual patient data results. Int J Technol Assess. 2005, 21 (1): 119-25.CrossRef
25.
go back to reference Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR: Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007, 8: 16-10.1186/1745-6215-8-16.CrossRefPubMedPubMedCentral Tierney JF, Stewart LA, Ghersi D, Burdett S, Sydes MR: Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007, 8: 16-10.1186/1745-6215-8-16.CrossRefPubMedPubMedCentral
26.
go back to reference Williamson PR, Tudur Smith C, Hutton JL, Marson AG: Aggregate data meta-analysis with time-to-event outcomes. Stat Med. 2002, 21: 3337-51. 10.1002/sim.1303.CrossRefPubMed Williamson PR, Tudur Smith C, Hutton JL, Marson AG: Aggregate data meta-analysis with time-to-event outcomes. Stat Med. 2002, 21: 3337-51. 10.1002/sim.1303.CrossRefPubMed
27.
go back to reference Higgins JPT, Deeks JJ, (editors): Chapter 7: Selecting studies and collecting data. Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.0 (updated February 2008). The Cochrane Collaboration. Edited by: Higgins JPT, Green S. 2008, [http://www.cochrane-handbook.org] Higgins JPT, Deeks JJ, (editors): Chapter 7: Selecting studies and collecting data. Cochrane Handbook for Systematic Reviews of Interventions Version 5.0.0 (updated February 2008). The Cochrane Collaboration. Edited by: Higgins JPT, Green S. 2008, [http://​www.​cochrane-handbook.​org]
28.
go back to reference Green JA, Kirwan JM, Tierney JF, Symonds P, Fresco L, Collingwood M, Williams CJ: Survival and recurrence after concomitant chemotherapy and radiotherapy for cancer of the uterine cervix: a systematic review and meta-analysis. Lancet. 2001, 358 (8): 781-86. 10.1016/S0140-6736(01)05965-7.CrossRefPubMed Green JA, Kirwan JM, Tierney JF, Symonds P, Fresco L, Collingwood M, Williams CJ: Survival and recurrence after concomitant chemotherapy and radiotherapy for cancer of the uterine cervix: a systematic review and meta-analysis. Lancet. 2001, 358 (8): 781-86. 10.1016/S0140-6736(01)05965-7.CrossRefPubMed
29.
go back to reference Langendijk JA, Leemans CR, Buter J, Berkhof J, Slotman BJ: The Additional Value of Chemotherapy to Radiotherapy in Locally Advanced Nasopharyngeal Carcinoma: A Meta-Analysis of the Published Literature. J Clin Oncol. 2004, 22 (22): 4604-12. 10.1200/JCO.2004.10.074.CrossRefPubMed Langendijk JA, Leemans CR, Buter J, Berkhof J, Slotman BJ: The Additional Value of Chemotherapy to Radiotherapy in Locally Advanced Nasopharyngeal Carcinoma: A Meta-Analysis of the Published Literature. J Clin Oncol. 2004, 22 (22): 4604-12. 10.1200/JCO.2004.10.074.CrossRefPubMed
30.
go back to reference Lyman GH, Kuderer NM: The strengths and limitations of meta-analyses based on aggregate data. BMC Med Res Methodol. 2005, 5 (1): 14-10.1186/1471-2288-5-14.CrossRefPubMedPubMedCentral Lyman GH, Kuderer NM: The strengths and limitations of meta-analyses based on aggregate data. BMC Med Res Methodol. 2005, 5 (1): 14-10.1186/1471-2288-5-14.CrossRefPubMedPubMedCentral
31.
go back to reference Riley RD, Simmonds MC, Look MP: Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. J Clin Epidemiol. 2007, 60 (5): 431-9. 10.1016/j.jclinepi.2006.09.009.CrossRefPubMed Riley RD, Simmonds MC, Look MP: Evidence synthesis combining individual patient data and aggregate data: a systematic review identified current practice and possible methods. J Clin Epidemiol. 2007, 60 (5): 431-9. 10.1016/j.jclinepi.2006.09.009.CrossRefPubMed
Metadata
Title
Network meta-analysis on the log-hazard scale, combining count and hazard ratio statistics accounting for multi-arm trials: A tutorial
Authors
Beth S Woods
Neil Hawkins
David A Scott
Publication date
01-12-2010
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2010
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-10-54

Other articles of this Issue 1/2010

BMC Medical Research Methodology 1/2010 Go to the issue