Skip to main content
Top
Published in: Systematic Reviews 1/2021

Open Access 01-12-2021 | Methodology

Using median survival in meta-analysis of experimental time-to-event data

Authors: Theodore C. Hirst, Emily S. Sena, Malcolm R. Macleod

Published in: Systematic Reviews | Issue 1/2021

Login to get access

Abstract

Background

Time-to-event data is frequently reported in both clinical and preclinical research spheres. Systematic review and meta-analysis is a tool that can help to identify pitfalls in preclinical research conduct and reporting that can help to improve translational efficacy. However, pooling of studies using hazard ratios (HRs) is cumbersome especially in preclinical meta-analyses including large numbers of small studies. Median survival is a much simpler metric although because of some limitations, which may not apply to preclinical data, it is generally not used in survival meta-analysis. We aimed to appraise its performance when compared with hazard ratio-based meta-analysis when pooling large numbers of small, imprecise studies.

Methods

We simulated a survival dataset with features representative of a typical preclinical survival meta-analysis, including with influence of a treatment and a number of covariates. We calculated individual patient data-based hazard ratios and median survival ratios (MSRs), comparing the summary statistics directly and their performance at random-effects meta-analysis. Finally, we compared their sensitivity to detect associations between treatment and influential covariates at meta-regression.

Results

There was an imperfect correlation between MSR and HR, although the opposing direction of treatment effects between summary statistics appeared not to be a major issue. Precision was more conservative for HR than MSR, meaning that estimates of heterogeneity were lower. There was a slight sensitivity advantage for MSR at meta-analysis and meta-regression, although power was low in all circumstances.

Conclusions

We believe we have validated MSR as a summary statistic for use in a meta-analysis of small, imprecise experimental survival studies—helping to increase confidence and efficiency in future reviews in this area. While assessment of study precision and therefore weighting is less reliable, MSR appears to perform favourably during meta-analysis. Sensitivity of meta-regression was low for this set of parameters, so pooling of treatments to increase sample size may be required to ensure confidence in preclinical survival meta-regressions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Torre LA, et al. Global cancer statistics, 2012. CA Cancer J Clin. 2015;65(2):87–108.CrossRef Torre LA, et al. Global cancer statistics, 2012. CA Cancer J Clin. 2015;65(2):87–108.CrossRef
2.
go back to reference Hanly P, Soerjomataram I, Sharp L. Measuring the societal burden of cancer: the cost of lost productivity due to premature cancer-related mortality in Europe. Int J Cancer. 2015;136(4):E136–45.CrossRef Hanly P, Soerjomataram I, Sharp L. Measuring the societal burden of cancer: the cost of lost productivity due to premature cancer-related mortality in Europe. Int J Cancer. 2015;136(4):E136–45.CrossRef
3.
go back to reference Atkins D, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490.CrossRef Atkins D, et al. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490.CrossRef
4.
go back to reference Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg. 2011;128(1):305–10.CrossRef Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg. 2011;128(1):305–10.CrossRef
5.
go back to reference Howells DW, et al. Improving the efficiency of the development of drugs for stroke. Int J Stroke. 2012;7(5):371–7.CrossRef Howells DW, et al. Improving the efficiency of the development of drugs for stroke. Int J Stroke. 2012;7(5):371–7.CrossRef
6.
go back to reference Scannell JW, et al. Diagnosing the decline in pharmaceutical R&D efficiency. Nat Rev Drug Discov. 2012;11(3):191–200.CrossRef Scannell JW, et al. Diagnosing the decline in pharmaceutical R&D efficiency. Nat Rev Drug Discov. 2012;11(3):191–200.CrossRef
7.
go back to reference Hirst JA, et al. The need for randomization in animal trials: an overview of systematic reviews. PLoS One. 2014;9(6):e98856.CrossRef Hirst JA, et al. The need for randomization in animal trials: an overview of systematic reviews. PLoS One. 2014;9(6):e98856.CrossRef
9.
go back to reference Sena ES, et al. Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically. J Cereb Blood Flow Metab. 2014;34(5):737–42.CrossRef Sena ES, et al. Systematic reviews and meta-analysis of preclinical studies: why perform them and how to appraise them critically. J Cereb Blood Flow Metab. 2014;34(5):737–42.CrossRef
10.
go back to reference Walker E, Hernandez AV, Kattan MW. Meta-analysis: its strengths and limitations. Cleve Clin J Med. 2008;75(6):431–9.CrossRef Walker E, Hernandez AV, Kattan MW. Meta-analysis: its strengths and limitations. Cleve Clin J Med. 2008;75(6):431–9.CrossRef
11.
go back to reference Viechtbauer W. Accounting for heterogeneity via random-effects models and moderator analyses in meta-analysis. Zeitschrift Fur Psychol J Psychology - Z PSYCHOL. 2007;215:104–21.CrossRef Viechtbauer W. Accounting for heterogeneity via random-effects models and moderator analyses in meta-analysis. Zeitschrift Fur Psychol J Psychology - Z PSYCHOL. 2007;215:104–21.CrossRef
12.
go back to reference Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.CrossRef Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.CrossRef
13.
go back to reference Simonsohn U, Nelson LD, Simmons JP. p-curve and effect size: correcting for publication bias using only significant results. Perspect Psychol Sci. 2014;9(6):666–81.CrossRef Simonsohn U, Nelson LD, Simmons JP. p-curve and effect size: correcting for publication bias using only significant results. Perspect Psychol Sci. 2014;9(6):666–81.CrossRef
14.
go back to reference Singh R, Mukhopadhyay K. Survival analysis in clinical trials: basics and must know areas. Perspect Clin Res. 2011;2(4):145–8.CrossRef Singh R, Mukhopadhyay K. Survival analysis in clinical trials: basics and must know areas. Perspect Clin Res. 2011;2(4):145–8.CrossRef
15.
go back to reference Spruance SL, et al. Hazard ratio in clinical trials. Antimicrob Agents Chemother. 2004;48(8):2787–92.CrossRef Spruance SL, et al. Hazard ratio in clinical trials. Antimicrob Agents Chemother. 2004;48(8):2787–92.CrossRef
16.
go back to reference Stensrud MJ, et al. Limitations of hazard ratios in clinical trials. Eur Heart J. 2019;40(17):1378–83.CrossRef Stensrud MJ, et al. Limitations of hazard ratios in clinical trials. Eur Heart J. 2019;40(17):1378–83.CrossRef
17.
go back to reference JPT, H., Cochrane handbook for systematic reviews of interventions, G. S, Editor. 2011, The Cochrane Collaboration. JPT, H., Cochrane handbook for systematic reviews of interventions, G. S, Editor. 2011, The Cochrane Collaboration.
18.
go back to reference Altman DG, et al. Review of survival analyses published in cancer journals. Br J Cancer. 1995;72(2):511–8.CrossRef Altman DG, et al. Review of survival analyses published in cancer journals. Br J Cancer. 1995;72(2):511–8.CrossRef
19.
go back to reference Saluja R, et al. Estimating hazard ratios from published Kaplan-Meier survival curves: a methods validation study. Res Synth Methods. 2019;10(3):465–75.CrossRef Saluja R, et al. Estimating hazard ratios from published Kaplan-Meier survival curves: a methods validation study. Res Synth Methods. 2019;10(3):465–75.CrossRef
20.
go back to reference Tierney JF, et al. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8:16.CrossRef Tierney JF, et al. Practical methods for incorporating summary time-to-event data into meta-analysis. Trials. 2007;8:16.CrossRef
21.
go back to reference Parmar MK, Torri V, Stewart L. Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med. 1998;17(24):2815–34.CrossRef Parmar MK, Torri V, Stewart L. Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Stat Med. 1998;17(24):2815–34.CrossRef
22.
go back to reference Williamson PR, et al. Aggregate data meta-analysis with time-to-event outcomes. Stat Med. 2002;21(22):3337–51.CrossRef Williamson PR, et al. Aggregate data meta-analysis with time-to-event outcomes. Stat Med. 2002;21(22):3337–51.CrossRef
23.
go back to reference Michiels S, et al. Meta-analysis when only the median survival times are known: a comparison with individual patient data results. Int J Technol Assess Health Care. 2005;21(1):119–25.CrossRef Michiels S, et al. Meta-analysis when only the median survival times are known: a comparison with individual patient data results. Int J Technol Assess Health Care. 2005;21(1):119–25.CrossRef
24.
go back to reference Vesterinen HM, et al. Meta-analysis of data from animal studies: a practical guide. J Neurosci Methods. 2014;221:92–102.CrossRef Vesterinen HM, et al. Meta-analysis of data from animal studies: a practical guide. J Neurosci Methods. 2014;221:92–102.CrossRef
25.
go back to reference Hirst, T.C., et al., A systematic review and meta-analysis of gene therapy in animal models of cerebral glioma: why did promise not translate to human therapy? 2015. Hirst, T.C., et al., A systematic review and meta-analysis of gene therapy in animal models of cerebral glioma: why did promise not translate to human therapy? 2015.
26.
go back to reference Hirst TC, et al. Systematic review and meta-analysis of temozolomide in animal models of glioma: was clinical efficacy predicted? Br J Cancer. 2013;108(1):64–71.CrossRef Hirst TC, et al. Systematic review and meta-analysis of temozolomide in animal models of glioma: was clinical efficacy predicted? Br J Cancer. 2013;108(1):64–71.CrossRef
27.
go back to reference Jue TR, et al. A systematic review and meta-analysis of topoisomerase inhibition in pre-clinical glioma models. Oncotarget. 2018;9(13):11387–401.CrossRef Jue TR, et al. A systematic review and meta-analysis of topoisomerase inhibition in pre-clinical glioma models. Oncotarget. 2018;9(13):11387–401.CrossRef
28.
go back to reference Amarasingh S, Macleod MR, Whittle IR. What is the translational efficacy of chemotherapeutic drug research in neuro-oncology? A systematic review and meta-analysis of the efficacy of BCNU and CCNU in animal models of glioma. J Neurooncol. 2009;91(2):117–25.CrossRef Amarasingh S, Macleod MR, Whittle IR. What is the translational efficacy of chemotherapeutic drug research in neuro-oncology? A systematic review and meta-analysis of the efficacy of BCNU and CCNU in animal models of glioma. J Neurooncol. 2009;91(2):117–25.CrossRef
29.
go back to reference Crowther MJ, Lambert PC. Simulating biologically plausible complex survival data. Stat Med. 2013;32(23):4118–34.CrossRef Crowther MJ, Lambert PC. Simulating biologically plausible complex survival data. Stat Med. 2013;32(23):4118–34.CrossRef
30.
go back to reference Morris TP, White IR, Crowther MJ. Using simulation studies to evaluate statistical methods. Stat Med. 2019;38(11):2074–102.CrossRef Morris TP, White IR, Crowther MJ. Using simulation studies to evaluate statistical methods. Stat Med. 2019;38(11):2074–102.CrossRef
31.
go back to reference DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88.CrossRef DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88.CrossRef
32.
go back to reference Lalu MM, et al. Identifying stroke therapeutics from preclinical models: a protocol for a novel application of network meta-analysis. F1000Res. 2019;8:11.CrossRef Lalu MM, et al. Identifying stroke therapeutics from preclinical models: a protocol for a novel application of network meta-analysis. F1000Res. 2019;8:11.CrossRef
Metadata
Title
Using median survival in meta-analysis of experimental time-to-event data
Authors
Theodore C. Hirst
Emily S. Sena
Malcolm R. Macleod
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-021-01824-0

Other articles of this Issue 1/2021

Systematic Reviews 1/2021 Go to the issue