Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2012

Open Access 01-12-2012 | Technical advance

Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves

Authors: Patricia Guyot, AE Ades, Mario JNM Ouwens, Nicky J Welton

Published in: BMC Medical Research Methodology | Issue 1/2012

Login to get access

Abstract

Background

The results of Randomized Controlled Trials (RCTs) on time-to-event outcomes that are usually reported are median time to events and Cox Hazard Ratio. These do not constitute the sufficient statistics required for meta-analysis or cost-effectiveness analysis, and their use in secondary analyses requires strong assumptions that may not have been adequately tested. In order to enhance the quality of secondary data analyses, we propose a method which derives from the published Kaplan Meier survival curves a close approximation to the original individual patient time-to-event data from which they were generated.

Methods

We develop an algorithm that maps from digitised curves back to KM data by finding numerical solutions to the inverted KM equations, using where available information on number of events and numbers at risk. The reproducibility and accuracy of survival probabilities, median survival times and hazard ratios based on reconstructed KM data was assessed by comparing published statistics (survival probabilities, medians and hazard ratios) with statistics based on repeated reconstructions by multiple observers.

Results

The validation exercise established there was no material systematic error and that there was a high degree of reproducibility for all statistics. Accuracy was excellent for survival probabilities and medians, for hazard ratios reasonable accuracy can only be obtained if at least numbers at risk or total number of events are reported.

Conclusion

The algorithm is a reliable tool for meta-analysis and cost-effectiveness analyses of RCTs reporting time-to-event data. It is recommended that all RCTs should report information on numbers at risk and total number of events alongside KM curves.
Appendix
Available only for authorised users
Literature
1.
go back to reference Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ, Elbourne D, Egger M, Altman DG: CONSORT 2010 Explanation and Elaboration: updated guidelines for reporting parallel group randomised trials. BMJ. 2010, 340: c869-10.1136/bmj.c869.CrossRefPubMedPubMedCentral
2.
go back to reference Whitehead A, Whitehead J: A general parametric approach to the meta-analysis of randomized clinical trials. Statistics in medicine. 1991, 10: 1665-1677. 10.1002/sim.4780101105.CrossRefPubMed Whitehead A, Whitehead J: A general parametric approach to the meta-analysis of randomized clinical trials. Statistics in medicine. 1991, 10: 1665-1677. 10.1002/sim.4780101105.CrossRefPubMed
3.
go back to reference Michiels S, Piedbois P, Burdett S, Syz N, Stewart L, Pignon JP: Meta-analysis when only the median survival times are known: a comparison with individual patient data results. Int J Technol Assess Health Care. 2005, 21 (1): 119-25.CrossRefPubMed Michiels S, Piedbois P, Burdett S, Syz N, Stewart L, Pignon JP: Meta-analysis when only the median survival times are known: a comparison with individual patient data results. Int J Technol Assess Health Care. 2005, 21 (1): 119-25.CrossRefPubMed
4.
go back to reference Dear KBG: Alternative generalized least squares for meta-analysis of survival data at multiple time. Biometrics. 1994, 50: 989-1002. 10.2307/2533438.CrossRefPubMed Dear KBG: Alternative generalized least squares for meta-analysis of survival data at multiple time. Biometrics. 1994, 50: 989-1002. 10.2307/2533438.CrossRefPubMed
5.
go back to reference Arends L, Hunink M, Stijnen T: Meta-analysis of summary survival curve. Statistics in medicine. 2008, 27: 4381-4396. 10.1002/sim.3311.CrossRefPubMed Arends L, Hunink M, Stijnen T: Meta-analysis of summary survival curve. Statistics in medicine. 2008, 27: 4381-4396. 10.1002/sim.3311.CrossRefPubMed
6.
go back to reference Fiocco M, Putter H, van Houwelingen JC: Meta-analysis of pairs of survival curves under heterogeneity: a Poisson correlated gamma-frailty approach. Statistics in medicine. 2009, 28: 3782-3797. 10.1002/sim.3752.CrossRefPubMed Fiocco M, Putter H, van Houwelingen JC: Meta-analysis of pairs of survival curves under heterogeneity: a Poisson correlated gamma-frailty approach. Statistics in medicine. 2009, 28: 3782-3797. 10.1002/sim.3752.CrossRefPubMed
7.
go back to reference Parmar MKB, Torri V, Stewart L: Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Statistics in medicine. 1998, 17: 2815-2834. 10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8.CrossRefPubMed Parmar MKB, Torri V, Stewart L: Extracting summary statistics to perform meta-analyses of the published literature for survival endpoints. Statistics in medicine. 1998, 17: 2815-2834. 10.1002/(SICI)1097-0258(19981230)17:24<2815::AID-SIM110>3.0.CO;2-8.CrossRefPubMed
8.
go back to reference Ouwens MJNM, Philips Z, Jansen JP: Network meta-analysis of parametric survival curves. Research Synthesis Methods. 2010, 1 (3-4): 258-271. 10.1002/jrsm.25.CrossRefPubMed Ouwens MJNM, Philips Z, Jansen JP: Network meta-analysis of parametric survival curves. Research Synthesis Methods. 2010, 1 (3-4): 258-271. 10.1002/jrsm.25.CrossRefPubMed
9.
10.
go back to reference Earle C, Wells G: An Assessment of Methods to Combine Published Survival Curves. Medical Decision Making. 2000, 20: 104-111. 10.1177/0272989X0002000113.CrossRefPubMed Earle C, Wells G: An Assessment of Methods to Combine Published Survival Curves. Medical Decision Making. 2000, 20: 104-111. 10.1177/0272989X0002000113.CrossRefPubMed
11.
go back to reference Williamson PR, Tudur Smith C, Hutton JL, Marson AG: Aggregate data meta-analysis with time-to-event outcomes. Statistics in medicine. 2002, 21: 3337-3351. 10.1002/sim.1303.CrossRefPubMed Williamson PR, Tudur Smith C, Hutton JL, Marson AG: Aggregate data meta-analysis with time-to-event outcomes. Statistics in medicine. 2002, 21: 3337-3351. 10.1002/sim.1303.CrossRefPubMed
12.
go back to reference Bonner JA, Harari PM, Giralt J, Azarnia N, Shin DM, Cohen RB, Jones CU, Sur R, Raben D, Jassem J, Ove R, Kies MS, Baselga J, Youssoufian H, Amellal N, Rowinsky EK, Ang KK: Radiotherapy plus Cetuximab for Squamous-Cell Carcinoma of the Head and Neck. N Engl J Med. 2006, 354: 567-78. 10.1056/NEJMoa053422.CrossRefPubMed Bonner JA, Harari PM, Giralt J, Azarnia N, Shin DM, Cohen RB, Jones CU, Sur R, Raben D, Jassem J, Ove R, Kies MS, Baselga J, Youssoufian H, Amellal N, Rowinsky EK, Ang KK: Radiotherapy plus Cetuximab for Squamous-Cell Carcinoma of the Head and Neck. N Engl J Med. 2006, 354: 567-78. 10.1056/NEJMoa053422.CrossRefPubMed
13.
go back to reference Guyot P, Welton NJ, Ouwens MJNM, Ades AE: Survival time outcomes in randomised controlled trials and meta-analyses: the parallel universes of efficacy and cost-effectiveness. Value In Health. 2011, 14 (5): 640-6. 10.1016/j.jval.2011.01.008.CrossRefPubMed Guyot P, Welton NJ, Ouwens MJNM, Ades AE: Survival time outcomes in randomised controlled trials and meta-analyses: the parallel universes of efficacy and cost-effectiveness. Value In Health. 2011, 14 (5): 640-6. 10.1016/j.jval.2011.01.008.CrossRefPubMed
14.
go back to reference Williamson PR, Marson AG, Tudur C, Hutton JL, Chadwick D: Individual patient data meta-analysis of randomized anti-epileptic drug monotherapy trials. Journal of evaluation in clinical practice. 2000, 6 (2): 205-214. 10.1046/j.1365-2753.2000.00236.x.CrossRefPubMed Williamson PR, Marson AG, Tudur C, Hutton JL, Chadwick D: Individual patient data meta-analysis of randomized anti-epileptic drug monotherapy trials. Journal of evaluation in clinical practice. 2000, 6 (2): 205-214. 10.1046/j.1365-2753.2000.00236.x.CrossRefPubMed
15.
go back to reference Stewart LA, Tierney JF: To IPD or not to IPD? : Advantages and disadvantages of systematic reviews using individual patient data. Evaluation and the Health Professions. 2002, 25: 76-10.1177/0163278702025001006.CrossRefPubMed Stewart LA, Tierney JF: To IPD or not to IPD? : Advantages and disadvantages of systematic reviews using individual patient data. Evaluation and the Health Professions. 2002, 25: 76-10.1177/0163278702025001006.CrossRefPubMed
16.
go back to reference Bellera CA, MacGrogan G, Debled M, Tunon de Lara C, Brouste V, Mathoulin-Pélissier S: Variables with time-varying effects and the Cox model: Some statistical concepts illustrated with a prognostic factor study in breast cancer. BMC Medical Research Methodology. 2010, 10: 20-10.1186/1471-2288-10-20.CrossRefPubMedPubMedCentral Bellera CA, MacGrogan G, Debled M, Tunon de Lara C, Brouste V, Mathoulin-Pélissier S: Variables with time-varying effects and the Cox model: Some statistical concepts illustrated with a prognostic factor study in breast cancer. BMC Medical Research Methodology. 2010, 10: 20-10.1186/1471-2288-10-20.CrossRefPubMedPubMedCentral
17.
go back to reference Collett D: Modelling Survival Data in Medical Research. 2003, Boca Raton: Chapman & Hall/CRC, Second Collett D: Modelling Survival Data in Medical Research. 2003, Boca Raton: Chapman & Hall/CRC, Second
18.
go back to reference Cox C: The generalized F distribution: an umbrella for parametric survival analysis. Stat Med. 2008, 27: 4301-12. 10.1002/sim.3292.CrossRefPubMed Cox C: The generalized F distribution: an umbrella for parametric survival analysis. Stat Med. 2008, 27: 4301-12. 10.1002/sim.3292.CrossRefPubMed
19.
go back to reference McDonald JB, Xub YJ: A generalization of the beta distribution with applications. Journal of Econometrics. 1995, 66: 133-152. 10.1016/0304-4076(94)01612-4.CrossRef McDonald JB, Xub YJ: A generalization of the beta distribution with applications. Journal of Econometrics. 1995, 66: 133-152. 10.1016/0304-4076(94)01612-4.CrossRef
20.
go back to reference Royston P, Parmar MKB: Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modeling and estimation of treatment effects. Stat Med. 2002, 21: 2175-97. 10.1002/sim.1203.CrossRefPubMed Royston P, Parmar MKB: Flexible parametric proportional-hazards and proportional-odds models for censored survival data, with application to prognostic modeling and estimation of treatment effects. Stat Med. 2002, 21: 2175-97. 10.1002/sim.1203.CrossRefPubMed
22.
go back to reference van Houwelingen HC, van de Velde CJH, Stijnen T: Interim analysis on survival data: its potential bias and how to repair it. Statistics in medicine. 2005, 24: 2823-2835. 10.1002/sim.2248.CrossRefPubMed van Houwelingen HC, van de Velde CJH, Stijnen T: Interim analysis on survival data: its potential bias and how to repair it. Statistics in medicine. 2005, 24: 2823-2835. 10.1002/sim.2248.CrossRefPubMed
23.
go back to reference Hunink MGM, Wong JB: Meta-analysis of failure-time data with adjustment for covariates. Medical decision Making. 1994, 14: 59-70. 10.1177/0272989X9401400108.CrossRefPubMed Hunink MGM, Wong JB: Meta-analysis of failure-time data with adjustment for covariates. Medical decision Making. 1994, 14: 59-70. 10.1177/0272989X9401400108.CrossRefPubMed
24.
go back to reference Shore T, Nelson N, Weinerman B: A meta-analysis of stages I and II Hodgkin's disease. Cancer. 1990, 65: 1155-60. 10.1002/1097-0142(19900301)65:5<1155::AID-CNCR2820650521>3.0.CO;2-7.CrossRefPubMed Shore T, Nelson N, Weinerman B: A meta-analysis of stages I and II Hodgkin's disease. Cancer. 1990, 65: 1155-60. 10.1002/1097-0142(19900301)65:5<1155::AID-CNCR2820650521>3.0.CO;2-7.CrossRefPubMed
25.
go back to reference Voest EE, Van Houwelingen JC, Neijt JP: A meta-analysis of prognostic factors in advanced ovarian cancer with median survival and overall survival (measured with the log(relative risk)) as main objectives. European Journal of Cancer and Clinical Oncology. 1989, 25: 711-20. 10.1016/0277-5379(89)90208-3.CrossRefPubMed Voest EE, Van Houwelingen JC, Neijt JP: A meta-analysis of prognostic factors in advanced ovarian cancer with median survival and overall survival (measured with the log(relative risk)) as main objectives. European Journal of Cancer and Clinical Oncology. 1989, 25: 711-20. 10.1016/0277-5379(89)90208-3.CrossRefPubMed
26.
go back to reference Rothman K, Greenland S, Lash TL: Modern epidemiology. 2008, Lippincott Williams & Wilkins, Third Rothman K, Greenland S, Lash TL: Modern epidemiology. 2008, Lippincott Williams & Wilkins, Third
27.
go back to reference Van Oers MH, Klasa R, Marcus RE, Wolf M, Gascoyne RD, Jack A, Van'tVeer M, Vranovsky A, Holte H, van Glabbeke M, Teodorovic I, Rozewicz C, Hagenbeek A: Rituximab maintenance improves clinical outcome of relapsed/resistant follicular non-Hodgkin's lymphoma, both in patients with and without rituximab during induction: results of a prospective randomized phase III study. Blood. 2006, 108: 3295-3301. 10.1182/blood-2006-05-021113.CrossRefPubMed Van Oers MH, Klasa R, Marcus RE, Wolf M, Gascoyne RD, Jack A, Van'tVeer M, Vranovsky A, Holte H, van Glabbeke M, Teodorovic I, Rozewicz C, Hagenbeek A: Rituximab maintenance improves clinical outcome of relapsed/resistant follicular non-Hodgkin's lymphoma, both in patients with and without rituximab during induction: results of a prospective randomized phase III study. Blood. 2006, 108: 3295-3301. 10.1182/blood-2006-05-021113.CrossRefPubMed
28.
go back to reference Goss PE, Ingle JN, Martino S, Robert NJ, Muss HB, Piccart MJ, Castiglione M, Tu D, Shepherd LE, Pritchard KI, Livingston RB, Davidson NE, Norton L, Perez EA, Abrams JS, Cameron DA, Palmer MJ, Pater JL: Randomized Trial of Letrozole Following Tamoxifen as Extended Adjuvant Therapy in Receptor-Positive Breast Cancer: Updated Findings from NCIC CTG MA.17. JNCI Cancer Spectrum. 2005, 97: 1262-1271.PubMed Goss PE, Ingle JN, Martino S, Robert NJ, Muss HB, Piccart MJ, Castiglione M, Tu D, Shepherd LE, Pritchard KI, Livingston RB, Davidson NE, Norton L, Perez EA, Abrams JS, Cameron DA, Palmer MJ, Pater JL: Randomized Trial of Letrozole Following Tamoxifen as Extended Adjuvant Therapy in Receptor-Positive Breast Cancer: Updated Findings from NCIC CTG MA.17. JNCI Cancer Spectrum. 2005, 97: 1262-1271.PubMed
29.
go back to reference Seymour MT, Maughan TS, Ledermann JA, Topham C, James R, Gwyther SJ, Smith DB, Sheperd S, Maraveyas A, Ferry DR, Meade AM, Thompson L, Griffiths GO, Parmar MKB, Stephens RJ: FOCUS Trial Investigators. Different strategies of sequential and combination chemotherapy for patients with poor prognosis advanced colorectal cancer (MRC FOCUS): a randomised controlled trial. Lancet. 2007, 370 (9582): 143-52. 10.1016/S0140-6736(07)61087-3. Erratum in: Lancet. 2007 Aug 18; 370(9587):566CrossRefPubMed Seymour MT, Maughan TS, Ledermann JA, Topham C, James R, Gwyther SJ, Smith DB, Sheperd S, Maraveyas A, Ferry DR, Meade AM, Thompson L, Griffiths GO, Parmar MKB, Stephens RJ: FOCUS Trial Investigators. Different strategies of sequential and combination chemotherapy for patients with poor prognosis advanced colorectal cancer (MRC FOCUS): a randomised controlled trial. Lancet. 2007, 370 (9582): 143-52. 10.1016/S0140-6736(07)61087-3. Erratum in: Lancet. 2007 Aug 18; 370(9587):566CrossRefPubMed
30.
go back to reference Pan J-N: Evaluating the Gauge repeatability and reproducibility for different industries. Quality & Quantity. 2006, 40: 499-518. 10.1007/s11135-005-1100-y.CrossRef Pan J-N: Evaluating the Gauge repeatability and reproducibility for different industries. Quality & Quantity. 2006, 40: 499-518. 10.1007/s11135-005-1100-y.CrossRef
31.
go back to reference Wang F-K, Li E: Confidence intervals in repeatability and reproducibility using the Bootstrap method. Total quality management. 2003, 14 (3): 341-354. 10.1080/1478336032000046643.CrossRef Wang F-K, Li E: Confidence intervals in repeatability and reproducibility using the Bootstrap method. Total quality management. 2003, 14 (3): 341-354. 10.1080/1478336032000046643.CrossRef
Metadata
Title
Enhanced secondary analysis of survival data: reconstructing the data from published Kaplan-Meier survival curves
Authors
Patricia Guyot
AE Ades
Mario JNM Ouwens
Nicky J Welton
Publication date
01-12-2012
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2012
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-12-9

Other articles of this Issue 1/2012

BMC Medical Research Methodology 1/2012 Go to the issue