Skip to main content
Top
Published in: World Journal of Surgery 7/2006

01-07-2006

Meta-analyses in Cancer Clinical Trials: Principles and Pitfalls

Authors: J. R. Benson, MA, DM, K. Saeb-Parsy, MA, PhD

Published in: World Journal of Surgery | Issue 7/2006

Login to get access

Excerpt

The term “meta-analysis” was first applied by Glass in 1976 to describe the combination and analysis of data from multiple research projects.1 Other terms such as “overview”2,3 and “combined analysis” were in usage prior to this and results from physical sciences have been pooled to generate meta-analyses or overviews since the 1930s.4 Indeed, the practice is commonplace and not controversial within this discipline where individual trials tend to be less heterogeneous than within the biological field. The utilization of this approach as a research tool in clinical medicine was introduced in the 1970s, initially to investigate therapeutic questions in cardiovascular disorders.57 More recently, this methodology has been championed by Peto (among others) as an effective means of increasing the power of similar studies on cancer treatments where the same or a similar question is addressed by the randomization process.8 Meta-analyses have been rapidly accepted over the past 10 years, and continuing analysis of past studies for a particular type and stage of cancer have provided more definitive guidance on treatment efficacy and the direction of future research strategy. The formulation of public policy should be based on robust randomized clinical data and ideally come from large single randomized trials.911 Though a meta-analysis is not a substitute for the latter, these “studies of studies”12 can yield affirmative conclusions, and when the null hypothesis is not refuted, resources can be channeled into other areas of research. Meta-analysis is an instrument of exploration rather than confirmation,13 and it leads to hypothesis generation rather than testing.14,15 Such analyses can provide powerful statistical evidence to either support or denounce a new treatment policy.16
Literature
1.
go back to reference Glass GV. Primary, secondary, meta-analysis of research. Educat Res1976;5:3–8CrossRef Glass GV. Primary, secondary, meta-analysis of research. Educat Res1976;5:3–8CrossRef
2.
go back to reference Pocock SJ, Lagakos SW. Practical experience of randomization in cancer trials: an international survey. Br J Cancer 1982;46:368PubMed Pocock SJ, Lagakos SW. Practical experience of randomization in cancer trials: an international survey. Br J Cancer 1982;46:368PubMed
3.
go back to reference Sacks HS, Barrier J, Reitman D, et al. Meta-analyses of randomized controlled trials. N Engl J Med 1987;316:450PubMedCrossRef Sacks HS, Barrier J, Reitman D, et al. Meta-analyses of randomized controlled trials. N Engl J Med 1987;316:450PubMedCrossRef
4.
go back to reference Yates F, Cochran WG. The analysis of groups of patients. J R Stat Soc 1937;4:102–118 Yates F, Cochran WG. The analysis of groups of patients. J R Stat Soc 1937;4:102–118
5.
go back to reference Chalmers TC, Matta RJ, Smith H, et al. Evidence favouring the use of anticoagulants in the hospital phase of acute myocardial infarction. N Engl J Med 1977;297:1091–1096PubMedCrossRef Chalmers TC, Matta RJ, Smith H, et al. Evidence favouring the use of anticoagulants in the hospital phase of acute myocardial infarction. N Engl J Med 1977;297:1091–1096PubMedCrossRef
6.
go back to reference Fibrinolytic Therapy Trialists Collaborative Group. Indications for fibrinolytic therapy in suspected acute myocardial infarction. Lancet 1994;343:311 Fibrinolytic Therapy Trialists Collaborative Group. Indications for fibrinolytic therapy in suspected acute myocardial infarction. Lancet 1994;343:311
7.
go back to reference ISIS-1 (First International Study of Infarct Survival) Collaborative Group. A randomized trial of intravenous atenolol amongst 16,027 cases of suspected acute myocardial infarction: ISIS-1. Lancet 1986;2:57–66 ISIS-1 (First International Study of Infarct Survival) Collaborative Group. A randomized trial of intravenous atenolol amongst 16,027 cases of suspected acute myocardial infarction: ISIS-1. Lancet 1986;2:57–66
8.
go back to reference Peto R. Why do we need systematic overviews of randomized trials? Stat Med 1987;6:233–240PubMed Peto R. Why do we need systematic overviews of randomized trials? Stat Med 1987;6:233–240PubMed
9.
go back to reference Hennekens CH, Buring JE, Hebert PR. Implications of overviews of randomized trials. Stat Med 1987;6:397–402PubMed Hennekens CH, Buring JE, Hebert PR. Implications of overviews of randomized trials. Stat Med 1987;6:397–402PubMed
10.
go back to reference Chalmers TC, Leven H, Sacks HS, et al. Meta-analysis of clinical trials as a scientific discipline. I: control of bias and comparison with large co-operative trials. Stat Med 1987;6:315PubMed Chalmers TC, Leven H, Sacks HS, et al. Meta-analysis of clinical trials as a scientific discipline. I: control of bias and comparison with large co-operative trials. Stat Med 1987;6:315PubMed
11.
go back to reference Peto R, Collins R, Gray R. Large-scale randomized evidence: large, simple trials and overviews of trials. Ann NY Acad Sci 1994;703:314 Peto R, Collins R, Gray R. Large-scale randomized evidence: large, simple trials and overviews of trials. Ann NY Acad Sci 1994;703:314
13.
go back to reference Green S, Benedetti J, Crowley J. Clinical Trials in Oncology, Chapter 9, London, Chapman and Hall, 1997;167–182 Green S, Benedetti J, Crowley J. Clinical Trials in Oncology, Chapter 9, London, Chapman and Hall, 1997;167–182
14.
go back to reference Furberg CD, Morgan TM. Lessons from overviews of cardiovascular trials. Stat Med 1987;6:295PubMed Furberg CD, Morgan TM. Lessons from overviews of cardiovascular trials. Stat Med 1987;6:295PubMed
15.
16.
go back to reference Tobias J, Houghton J, Riley DL. Moving the Goalposts–a review of clinical trial strategies in early breast cancer. In Breast Cancer–New Horizons in Research and Treatment, Chapter 17, London, Arnold, 2001;195–202 Tobias J, Houghton J, Riley DL. Moving the Goalposts–a review of clinical trial strategies in early breast cancer. In Breast Cancer–New Horizons in Research and Treatment, Chapter 17, London, Arnold, 2001;195–202
17.
go back to reference Early Breast Cancer Trialists Collaborative Group. Treatment of early breast cancer. Vol I: Worldwide Evidence, 1985–1990, Oxford and New York, Oxford University Press, 1990 Early Breast Cancer Trialists Collaborative Group. Treatment of early breast cancer. Vol I: Worldwide Evidence, 1985–1990, Oxford and New York, Oxford University Press, 1990
18.
go back to reference Early Breast Cancer Trialists’ Collaborative Group. Systemic treatment of early breast cancer by hormonal, cytotoxic or immune therapy: 133 randomised trials involving 31,000 recurrences and 24,000 deaths among 75,000 women. Lancet 1992;339:1–15, 71–85 Early Breast Cancer Trialists’ Collaborative Group. Systemic treatment of early breast cancer by hormonal, cytotoxic or immune therapy: 133 randomised trials involving 31,000 recurrences and 24,000 deaths among 75,000 women. Lancet 1992;339:1–15, 71–85
19.
go back to reference Begg CB. A measure to aid in the interpretation of publicized clinical trials. Stat Med 1985;4:1PubMed Begg CB. A measure to aid in the interpretation of publicized clinical trials. Stat Med 1985;4:1PubMed
20.
go back to reference Collins R, Gray R, Godwin J, et al. Avoidance of large biases and large random errors in assessment of moderate treatment effects: the need for systematic overviews. Stat Med 1987;2:245 Collins R, Gray R, Godwin J, et al. Avoidance of large biases and large random errors in assessment of moderate treatment effects: the need for systematic overviews. Stat Med 1987;2:245
21.
go back to reference Gelber RD, Goldhirsch A. The concept of an overview of cancer clinical trials with special emphasis on early breast cancer. J Clin Oncol 1986;4:1696–1703PubMed Gelber RD, Goldhirsch A. The concept of an overview of cancer clinical trials with special emphasis on early breast cancer. J Clin Oncol 1986;4:1696–1703PubMed
22.
go back to reference Demets D. Methods for combining randomized clinical trials: strengths and limitations. Stat Med 1987;6:341–348PubMed Demets D. Methods for combining randomized clinical trials: strengths and limitations. Stat Med 1987;6:341–348PubMed
23.
go back to reference Simon R. The role of overviews in cancer therapeutics. Stat Med 1987;6:389–393PubMed Simon R. The role of overviews in cancer therapeutics. Stat Med 1987;6:389–393PubMed
24.
go back to reference Simes RJ. Publication bias: the case for an international registry of clinical trials. J Clin Oncol 1986;4:1529PubMed Simes RJ. Publication bias: the case for an international registry of clinical trials. J Clin Oncol 1986;4:1529PubMed
25.
go back to reference Tippett LHC. The Method of Statistics, London, Williams and Norgate, 1931 Tippett LHC. The Method of Statistics, London, Williams and Norgate, 1931
26.
go back to reference Fisher RA. Statistical Methods for Research Workers, 4th edn, London, Oliver and Boyd, 1932 Fisher RA. Statistical Methods for Research Workers, 4th edn, London, Oliver and Boyd, 1932
27.
go back to reference Pearson K. On a method of determining whether a sample of given size n supposed to have been drawn from a parent population having a known probability integral has probably been drawn at random. Biometrika 1933;25:379CrossRef Pearson K. On a method of determining whether a sample of given size n supposed to have been drawn from a parent population having a known probability integral has probably been drawn at random. Biometrika 1933;25:379CrossRef
28.
29.
30.
go back to reference May GS, Eberlein K, Furberg G, et al. Secondary prevention trials after myocardial infarction: a review. Prog Cardiovasc Dis 1982;24:331–352PubMedCrossRef May GS, Eberlein K, Furberg G, et al. Secondary prevention trials after myocardial infarction: a review. Prog Cardiovasc Dis 1982;24:331–352PubMedCrossRef
31.
go back to reference Yusuf S, Peto R, Lewis J. et al. Beta-blockade during and after myocardial infarction: an overview of the randomized trials. Prog Cardiovasc Dis 1985;27:335–371PubMed Yusuf S, Peto R, Lewis J. et al. Beta-blockade during and after myocardial infarction: an overview of the randomized trials. Prog Cardiovasc Dis 1985;27:335–371PubMed
32.
go back to reference Yusuf S, Collins R, Peto R, et al. Intravenous and intracoronary fibrinolytic therapy in acute myocardial infarction: overview of results on mortality, reinfarction and side-effects from 33 randomised controlled trials. Eur Heart J 1985;6:556–585PubMed Yusuf S, Collins R, Peto R, et al. Intravenous and intracoronary fibrinolytic therapy in acute myocardial infarction: overview of results on mortality, reinfarction and side-effects from 33 randomised controlled trials. Eur Heart J 1985;6:556–585PubMed
33.
go back to reference The 2000 EBCTCG overview: a widening gap. Comment. Lancet 2005;365:1665–1666 The 2000 EBCTCG overview: a widening gap. Comment. Lancet 2005;365:1665–1666
34.
go back to reference Wittes RE. Problems in the medical interpretation of overviews. Stat Med 1987;6:269PubMed Wittes RE. Problems in the medical interpretation of overviews. Stat Med 1987;6:269PubMed
35.
go back to reference Berlin JA, Laird NM, Sacks HS, et al. A comparison of statistical methods for combining event rates from clinical trials. Stat Med 1989;8:141PubMed Berlin JA, Laird NM, Sacks HS, et al. A comparison of statistical methods for combining event rates from clinical trials. Stat Med 1989;8:141PubMed
36.
go back to reference Lau J, Antman EM, Jimenez-Silva J, et al. Cumulative meta-analysis of therapeutic trials for myocardial infarction. JAMA 1992;268:240–248PubMedCrossRef Lau J, Antman EM, Jimenez-Silva J, et al. Cumulative meta-analysis of therapeutic trials for myocardial infarction. JAMA 1992;268:240–248PubMedCrossRef
37.
go back to reference Early Breast Cancer Trialists Collaborative Group. Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15 year survival: an overview of the randomized trials. Lancet 2005;365:1687–1717CrossRef Early Breast Cancer Trialists Collaborative Group. Effects of chemotherapy and hormonal therapy for early breast cancer on recurrence and 15 year survival: an overview of the randomized trials. Lancet 2005;365:1687–1717CrossRef
Metadata
Title
Meta-analyses in Cancer Clinical Trials: Principles and Pitfalls
Authors
J. R. Benson, MA, DM
K. Saeb-Parsy, MA, PhD
Publication date
01-07-2006
Publisher
Springer-Verlag
Published in
World Journal of Surgery / Issue 7/2006
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-006-0081-x

Other articles of this Issue 7/2006

World Journal of Surgery 7/2006 Go to the issue