Skip to main content
Top
Published in: Journal of Neuro-Oncology 3/2015

01-09-2015 | Topic Review

Randomized controlled trials and neuro-oncology: should alternative designs be considered?

Authors: Alireza Mansouri, Samuel Shin, Benjamin Cooper, Archita Srivastava, Mohit Bhandari, Douglas Kondziolka

Published in: Journal of Neuro-Oncology | Issue 3/2015

Login to get access

Abstract

Deficiencies in design and reporting of randomized controlled trials (RCTs) hinders interpretability and critical appraisal. The reporting quality of recent RCTs in neuro-oncology was analyzed to assess adequacy of design and reporting. The MEDLINE and EMBASE databases were searched to identify non-surgical RCTs (years 2005–2014, inclusive). The CONSORT and Jadad scales were used to assess the quality of design/reporting. Studies published in 2005–2010 were compared as a cohort against studies published in 2011–2014, in terms of general characteristics and reporting quality. A PRECIS-based scale was used to designate studies on the pragmatic-explanatory continuum. Spearman’s test was used to assess correlations. Regression analysis was used to assess associations. Overall 68 RCTs were identified. Studies were often chemotherapy-based (n = 41 studies) focusing upon high grade gliomas (46 %) and metastases (41 %) as the top pathologies. Multi-center trials (71 %) were frequent. The overall median CONSORT and Jadad scores were 34.5 (maximum 44) and 2 (maximum 5), respectively; these scores were similar in radiation and chemotherapy-based trials. Major areas of deficiency pertained to allocation concealment, implementation of methods, and blinding whereby less than 20 % of articles fulfilled all criteria. Description of intervention, random sequence generation, and the details regarding recruitment were also deficient; less than 50 % of studies fulfilled all criteria. Description of sample size calculations and blinding improved in later published cohorts. Journal impact factor was significantly associated with higher quality (p = 0.04). Large academic consortia, multi-center designs, ITT analysis, collaboration with biostatisticians, larger sample sizes, and studies with pragmatic objectives were more likely to achieve positive primary outcomes on univariate analysis; none of these variables were significant on multivariate analysis. Deficiencies in the quality of design/reporting of RCTs in neuro-oncology persist. Quality improvement is necessary. Consideration of alternative strategies should be considered.
Appendix
Available only for authorised users
Literature
2.
go back to reference Yusuf S, Collins R, Peto R (1984) Why do we need some large, simple randomized trials? Stat Med 3:409–422CrossRefPubMed Yusuf S, Collins R, Peto R (1984) Why do we need some large, simple randomized trials? Stat Med 3:409–422CrossRefPubMed
4.
go back to reference Andrews DW, Scott CB, Sperduto PW, Flanders AE, Gaspar LE, Schell MC, Werner-Wasik M, Demas W, Ryu J, Bahary JP, Souhami L, Rotman M, Mehta MP, Curran WJ Jr (2004) Whole brain radiation therapy with or without stereotactic radiosurgery boost for patients with one to three brain metastases: phase III results of the RTOG 9508 randomised trial. Lancet 363:1665–1672. doi:10.1016/S0140-6736(04)16250-8 CrossRefPubMed Andrews DW, Scott CB, Sperduto PW, Flanders AE, Gaspar LE, Schell MC, Werner-Wasik M, Demas W, Ryu J, Bahary JP, Souhami L, Rotman M, Mehta MP, Curran WJ Jr (2004) Whole brain radiation therapy with or without stereotactic radiosurgery boost for patients with one to three brain metastases: phase III results of the RTOG 9508 randomised trial. Lancet 363:1665–1672. doi:10.​1016/​S0140-6736(04)16250-8 CrossRefPubMed
5.
go back to reference Patchell RA, Tibbs PA, Walsh JW, Dempsey RJ, Maruyama Y, Kryscio RJ, Markesbery WR, Macdonald JS, Young B (1990) A randomized trial of surgery in the treatment of single metastases to the brain. New Engl J Med 322:494–500. doi:10.1056/NEJM199002223220802 CrossRefPubMed Patchell RA, Tibbs PA, Walsh JW, Dempsey RJ, Maruyama Y, Kryscio RJ, Markesbery WR, Macdonald JS, Young B (1990) A randomized trial of surgery in the treatment of single metastases to the brain. New Engl J Med 322:494–500. doi:10.​1056/​NEJM199002223220​802 CrossRefPubMed
6.
go back to reference Tsao M, Xu W, Sahgal A (2012) A meta-analysis evaluating stereotactic radiosurgery, whole-brain radiotherapy, or both for patients presenting with a limited number of brain metastases. Cancer 118:2486–2493. doi:10.1002/cncr.26515 CrossRefPubMed Tsao M, Xu W, Sahgal A (2012) A meta-analysis evaluating stereotactic radiosurgery, whole-brain radiotherapy, or both for patients presenting with a limited number of brain metastases. Cancer 118:2486–2493. doi:10.​1002/​cncr.​26515 CrossRefPubMed
7.
go back to reference Tsao MN, Lloyd N, Wong RK, Chow E, Rakovitch E, Laperriere N, Xu W, Sahgal A (2012) Whole brain radiotherapy for the treatment of newly diagnosed multiple brain metastases. Cochrane Database Syst Rev 4:CD003869. doi:10.1002/14651858.CD003869.pub3 Tsao MN, Lloyd N, Wong RK, Chow E, Rakovitch E, Laperriere N, Xu W, Sahgal A (2012) Whole brain radiotherapy for the treatment of newly diagnosed multiple brain metastases. Cochrane Database Syst Rev 4:CD003869. doi:10.​1002/​14651858.​CD003869.​pub3
9.
go back to reference Moher D, Jones A, Lepage L, Group C (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995CrossRefPubMed Moher D, Jones A, Lepage L, Group C (2001) Use of the CONSORT statement and quality of reports of randomized trials: a comparative before-and-after evaluation. JAMA 285:1992–1995CrossRefPubMed
11.
go back to reference Kunz R, Neumayer HH, Khan KS (2002) When small degrees of bias in randomized trials can mislead clinical decisions: an example of individualizing preventive treatment of upper gastrointestinal bleeding. Crit Care Med 30:1503–1507CrossRefPubMed Kunz R, Neumayer HH, Khan KS (2002) When small degrees of bias in randomized trials can mislead clinical decisions: an example of individualizing preventive treatment of upper gastrointestinal bleeding. Crit Care Med 30:1503–1507CrossRefPubMed
15.
16.
go back to reference Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A (1989) Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA 262:2101–2107CrossRefPubMed Nicolucci A, Grilli R, Alexanian AA, Apolone G, Torri V, Liberati A (1989) Quality, evolution, and clinical implications of randomized, controlled trials on the treatment of lung cancer. A lost opportunity for meta-analysis. JAMA 262:2101–2107CrossRefPubMed
17.
go back to reference Moher D, Schulz KF, Altman DG, Group C (2001) The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc 91:437–442CrossRef Moher D, Schulz KF, Altman DG, Group C (2001) The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomized trials. J Am Podiatr Med Assoc 91:437–442CrossRef
18.
go back to reference Jadad AR, Cook DJ, Browman GP (1997) A guide to interpreting discordant systematic reviews. Can Med Assoc J 156:1411–1416 Jadad AR, Cook DJ, Browman GP (1997) A guide to interpreting discordant systematic reviews. Can Med Assoc J 156:1411–1416
19.
go back to reference Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K (2009) A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. Can Med Assoc J 180:47–57. doi:10.1503/cmaj.090523 CrossRef Thorpe KE, Zwarenstein M, Oxman AD, Treweek S, Furberg CD, Altman DG, Tunis S, Bergel E, Harvey I, Magid DJ, Chalkidou K (2009) A pragmatic-explanatory continuum indicator summary (PRECIS): a tool to help trial designers. Can Med Assoc J 180:47–57. doi:10.​1503/​cmaj.​090523 CrossRef
20.
go back to reference Mansouri A, CB, Shin S, Kondziolka D (2015) Randomized Controlled Trials and Neurosurgery: the ideal fit or should alternative methodologies be considered? J Neurosurg Mansouri A, CB, Shin S, Kondziolka D (2015) Randomized Controlled Trials and Neurosurgery: the ideal fit or should alternative methodologies be considered? J Neurosurg
21.
go back to reference You B, Gan HK, Pond G, Chen EX (2012) Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials from registration to publication: a systematic review. J Clin Oncol 30:210–216. doi:10.1200/JCO.2011.37.0890 CrossRefPubMed You B, Gan HK, Pond G, Chen EX (2012) Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials from registration to publication: a systematic review. J Clin Oncol 30:210–216. doi:10.​1200/​JCO.​2011.​37.​0890 CrossRefPubMed
22.
go back to reference Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR (1991) Publication bias in clinical research. Lancet 337:867–872CrossRefPubMed Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR (1991) Publication bias in clinical research. Lancet 337:867–872CrossRefPubMed
23.
26.
27.
go back to reference Chan AY, Hooi LS (2000) Outcome of 85 lupus nephritis patients treated with intravenous cyclophosphamide: a single centre 10 year experience. Med J Malays 55:14–20 Chan AY, Hooi LS (2000) Outcome of 85 lupus nephritis patients treated with intravenous cyclophosphamide: a single centre 10 year experience. Med J Malays 55:14–20
28.
go back to reference Schulz KF, Chalmers I, Hayes RJ, Altman DG (1995) Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273:408–412CrossRefPubMed Schulz KF, Chalmers I, Hayes RJ, Altman DG (1995) Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA 273:408–412CrossRefPubMed
29.
go back to reference Pildal J, Hrobjartsson A, Jorgensen KJ, Hilden J, Altman DG, Gotzsche PC (2007) Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 36:847–857. doi:10.1093/ije/dym087 CrossRefPubMed Pildal J, Hrobjartsson A, Jorgensen KJ, Hilden J, Altman DG, Gotzsche PC (2007) Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials. Int J Epidemiol 36:847–857. doi:10.​1093/​ije/​dym087 CrossRefPubMed
31.
go back to reference Feinstein AR (1995) Meta-analysis: statistical alchemy for the 21st century. J Clin Epidemiol 48:71–79CrossRefPubMed Feinstein AR (1995) Meta-analysis: statistical alchemy for the 21st century. J Clin Epidemiol 48:71–79CrossRefPubMed
32.
go back to reference Huwiler-Muntener K, Juni P, Junker C, Egger M (2002) Quality of reporting of randomized trials as a measure of methodologic quality. JAMA 287:2801–2804CrossRefPubMed Huwiler-Muntener K, Juni P, Junker C, Egger M (2002) Quality of reporting of randomized trials as a measure of methodologic quality. JAMA 287:2801–2804CrossRefPubMed
33.
go back to reference Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B, Radiation Therapy Oncology G (2004) Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ 328:22–24. doi:10.1136/bmj.328.7430.22 CrossRefPubMedPubMedCentral Soares HP, Daniels S, Kumar A, Clarke M, Scott C, Swann S, Djulbegovic B, Radiation Therapy Oncology G (2004) Bad reporting does not mean bad methods for randomised trials: observational study of randomised controlled trials performed by the Radiation Therapy Oncology Group. BMJ 328:22–24. doi:10.​1136/​bmj.​328.​7430.​22 CrossRefPubMedPubMedCentral
34.
go back to reference Devereaux PJ, Choi PT, El-Dika S, Bhandari M, Montori VM, Schunemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH (2004) An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 57:1232–1236. doi:10.1016/j.jclinepi.2004.03.017 CrossRefPubMed Devereaux PJ, Choi PT, El-Dika S, Bhandari M, Montori VM, Schunemann HJ, Garg AX, Busse JW, Heels-Ansdell D, Ghali WA, Manns BJ, Guyatt GH (2004) An observational study found that authors of randomized controlled trials frequently use concealment of randomization and blinding, despite the failure to report these methods. J Clin Epidemiol 57:1232–1236. doi:10.​1016/​j.​jclinepi.​2004.​03.​017 CrossRefPubMed
35.
go back to reference Liberati A, Himel HN, Chalmers TC (1986) A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol 4:942–951CrossRefPubMed Liberati A, Himel HN, Chalmers TC (1986) A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol 4:942–951CrossRefPubMed
38.
go back to reference Ioannidis JP, Cappelleri JC, Lau J (1998) Issues in comparisons between meta-analyses and large trials. JAMA 279:1089–1093CrossRefPubMed Ioannidis JP, Cappelleri JC, Lau J (1998) Issues in comparisons between meta-analyses and large trials. JAMA 279:1089–1093CrossRefPubMed
40.
go back to reference Misakian AL, Bero LA (1998) Publication bias and research on passive smoking: comparison of published and unpublished studies. JAMA 280:250–253CrossRefPubMed Misakian AL, Bero LA (1998) Publication bias and research on passive smoking: comparison of published and unpublished studies. JAMA 280:250–253CrossRefPubMed
42.
go back to reference Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ (2010) Sample size calculations: basic principles and common pitfalls. Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association—European Renal Association 25:1388–1393. doi:10.1093/ndt/gfp732 CrossRef Noordzij M, Tripepi G, Dekker FW, Zoccali C, Tanck MW, Jager KJ (2010) Sample size calculations: basic principles and common pitfalls. Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association—European Renal Association 25:1388–1393. doi:10.​1093/​ndt/​gfp732 CrossRef
43.
go back to reference Wittes J (2002) Sample size calculations for randomized controlled trials. Epidemiol Rev 24:39–53CrossRefPubMed Wittes J (2002) Sample size calculations for randomized controlled trials. Epidemiol Rev 24:39–53CrossRefPubMed
45.
go back to reference Bhandari M, Richards RR, Sprague S, Schemitsch EH (2002) The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am 84:388–396CrossRefPubMed Bhandari M, Richards RR, Sprague S, Schemitsch EH (2002) The quality of reporting of randomized trials in the Journal of Bone and Joint Surgery from 1988 through 2000. J Bone Joint Surg Am 84:388–396CrossRefPubMed
51.
go back to reference Wheatley K, Clayton D (2003) Be skeptical about unexpected large apparent treatment effects: the case of an MRC AML12 randomization. Control Clin Trials 24:66–70CrossRefPubMed Wheatley K, Clayton D (2003) Be skeptical about unexpected large apparent treatment effects: the case of an MRC AML12 randomization. Control Clin Trials 24:66–70CrossRefPubMed
52.
go back to reference Roche N, Reddel H, Martin R, Brusselle G, Papi A, Thomas M, Postma D, Thomas V, Rand C, Chisholm A, Price D, Respiratory Effectiveness G (2014) Quality standards for real-world research. Focus on observational database studies of comparative effectiveness. Ann Am Thorac Soc 11(Suppl 2):S99–104. doi:10.1513/AnnalsATS.201309-300RM CrossRefPubMed Roche N, Reddel H, Martin R, Brusselle G, Papi A, Thomas M, Postma D, Thomas V, Rand C, Chisholm A, Price D, Respiratory Effectiveness G (2014) Quality standards for real-world research. Focus on observational database studies of comparative effectiveness. Ann Am Thorac Soc 11(Suppl 2):S99–104. doi:10.​1513/​AnnalsATS.​201309-300RM CrossRefPubMed
53.
Metadata
Title
Randomized controlled trials and neuro-oncology: should alternative designs be considered?
Authors
Alireza Mansouri
Samuel Shin
Benjamin Cooper
Archita Srivastava
Mohit Bhandari
Douglas Kondziolka
Publication date
01-09-2015
Publisher
Springer US
Published in
Journal of Neuro-Oncology / Issue 3/2015
Print ISSN: 0167-594X
Electronic ISSN: 1573-7373
DOI
https://doi.org/10.1007/s11060-015-1870-6

Other articles of this Issue 3/2015

Journal of Neuro-Oncology 3/2015 Go to the issue