Skip to main content
Top
Published in: Trials 1/2022

Open Access 01-12-2022 | Research

A longitudinal assessment of trial protocols approved by research ethics committees: The Adherance to SPIrit REcommendations in the UK (ASPIRE-UK) study

Authors: Benjamin Speich, Ayodele Odutayo, Nicholas Peckham, Alexander Ooms, Jamie R. Stokes, Ramon Saccilotto, Dmitry Gryaznov, Belinda von Niederhäusern, Bethan Copsey, Douglas G. Altman, Matthias Briel, Sally Hopewell

Published in: Trials | Issue 1/2022

Login to get access

Abstract

Background

To assess the quality of reporting of RCT protocols approved by UK research ethics committees before and after the publication of the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) guideline.

Methods

We had access to RCT study protocols that received ethical approval in the UK in 2012 (n=103) and 2016 (n=108). From those, we assessed the adherence to the 33 SPIRIT items (i.e. a total of 64 components of the 33 SPIRIT items). We descriptively analysed the adherence to SPIRIT guidelines as proportion of adequately reported items (median and interquartile range [IQR]) and stratified the results by year of approval and sponsor.

Results

The proportion of reported SPIRIT items increased from a median of 64.9% (IQR, 57.6–69.2%) in 2012 to a median of 72.5% (IQR, 65.3–78.3%) in 2016. Industry-sponsored RCTs reported more SPIRIT items in 2012 (median 67.4%; IQR, 64.1–69.4%) compared to non-industry-sponsored trials (median 59.8%; IQR, 46.5–67.7%). This gap between industry- and non-industry-sponsored trials increased in 2016 (industry-sponsored: median 75.6%; IQR, 71.2–79.0% vs non-industry-sponsored: median 65.3%; IQR, 51.6–76.3%).

Conclusions

The adherence to SPIRIT guidelines has improved in the UK from 2012 to 2016 but remains on a modest level, especially for non-industry-sponsored RCTs.
Appendix
Available only for authorised users
Literature
1.
go back to reference Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg. 2011;128(1):305–10.CrossRef Burns PB, Rohrich RJ, Chung KC. The levels of evidence and their role in evidence-based medicine. Plast Reconstr Surg. 2011;128(1):305–10.CrossRef
2.
go back to reference Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016;21(4):125–7.CrossRef Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evid Based Med. 2016;21(4):125–7.CrossRef
4.
go back to reference Vijayananthan A, Nawawi O. The importance of good clinical practice guidelines and its role in clinical trials. Biomed Imaging Interv J. 2008;4(1):e5.CrossRef Vijayananthan A, Nawawi O. The importance of good clinical practice guidelines and its role in clinical trials. Biomed Imaging Interv J. 2008;4(1):e5.CrossRef
5.
go back to reference Chan AW, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.CrossRef Chan AW, Tetzlaff JM, Gotzsche PC, Altman DG, Mann H, Berlin JA, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.CrossRef
6.
go back to reference Getz KA, Stergiopoulos S, Short M, Surgeon L, Krauss R, Pretorius S, et al. The impact of protocol amendments on clinical trial performance and cost. Ther Innov Regul Sci. 2016;50(4):436–41.CrossRef Getz KA, Stergiopoulos S, Short M, Surgeon L, Krauss R, Pretorius S, et al. The impact of protocol amendments on clinical trial performance and cost. Ther Innov Regul Sci. 2016;50(4):436–41.CrossRef
7.
go back to reference Getz KA, Zuckerman R, Cropp AB, Hindle AL, Krauss R, Kaitin KI. Measuring the incidence, causes, and repercussions of protocol amendments. Drug Inform J. 2011;45(3):265–75.CrossRef Getz KA, Zuckerman R, Cropp AB, Hindle AL, Krauss R, Kaitin KI. Measuring the incidence, causes, and repercussions of protocol amendments. Drug Inform J. 2011;45(3):265–75.CrossRef
8.
go back to reference Chan AW, Hrobjartsson A, Jorgensen KJ, Gotzsche PC, Altman DG. Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. BMJ. 2008;337:a2299.CrossRef Chan AW, Hrobjartsson A, Jorgensen KJ, Gotzsche PC, Altman DG. Discrepancies in sample size calculations and data analyses reported in randomised trials: comparison of publications with protocols. BMJ. 2008;337:a2299.CrossRef
9.
go back to reference Tetzlaff JM, Chan AW, Kitchen J, Sampson M, Tricco AC, Moher D. Guidelines for randomized clinical trial protocol content: a systematic review. Syst Rev. 2012;1:43.CrossRef Tetzlaff JM, Chan AW, Kitchen J, Sampson M, Tricco AC, Moher D. Guidelines for randomized clinical trial protocol content: a systematic review. Syst Rev. 2012;1:43.CrossRef
10.
go back to reference Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24(24):3933–8.CrossRef Scharf O, Colevas AD. Adverse event reporting in publications compared with sponsor database for cancer clinical trials. J Clin Oncol. 2006;24(24):3933–8.CrossRef
11.
go back to reference Pildal J, Chan AW, Hrobjartsson A, Forfang E, Altman DG, Gotzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. BMJ. 2005;330(7499):1049.CrossRef Pildal J, Chan AW, Hrobjartsson A, Forfang E, Altman DG, Gotzsche PC. Comparison of descriptions of allocation concealment in trial protocols and the published reports: cohort study. BMJ. 2005;330(7499):1049.CrossRef
12.
go back to reference Hrobjartsson A, Pildal J, Chan AW, Haahr MT, Altman DG, Gotzsche PC. Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory. J Clin Epidemiol. 2009;62(9):967–73.CrossRef Hrobjartsson A, Pildal J, Chan AW, Haahr MT, Altman DG, Gotzsche PC. Reporting on blinding in trial protocols and corresponding publications was often inadequate but rarely contradictory. J Clin Epidemiol. 2009;62(9):967–73.CrossRef
13.
go back to reference Chan A, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457–65.CrossRef Chan A, Hróbjartsson A, Haahr MT, Gøtzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457–65.CrossRef
14.
go back to reference Al-Marzouki S, Roberts I, Evans S, Marshall T. Selective reporting in clinical trials: analysis of trial protocols accepted by the lancet. Lancet. 2008;372(9634):201.CrossRef Al-Marzouki S, Roberts I, Evans S, Marshall T. Selective reporting in clinical trials: analysis of trial protocols accepted by the lancet. Lancet. 2008;372(9634):201.CrossRef
15.
go back to reference Smyth RM, Kirkham JJ, Jacoby A, Altman DG, Gamble C, Williamson PR. Frequency and reasons for outcome reporting bias in clinical trials: interviews with trialists. BMJ. 2011;342:c7153.CrossRef Smyth RM, Kirkham JJ, Jacoby A, Altman DG, Gamble C, Williamson PR. Frequency and reasons for outcome reporting bias in clinical trials: interviews with trialists. BMJ. 2011;342:c7153.CrossRef
16.
go back to reference Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRef Chan AW, Tetzlaff JM, Altman DG, Laupacis A, Gotzsche PC, Krleza-Jeric K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158(3):200–7.CrossRef
17.
go back to reference Gryaznov D, Odutayo A, von Niederhausern B, Speich B, Kasenda B, Ojeda-Ruiz E, et al. Rationale and design of repeated cross-sectional studies to evaluate the reporting quality of trial protocols: the adherence to SPIrit REcommendations (ASPIRE) study and associated projects. Trials. 2020;21(1):896.CrossRef Gryaznov D, Odutayo A, von Niederhausern B, Speich B, Kasenda B, Ojeda-Ruiz E, et al. Rationale and design of repeated cross-sectional studies to evaluate the reporting quality of trial protocols: the adherence to SPIrit REcommendations (ASPIRE) study and associated projects. Trials. 2020;21(1):896.CrossRef
18.
go back to reference Gryaznov D, von Niederhausern B, Speich B, Kasenda B, Ojeda-Ruiz E, Blumle A, et al. Reporting quality of clinical trial protocols: a repeated cross-sectional study about the adherence to SPIrit recommendations in Switzerland, CAnada and GErmany (ASPIRE-SCAGE). BMJ Open. 2022;12(5):e053417.CrossRef Gryaznov D, von Niederhausern B, Speich B, Kasenda B, Ojeda-Ruiz E, Blumle A, et al. Reporting quality of clinical trial protocols: a repeated cross-sectional study about the adherence to SPIrit recommendations in Switzerland, CAnada and GErmany (ASPIRE-SCAGE). BMJ Open. 2022;12(5):e053417.CrossRef
19.
go back to reference Speich B, Gryaznov D, Busse JW, Gloy VL, Lohner S, Klatte K, et al. Nonregistration, discontinuation, and nonpublication of randomized trials: a repeated metaresearch analysis. PLoS Med. 2022;19(4):e1003980.CrossRef Speich B, Gryaznov D, Busse JW, Gloy VL, Lohner S, Klatte K, et al. Nonregistration, discontinuation, and nonpublication of randomized trials: a repeated metaresearch analysis. PLoS Med. 2022;19(4):e1003980.CrossRef
20.
go back to reference Lohner S, Gryaznov D, von Niederhausern B, Speich B, Kasenda B, Ojeda-Ruiz E, et al. Reporting quality of trial protocols improved for non-regulated interventions but not regulated interventions: a repeated cross-sectional study. J Clin Epidemiol. 2021;139:340-349. https://pubmed.ncbi.nlm.nih.gov/34029678/. Lohner S, Gryaznov D, von Niederhausern B, Speich B, Kasenda B, Ojeda-Ruiz E, et al. Reporting quality of trial protocols improved for non-regulated interventions but not regulated interventions: a repeated cross-sectional study. J Clin Epidemiol. 2021;139:340-349. https://​pubmed.​ncbi.​nlm.​nih.​gov/​34029678/​.
21.
go back to reference StataCorp. Stata statistical software: release 16. College Station: StataCorp LLC; 2019. StataCorp. Stata statistical software: release 16. College Station: StataCorp LLC; 2019.
22.
go back to reference Kyte D, Duffy H, Fletcher B, Gheorghe A, Mercieca-Bebber R, King M, et al. Systematic evaluation of the patient-reported outcome (PRO) content of clinical trial protocols. PLoS One. 2014;9(10):e110229.CrossRef Kyte D, Duffy H, Fletcher B, Gheorghe A, Mercieca-Bebber R, King M, et al. Systematic evaluation of the patient-reported outcome (PRO) content of clinical trial protocols. PLoS One. 2014;9(10):e110229.CrossRef
24.
go back to reference Treweek S. Protocols-more structure, less 'Wuthering Heights'. Trials. 2019;20(1):649.CrossRef Treweek S. Protocols-more structure, less 'Wuthering Heights'. Trials. 2019;20(1):649.CrossRef
25.
go back to reference NHS Health Research Authority. Protocol guidance and template for use in a CTIMP: consultation. (Accessed: 3 Sep 2021). NHS Health Research Authority. Protocol guidance and template for use in a CTIMP: consultation. (Accessed: 3 Sep 2021).
26.
go back to reference Sender D, Clark J, Hoffmann TC. Analysis of articles directly related to randomized trials finds poor protocol availability and inconsistent linking of articles. J Clin Epidemiol. 2020;124:69–74.CrossRef Sender D, Clark J, Hoffmann TC. Analysis of articles directly related to randomized trials finds poor protocol availability and inconsistent linking of articles. J Clin Epidemiol. 2020;124:69–74.CrossRef
27.
go back to reference Speich B, Gryaznov D, Busse JW, Gloy VL, Lohner S, et al. Non-registration, discontinuation, and non-publication of randomized trials: a repeated meta-research analysis. PLoS Med. 2022; (in press). Speich B, Gryaznov D, Busse JW, Gloy VL, Lohner S, et al. Non-registration, discontinuation, and non-publication of randomized trials: a repeated meta-research analysis. PLoS Med. 2022; (in press).
Metadata
Title
A longitudinal assessment of trial protocols approved by research ethics committees: The Adherance to SPIrit REcommendations in the UK (ASPIRE-UK) study
Authors
Benjamin Speich
Ayodele Odutayo
Nicholas Peckham
Alexander Ooms
Jamie R. Stokes
Ramon Saccilotto
Dmitry Gryaznov
Belinda von Niederhäusern
Bethan Copsey
Douglas G. Altman
Matthias Briel
Sally Hopewell
Publication date
01-12-2022
Publisher
BioMed Central
Published in
Trials / Issue 1/2022
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-022-06516-1

Other articles of this Issue 1/2022

Trials 1/2022 Go to the issue