Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2019

Open Access 01-12-2019 | Research article

European Medicines Agency Policy 0070: an exploratory review of data utility in clinical study reports for academic research

Authors: Jean-Marc Ferran, Sarah J. Nevitt

Published in: BMC Medical Research Methodology | Issue 1/2019

Login to get access

Abstract

Background

Clinical study reports (CSRs) have been increasingly utilised within academic research in recent years. European Medicines Agency (EMA) Policy 0070 ‘Phase 1,’ which came into effect in January 2015, requires the publication of regulatory documents such as CSRs from central applications in an anonymised format. EMA Policy 0070 requires sponsors to demonstrate careful consideration of data utility within anonymised CSRs published within the scope of the policy, yet the concept of data utility is not clearly defined in the associated anonymisation guidance.

Objective

To review the use of data from CSRs in published academic research and to hypothesise the potential data utility of CSRs anonymised under the objectives of EMA Policy 0070 for future academic research.

Methods

Review of the objectives, research methodologies and findings of academic research reports using unpublished data from CSRs (prior to EMA Policy 0070). Semi-structured interviews with authors of academic research reports, including questions related to data utility of anonymised CSRs published under EMA Policy 0070.

Results

Thirteen academic research reports were identified and reviewed. The research purposes ranged from assessment of reporting bias, comparison of methods and results with published data sources, detailed evaluation of harms and adverse events, re-analysis and novel analyses including systematic reviews and meta-analysis. All of the examples identified required access to the methods and results sections of CSRs (including aggregated summary tables) and research purposes relating to evaluation of adverse events also required access to participant narratives. Retaining anonymised participant narratives relating to interventions, findings and events, while maintaining an acceptably low risk of participant re-identification, may provide an important gain in data utility and further understanding of drug safety profiles.

Conclusions

This work provides an initial insight into the previous use of CSR data and current practices for including regulatory data in academic research. This work also provides early guidance to qualitatively assess and document data utility within anonymised CSRs published under EMA Policy 0070.
Appendix
Available only for authorised users
Literature
2.
go back to reference Dwan K, Gamble C, Williamson PR, Kirkham JJ. Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. PLoS One. 2013;8:e66844.CrossRef Dwan K, Gamble C, Williamson PR, Kirkham JJ. Systematic review of the empirical evidence of study publication bias and outcome reporting bias - an updated review. PLoS One. 2013;8:e66844.CrossRef
3.
go back to reference Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, Williamson PR. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365.CrossRef Kirkham JJ, Dwan KM, Altman DG, Gamble C, Dodd S, Smyth R, Williamson PR. The impact of outcome reporting bias in randomised controlled trials on a cohort of systematic reviews. BMJ. 2010;340:c365.CrossRef
4.
go back to reference Eyding D, Lelgemann M, Grouven U, Harter M, Kromp M, Kaiser T, Kerekes MF, Gerken M, Wieseler B. Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010;341:c4737.CrossRef Eyding D, Lelgemann M, Grouven U, Harter M, Kromp M, Kaiser T, Kerekes MF, Gerken M, Wieseler B. Reboxetine for acute treatment of major depression: systematic review and meta-analysis of published and unpublished placebo and selective serotonin reuptake inhibitor controlled trials. BMJ. 2010;341:c4737.CrossRef
5.
go back to reference Wieseler B, Kerekes MF, Vervoelgyi V, McGauran N, Kaiser T. Impact of document type on reporting quality of clinical drug trials: a comparison of registry reports, clinical study reports, and journal publications. BMJ. 2012;344:d8141.CrossRef Wieseler B, Kerekes MF, Vervoelgyi V, McGauran N, Kaiser T. Impact of document type on reporting quality of clinical drug trials: a comparison of registry reports, clinical study reports, and journal publications. BMJ. 2012;344:d8141.CrossRef
6.
go back to reference Wieseler B, Wolfram N, McGauran N, Kerekes MF, Vervolgyi V, Kohlepp P, Kamphuis M, Grouven U. Completeness of reporting of patient-relevant clinical trial outcomes: comparison of unpublished clinical study reports with publicly available data. PLoS Med. 2013;10:e1001526.CrossRef Wieseler B, Wolfram N, McGauran N, Kerekes MF, Vervolgyi V, Kohlepp P, Kamphuis M, Grouven U. Completeness of reporting of patient-relevant clinical trial outcomes: comparison of unpublished clinical study reports with publicly available data. PLoS Med. 2013;10:e1001526.CrossRef
7.
go back to reference Kohler M, Haag S, Biester K, Brockhaus AC, McGauran N, Grouven U, Kolsch H, Seay U, Horn H, Moritz G, et al. Information on new drugs at market entry: retrospective analysis of health technology assessment reports versus regulatory reports, journal publications, and registry reports. BMJ. 2015;350:h796.CrossRef Kohler M, Haag S, Biester K, Brockhaus AC, McGauran N, Grouven U, Kolsch H, Seay U, Horn H, Moritz G, et al. Information on new drugs at market entry: retrospective analysis of health technology assessment reports versus regulatory reports, journal publications, and registry reports. BMJ. 2015;350:h796.CrossRef
8.
go back to reference Le Noury J, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, Abi-Jaoude E. Restoring study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.CrossRef Le Noury J, Nardo JM, Healy D, Jureidini J, Raven M, Tufanaru C, Abi-Jaoude E. Restoring study 329: efficacy and harms of paroxetine and imipramine in treatment of major depression in adolescence. BMJ. 2015;351:h4320.CrossRef
9.
go back to reference Schroll JB, Bero L, Gotzsche PC. Searching for unpublished data for Cochrane reviews: cross sectional study. BMJ. 2013;346:f2231.CrossRef Schroll JB, Bero L, Gotzsche PC. Searching for unpublished data for Cochrane reviews: cross sectional study. BMJ. 2013;346:f2231.CrossRef
10.
go back to reference Hodkinson A, Gamble C, Smith CT. Reporting of harms outcomes: a comparison of journal publications with unpublished clinical study reports of orlistat trials. Trials. 2016;17:207.CrossRef Hodkinson A, Gamble C, Smith CT. Reporting of harms outcomes: a comparison of journal publications with unpublished clinical study reports of orlistat trials. Trials. 2016;17:207.CrossRef
11.
go back to reference Jefferson T, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, Spencer EA, Onakpoya I, Mahtani KR, Nunan D, et al. Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2014;10(4):Cd008965. Jefferson T, Jones MA, Doshi P, Del Mar CB, Hama R, Thompson MJ, Spencer EA, Onakpoya I, Mahtani KR, Nunan D, et al. Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2014;10(4):Cd008965.
12.
go back to reference Maund E, Tendal B, Hrobjartsson A, Jorgensen KJ, Lundh A, Schroll J, Gotzsche PC. Benefits and harms in clinical trials of duloxetine for treatment of major depressive disorder: comparison of clinical study reports, trial registries, and publications. BMJ. 2014;348:g3510.CrossRef Maund E, Tendal B, Hrobjartsson A, Jorgensen KJ, Lundh A, Schroll J, Gotzsche PC. Benefits and harms in clinical trials of duloxetine for treatment of major depressive disorder: comparison of clinical study reports, trial registries, and publications. BMJ. 2014;348:g3510.CrossRef
13.
go back to reference Maund E, Tendal B, Hrobjartsson A, Lundh A, Gotzsche PC. Coding of adverse events of suicidality in clinical study reports of duloxetine for the treatment of major depressive disorder: descriptive study. BMJ. 2014;348:g3555.CrossRef Maund E, Tendal B, Hrobjartsson A, Lundh A, Gotzsche PC. Coding of adverse events of suicidality in clinical study reports of duloxetine for the treatment of major depressive disorder: descriptive study. BMJ. 2014;348:g3555.CrossRef
14.
go back to reference Maund E, Guski LS, Gotzsche PC. Considering benefits and harms of duloxetine for treatment of stress urinary incontinence: a meta-analysis of clinical study reports. CMAJ. 2017;189:E194–e203.CrossRef Maund E, Guski LS, Gotzsche PC. Considering benefits and harms of duloxetine for treatment of stress urinary incontinence: a meta-analysis of clinical study reports. CMAJ. 2017;189:E194–e203.CrossRef
15.
go back to reference Vedula SS, Bero L, Scherer RW, Dickersin K. Outcome reporting in industry-sponsored trials of gabapentin for off-label use. N Engl J Med. 2009;361:1963–71.CrossRef Vedula SS, Bero L, Scherer RW, Dickersin K. Outcome reporting in industry-sponsored trials of gabapentin for off-label use. N Engl J Med. 2009;361:1963–71.CrossRef
16.
go back to reference Nevitt SJ, Thornton J, Murray CS, Dwyer T. Inhaled mannitol for cystic fibrosis. Cochrane Database Syst Rev. 2018;2:Cd008649.PubMed Nevitt SJ, Thornton J, Murray CS, Dwyer T. Inhaled mannitol for cystic fibrosis. Cochrane Database Syst Rev. 2018;2:Cd008649.PubMed
18.
go back to reference Organisation for Economic Cooperation and Development. Data Utility Definition. In: Statistics Netherlands, Statistics Canada, Germany FSO, University of Manchester; 2005. Glossary of statistical disclosure control, incorporated in paper presented at joint UNECE/Eurostat work session on statistical data confidentiality, Geneva, 9-11 October 2005. Organisation for Economic Cooperation and Development. Data Utility Definition. In: Statistics Netherlands, Statistics Canada, Germany FSO, University of Manchester; 2005. Glossary of statistical disclosure control, incorporated in paper presented at joint UNECE/Eurostat work session on statistical data confidentiality, Geneva, 9-11 October 2005.
20.
go back to reference Jefferson T. EMA’s policy 0070: opportunities, challenges and measuring success. In: Drug Information Association (DIA) annual conference Glasgow, United Kingdom; 2017. Jefferson T. EMA’s policy 0070: opportunities, challenges and measuring success. In: Drug Information Association (DIA) annual conference Glasgow, United Kingdom; 2017.
21.
go back to reference Jefferson T, Doshi P, Boutron I, et al. When to include clinical study reports and regulatory documents in systematic reviews. BMJ Evid Based Med. 2018;23:210-7.CrossRef Jefferson T, Doshi P, Boutron I, et al. When to include clinical study reports and regulatory documents in systematic reviews. BMJ Evid Based Med. 2018;23:210-7.CrossRef
23.
go back to reference JPT H, Altman DG, Sterne JAC. Chapter 8: Assessing risk of bias in included studies. In: JPT H, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 510 (updated March 2011) The Cochrane Collaboration; 2011. Available from www.handbook.cochrane.org. Accessed 5 Oct 2018. JPT H, Altman DG, Sterne JAC. Chapter 8: Assessing risk of bias in included studies. In: JPT H, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 510 (updated March 2011) The Cochrane Collaboration; 2011. Available from www.​handbook.​cochrane.​org. Accessed 5 Oct 2018.
24.
go back to reference Zarin DA, Tse T. Medicine. Moving toward transparency of clinical trials. Science. 2008;319:1340–2.CrossRef Zarin DA, Tse T. Medicine. Moving toward transparency of clinical trials. Science. 2008;319:1340–2.CrossRef
25.
go back to reference Kniola L. Analysis of CSRs already published (PhUSE review). In: EMA Technical Anonymisation Group Meeting; 2017. Available from https://wwwemaeuropaeu/en/documents/presentation/presentation-phuses-analysis-clinical-reports-published-l-kniola_enpdf (Accessed 19 Mar 2019). Kniola L. Analysis of CSRs already published (PhUSE review). In: EMA Technical Anonymisation Group Meeting; 2017. Available from https://​wwwemaeuropaeu/​en/​documents/​presentation/​presentation-phuses-analysis-clinical-reports-published-l-kniola_​enpdf (Accessed 19 Mar 2019).
27.
go back to reference Tudur Smith C, Marcucci M, Nolan SJ, Iorio A, Sudell M, Riley R, Rovers MM, Williamson PR. Individual participant data meta-analyses compared with meta-analyses based on aggregate data. Cochrane Database Syst Rev. 2016;9:Mr000007.PubMed Tudur Smith C, Marcucci M, Nolan SJ, Iorio A, Sudell M, Riley R, Rovers MM, Williamson PR. Individual participant data meta-analyses compared with meta-analyses based on aggregate data. Cochrane Database Syst Rev. 2016;9:Mr000007.PubMed
28.
go back to reference Jefferson T, Jones M, Doshi P, Spencer EA, Onakpoya I, Heneghan CJ. Oseltamivir for influenza in adults and children: systematic review of clinical study reports and summary of regulatory comments. BMJ. 2014;348:g2545.CrossRef Jefferson T, Jones M, Doshi P, Spencer EA, Onakpoya I, Heneghan CJ. Oseltamivir for influenza in adults and children: systematic review of clinical study reports and summary of regulatory comments. BMJ. 2014;348:g2545.CrossRef
29.
go back to reference Hodkinson A, Dietz KC, Lefebvre C, Golder S, Jones M, Doshi P, Heneghan C, Jefferson T, Boutron I, Stewart L. The use of clinical study reports to enhance the quality of systematic reviews: a survey of systematic review authors. Syst Rev. 2018;7:117.CrossRef Hodkinson A, Dietz KC, Lefebvre C, Golder S, Jones M, Doshi P, Heneghan C, Jefferson T, Boutron I, Stewart L. The use of clinical study reports to enhance the quality of systematic reviews: a survey of systematic review authors. Syst Rev. 2018;7:117.CrossRef
30.
go back to reference Musini V, Lawrence K, Wright J. Using Clinical Study Reports versus published articles in a Cochrane Review update. In: Challenges to evidence-based health care and Cochrane Abstracts of the 24th Cochrane Colloquium. Seoul: Wiley; 2016. p. 23–7. Musini V, Lawrence K, Wright J. Using Clinical Study Reports versus published articles in a Cochrane Review update. In: Challenges to evidence-based health care and Cochrane Abstracts of the 24th Cochrane Colloquium. Seoul: Wiley; 2016. p. 23–7.
31.
go back to reference Beaumier JLK, Mintzes B, Jauca C, Wright J, Perry T, Turner E, Puil L. Accessing clinical study reports: potential to reduce bias in systematic reviews. In: Filtering the information overload for better decisions Abstracts of the 23rd Cochrane Colloquium. Vienna: Wiley; 2015. p. 3–7. Beaumier JLK, Mintzes B, Jauca C, Wright J, Perry T, Turner E, Puil L. Accessing clinical study reports: potential to reduce bias in systematic reviews. In: Filtering the information overload for better decisions Abstracts of the 23rd Cochrane Colloquium. Vienna: Wiley; 2015. p. 3–7.
34.
go back to reference Bonini S, Eichler HG, Wathion N, Rasi G. Transparency and the European medicines agency--sharing of clinical trial data. N Engl J Med. 2014;371:2452–5.CrossRef Bonini S, Eichler HG, Wathion N, Rasi G. Transparency and the European medicines agency--sharing of clinical trial data. N Engl J Med. 2014;371:2452–5.CrossRef
38.
go back to reference Bamford S. Thoughts on the EMA Policy 0070 Experience. In: Drug Information Association (DIA) annual conference. Basel; 2018. Bamford S. Thoughts on the EMA Policy 0070 Experience. In: Drug Information Association (DIA) annual conference. Basel; 2018.
Metadata
Title
European Medicines Agency Policy 0070: an exploratory review of data utility in clinical study reports for academic research
Authors
Jean-Marc Ferran
Sarah J. Nevitt
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2019
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-019-0836-3

Other articles of this Issue 1/2019

BMC Medical Research Methodology 1/2019 Go to the issue