Skip to main content
Top
Published in: Trials 1/2020

Open Access 01-12-2020 | Research

Advantages of visualisations to evaluate and communicate adverse event information in randomised controlled trials

Authors: Victoria Cornelius, Suzie Cro, Rachel Phillips

Published in: Trials | Issue 1/2020

Login to get access

Abstract

Background

Randomised controlled trials (RCTs) provide valuable information and inform the development of harm profiles of new treatments. Harms are typically assessed through the collection of adverse events (AEs). Despite AEs being routine outcomes collected in trials, analysis and reporting of AEs in journal articles are continually shown to be suboptimal. One key challenge is the large volume of AEs, which can make evaluation and communication problematic. Prominent practice is to report frequency tables of AEs by arm. Visual displays offer an effective solution to assess and communicate complex information; however, they are rarely used and there is a lack of practical guidance on what and how to visually display complex AE data.

Methods

In this article, we demonstrate the use of two plots identified to be beneficial for wide use in RCTs, since both can display multiple AEs and are suitable to display point estimates for binary, count, or time-to-event AE data: the volcano and dot plots. We compare and contrast the use of data visualisations against traditional frequency table reporting, using published AE information in two placebo-controlled trials, of remdesivir for COVID-19 and GDNF for Parkinson disease. We introduce statistical programmes for implementation in Stata.

Results/case study

Visualisations of AEs in the COVID-19 trial communicated a risk profile for remdesivir which differed from the main message in the published authors’ conclusion. In the Parkinson’s disease trial of GDNF, the visualisation provided immediate communication of harm signals, which had otherwise been contained within lengthy descriptive text and tables. Asymmetry in the volcano plot helped flag extreme events that were less obvious from review of the frequency table and dot plot. The dot plot allowed a more comprehensive representation by means of a more detailed summary.

Conclusions

Visualisations can better support investigators to assimilate large volumes of data and enable improved informal between-arm comparisons compared to tables. We endorse increased uptake for use in trial publications. Care in construction of visual displays needs to be taken as there can be potential to overemphasise treatment effects in some circumstances.
Appendix
Available only for authorised users
Literature
1.
go back to reference European Medicines Agency. ICH guidelines E19 on optimisation of safety data collection Step 2b. EMA/CHMP/ICH/173706/2019; 2019;Draft(29th March). p. 1–11. European Medicines Agency. ICH guidelines E19 on optimisation of safety data collection Step 2b. EMA/CHMP/ICH/173706/2019; 2019;Draft(29th March). p. 1–11.
2.
go back to reference Edwards IR, Biriell C. Harmonisation in pharmacovigilance. Drug Saf. 1994;10(2):93–102.CrossRef Edwards IR, Biriell C. Harmonisation in pharmacovigilance. Drug Saf. 1994;10(2):93–102.CrossRef
3.
go back to reference European Medicines Agency. ICH E9 guidance for industry: E9 statistical principles for clinical trials. CPMP/ICH/363/96; 1998. p. 1–37. European Medicines Agency. ICH E9 guidance for industry: E9 statistical principles for clinical trials. CPMP/ICH/363/96; 1998. p. 1–37.
4.
go back to reference Singh S, Loke YK. Drug safety assessment in clinical trials: methodological challenges and opportunities. Trials. 2012;13:138.CrossRef Singh S, Loke YK. Drug safety assessment in clinical trials: methodological challenges and opportunities. Trials. 2012;13:138.CrossRef
5.
go back to reference Patson N, Mukaka M, Otwombe KN, Kazembe L, Mathanga DP, Mwapasa V, et al. Systematic review of statistical methods for safety data in malaria chemoprevention in pregnancy trials. Malar J. 2020;19(1):119.CrossRef Patson N, Mukaka M, Otwombe KN, Kazembe L, Mathanga DP, Mwapasa V, et al. Systematic review of statistical methods for safety data in malaria chemoprevention in pregnancy trials. Malar J. 2020;19(1):119.CrossRef
6.
go back to reference Phillips R, Hazell L, Sauzet O, Cornelius V. Analysis and reporting of adverse events in randomised controlled trials: a review. BMJ Open. 2019;9(2):e024537.CrossRef Phillips R, Hazell L, Sauzet O, Cornelius V. Analysis and reporting of adverse events in randomised controlled trials: a review. BMJ Open. 2019;9(2):e024537.CrossRef
7.
go back to reference Favier R, Crepin S. The reporting of harms in publications on randomized controlled trials funded by the “Programme Hospitalier de Recherche Clinique”, a French academic funding scheme. Clin Trials. 2018;15(3):257–67.CrossRef Favier R, Crepin S. The reporting of harms in publications on randomized controlled trials funded by the “Programme Hospitalier de Recherche Clinique”, a French academic funding scheme. Clin Trials. 2018;15(3):257–67.CrossRef
8.
go back to reference European Medicines Agency. Guideline on multiplicity issues in clinical trials. EMA/CHMP/44762/2017; 2016. p. 1–15. European Medicines Agency. Guideline on multiplicity issues in clinical trials. EMA/CHMP/44762/2017; 2016. p. 1–15.
9.
go back to reference Administration UFaD. Conducting a clinical safety review of a new product application and preparing a report on the review. In: U.S. Department of Health and Human Services CfDEaRC, editor. 2005. Administration UFaD. Conducting a clinical safety review of a new product application and preparing a report on the review. In: U.S. Department of Health and Human Services CfDEaRC, editor. 2005.
10.
go back to reference Lineberry N, Berlin JA, Mansi B, Glasser S, Berkwits M, Klem C, et al. Recommendations to improve adverse event reporting in clinical trial publications: a joint pharmaceutical industry/journal editor perspective. BMJ. 2016;355:i5078.CrossRef Lineberry N, Berlin JA, Mansi B, Glasser S, Berkwits M, Klem C, et al. Recommendations to improve adverse event reporting in clinical trial publications: a joint pharmaceutical industry/journal editor perspective. BMJ. 2016;355:i5078.CrossRef
11.
go back to reference Ioannidis JP, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781–8.CrossRef Ioannidis JP, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781–8.CrossRef
12.
go back to reference Crowe BJ, Xia HA, Berlin JA, Watson DJ, Shi H, Lin SL, et al. Recommendations for safety planning, data collection, evaluation and reporting during drug, biologic and vaccine development: a report of the safety planning, evaluation, and reporting team. Clin Trials. 2009;6(5):430–40.CrossRef Crowe BJ, Xia HA, Berlin JA, Watson DJ, Shi H, Lin SL, et al. Recommendations for safety planning, data collection, evaluation and reporting during drug, biologic and vaccine development: a report of the safety planning, evaluation, and reporting team. Clin Trials. 2009;6(5):430–40.CrossRef
13.
go back to reference Amit O, Heiberger RM, Lane PW. Graphical approaches to the analysis of safety data from clinical trials. Pharm Stat. 2008;7(1):20–35.CrossRef Amit O, Heiberger RM, Lane PW. Graphical approaches to the analysis of safety data from clinical trials. Pharm Stat. 2008;7(1):20–35.CrossRef
14.
go back to reference Chuang-Stein C, Xia HA. The practice of pre-marketing safety assessment in drug development. J Biopharm Stat. 2013;23(1):3–25.CrossRef Chuang-Stein C, Xia HA. The practice of pre-marketing safety assessment in drug development. J Biopharm Stat. 2013;23(1):3–25.CrossRef
15.
go back to reference Zink RC, Marchenko O, Sanchez-Kam M, Ma H, Jiang Q. Sources of safety data and statistical strategies for design and analysis: clinical trials. Ther Innov Regul Sci. 2018;52(2):141–58.CrossRef Zink RC, Marchenko O, Sanchez-Kam M, Ma H, Jiang Q. Sources of safety data and statistical strategies for design and analysis: clinical trials. Ther Innov Regul Sci. 2018;52(2):141–58.CrossRef
17.
go back to reference Phillips R, Cro S. AEVOLCANO: Stata module to produce volcano plot for adverse event data. Statistical Software Components S458736: Boston College Department of Economics; 2020. Phillips R, Cro S. AEVOLCANO: Stata module to produce volcano plot for adverse event data. Statistical Software Components S458736: Boston College Department of Economics; 2020.
18.
go back to reference Phillips R, Cro S. AEDOT: Stata module to produce dot plot for adverse event data. Statistical Software Components S458735: Boston College Department of Economics; 2020. Phillips R, Cro S. AEDOT: Stata module to produce dot plot for adverse event data. Statistical Software Components S458735: Boston College Department of Economics; 2020.
19.
go back to reference Zink RC, Wolfinger RD, Mann G. Summarizing the incidence of adverse events using volcano plots and time intervals. Clin Trials. 2013;10(3):398–406.CrossRef Zink RC, Wolfinger RD, Mann G. Summarizing the incidence of adverse events using volcano plots and time intervals. Clin Trials. 2013;10(3):398–406.CrossRef
20.
go back to reference Sweeting MJ, Sutton AJ, Lambert PC. What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. Stat Med. 2004;23(9):1351–75.CrossRef Sweeting MJ, Sutton AJ, Lambert PC. What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. Stat Med. 2004;23(9):1351–75.CrossRef
21.
go back to reference Mehrotra DV, Adewale AJ. Flagging clinical adverse experiences: reducing false discoveries without materially compromising power for detecting true signals. Stat Med. 2012;31(18):1918–30.CrossRef Mehrotra DV, Adewale AJ. Flagging clinical adverse experiences: reducing false discoveries without materially compromising power for detecting true signals. Stat Med. 2012;31(18):1918–30.CrossRef
22.
go back to reference Wang Y, Zhang D, Du G, Du R, Zhao J, Jin Y, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet. 2020;395(10236):1569–78.CrossRef Wang Y, Zhang D, Du G, Du R, Zhao J, Jin Y, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet. 2020;395(10236):1569–78.CrossRef
23.
go back to reference Whone A, Luz M, Boca M, Woolley M, Mooney L, Dharia S, et al. Randomized trial of intermittent intraputamenal glial cell line-derived neurotrophic factor in Parkinson’s disease. Brain. 2019;142(3):512–25.CrossRef Whone A, Luz M, Boca M, Woolley M, Mooney L, Dharia S, et al. Randomized trial of intermittent intraputamenal glial cell line-derived neurotrophic factor in Parkinson’s disease. Brain. 2019;142(3):512–25.CrossRef
Metadata
Title
Advantages of visualisations to evaluate and communicate adverse event information in randomised controlled trials
Authors
Victoria Cornelius
Suzie Cro
Rachel Phillips
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Trials / Issue 1/2020
Electronic ISSN: 1745-6215
DOI
https://doi.org/10.1186/s13063-020-04903-0

Other articles of this Issue 1/2020

Trials 1/2020 Go to the issue