Skip to main content
Top
Published in: BMC Complementary Medicine and Therapies 1/2011

Open Access 01-12-2011 | Correspondence

An evaluation of the completeness of safety reporting in reports of complementary and alternative medicine trials

Authors: Lucy-Ann Turner, Kavita Singh, Chantelle Garritty, Alexander Tsertsvadze, Eric Manheimer, L Susan Wieland, James Galipeau, David Moher

Published in: BMC Complementary Medicine and Therapies | Issue 1/2011

Login to get access

Abstract

Background

Adequate reporting of safety in publications of randomized controlled trials (RCTs) is a pre-requisite for accurate and comprehensive profile evaluation of conventional as well as complementary and alternative medicine (CAM) treatments. Clear and concise information on the definition, frequency, and severity of adverse events (AEs) is necessary for assessing the benefit-harm ratio of any intervention. The objectives of this study are to assess the quality of safety reporting in CAM RCTs; to explore the influence of different trial characteristics on the quality of safety reporting.

Methods

Survey of safety reporting in RCTs published in 2009 across 15 widely used CAM interventions identified from the Cochrane Collaboration's CAM Field specialized register of trials. Primary outcome measures, the adequacy of reporting of AEs; was defined and categorized according to the CONSORT for harms extension; the percentage of words devoted to the reporting of safety in the entire report and in the results section.

Results

Two-hundred and five trials were included in the review. Of these, 15% (31/205) reported that no harms were observed during the trial period. Of the remaining 174 trials reporting any safety information, only 21% (36/174) had adequate safety reporting.
For all trials, the median percentage of words devoted to the reporting of safety in the results section was 2.6. Moreover, 69% (n = 141) of all trials devoted a lesser or equal percentage of words to safety compared to author affiliations. Of the predictor variables used in regression analysis, multicenter trials had more words devoted to safety in the results section than single centre trials (P = 0.045).

Conclusions

An evaluation of safety reporting in the reports of CAM RCTs across 15 different CAM interventions demonstrated that the reporting of harms was largely inadequate. The quality of reporting safety information in primary reports of CAM randomized trials requires improvement.
Appendix
Available only for authorised users
Literature
2.
go back to reference Ioannidis JPA, Contopoulos-Ioannidis DG: Reporting of safety data from randomized trials. Lancet. 1998, 352: 1752-1753. 10.1016/S0140-6736(05)79825-1.CrossRefPubMed Ioannidis JPA, Contopoulos-Ioannidis DG: Reporting of safety data from randomized trials. Lancet. 1998, 352: 1752-1753. 10.1016/S0140-6736(05)79825-1.CrossRefPubMed
3.
go back to reference Ioannidis JPA, Lau J: Completeness of Safety Reporting in Randomized Trials. An Evaluation of 7 Medical Areas. JAMA. 2001, 285 (4): 437-443. 10.1001/jama.285.4.437.CrossRefPubMed Ioannidis JPA, Lau J: Completeness of Safety Reporting in Randomized Trials. An Evaluation of 7 Medical Areas. JAMA. 2001, 285 (4): 437-443. 10.1001/jama.285.4.437.CrossRefPubMed
4.
go back to reference The Asilomar Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature. Checklist of information for inclusion in reports of clinical trials. Ann Intern Med. 1996, 124: 741-743. The Asilomar Working Group on Recommendations for Reporting of Clinical Trials in the Biomedical Literature. Checklist of information for inclusion in reports of clinical trials. Ann Intern Med. 1996, 124: 741-743.
6.
go back to reference Ioannidis JPA, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, Moher D: Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141 (10): 781-788.CrossRefPubMed Ioannidis JPA, Evans SJ, Gotzsche PC, O'Neill RT, Altman DG, Schulz K, Moher D: Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004, 141 (10): 781-788.CrossRefPubMed
10.
go back to reference Chung CK, Wyman JF, Halcon LL: Use of complementary and alternative therapies in community-dwelling older adults. J Altern Complement Med. 2007, 13 (9): 997-1066. 10.1089/acm.2007.0527.CrossRef Chung CK, Wyman JF, Halcon LL: Use of complementary and alternative therapies in community-dwelling older adults. J Altern Complement Med. 2007, 13 (9): 997-1066. 10.1089/acm.2007.0527.CrossRef
11.
go back to reference Chen F, Chen T, Kung Y, Chen YC, Chou LF, Chen FJ, Hwang SJ: Use frequency of traditional Chinese medicine in Taiwan. BMC Health Serv Res. 2007, 7: 26-10.1186/1472-6963-7-26.CrossRefPubMedPubMedCentral Chen F, Chen T, Kung Y, Chen YC, Chou LF, Chen FJ, Hwang SJ: Use frequency of traditional Chinese medicine in Taiwan. BMC Health Serv Res. 2007, 7: 26-10.1186/1472-6963-7-26.CrossRefPubMedPubMedCentral
14.
go back to reference Langevin H, Wayne PM, MacPherson H, Schnyer R, Milley RM, Napadow V, Lao L, Park J, Harris RE, Cohen M, Sherman KJ, Haramati A, Hammerschlag R: Paradoxes in acupuncture research: strategies for moving forward. Evid Based Complement Alternat Med. 2011, 180805- Langevin H, Wayne PM, MacPherson H, Schnyer R, Milley RM, Napadow V, Lao L, Park J, Harris RE, Cohen M, Sherman KJ, Haramati A, Hammerschlag R: Paradoxes in acupuncture research: strategies for moving forward. Evid Based Complement Alternat Med. 2011, 180805-
15.
go back to reference Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.276.8.637.CrossRefPubMed Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D, Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of randomized controlled trials: the CONSORT statement. JAMA. 1996, 276: 637-639. 10.1001/jama.276.8.637.CrossRefPubMed
16.
go back to reference Moher D, Schulz KF, Altman DG, the CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-4. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed Moher D, Schulz KF, Altman DG, the CONSORT Group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel-group randomised trials. Lancet. 2001, 357: 1191-4. 10.1016/S0140-6736(00)04337-3.CrossRefPubMed
17.
go back to reference Schulz KF, Altman DG, Moher D, the CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Medicine. 2010, 8: 18-10.1186/1741-7015-8-18.CrossRefPubMedPubMedCentral Schulz KF, Altman DG, Moher D, the CONSORT Group: CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Medicine. 2010, 8: 18-10.1186/1741-7015-8-18.CrossRefPubMedPubMedCentral
18.
go back to reference Moher D: Reporting Research results: a moral obligation for all researchers. Can J Anaesth. 2007, 54: 331-335. 10.1007/BF03022653.CrossRefPubMed Moher D: Reporting Research results: a moral obligation for all researchers. Can J Anaesth. 2007, 54: 331-335. 10.1007/BF03022653.CrossRefPubMed
19.
go back to reference MacPherson H, Thomas K, Walters S, Fitter M: A prospective survey of adverse events and treatment reactions following 34,000 consultations with professional acupuncturists. Acupunct Med. 2001, 19: 93-102. 10.1136/aim.19.2.93.CrossRefPubMed MacPherson H, Thomas K, Walters S, Fitter M: A prospective survey of adverse events and treatment reactions following 34,000 consultations with professional acupuncturists. Acupunct Med. 2001, 19: 93-102. 10.1136/aim.19.2.93.CrossRefPubMed
20.
go back to reference Melchart D, Weidenhammer W, Streng A, Reitmayr S, Troph DO, Hoppe A, Ernst E, Linde K: Prospective Investigation of Adverse Effects of Acupuncture in 97 733 Patients. Arch Intern Med. 2004, 164: 104-105. 10.1001/archinte.164.1.104.CrossRefPubMed Melchart D, Weidenhammer W, Streng A, Reitmayr S, Troph DO, Hoppe A, Ernst E, Linde K: Prospective Investigation of Adverse Effects of Acupuncture in 97 733 Patients. Arch Intern Med. 2004, 164: 104-105. 10.1001/archinte.164.1.104.CrossRefPubMed
23.
go back to reference Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'. Trials. 2008, 9: 20-10.1186/1745-6215-9-20.CrossRefPubMedPubMedCentral Hopewell S, Altman DG, Moher D, Schulz KF: Endorsement of the CONSORT Statement by high impact factor medical journals: a survey of journal editors and journal 'Instructions to Authors'. Trials. 2008, 9: 20-10.1186/1745-6215-9-20.CrossRefPubMedPubMedCentral
24.
go back to reference Prady SL, MacPherson H: Assessing the Utility of the Standards for Reporting Trials of Acupuncture (STRICTA): A Survey of Authors. The Journal of Alternative and Complementary Medicine. 2007, 13 (9): 939-943. 10.1089/acm.2007.7186.CrossRefPubMed Prady SL, MacPherson H: Assessing the Utility of the Standards for Reporting Trials of Acupuncture (STRICTA): A Survey of Authors. The Journal of Alternative and Complementary Medicine. 2007, 13 (9): 939-943. 10.1089/acm.2007.7186.CrossRefPubMed
25.
go back to reference Hopewell S, Dutton S, Yu L, Chan AW, Altman DG: The quality of reporting of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral Hopewell S, Dutton S, Yu L, Chan AW, Altman DG: The quality of reporting of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. BMJ. 2010, 340: c723-10.1136/bmj.c723.CrossRefPubMedPubMedCentral
26.
go back to reference Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of 17andomized controlled trials? A systematic review. MJA. 2006, 185 (5): 263-267.PubMed Plint AC, Moher D, Morrison A, Schulz K, Altman DG, Hill C, Gaboury I: Does the CONSORT checklist improve the quality of reports of 17andomized controlled trials? A systematic review. MJA. 2006, 185 (5): 263-267.PubMed
27.
go back to reference Moher D, Plint AC, Altman DG, Schulz KF, Kober T, Galloway EK, Weeks L, Dias S: Consolidated standards of reporting trials (CONSORT) and the quality of reporting of randomized controlled trials (Protocol). Cochrane Database of Systematic Reviews. 2010, 3 Moher D, Plint AC, Altman DG, Schulz KF, Kober T, Galloway EK, Weeks L, Dias S: Consolidated standards of reporting trials (CONSORT) and the quality of reporting of randomized controlled trials (Protocol). Cochrane Database of Systematic Reviews. 2010, 3
Metadata
Title
An evaluation of the completeness of safety reporting in reports of complementary and alternative medicine trials
Authors
Lucy-Ann Turner
Kavita Singh
Chantelle Garritty
Alexander Tsertsvadze
Eric Manheimer
L Susan Wieland
James Galipeau
David Moher
Publication date
01-12-2011
Publisher
BioMed Central
Published in
BMC Complementary Medicine and Therapies / Issue 1/2011
Electronic ISSN: 2662-7671
DOI
https://doi.org/10.1186/1472-6882-11-67

Other articles of this Issue 1/2011

BMC Complementary Medicine and Therapies 1/2011 Go to the issue