Skip to main content
Top
Published in: BMC Pediatrics 1/2002

Open Access 01-12-2002 | Research article

Assessing the quality of reports of randomized trials in pediatric complementary and alternative medicine

Authors: David Moher, Margaret Sampson, Kaitryn Campbell, William Beckner, Leah Lepage, Isabelle Gaboury, Brian Berman

Published in: BMC Pediatrics | Issue 1/2002

Login to get access

Abstract

Objective

To evaluate the quality of reports of complementary and alternative medicine (CAM) randomized controlled trials (RCTs) in the pediatric population. We also examined whether there was a change in the quality of reporting over time.

Methods

We used a systematic sample of 251 reports of RCTs that used a CAM intervention. The quality of each report was assessed using the number of CONSORT checklist items included, the frequency of unclear allocation concealment, and a 5-point quality assessment instrument.

Results

Nearly half (40%) of the CONSORT checklist items were included in the reports, with an increase in the number of items included. The majority (81.3%) of RCTs reported unclear allocation concealment with no significant change over time. The quality of reports achieved approximately 40% of their maximum possible total score as assessed with the Jadad scale with no change over time. Information regarding adverse events was reported in less than one quarter of the RCTs (22%) and information regarding costs was mentioned in only a minority of reports (4%).

Conclusions

RCTs are an important tool for evidence based health care decisions. If these studies are to be relevant in the evaluation of CAM interventions it is important that they are conducted and reported with the highest possible standards. There is a need to redouble efforts to ensure that children and their families are participating in RCTs that are conducted and reported with minimal bias. Such studies will increase their usefulness to a board spectrum of interested stakeholders.
Literature
1.
go back to reference Spigelblatt L, Laine-Ammara G, Pless IB, Guyver A: The use of alternative medicine by children. Pediatrics. 1994, 94: 811-4.PubMed Spigelblatt L, Laine-Ammara G, Pless IB, Guyver A: The use of alternative medicine by children. Pediatrics. 1994, 94: 811-4.PubMed
2.
go back to reference Ramsay S: In whose best interest is government-run health care?. Fraser Forum. Fraser Institute. 11-13-2001. Ref Type: Electronic Citation. 1997 Ramsay S: In whose best interest is government-run health care?. Fraser Forum. Fraser Institute. 11-13-2001. Ref Type: Electronic Citation. 1997
3.
go back to reference Millar WJ: Use of Alternative Health Care Practitioners by Canadians. Canadian Journal of Public Health. 1997, 88: 154-8.PubMed Millar WJ: Use of Alternative Health Care Practitioners by Canadians. Canadian Journal of Public Health. 1997, 88: 154-8.PubMed
4.
go back to reference Berger E: Berger Population Health Monitor 21. 2000. Toronto, Hay Associates. Ref Type: Serial (Book, Monograph). 2000, . Toronto, Hay Associates. Ref Type: Serial (Book, Monograph) Berger E: Berger Population Health Monitor 21. 2000. Toronto, Hay Associates. Ref Type: Serial (Book, Monograph). 2000, . Toronto, Hay Associates. Ref Type: Serial (Book, Monograph)
5.
go back to reference Eisenberg DM, Kessler RC, Foster C, Norlock FE, Calkins DR, Delbanco TL: Unconventional medicine in the United States: prevalence, costs and pattern use. N Engl J Med. 1993, 328: 246-52. 10.1056/NEJM199301283280406.CrossRefPubMed Eisenberg DM, Kessler RC, Foster C, Norlock FE, Calkins DR, Delbanco TL: Unconventional medicine in the United States: prevalence, costs and pattern use. N Engl J Med. 1993, 328: 246-52. 10.1056/NEJM199301283280406.CrossRefPubMed
6.
go back to reference Eisenberg DM, Davis RB, Ettner SL, Appel S, Wilkey S, van Rompay M, et al: Trends in alternative medicine use in the United States, 1990–1997: results of a follow-up national survey. JAMA. 1998, 280: 1569-75. 10.1001/jama.280.18.1569.CrossRefPubMed Eisenberg DM, Davis RB, Ettner SL, Appel S, Wilkey S, van Rompay M, et al: Trends in alternative medicine use in the United States, 1990–1997: results of a follow-up national survey. JAMA. 1998, 280: 1569-75. 10.1001/jama.280.18.1569.CrossRefPubMed
7.
go back to reference Schulz KF, Chalmers I, Grimes DA, Altman DG: Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. JAMA. 1994, 272: 125-8. 10.1001/jama.272.2.125.CrossRefPubMed Schulz KF, Chalmers I, Grimes DA, Altman DG: Assessing the quality of randomization from reports of controlled trials published in obstetrics and gynecology journals. JAMA. 1994, 272: 125-8. 10.1001/jama.272.2.125.CrossRefPubMed
8.
go back to reference Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273: 408-12. 10.1001/jama.273.5.408.CrossRefPubMed Schulz KF, Chalmers I, Hayes RJ, Altman DG: Empirical evidence of bias: Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. JAMA. 1995, 273: 408-12. 10.1001/jama.273.5.408.CrossRefPubMed
9.
go back to reference Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al: Does the quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. Lancet. 1998, 352: 609-13. 10.1016/S0140-6736(98)01085-X.CrossRefPubMed Moher D, Pham B, Jones A, Cook DJ, Jadad AR, Moher M, et al: Does the quality of reports of randomised trials affect estimates of intervention efficacy reported in meta-analyses?. Lancet. 1998, 352: 609-13. 10.1016/S0140-6736(98)01085-X.CrossRefPubMed
10.
go back to reference Kjaergård LL, Villumsen J, Gluud C: Reported methodological quality and discrepancies between large and smaller randomized trials. BMJ. 2001, Kjaergård LL, Villumsen J, Gluud C: Reported methodological quality and discrepancies between large and smaller randomized trials. BMJ. 2001,
12.
go back to reference Campbell K, Sampson M, Ajiferuke I, Moher D: Publication characteristics of randomized controlled trials in pediatric complementary and alternative medicine. Submitted for publication. Campbell K, Sampson M, Ajiferuke I, Moher D: Publication characteristics of randomized controlled trials in pediatric complementary and alternative medicine. Submitted for publication.
13.
go back to reference Moher D, Soeken K, Sampson M, Campbell K, Ben Perot L, Berman B: Assessing the quality of reports of systematic reviews in pediatric complementary and alternative medicine. BMC Pediatrics. 2002, 2: 3-10.1186/1471-2431-2-3.CrossRefPubMedPubMedCentral Moher D, Soeken K, Sampson M, Campbell K, Ben Perot L, Berman B: Assessing the quality of reports of systematic reviews in pediatric complementary and alternative medicine. BMC Pediatrics. 2002, 2: 3-10.1186/1471-2431-2-3.CrossRefPubMedPubMedCentral
14.
go back to reference Moher D, Schulz KF, Altman DG, for the CONSORT group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. Annals of Internal Medicine. 2001, 134: 657-662.CrossRefPubMed Moher D, Schulz KF, Altman DG, for the CONSORT group: The CONSORT statement: revised recommendations for improving the quality of reports of parallel group randomized trials. Annals of Internal Medicine. 2001, 134: 657-662.CrossRefPubMed
15.
go back to reference Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al: Assessing the quality of reports of randomized clinical trials: Is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed Jadad AR, Moore RA, Carroll D, Jenkinson C, Reynolds DJ, Gavaghan DJ, et al: Assessing the quality of reports of randomized clinical trials: Is blinding necessary?. Control Clin Trials. 1996, 17: 1-12. 10.1016/0197-2456(95)00134-4.CrossRefPubMed
16.
go back to reference Moher D, Jones A, Lepage L, for the CONSORT group: Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation. JAMA. 2001, 285: 1992-5. 10.1001/jama.285.15.1992.CrossRefPubMed Moher D, Jones A, Lepage L, for the CONSORT group: Use of the CONSORT statement and quality of reports of randomized trials: A comparative before-and-after evaluation. JAMA. 2001, 285: 1992-5. 10.1001/jama.285.15.1992.CrossRefPubMed
17.
go back to reference Linde K, Jonas WB, Melchart D, Willich S: The methodological quality of randomized controlled trials of homeopathy, herbal medicines and acupuncture. Int J Epidemiol. 2001, 30: S26-31. 10.1093/ije/30.3.526.CrossRef Linde K, Jonas WB, Melchart D, Willich S: The methodological quality of randomized controlled trials of homeopathy, herbal medicines and acupuncture. Int J Epidemiol. 2001, 30: S26-31. 10.1093/ije/30.3.526.CrossRef
19.
go back to reference loannidis JPA, Lau J: Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA. 2001, 285: 437-443.CrossRef loannidis JPA, Lau J: Completeness of safety reporting in randomized trials: an evaluation of 7 medical areas. JAMA. 2001, 285: 437-443.CrossRef
20.
go back to reference loannidis JPA, Contopoulos-Ioannidis DG: Reporting of safety data from randomised trials. Lancet. 1998, 352: 1752-1753.CrossRef loannidis JPA, Contopoulos-Ioannidis DG: Reporting of safety data from randomised trials. Lancet. 1998, 352: 1752-1753.CrossRef
21.
go back to reference Liberati A, Himel HN, Chalmers TC: A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol. 1986, 4: 942-51.PubMed Liberati A, Himel HN, Chalmers TC: A quality assessment of randomized control trials of primary treatment of breast cancer. J Clin Oncol. 1986, 4: 942-51.PubMed
22.
go back to reference Hadhazy V, Ezzo J, Berman B: How valuable is effort to contact authors to obtain missing data in systematic reviews. Presented at the VII Cochrane Colloquium, Rome, Italy. 1999 Hadhazy V, Ezzo J, Berman B: How valuable is effort to contact authors to obtain missing data in systematic reviews. Presented at the VII Cochrane Colloquium, Rome, Italy. 1999
23.
go back to reference Moher D, Fortin P, Jadad AR, Jüni P, Klassen T, Le Lorier J, Liberati A, Linde K, Penna A: Completeness of reporting of trials published in languages other than English: implications for the conduct of systematic reviews. The Lancet. 1996, 347: 363-366.CrossRef Moher D, Fortin P, Jadad AR, Jüni P, Klassen T, Le Lorier J, Liberati A, Linde K, Penna A: Completeness of reporting of trials published in languages other than English: implications for the conduct of systematic reviews. The Lancet. 1996, 347: 363-366.CrossRef
Metadata
Title
Assessing the quality of reports of randomized trials in pediatric complementary and alternative medicine
Authors
David Moher
Margaret Sampson
Kaitryn Campbell
William Beckner
Leah Lepage
Isabelle Gaboury
Brian Berman
Publication date
01-12-2002
Publisher
BioMed Central
Published in
BMC Pediatrics / Issue 1/2002
Electronic ISSN: 1471-2431
DOI
https://doi.org/10.1186/1471-2431-2-2

Other articles of this Issue 1/2002

BMC Pediatrics 1/2002 Go to the issue