Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2013

Open Access 01-12-2013 | Research article

ClinicalTrials.gov registration can supplement information in abstracts for systematic reviews: a comparison study

Authors: Roberta W Scherer, Lynn Huynh, Ann-Margret Ervin, Jakeisha Taylor, Kay Dickersin

Published in: BMC Medical Research Methodology | Issue 1/2013

Login to get access

Abstract

Background

The inclusion of randomized controlled trials (RCTs) reported in conference abstracts in systematic reviews is controversial, partly because study design information and risk of bias is often not fully reported in the abstract. The Association for Research in Vision and Ophthalmology (ARVO) requires trial registration of abstracts submitted for their annual conference as of 2007. Our goal was to assess the feasibility of obtaining study design information critical to systematic reviews, but not typically included in conference abstracts, from the trial registration record.

Methods

We reviewed all conference abstracts presented at the ARVO meetings from 2007 through 2009, and identified 496 RCTs; 154 had a single matching registration record in ClinicalTrials.gov. Two individuals independently extracted information from the abstract and the ClinicalTrials.gov record, including study design, sample size, inclusion criteria, masking, interventions, outcomes, funder, and investigator name and contact information. Discrepancies were resolved by consensus. We assessed the frequencies of reporting variables appearing in the abstract and the trial register and assessed agreement of information reported in both sources.

Results

We found a substantial amount of study design information in the ClinicalTrials.gov record that was unavailable in the corresponding conference abstract, including eligibility criteria associated with gender (83%; 128/154); masking or blinding of study participants (53%, 82/154), persons administering treatment (30%, 46/154), and persons measuring the outcomes (40%, 61/154)); and number of study centers (58%; 90/154). Only 34% (52/154) of abstracts explicitly described a primary outcome, but a primary outcome was included in the “Primary Outcome” field in the ClinicalTrials.gov record for 82% (126/154) of studies. One or more study interventions were reported in each abstract, but agreed exactly with those reported in ClinicalTrials.gov only slightly more than half the time (88/154, 56%). We found no contact information for study investigators in the abstract, but this information was available in less than one quarter of ClinicalTrial.gov records (17%; 26/154).

Conclusion

RCT design information not reported in conference abstracts is often available in the corresponding ClinicalTrials.gov registration record. Sometimes there is conflicting information reported in the two sources and further contact with the trial investigators may still be required.
Appendix
Available only for authorised users
Literature
1.
go back to reference IOM (Institute of Medicine): Knowing What Works in Health Care: a Roadmap for the Nation. Committee on Reviewing Evidence to Identify Highly Effective Clinical Services. 2011, Washington DC: The National Academic Press IOM (Institute of Medicine): Knowing What Works in Health Care: a Roadmap for the Nation. Committee on Reviewing Evidence to Identify Highly Effective Clinical Services. 2011, Washington DC: The National Academic Press
2.
go back to reference Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: 10.1002/14651858.MR000005.pub3. Art. No.: MR000005 Scherer RW, Langenberg P, Von Elm E: Full publication of results initially presented in abstracts. Cochrane Database Syst Rev. 2007, 2: 10.1002/14651858.MR000005.pub3. Art. No.: MR000005
3.
go back to reference Hopewell S, McDonald S, Clarke MJ, Egger M: Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007, 2: 10.1002/14651858.MR000010.pub3. Art. No.:MR000010 Hopewell S, McDonald S, Clarke MJ, Egger M: Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007, 2: 10.1002/14651858.MR000010.pub3. Art. No.:MR000010
4.
go back to reference Hopewell S, Eisinga A, Clarke M: Better reporting of randomized trials in biomedical journal and conference abstracts. J Information Science. 2008, 34: 162-173.CrossRef Hopewell S, Eisinga A, Clarke M: Better reporting of randomized trials in biomedical journal and conference abstracts. J Information Science. 2008, 34: 162-173.CrossRef
5.
go back to reference Dundar Y, Dodd S, Williamson P, Walley T, Dickson R: Searching for and use of conference abstracts in health technology assessments: Policy and practice. Int J Technol Assess Health Care. 2006, 22: 283-287.PubMed Dundar Y, Dodd S, Williamson P, Walley T, Dickson R: Searching for and use of conference abstracts in health technology assessments: Policy and practice. Int J Technol Assess Health Care. 2006, 22: 283-287.PubMed
6.
go back to reference Egger M, Juni P, Bartlett C, Holensteing F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7 (Issue 1): 1-76.PubMed Egger M, Juni P, Bartlett C, Holensteing F, Sterne J: How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. Health Technol Assess. 2003, 7 (Issue 1): 1-76.PubMed
7.
go back to reference Cook DJ, Guyatt GH, Ryan G, Clifton J, Buckingham L, Willan A, McIlroy , Oxman AD: Should unpublished data be included in meta-analyses?. JAMA. 1993, 269: 2749-2753. 10.1001/jama.1993.03500210049030.CrossRefPubMed Cook DJ, Guyatt GH, Ryan G, Clifton J, Buckingham L, Willan A, McIlroy , Oxman AD: Should unpublished data be included in meta-analyses?. JAMA. 1993, 269: 2749-2753. 10.1001/jama.1993.03500210049030.CrossRefPubMed
9.
go back to reference Scherer RW, Sieving P, Dickersin K: Can we depend on investigators to identify and register randomized controlled trials?. PLoS One. 2012, 7: e44183-10.1371/journal.pone.0044183.CrossRefPubMedPubMedCentral Scherer RW, Sieving P, Dickersin K: Can we depend on investigators to identify and register randomized controlled trials?. PLoS One. 2012, 7: e44183-10.1371/journal.pone.0044183.CrossRefPubMedPubMedCentral
11.
go back to reference Dwan K, Altman DG, Cresswell L, Blundell M, Gamble CL, Williamson PR: Comparison of protocols and registry entries to published reports for randomised controlled trials. Cochrane Database Syst Rev. 2011, 10.1002/14651858.MR000031.pub2. Art. No.: MR000031, Issue 1CrossRef Dwan K, Altman DG, Cresswell L, Blundell M, Gamble CL, Williamson PR: Comparison of protocols and registry entries to published reports for randomised controlled trials. Cochrane Database Syst Rev. 2011, 10.1002/14651858.MR000031.pub2. Art. No.: MR000031, Issue 1CrossRef
13.
go back to reference You B, Gan HK, Pnd G, Chen EX: Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials form registration to publication: a systematic review. J Clin Oncol. 2012, 30: 210-216. 10.1200/JCO.2011.37.0890.CrossRefPubMed You B, Gan HK, Pnd G, Chen EX: Consistency in the analysis and reporting of primary end points in oncology randomized controlled trials form registration to publication: a systematic review. J Clin Oncol. 2012, 30: 210-216. 10.1200/JCO.2011.37.0890.CrossRefPubMed
14.
go back to reference Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P: Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009, 302: 977-984. 10.1001/jama.2009.1242.CrossRefPubMed Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P: Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009, 302: 977-984. 10.1001/jama.2009.1242.CrossRefPubMed
15.
go back to reference Millette K, Roseman M, Thombs BD: Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosomatic Research. 2011, 70: 205-217. 10.1016/j.jpsychores.2010.09.015.CrossRef Millette K, Roseman M, Thombs BD: Transparency of outcome reporting and trial registration of randomized controlled trials in top psychosomatic and behavioral health journals: a systematic review. J Psychosomatic Research. 2011, 70: 205-217. 10.1016/j.jpsychores.2010.09.015.CrossRef
16.
go back to reference Bourgeois F, Murthy S, Mandl KD: Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med. 2010, 153: 158-166. 10.7326/0003-4819-153-3-201008030-00006.CrossRefPubMedPubMedCentral Bourgeois F, Murthy S, Mandl KD: Outcome reporting among drug trials registered in ClinicalTrials.gov. Ann Intern Med. 2010, 153: 158-166. 10.7326/0003-4819-153-3-201008030-00006.CrossRefPubMedPubMedCentral
17.
go back to reference Toma M, McAlister FA, Bialy L, Adams D, Vendermeer B, Armstrong PW: Transition from meeting abstract to full-length journal article for randomized controlled trials. JAMA. 2006, 295: 1281-1287. 10.1001/jama.295.11.1281.CrossRefPubMed Toma M, McAlister FA, Bialy L, Adams D, Vendermeer B, Armstrong PW: Transition from meeting abstract to full-length journal article for randomized controlled trials. JAMA. 2006, 295: 1281-1287. 10.1001/jama.295.11.1281.CrossRefPubMed
18.
go back to reference Dundar Y, Dodd S, Williamson P, Dickson R, Walley T: Case study of the comparison of data from conference abstracts and full-text articles in health technology assessment of rapidly evolving technologies: Does it make a difference?. Int J Tech Assess Health Care. 2006, 22: 288-294. Dundar Y, Dodd S, Williamson P, Dickson R, Walley T: Case study of the comparison of data from conference abstracts and full-text articles in health technology assessment of rapidly evolving technologies: Does it make a difference?. Int J Tech Assess Health Care. 2006, 22: 288-294.
19.
go back to reference Prasad S, Lee DJ, Yuan JC-C, Barao VAR, Shyamsundeer N, Sukotjo C: Discrepancies between abstracts presented at International Association for Dental Research annual sessions from 2004 to 2005 and full-text publications. International J Dentistry. 2012, 10.1155/2012/859561. 859561 Prasad S, Lee DJ, Yuan JC-C, Barao VAR, Shyamsundeer N, Sukotjo C: Discrepancies between abstracts presented at International Association for Dental Research annual sessions from 2004 to 2005 and full-text publications. International J Dentistry. 2012, 10.1155/2012/859561. 859561
20.
go back to reference Tam VC, Hotte SJ: Consistency of phase III clinical trial abstracts presented at an annual meeting of the American Society of Clinical Oncology compared with their subsequent full-text publications. J Clin Oncol. 2008, 26: 2205-2211. 10.1200/JCO.2007.14.6795.CrossRefPubMed Tam VC, Hotte SJ: Consistency of phase III clinical trial abstracts presented at an annual meeting of the American Society of Clinical Oncology compared with their subsequent full-text publications. J Clin Oncol. 2008, 26: 2205-2211. 10.1200/JCO.2007.14.6795.CrossRefPubMed
21.
go back to reference Snedeker KG, Campbell M, Totton SC, Guthrie A, Sargeant JM: Comparison of outcomes and other variables between conference abstracts and subsequent peer-reviewed papers involving pre-harvest or abbatoir-level interventions against foodborne pathogens. Prev Vet Med. 2010, 9: 67-76.CrossRef Snedeker KG, Campbell M, Totton SC, Guthrie A, Sargeant JM: Comparison of outcomes and other variables between conference abstracts and subsequent peer-reviewed papers involving pre-harvest or abbatoir-level interventions against foodborne pathogens. Prev Vet Med. 2010, 9: 67-76.CrossRef
22.
go back to reference Weizman AV, Griesman J, Bell CM: The use of research abstracts in formulary decision making by the Joint Oncology Drug Review of Canada. Appl Health Econ Policy. 2010, 8: 387-391. 10.2165/11530510-000000000-00000.CrossRef Weizman AV, Griesman J, Bell CM: The use of research abstracts in formulary decision making by the Joint Oncology Drug Review of Canada. Appl Health Econ Policy. 2010, 8: 387-391. 10.2165/11530510-000000000-00000.CrossRef
24.
go back to reference Relevo R, Balshem H: Finding evidence for comparing medical interventions: AHRQ and the Effective Health Care Program. J Clin Epidem. 2011, 64: 168-1177.CrossRef Relevo R, Balshem H: Finding evidence for comparing medical interventions: AHRQ and the Effective Health Care Program. J Clin Epidem. 2011, 64: 168-1177.CrossRef
25.
go back to reference Falagas ME, Rosmarakis ES: Clinical decision-making based on findings presented in conference abstracts: is it safe for our patients?. Eur Heart J. 2006, 27: 2038-2039. 10.1093/eurheartj/ehl175.CrossRefPubMed Falagas ME, Rosmarakis ES: Clinical decision-making based on findings presented in conference abstracts: is it safe for our patients?. Eur Heart J. 2006, 27: 2038-2039. 10.1093/eurheartj/ehl175.CrossRefPubMed
26.
go back to reference Wong SS-W, Fraser C, Lurenco T, Barnett D, Avenell A, Glazener C, Cuthberston B, N’Dow J: The fate of conference abstracts: systematic review and meta-analysis of surgical treatments for men with benign prostatic enlargement. World J Urol. 2010, 28: 63-69. 10.1007/s00345-009-0500-3.CrossRefPubMed Wong SS-W, Fraser C, Lurenco T, Barnett D, Avenell A, Glazener C, Cuthberston B, N’Dow J: The fate of conference abstracts: systematic review and meta-analysis of surgical treatments for men with benign prostatic enlargement. World J Urol. 2010, 28: 63-69. 10.1007/s00345-009-0500-3.CrossRefPubMed
27.
go back to reference Hoehner C, Soares J, Parra DC, Ribeiro IC, Pratt M, Bracco M, Hallal PC, Bownson RC: Physical activity interventions in Latin America: What value might be added by including conference abstracts in a literature review?. J Physical Activity and Health. 2010, 7 (Suppl 2): S265-S278. Hoehner C, Soares J, Parra DC, Ribeiro IC, Pratt M, Bracco M, Hallal PC, Bownson RC: Physical activity interventions in Latin America: What value might be added by including conference abstracts in a literature review?. J Physical Activity and Health. 2010, 7 (Suppl 2): S265-S278.
28.
go back to reference Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: Explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral Hopewell S, Clarke M, Moher D, Wager E, Middleton P, Altman DG, Schulz KF, CONSORT Group: CONSORT for reporting randomized controlled trials in journal and conference abstracts: Explanation and elaboration. PLoS Med. 2008, 5: e20-10.1371/journal.pmed.0050020.CrossRefPubMedPubMedCentral
Metadata
Title
ClinicalTrials.gov registration can supplement information in abstracts for systematic reviews: a comparison study
Authors
Roberta W Scherer
Lynn Huynh
Ann-Margret Ervin
Jakeisha Taylor
Kay Dickersin
Publication date
01-12-2013
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2013
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/1471-2288-13-79

Other articles of this Issue 1/2013

BMC Medical Research Methodology 1/2013 Go to the issue