Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

At a glance: The ONWARDS insulin icodec trials

A round-up of the ONWARDS phase 3 clinical trials evaluating the novel weekly insulin icodec in people with diabetes.
ADVANCED SEARCH
Log in
Top
Systematic Reviews
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Research

Clinical trials registries are under-utilized in the conduct of systematic reviews: a cross-sectional analysis

Authors: Christopher W Jones, Lukas G Keil, Mark A Weaver, Timothy F Platts-Mills

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

Publication bias is a major threat to the validity of systematic reviews. Searches of clinical trials registries can help to identify unpublished trials, though little is known about how often these resources are utilized. We assessed the usage and results of registry searches reported in systematic reviews published in major general medical journals.

Methods

This cross-sectional analysis includes data from systematic reviews assessing medical interventions which were published in one of six major general medical journals between July 2012 and June 2013. Two authors independently examined each published systematic review and all available supplementary materials to determine whether at least one clinical trials registry was searched.

Results

Of the 117 included systematic reviews, 41 (35%) reported searching a trials registry. Of the 29 reviews which also provided detailed registry search results, 15 (52%) identified at least one completed trial and 18 (62%) identified at least one ongoing trial.

Conclusions

Clinical trials registry searches are not routinely included in systematic reviews published in major medical journals. Routine examination of registry databases may allow a more accurate characterization of publication and outcome reporting biases and improve the validity of estimated effects of medical treatments.
Appendix
Available only for authorised users
Literature
1.
Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol. 2009, 62 (10): e1-e34. 10.1016/j.jclinepi.2009.06.006.CrossRefPubMed
2.
Spoor P, Airey M, Bennett C, Greensill J, Williams R: Use of the capture-recapture technique to evaluate the completeness of systematic literature searches. BMJ. 1996, 313: 342-343. 10.1136/bmj.313.7053.342.CrossRefPubMedPubMedCentral
3.
Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L: Comparison of two methods to detect publication bias in meta-analysis. JAMA. 2006, 295: 676-680. 10.1001/jama.295.6.676.CrossRefPubMed
4.
Jones CW, Handler L, Crowell KE, Keil LG, Weaver MA, Platts-Mills TF: Non-publication of large randomized clinical trials: cross sectional analysis. BMJ. 2013, 347: f6104-10.1136/bmj.f6104.CrossRefPubMedPubMedCentral
5.
6.
Terrin N, Schmid CH, Lau J: In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. J Clin Epidemiol. 2005, 58: 894-901. 10.1016/j.jclinepi.2005.01.006.CrossRefPubMed
7.
De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, Kotzin S, Laine C, Marusic A, Overbeke AJ, Schroeder TV, Sox HC, Van Der Weyden MB: Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004, 351 (12): 1250-1251. 10.1056/NEJMe048225.CrossRefPubMed
8.
Food and Drug Administration Amendments Act of 2007. US Public Law 110–85. (2007, Sept 27); 21 USC 301
9.
Simes RJ: Publication bias: the case for an international registry of clinical trials. J Clin Oncol. 1986, 4: 1529-1541.PubMed
10.
11.
Jefferson T, Jones MA, Doshi P, Del Mar CB, Heneghan CJ, Hama R, Thompson MJ, Spencer EA, Onakpoya I, Mahtani KR, Nunan D, Howick J, Heneghan CJ: Neuraminidase inhibitors for preventing and treating influenza in healthy adults and children. Cochrane Database Syst Rev. 2012, 1: CD008965-PubMed
12.
13.
Relevo R, Balshem H: Finding evidence for comparing medical interventions: AHRQ and the Effective Health Care Program. J Clin Epidemiol. 2011, 64 (11): 1168-1177. 10.1016/j.jclinepi.2010.11.022.CrossRefPubMed
14.
Montori VM, Wilczynski NL, Morgan D, Haynes RB: Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ. 2005, 330: 68-10.1136/bmj.38336.804167.47.CrossRefPubMedPubMedCentral
15.
16.
Myung SK, Ju W, Cho B, Oh SW, Park SM, Koo BK, Park BJ: Efficacy of vitamin and antioxidant supplements in prevention of cardiovascular disease: systematic review and meta-analysis of randomised controlled trials. BMJ. 2013, 346: f10-10.1136/bmj.f10.CrossRefPubMedPubMedCentral
17.
Krogsboll LT, Jorgensen KJ, Gronhoj Larsen C, Gotzsche PC: General health checks in adults for reducing morbidity and mortality from disease: cochrane systematic review and meta-analysis. BMJ. 2012, 345: e7191-10.1136/bmj.e7191.CrossRefPubMedPubMedCentral
18.
Kayentao K, Garner P, van Eijk AM, Naidoo I, Roper C, Mulokozi A, MacArthur JR, Luntamo M, Ashorn P, Doumbo OK, ter Kuile FO: Intermittent preventive therapy for malaria during pregnancy using 2 vs 3 or more doses of sulfadoxine-pyrimethamine and risk of low birth weight in Africa: systematic review and meta-analysis. JAMA. 2013, 309 (6): 594-604. 10.1001/jama.2012.216231.CrossRefPubMedPubMedCentral
19.
Navarese EP, Gurbel PA, Andreotti F, Tantry U, Jeong YH, Kozinski M, Engstrom T, Di Pasquale G, Kochman W, Ardissino D, Kedhi E, Stone GW, Kubica J: Optimal timing of coronary invasive strategy in non-ST-segment elevation acute coronary syndromes: a systematic review and meta-analysis. Ann Intern Med. 2013, 158 (4): 261-270. 10.7326/0003-4819-158-4-201302190-00006.CrossRefPubMed
20.
Spielmans GI, Berman MI, Linardatos E, Rosenlicht NZ, Perry A, Tsai AC: Adjunctive atypical antipsychotic treatment for major depressive disorder: a meta-analysis of depression, quality of life, and safety outcomes. PLoS Med. 2013, 10: e1001403-10.1371/journal.pmed.1001403.CrossRefPubMedPubMedCentral
21.
Marschall J, Carpenter CR, Fowler S, Trautner BW: Antibiotic prophylaxis for urinary tract infections after removal of urinary catheter: meta-analysis. BMJ. 2013, 346: f3147-10.1136/bmj.f3147.CrossRefPubMedPubMedCentral
22.
Schweizer M, Perencevich E, McDanel J, Carson J, Formanek M, Hafner J, Braun B, Herwaldt L: Effectiveness of a bundled intervention of decolonization and prophylaxis to decrease Gram positive surgical site infections after cardiac or orthopedic surgery: systematic review and meta-analysis. BMJ. 2013, 346: f2743-10.1136/bmj.f2743.CrossRefPubMedPubMedCentral
23.
Rutjes AW, Juni P, da Costa BR, Trelle S, Nuesch E, Reichenbach S: Viscosupplementation for osteoarthritis of the knee: a systematic review and meta-analysis. Ann Intern Med. 2012, 157: 180-191. 10.7326/0003-4819-157-3-201208070-00473.CrossRefPubMed
24.
Ford JA, Elders A, Shyangdan D, Royle P, Waugh N: The relative clinical effectiveness of ranibizumab and bevacizumab in diabetic macular oedema: an indirect comparison in a systematic review. BMJ. 2012, 345: e5182-10.1136/bmj.e5182.CrossRefPubMedPubMedCentral
25.
Haase N, Perner A, Hennings LI, Siegemund M, Lauridsen B, Wetterslev M, Wettersley J: Hydroxyethyl starch 130/0.38–0.45 versus crystalloid or albumin in patients with sepsis: systematic review with meta-analysis and trial sequential analysis. BMJ. 2013, 346: f839-10.1136/bmj.f839.CrossRefPubMedPubMedCentral
26.
Cipriani A, Hawton K, Stockton S, Geddes JR: Lithium in the prevention of suicide in mood disorders: updated systematic review and meta-analysis. BMJ. 2013, 346: f3646-10.1136/bmj.f3646.CrossRefPubMed
27.
Fox BD, Kahn SR, Langleben D, Eisenberg MJ, Shimony A: Efficacy and safety of novel oral anticoagulants for treatment of acute venous thromboembolism: direct and adjusted indirect meta-analysis of randomised controlled trials. BMJ. 2012, 345: e7498-10.1136/bmj.e7498.CrossRefPubMedPubMedCentral
28.
Zarychanski R, Abou-Setta AM, Turgeon AF, Houston BL, McIntyre L, Marshall JC, Gergusson DA: Association of hydroxyethyl starch administration with mortality and acute kidney injury in critically ill patients requiring volume resuscitation: a systematic review and meta-analysis. JAMA. 2013, 309 (7): 678-688. 10.1001/jama.2013.430.CrossRefPubMed
29.
Aburto NJ, Ziolkovska A, Hooper L, Elliott P, Cappuccio FP, Meerpohl JJ: Effect of lower sodium intake on health: systematic review and meta-analyses. BMJ. 2013, 346: f1326-10.1136/bmj.f1326.CrossRefPubMedPubMedCentral
30.
Chopra V, Anand S, Hickner A, Buist M, Rogers MA, Saint S, Flanders SA: Risk of venous thromboembolism associated with peripherally inserted central catheters: a systematic review and meta-analysis. Lancet. 2013, 382 (9889): 311-325. 10.1016/S0140-6736(13)60592-9.CrossRefPubMed
31.
Fu R, Selph S, McDonagh M, Peterson K, Tiwari A, Chou R, Helfand M: Effectiveness and harms of recombinant human bone morphogenetic protein-2 in spine fusion: a systematic review and meta-analysis. Ann Intern Med. 2013, 158 (12): 890-902. 10.7326/0003-4819-158-12-201306180-00006.CrossRefPubMed
32.
Suthar AB, Lawn SD, del Amo J, Getahun H, Dye C, Sculier D, Sterling TR, Chaisson RE, Williams BG, Harries AD, Granich RM: Antiretroviral therapy for prevention of tuberculosis in adults with HIV: a systematic review and meta-analysis. PLoS Med. 2012, 9: e1001270-10.1371/journal.pmed.1001270.CrossRefPubMedPubMedCentral
33.
Pountain SJ, Roffe C: Does routine oxygen supplementation in patients with acute stroke improve outcome?. BMJ. 2012, 345: e6976-10.1136/bmj.e6976.CrossRefPubMed
34.
Leucht S, Cipriani A, Spineli L, Mavridis D, Orey D, Richter F, Samara M, Barbui C, Engel RR, Geddes JR, Kissling W, Stapf MP, Lassig B, Salanti G, Davis JM: Comparative efficacy and tolerability of 15 antipsychotic drugs in schizophrenia: a multiple-treatments meta-analysis. Lancet. 2013, 382 (9896): 951-962. 10.1016/S0140-6736(13)60733-3.CrossRefPubMed
35.
Maggard-Gibbons M, Maglione M, Livhits M, Ewing B, Maher AR, Hu J, Li Z, Shekelle PG: Bariatric surgery for weight loss and glycemic control in nonmorbidly obese adults with diabetes: a systematic review. JAMA. 2013, 309 (21): 2250-2261. 10.1001/jama.2013.4851.CrossRefPubMed
36.
Bhala N, Emberson J, Merhi A, Abramson S, Arber N, Baron JA, Bombardier C, Cannon C, Farkouh ME, FitzGerald GA, Goss P, Halls H, Hawk E, Hawkey C, Hennekens C, Hochberg M, Holland LE, Kearney PM, Laine L, Lanas A, Lance P, Laupacis A, Oates J, Patrono C, Schnitzer TJ, Solomon S, Tugwell P, Wilson K, Wittes J, Baigent C: Vascular and upper gastrointestinal effects of non-steroidal anti-inflammatory drugs: meta-analyses of individual participant data from randomised trials. Lancet. 2013, 382 (9894): 769-779.CrossRefPubMed
37.
Yeh HC, Brown TT, Maruthur N, Ranasinghe P, Berger Z, Suh YD, Wilson LM, Haberl EB, Brick J, Bass EB, Golden SH: Comparative effectiveness and safety of methods of insulin delivery and glucose monitoring for diabetes mellitus: a systematic review and meta-analysis. Ann Intern Med. 2012, 157 (5): 336-347. 10.7326/0003-4819-157-5-201209040-00508.CrossRefPubMed
38.
Harris T, Thomas GO, Brohi K: Early fluid resuscitation in severe trauma. BMJ. 2012, 345: e5752-10.1136/bmj.e5752.CrossRefPubMed
39.
Fink HA, Wilt TJ, Eidman KE, Garimella PS, MacDonald R, Rutks IR, Brasure M, Kane RL, Ouellette J, Monga M: Medical management to prevent recurrent nephrolithiasis in adults: a systematic review for an American College of Physicians Clinical Guideline. Ann Intern Med. 2013, 158 (7): 535-543. 10.7326/0003-4819-158-7-201304020-00005.CrossRefPubMed
40.
Adam SS, McDuffie JR, Ortel TL, Williams JW: Comparative effectiveness of warfarin and new oral anticoagulants for the management of atrial fibrillation and venous thromboembolism: a systematic review. Ann Intern Med. 2012, 157: 796-807. 10.7326/0003-4819-157-10-201211200-00532.CrossRefPubMed
41.
Raman G, Moorthy D, Hadar N, Dahabreh IJ, O’Donnell TF, Thaler DE, Feldmann E, Lau J, Kitsios GD: Management strategies for asymptomatic carotid stenosis: a systematic review and meta-analysis. Ann Intern Med. 2013, 158 (9): 676-685. 10.7326/0003-4819-158-9-201305070-00007.CrossRefPubMed
42.
Rosenfeld JV, Maas AI, Bragge P, Morganti-Kossmann MC, Manley GT, Gruen RL: Early management of severe traumatic brain injury. Lancet. 2012, 380: 1088-1098. 10.1016/S0140-6736(12)60864-2.CrossRefPubMed
43.
Simmonds MC, Brown JV, Heirs MK, Higgins JP, Mannion RJ, Rodgers MA, Stewart LA: Safety and effectiveness of recombinant human bone morphogenetic protein-2 for spinal fusion: a meta-analysis of individual-participant data. Ann Intern Med. 2013, 158 (12): 877-889. 10.7326/0003-4819-158-12-201306180-00005.CrossRefPubMed
44.
Wang SY, Olson-Kellogg B, Shamliyan TA, Choi JY, Ramakrishnan R, Kane RL: Physical therapy interventions for knee pain secondary to osteoarthritis: a systematic review. Ann Intern Med. 2012, 157: 632-644. 10.7326/0003-4819-157-9-201211060-00007.CrossRefPubMed
45.
Turner EH, Knoepflmacher D, Shapley L: Publication bias in antipsychotic trials: an analysis of efficacy comparing the published literature to the US Food and Drug Administration database. PLoS Med. 2012, 9: e1001189-10.1371/journal.pmed.1001189.CrossRefPubMedPubMedCentral
46.
Ross JS, Mulvey GK, Hines EM, Nissen SE, Krumholz HM: Trial publication after registration in ClinicalTrials.gov: a cross-sectional analysis. PLoS Med. 2009, 6: e1000144-10.1371/journal.pmed.1000144.CrossRefPubMedPubMedCentral
47.
Ross JS, Tse T, Zarin DA, Xu H, Zhou L, Krumholz HM: Publication of NIH funded trials registered in ClinicalTrials.gov: cross sectional analysis. BMJ. 2011, 344: d7292-CrossRef
48.
49.
50.
51.
Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG: Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004, 291: 2457-2465. 10.1001/jama.291.20.2457.CrossRefPubMed
52.
Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, Decullier E, Easterbrook PJ, Von Elm E, Gamble C, Ghersi D, Ioannidis JP, Simes J, Williamson PR: Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008, 3 (8): e3081-10.1371/journal.pone.0003081.CrossRefPubMedPubMedCentral
53.
Riveros C, Dechartres A, Perrodeau E, Haneef R, Boutron I, Ravaud P: Timing and completeness of trial results posted at ClinicalTrials.gov and published in journals. PLoS Med. 2013, 10 (12): e1001566-10.1371/journal.pmed.1001566.CrossRefPubMedPubMedCentral
54.
van Enst WA, Scholten RJ, Hooft L: Identification of additional trials in prospective trial registers for Cochrane systematic reviews. PLoS One. 2012, 7 (8): e42812-10.1371/journal.pone.0042812.CrossRefPubMedPubMedCentral
55.
Centre for Reviews and Dissemination, University of York: Systematic Reviews: CRD’s guidance for undertaking reviews in health care. 2009, York: University of York
56.
57.
Should protocols for observational research be registered?. Lancet. 2010, 375: 348-
58.
Potthast R, Vervölgyi V, McGauran N, Kerekes MF, Wieseler B, Kaiser T: Impact of inclusion of industry trial results registries as an information source for systematic reviews. PLoS One. 2014, 9 (4): e92067-10.1371/journal.pone.0092067.CrossRefPubMedPubMedCentral
Metadata
Title
Clinical trials registries are under-utilized in the conduct of systematic reviews: a cross-sectional analysis
Authors
Christopher W Jones
Lukas G Keil
Mark A Weaver
Timothy F Platts-Mills
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-126

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue

Protocol

Seeing the forests and the trees—innovative approaches to exploring heterogeneity in systematic reviews of complex interventions to enhance health system decision-making: a protocol

Protocol

Study protocol: systematic review and meta-analysis of randomized controlled trials in first-line treatment of squamous non-small cell lung cancer

Protocol

Protocol for a systematic review and meta-analysis of cognitive-behavioural therapy for social anxiety disorder in psychosis

Protocol

The effect of antenatal education in small classes on obstetric and psycho-social outcomes: a systematic review and meta-analysis protocol

Protocol

Instruments to measure patient experience of health care quality in hospitals: a systematic review protocol

Research

Failure or success of search strategies to identify adverse effects of medical devices: a feasibility study using a systematic review