Skip to main content
Top
Published in: Systematic Reviews 1/2013

Open Access 01-12-2013 | Research

Are systematic reviews up-to-date at the time of publication?

Authors: Elaine M Beller, Joyce Kee-Hsin Chen, Una Li-Hsiang Wang, Paul P Glasziou

Published in: Systematic Reviews | Issue 1/2013

Login to get access

Abstract

Background

Systematic reviews provide a synthesis of evidence for practitioners, for clinical practice guideline developers, and for those designing and justifying primary research. Having an up-to-date and comprehensive review is therefore important. Our main objective was to determine the recency of systematic reviews at the time of their publication, as measured by the time from last search date to publication. We also wanted to study the time from search date to acceptance, and from acceptance to publication, and measure the proportion of systematic reviews with recorded information on search dates and information sources in the abstract and full text of the review.

Methods

A descriptive analysis of published systematic reviews indexed in Medline in 2009, 2010 and 2011 by three reviewers, independently extracting data.

Results

Of the 300 systematic reviews included, 271 (90%) provided the date of search in the full-text article, but only 141 (47%) stated this in the abstract. The median (standard error; minimum to maximum) survival time from last search to acceptance was 5.1 (0.58; 0 to 43.8) months (95% confidence interval = 3.9 to 6.2) and from last search to first publication time was 8.0 (0.35; 0 to 46.7) months (95% confidence interval = 7.3 to 8.7), respectively. Of the 300 reviews, 295 (98%) stated which databases had been searched, but only 181 (60%) stated the databases in the abstract. Most researchers searched three (35%) or four (21%) databases. The top-three most used databases were MEDLINE (79%), Cochrane library (76%), and EMBASE (64%).

Conclusions

Being able to identify comprehensive, up-to-date reviews is important to clinicians, guideline groups, and those designing clinical trials. This study demonstrates that some reviews have a considerable delay between search and publication, but only 47% of systematic review abstracts stated the last search date and 60% stated the databases that had been searched. Improvements in the quality of abstracts of systematic reviews and ways to shorten the review and revision processes to make review publication more rapid are needed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Clarke M, Hopewell S, Chalmers I: Reports of clinical trials should begin and end with up-to-date systematic reviews of other relevant evidence: a status report. J R Soc Med. 2007, 100: 187-190. 10.1258/jrsm.100.4.187.CrossRefPubMedPubMedCentral Clarke M, Hopewell S, Chalmers I: Reports of clinical trials should begin and end with up-to-date systematic reviews of other relevant evidence: a status report. J R Soc Med. 2007, 100: 187-190. 10.1258/jrsm.100.4.187.CrossRefPubMedPubMedCentral
2.
go back to reference Chung M, Newberry SJ, Ansari MT, Yu WW, Wu H, Lee J, Suttorp M, Gaylor JM, Motala A, Moher D, Balk EM, Shekelle PG: Two methods provide similar signals for the need to update systematic reviews. J Clin Epidemiol. 2012, 65: 660-668. 10.1016/j.jclinepi.2011.12.004.CrossRefPubMedPubMedCentral Chung M, Newberry SJ, Ansari MT, Yu WW, Wu H, Lee J, Suttorp M, Gaylor JM, Motala A, Moher D, Balk EM, Shekelle PG: Two methods provide similar signals for the need to update systematic reviews. J Clin Epidemiol. 2012, 65: 660-668. 10.1016/j.jclinepi.2011.12.004.CrossRefPubMedPubMedCentral
3.
go back to reference Young C, Horton R: Putting clinical trials into context. Lancet. 2005, 366: 107-108. 10.1016/S0140-6736(05)66846-8.CrossRefPubMed Young C, Horton R: Putting clinical trials into context. Lancet. 2005, 366: 107-108. 10.1016/S0140-6736(05)66846-8.CrossRefPubMed
4.
go back to reference Sutton A, Cooper N, Jones D: Evidence synthesis as the key to more coherent and efficient research. BMC Med Res Methodol. 2009, 9: 29-10.1186/1471-2288-9-29.CrossRefPubMedPubMedCentral Sutton A, Cooper N, Jones D: Evidence synthesis as the key to more coherent and efficient research. BMC Med Res Methodol. 2009, 9: 29-10.1186/1471-2288-9-29.CrossRefPubMedPubMedCentral
5.
go back to reference Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009, 6: e1000100-10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gotzsche PC, Ioannidis JP, Clarke M, Devereaux PJ, Kleijnen J, Moher D: The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009, 6: e1000100-10.1371/journal.pmed.1000100.CrossRefPubMedPubMedCentral
6.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG: Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009, 6: e1000097-10.1371/journal.pmed.1000097.CrossRefPubMedPubMedCentral
7.
go back to reference Dogan RI, Murray GC, Neveol A, Lu Z: Understanding PubMed® user search behaviour through log analysis. Database. 2009, 2009: bap018-10.1093/database/bap018. Dogan RI, Murray GC, Neveol A, Lu Z: Understanding PubMed® user search behaviour through log analysis. Database. 2009, 2009: bap018-10.1093/database/bap018.
8.
go back to reference Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D: How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007, 147: 224-233. 10.7326/0003-4819-147-4-200708210-00179.CrossRefPubMed Shojania KG, Sampson M, Ansari MT, Ji J, Doucette S, Moher D: How quickly do systematic reviews go out of date? A survival analysis. Ann Intern Med. 2007, 147: 224-233. 10.7326/0003-4819-147-4-200708210-00179.CrossRefPubMed
9.
go back to reference Unalp A, Tonascia S, Meinert C: Presentation in relation to publication of results from clinical trials. Contemp Clin Trials. 2007, 28: 358-369. 10.1016/j.cct.2006.10.005.CrossRefPubMed Unalp A, Tonascia S, Meinert C: Presentation in relation to publication of results from clinical trials. Contemp Clin Trials. 2007, 28: 358-369. 10.1016/j.cct.2006.10.005.CrossRefPubMed
10.
go back to reference Sampson M, Shojania KG, Garritty C, Horsley T, Ocampo M, Moher D: Systematic reviews can be produced and published faster. J Clin Epidemiol. 2008, 61: 531-536. 10.1016/j.jclinepi.2008.02.004.CrossRefPubMed Sampson M, Shojania KG, Garritty C, Horsley T, Ocampo M, Moher D: Systematic reviews can be produced and published faster. J Clin Epidemiol. 2008, 61: 531-536. 10.1016/j.jclinepi.2008.02.004.CrossRefPubMed
12.
go back to reference Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.CrossRefPubMedPubMedCentral Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG: Epidemiology and reporting characteristics of systematic reviews. PLoS Med. 2007, 4: e78-10.1371/journal.pmed.0040078.CrossRefPubMedPubMedCentral
13.
go back to reference Yoshii A, Plaut DA, McGraw KA, Anderson MJ, Wellik KE: Analysis of the reporting of search strategies in Cochrane systematic reviews. J Med Libr Assoc. 2009, 97: 21-29. 10.3163/1536-5050.97.1.004.CrossRefPubMedPubMedCentral Yoshii A, Plaut DA, McGraw KA, Anderson MJ, Wellik KE: Analysis of the reporting of search strategies in Cochrane systematic reviews. J Med Libr Assoc. 2009, 97: 21-29. 10.3163/1536-5050.97.1.004.CrossRefPubMedPubMedCentral
14.
go back to reference Sampson M, McGowan J, Tetzlaff J, Cogo E, Moher D: No consensus exists on search reporting methods for systematic reviews. J Clin Epidemiol. 2008, 61: 748-754. 10.1016/j.jclinepi.2007.10.009.CrossRefPubMed Sampson M, McGowan J, Tetzlaff J, Cogo E, Moher D: No consensus exists on search reporting methods for systematic reviews. J Clin Epidemiol. 2008, 61: 748-754. 10.1016/j.jclinepi.2007.10.009.CrossRefPubMed
Metadata
Title
Are systematic reviews up-to-date at the time of publication?
Authors
Elaine M Beller
Joyce Kee-Hsin Chen
Una Li-Hsiang Wang
Paul P Glasziou
Publication date
01-12-2013
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2013
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-2-36

Other articles of this Issue 1/2013

Systematic Reviews 1/2013 Go to the issue