Skip to main content
Top
Published in: Systematic Reviews 1/2017

Open Access 01-12-2017 | Protocol

Epidemiology and reporting characteristics of overviews of reviews of healthcare interventions published 2012–2016: protocol for a systematic review

Authors: Dawid Pieper, Michelle Pollock, Ricardo M. Fernandes, Roland Brian Büchter, Lisa Hartling

Published in: Systematic Reviews | Issue 1/2017

Login to get access

Abstract

Background

Overviews of systematic reviews (overviews) attempt to systematically retrieve and summarize the results of multiple systematic reviews (SRs) for a given condition or public health problem. Two prior descriptive analyses of overviews found substantial variation in the methodological approaches used in overviews, and deficiencies in reporting of key methodological steps. Since then, new methods have been developed so it is timely to update the prior descriptive analyses. The objectives are to: (1) investigate the epidemiological, descriptive, and reporting characteristics of a random sample of 100 overviews published from 2012 to 2016 and (2) compare these recently published overviews (2012–2016) to those published prior to 2012 (based on the prior descriptive analyses).

Methods

Medline, EMBASE, and CDSR will be searched for overviews published 2012–2016, using a validated search filter for overviews. Only overviews written in English will be included. All titles and abstracts will be screened by one review author; those deemed not relevant will be verified by a second person for exclusion. Full-texts will be assessed for inclusion by two reviewers independently. Of those deemed relevant, a random sample of 100 overviews will be selected for inclusion. Data extraction will be either performed by one reviewer with verification by a second reviewer or by one reviewer only depending on the complexity of the item. Discrepancies at any stage will be resolved by consensus or consulting a third person. Data will be extracted on the epidemiological, descriptive, and reporting characteristics of each overview. Data will be analyzed descriptively. When data are available for both time points (up to 2011 vs. 2012–2016), we will compare characteristics by calculating risk ratios or applying the Mann-Whitney test.

Discussion

Overviews are becoming increasingly valuable evidence syntheses, and the number of published overviews is increasing. However, former analyses found limitations in the conduct and reporting of overviews. This update of a recent sample of overviews will inform whether this has changed, while also identifying areas for further improvement.

Systematic review registration

The review will not be registered in PROSPERO as it does not meet the eligibility criterion of dealing with health-related outcomes.
Literature
1.
go back to reference Becker LA, Oxman AD. Overviews of reviews. In: Cochrane Handbook for Systematic Reviews of Interventions. edn. Chichester: John Wiley & Sons, Ltd; 2008: 607–31. Becker LA, Oxman AD. Overviews of reviews. In: Cochrane Handbook for Systematic Reviews of Interventions. edn. Chichester: John Wiley & Sons, Ltd; 2008: 607–31.
2.
go back to reference Hartling L, Chisholm A, Thomson D, Dryden DM. A descriptive analysis of overviews of reviews published between 2000 and 2011. PLoS One. 2012;7(11):e49667.CrossRefPubMedPubMedCentral Hartling L, Chisholm A, Thomson D, Dryden DM. A descriptive analysis of overviews of reviews published between 2000 and 2011. PLoS One. 2012;7(11):e49667.CrossRefPubMedPubMedCentral
3.
go back to reference Pieper D, Buechter R, Jerinic P, Eikermann M. Overviews of reviews often have limited rigor: a systematic review. J Clin Epidemiol. 2012;65(12):1267–73.CrossRefPubMed Pieper D, Buechter R, Jerinic P, Eikermann M. Overviews of reviews often have limited rigor: a systematic review. J Clin Epidemiol. 2012;65(12):1267–73.CrossRefPubMed
4.
go back to reference Pieper D, Antoine SL, Mathes T, Neugebauer EA, Eikermann M. Systematic review finds overlapping reviews were not mentioned in every other overview. J Clin Epidemiol. 2014;67(4):368–75.CrossRefPubMed Pieper D, Antoine SL, Mathes T, Neugebauer EA, Eikermann M. Systematic review finds overlapping reviews were not mentioned in every other overview. J Clin Epidemiol. 2014;67(4):368–75.CrossRefPubMed
5.
go back to reference Crick K, Wingert A, Williams K, Fernandes RM, Thomson D, Hartling L. An evaluation of harvest plots to display results of meta-analyses in overviews of reviews: a cross-sectional study. BMC Med Res Methodol. 2015;15:91.CrossRefPubMedPubMedCentral Crick K, Wingert A, Williams K, Fernandes RM, Thomson D, Hartling L. An evaluation of harvest plots to display results of meta-analyses in overviews of reviews: a cross-sectional study. BMC Med Res Methodol. 2015;15:91.CrossRefPubMedPubMedCentral
6.
go back to reference Schünemann HJ, Oxman AD, Vist GE, Higgins JPT, Deeks JJ, Glasziou P, Guyatt GH. Interpreting results and drawing conclusions. In: Cochrane Handbook for Systematic Reviews of Interventions. edn. Chichester: John Wiley & Sons, Ltd; 2008: 359–87. Schünemann HJ, Oxman AD, Vist GE, Higgins JPT, Deeks JJ, Glasziou P, Guyatt GH. Interpreting results and drawing conclusions. In: Cochrane Handbook for Systematic Reviews of Interventions. edn. Chichester: John Wiley & Sons, Ltd; 2008: 359–87.
7.
go back to reference Agha RA, Fowler AJ, Limb C, Whitehurst K, Coe R, Sagoo H, Jafree DJ, Chandrakumar C, Gundogan B. Impact of the mandatory implementation of reporting guidelines on reporting quality in a surgical journal: a before and after study. Int J Surg (London, England). 2016;30:169–72.CrossRef Agha RA, Fowler AJ, Limb C, Whitehurst K, Coe R, Sagoo H, Jafree DJ, Chandrakumar C, Gundogan B. Impact of the mandatory implementation of reporting guidelines on reporting quality in a surgical journal: a before and after study. Int J Surg (London, England). 2016;30:169–72.CrossRef
8.
go back to reference Yu N, Yu P, Long X, Huang J, Jia Y, Wang X. A systematic quality evaluation of meta-analyses related to plastic surgery. Ann Plast Surg. 2017;78(1):111–8 Yu N, Yu P, Long X, Huang J, Jia Y, Wang X. A systematic quality evaluation of meta-analyses related to plastic surgery. Ann Plast Surg. 2017;78(1):111–8
9.
go back to reference Tan WK, Wigley J, Shantikumar S. The reporting quality of systematic reviews and meta-analyses in vascular surgery needs improvement: a systematic review. Int J Surg (London, England). 2014;12(12):1262–5.CrossRef Tan WK, Wigley J, Shantikumar S. The reporting quality of systematic reviews and meta-analyses in vascular surgery needs improvement: a systematic review. Int J Surg (London, England). 2014;12(12):1262–5.CrossRef
10.
go back to reference Tunis AS, McInnes MD, Hanna R, Esmail K. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013;269(2):413–26.CrossRefPubMed Tunis AS, McInnes MD, Hanna R, Esmail K. Association of study quality with completeness of reporting: have completeness of reporting and quality of systematic reviews and meta-analyses in major radiology journals changed since publication of the PRISMA statement? Radiology. 2013;269(2):413–26.CrossRefPubMed
11.
go back to reference Pollock M, Fernandes RM, Becker LA, Featherstone R, Hartling L. What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary. Syst Rev. 2016;5(1):190.CrossRefPubMedPubMedCentral Pollock M, Fernandes RM, Becker LA, Featherstone R, Hartling L. What guidance is available for researchers conducting overviews of reviews of healthcare interventions? A scoping review and qualitative metasummary. Syst Rev. 2016;5(1):190.CrossRefPubMedPubMedCentral
12.
go back to reference Lunny C, McKenzie JE, McDonald S. Retrieval of overviews of systematic reviews in MEDLINE was improved by the development of an objectively derived and validated search strategy. J Clin Epidemiol. 2016;74:107–18.CrossRefPubMed Lunny C, McKenzie JE, McDonald S. Retrieval of overviews of systematic reviews in MEDLINE was improved by the development of an objectively derived and validated search strategy. J Clin Epidemiol. 2016;74:107–18.CrossRefPubMed
13.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535.CrossRefPubMedPubMedCentral
14.
go back to reference Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33(1):159–74.CrossRefPubMed
17.
go back to reference Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, Group P-P. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.CrossRefPubMedPubMedCentral Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, Shekelle P, Stewart LA, Group P-P. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.CrossRefPubMedPubMedCentral
Metadata
Title
Epidemiology and reporting characteristics of overviews of reviews of healthcare interventions published 2012–2016: protocol for a systematic review
Authors
Dawid Pieper
Michelle Pollock
Ricardo M. Fernandes
Roland Brian Büchter
Lisa Hartling
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2017
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-017-0468-9

Other articles of this Issue 1/2017

Systematic Reviews 1/2017 Go to the issue