Skip to main content
Top
Published in: Systematic Reviews 1/2014

Open Access 01-12-2014 | Commentary

Routine piloting in systematic reviews—a modified approach?

Author: Linda Long

Published in: Systematic Reviews | Issue 1/2014

Login to get access

Abstract

Background

A continuous growth in the publication of research papers means that there is an expanding volume of data available to the systematic reviewer. Sometimes, researchers can become overwhelmed by the sheer volume of data being processed, leading to inefficient data extraction. This paper seeks to address this problem by proposing a modification to the current systematic review methodology.

Proposed method

This paper details the routine piloting of a systematic review all the way through to evidence-synthesis stage using data from a sample of included papers.

Results and discussion

The result of piloting a sample of papers through to evidence-synthesis stage is to produce a ‘mini systematic review’. Insights from such a pilot review may be used to modify the criteria in the data extraction form. It is proposed that this approach will ensure that in the full review the most useful and relevant information is extracted from all the papers in one phase without needing to re-visit the individual papers at a later stage.

Conclusions

Routine piloting in systematic reviews has been developed in response to advances in information technology and the subsequent increase in rapid access to clinical papers and data. It is proposed that the routine piloting of large systematic reviews will enable themes and meaning in the data to become apparent early in the review process. This, in turn, will facilitate the efficient extraction of data from all the papers in the full review. It is proposed that this approach will result in increased validity of the review, with potential benefits for increasing efficiency.
Appendix
Available only for authorised users
Literature
1.
go back to reference Egger M, Smith G, Altman D: Systematic Reviews in Health Care, Meta-Analysis in Context. 2008, London: BMJ Publishing Group, 2 Egger M, Smith G, Altman D: Systematic Reviews in Health Care, Meta-Analysis in Context. 2008, London: BMJ Publishing Group, 2
2.
go back to reference Moher D, Tsertsvadze A, Tricco AC, Eccles M, Grimshaw J, Sampson M, Barrowman N: When and how to update systematic reviews. Cochrane Database Syst Rev. 2008, 23 (1): MR000023 Moher D, Tsertsvadze A, Tricco AC, Eccles M, Grimshaw J, Sampson M, Barrowman N: When and how to update systematic reviews. Cochrane Database Syst Rev. 2008, 23 (1): MR000023
3.
go back to reference Centre for Reviews and Dissemination: University of York: Systematic reviews. 2009, ork: CRD: In CRD's Guidance for Undertaking Reviews in Health Care Centre for Reviews and Dissemination: University of York: Systematic reviews. 2009, ork: CRD: In CRD's Guidance for Undertaking Reviews in Health Care
4.
go back to reference Elliot JH, Mavergames C, Becker L, Meerpohl J, Thomas J, Green R, Tovey D: The automation of systematic reviews: achieving high quality and efficient systematic review through technological innovation. BMJ. 2013, 346: f139CrossRef Elliot JH, Mavergames C, Becker L, Meerpohl J, Thomas J, Green R, Tovey D: The automation of systematic reviews: achieving high quality and efficient systematic review through technological innovation. BMJ. 2013, 346: f139CrossRef
5.
go back to reference Ghersi D, Pang T: From Mexico to Mali: four years in the history of clinical trial registration. J Evid Based Med. 2009, 2 (1): 1-7.CrossRefPubMed Ghersi D, Pang T: From Mexico to Mali: four years in the history of clinical trial registration. J Evid Based Med. 2009, 2 (1): 1-7.CrossRefPubMed
6.
7.
go back to reference Gough D, Oliver S, Thomas J: An Introduction to Systematic Reviews. 2012, London: Sage Publications Gough D, Oliver S, Thomas J: An Introduction to Systematic Reviews. 2012, London: Sage Publications
9.
go back to reference Bonell C, Oakley J, Hargreaves J, Strange V, Rees R: Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006, 333 (7563): 346-349.CrossRefPubMedPubMedCentral Bonell C, Oakley J, Hargreaves J, Strange V, Rees R: Assessment of generalisability in trials of health interventions: suggested framework and systematic review. BMJ. 2006, 333 (7563): 346-349.CrossRefPubMedPubMedCentral
10.
go back to reference Thomas JM, McNaught J, Ananiadou S: Applications of text mining within systematic reviews. Res Synth Method. 2011, 2 (1): 1-14.CrossRef Thomas JM, McNaught J, Ananiadou S: Applications of text mining within systematic reviews. Res Synth Method. 2011, 2 (1): 1-14.CrossRef
12.
go back to reference Mavergames C, Becker L: Cochrane Linked Data Project: From "Star Trek" to the Present. 2014, Oxford: The Cochrane Collaboration Mavergames C, Becker L: Cochrane Linked Data Project: From "Star Trek" to the Present. 2014, Oxford: The Cochrane Collaboration
13.
go back to reference Welsh E: Saving time during development of Cochrane protocols. BMJ. 2013, 346: f139CrossRef Welsh E: Saving time during development of Cochrane protocols. BMJ. 2013, 346: f139CrossRef
15.
go back to reference Tsafnat G, Dunn A, Glasziou P, Coiera E: The automation of systematic reviews. BMJ. 2013, 346: f139CrossRefPubMed Tsafnat G, Dunn A, Glasziou P, Coiera E: The automation of systematic reviews. BMJ. 2013, 346: f139CrossRefPubMed
16.
go back to reference Clark AM: Re: the automation of systematic reviews: get real. BMJ. 2013, 346: f139CrossRef Clark AM: Re: the automation of systematic reviews: get real. BMJ. 2013, 346: f139CrossRef
17.
go back to reference Barreto PS: "Brave New World" for systematic reviews?. BMJ. 2013, 346: f139CrossRef Barreto PS: "Brave New World" for systematic reviews?. BMJ. 2013, 346: f139CrossRef
18.
go back to reference Haykowsky M, Liang Y, Pechter D, Jones L, McAlister F, Clark AM: A meta-analysis of the effect of exercise training on left ventricular remodelling in heart failure patients: the benefit depends on the type of training performed. J Am Coll Cardiol. 2007, 49: 2329-2336.CrossRefPubMed Haykowsky M, Liang Y, Pechter D, Jones L, McAlister F, Clark AM: A meta-analysis of the effect of exercise training on left ventricular remodelling in heart failure patients: the benefit depends on the type of training performed. J Am Coll Cardiol. 2007, 49: 2329-2336.CrossRefPubMed
19.
go back to reference Thomas JM, O'Mara-Eves A, McNaught J, Ananiadou S: Re: the automation of systematic reviews. BMJ. 2013, 346: f139CrossRef Thomas JM, O'Mara-Eves A, McNaught J, Ananiadou S: Re: the automation of systematic reviews. BMJ. 2013, 346: f139CrossRef
20.
go back to reference Pawson R: Evidence-Based Policy: A Realist Perspective. 2006, London: Sage PublicationsCrossRef Pawson R: Evidence-Based Policy: A Realist Perspective. 2006, London: Sage PublicationsCrossRef
Metadata
Title
Routine piloting in systematic reviews—a modified approach?
Author
Linda Long
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2014
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/2046-4053-3-77

Other articles of this Issue 1/2014

Systematic Reviews 1/2014 Go to the issue