Top

Published in:

Open Access 01-12-2016 | Commentary

Exploring issues in the conduct of website searching and other online sources for systematic reviews: how can we be systematic?

Published in: Systematic Reviews | Issue 1/2016

Abstract

Websites and online resources outside academic bibliographic databases can be significant sources for identifying literature, though there are challenges in searching and managing the results. These are pertinent to systematic reviews that are underpinned by principles of transparency, accountability and reproducibility. We consider how the conduct of searching these resources can be compatible with the principles of a systematic search. We present an approach to address some of the challenges. This is particularly relevant when websites are relied upon to identify important literature for a review. We recommend considering the process as three stages and having a considered rationale and sufficient recordkeeping at each stage that balances transparency with practicality of purpose. Advances in technology and recommendations for website providers are briefly discussed.

Hammerstrøm K, Wade A, Jørgensen AMK. Searching for studies: a guide to information retrieval for Campbell Systematic Reviews Campbell Systematic Reviews 2010; Supplement 1 DOI: 10.4073/csrs.2010.1.

Lefebvre C, Manheimer E, Glanville J. Chapter 6: searching for studies. In: Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 (updated March 2011). The Cochrane Collaboration, 2011. http://handbook.cochrane.org/. Accessed 22 Mar 2016.

Oliver S, Bangpan M, Stansfield C, Stewart R. Capacity for conducting systematic reviews in low- and middle-income countries: a rapid appraisal. Health Res Policy Syst. 2015;13:23. doi:10.1186/s12961-015-0012-0.CrossRefPubMedPubMedCentral

Birdthistle I, Dickson K, Freeman M, Javidi L. What impact does the provision of separate toilets for girls at schools have on their primary and secondary school enrolment, attendance and completion? A systematic review of the evidence. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2011.

Brunton G, Oliver S, Oliver K, Lorenc T. A synthesis of research addressing children's, young people's and parents' views of walking and cycling for transport. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2006. http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=942.

Brunton G, Wiggins M, Oakley A. Becoming a mother: a research synthesis of women's experiences of first-time motherhood. EPPI Centre, Social Science Research Unit, Institute of Education, University of London. 2011 http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3295.

Dickson K, Bangpan M. Providing access to economic assets for girls and young women in low-and-lower middle income countries: a systematic review of the evidence. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2012. http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3359. ISBN 978-1-907345-38-8.

Rees R, Oliver K, Woodman J, Thomas J. The views of young children in the UK about obesity, body size, shape and weight: a systematic review. BMC Public Health. 2011;11:188.CrossRefPubMedPubMedCentral

Rees R, Caird J, Dickson K, Vigurs C, Thomas J. ‘It’s on your conscience all the time’: a systematic review of qualitative studies examining views on obesity among young people aged 12–18 years in the UK. BMJ Open. 2014;4:e004404. doi:10.1136/bmjopen-2013-004404.CrossRefPubMedPubMedCentral

10.

Stansfield C, Brunton G, Rees R. Search wide, dig deep: literature searching for qualitative research studies. An analysis of the publication formats and information sources used for four systematic reviews in public health. Res Synth Methods. 2014;5(2):142–51.CrossRefPubMed

11.

Stansfield C, Dickson K. Locating evidence for developing countries: a case study of three public health reviews. Poster presentation at the 19th Cochrane Colloquium; 2011 Oct 19-22; Madrid, Spain [abstract] Cochrane Database of Syst Rev. 2011;Suppl(CD000003), 51-2, CMR-16617.

12.

Stewart R, van Rooyen C, Dickson K, Majoro M, de Wet T. What is the impact of microfinance on poor people? A systematic review of evidence from sub-Saharan Africa. Technical report. London: EPPI-Centre, Social Science Research Unit, University of London; 2010.

13.

Tripney J, Schucan Bird K, Kwan I, Kavanagh J. The impact of post-abortion care family planning counselling and services in low-income countries: a systematic review of the evidence. Technical report. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2011.

14.

Brunton G, Stansfield C, Caird J, Thomas J. Chapter: 6: finding relevant studies. In: Gough, D. Oliver S, Thomas J, editors. An introduction to systematic reviews. 2^nd Edition. London: Sage Publications; 2017. In press.

15.

Collaboration for Environmental Evidence. Guidelines for systematic review and evidence synthesis in environmental management. Version 4.2. Environmental Evidence: Centre for Evidence-Based Conservation, Bangor University. 2013 www.environmentalevidence.org/Documents/Guidelines/Guidelines4.2.pdf, Accessed 22 Mar 2016.

16.

Haddaway N, Bayliss H. Shades of grey: two forms of grey literature important for reviews in conservation. Biol Conserv. 2015;191:827–9.CrossRef

17.

Godin K, Stapleton J, Kirkpatrick SI, Hanning RM, Leatherdale ST. Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada. Syst Rev. 2015;4:138.CrossRefPubMedPubMedCentral

18.

Mahood Q, Eerd DV, Irvin E. Searching for grey literature for systematic reviews: challenges and benefits. Res Synth Methods. 2013;5:221–34.CrossRefPubMed

19.

McGrath Y, Sumnall H, Edmonds K, McVeigh J, Bellis M. Review of grey literature on drug prevention among young people. National Institute for Health and Clinical Excellence. ISBN:1-84629-184-4. 2006.

20.

Eysenbach G, Tuische J, Diepgen TL. Evaluation of the usefulness of Internet searches to identify unpublished clinical trials for systematic reviews. Med Inform Internet Med. 2001;26:203–18.CrossRefPubMed

21.

Boeker M, Vach W, Motschall E. Google Scholar as replacement for systematic literature searches: good relative recall and precision are not enough. BMC Med Res Meth. 2013;13:131.CrossRef

22.

Bramer W, Giustini D, Kramer B. Comparing the coverage, recall, and precision of searches for 120 systematic reviews in Embase, MEDLINE, and Google Scholar: a prospective study. Syst Rev. 2016;5:39.CrossRefPubMedPubMedCentral

23.

Bramer WM, Giustini D, Kramer BMR, Anderson PF. The comparative recall of Google Scholar versus PubMed in identical searches for biomedical systematic reviews: a review of searches used in systematic reviews. Syst Rev. 2013;2:115.CrossRefPubMedPubMedCentral

24.

Haddaway NR, Collins AM, Coughlin D, Kirk S. The role of Google Scholar in evidence reviews and its applicability to grey literature searching. PLoS One. 2015;10:e0138237.CrossRefPubMedPubMedCentral

25.

Glanville JM, Duffy S, McCool R, Varley D. Searching ClinicalTrials.gov and the International Clinical Trials Registry Platform to inform systematic reviews: what are the optimal search approaches? J Med Libr Assoc. 2014;102(3):177–83.CrossRefPubMedPubMedCentral

26.

Blakeman K. Finding research information on the web: how to make the most of Google and other free search tools. Sci Prog. 2013;96(Pt 1):61–84.CrossRefPubMed

27.

Briscoe S. Web searching for systematic reviews: a case study of reporting standards in the UK Health Technology Assessment programme. BMC Res Notes. 2015;8:153.CrossRefPubMedPubMedCentral

28.

Schucan Bird K, Tripney J. Systematic literature searching in policy relevant, inter-disciplinary reviews: an example from culture and sport. Res Synth Methods. 2011;2(3):163–73.CrossRefPubMed

29.

Rader T, Mann M, Stansfield C, Cooper C, Sampson M. Methods for documenting systematic review searches: a discussion of common issues. Res Synth Methods. 2014;5(2):98–115.CrossRefPubMed

30.

Adams J, Hillier-Brown F, Moore H, Lake A, Araujo-Soares V, White M, Summerbell C. Searching and synthesising ‘grey literature’ and ‘grey information’ in public health: critical reflections on three case studies. Syst Rev. 2016;5:164.CrossRefPubMedPubMedCentral

31.

Rees R, Hinds K, Dickson K, O'Mara-Eves A, Thomas J. Communities that cook: a systematic review of the effectiveness and appropriateness of interventions to introduce adults to home cooking. London: EPPI-Centre, Social Science Research Unit, Institute of Education, University of London; 2012. http://eppi.ioe.ac.uk/cms/Default.aspx?tabid=3322.

32.

Brunton G, Caird J, Sutcliffe K, Rees R, Stokes G, Oliver S, Stansfield C, Llewellyn A, Simmonds M, Thomas J. Depression, anxiety, pain and quality of life in people living with chronic hepatitis C: a systematic review and meta-analysis. London: EPPI-Centre, Social Science Research Unit, UCL Institute of Education, University College London; 2015.

33.

Spicer D, Ehren M, Bangpan M, Khatwa M (2014) Under what conditions do inspection, monitoring and assessment improve system efficiency, service delivery and learning outcomes for the poorest and most marginalised? A realist synthesis of school accountability in low- and middle-income countries. Protocol. London: EPPI-Centre, Social Science Research Centre, Institute of Education, University of London.

34.

Hurley M, Dickson K, Walsh N, Hauari H, Grant R, Cumming J, Oliver S. Exercise interventions and patient beliefs for people with chronic hip and knee pain: a mixed methods review (protocol). Cochrane Database of Systematic Reviews. 2013, Issue 12.

Title: Exploring issues in the conduct of website searching and other online sources for systematic reviews: how can we be systematic?
Publication date: 01-12-2016
Published in: Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI: https://doi.org/10.1186/s13643-016-0371-9

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Exploring issues in the conduct of website searching and other online sources for systematic reviews: how can we be systematic?

Abstract

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 1/2016

The effects of public health policies on population health and health inequalities in European welfare states: protocol for an umbrella review

The impact of intervention strategies that target arterial stiffness in end-stage renal disease: a systematic review protocol

The impact of mHealth interventions on health systems: a systematic review protocol

Blinding in randomized controlled trials in general and abdominal surgery: protocol for a systematic review and empirical study

Efficacy and safety of regenerative cell therapy for pulmonary arterial hypertension in animal models: a preclinical systematic review protocol

The effects of graded motor imagery and its components on phantom limb pain and disability in upper and lower limb amputees: a systematic review protocol