Skip to main content
Top
Published in: BMC Health Services Research 1/2016

Open Access 01-12-2016 | Research article

Advancing scoping study methodology: a web-based survey and consultation of perceptions on terminology, definition and methodological steps

Authors: Kelly K. O’Brien, Heather Colquhoun, Danielle Levac, Larry Baxter, Andrea C. Tricco, Sharon Straus, Lisa Wickerson, Ayesha Nayar, David Moher, Lisa O’Malley

Published in: BMC Health Services Research | Issue 1/2016

Login to get access

Abstract

Background

Scoping studies (or reviews) are a method used to comprehensively map evidence across a range of study designs in an area, with the aim of informing future research practice, programs and policy. However, no universal agreement exists on terminology, definition or methodological steps. Our aim was to understand the experiences of, and considerations for conducting scoping studies from the perspective of academic and community partners. Primary objectives were to 1) describe experiences conducting scoping studies including strengths and challenges; and 2) describe perspectives on terminology, definition, and methodological steps.

Methods

We conducted a cross-sectional web-based survey with clinicians, educators, researchers, knowledge users, representatives from community-based organizations, graduate students, and policy stakeholders with experience and/or interest in conducting scoping studies to gain an understanding of experiences and perspectives on the conduct and reporting of scoping studies. We administered an electronic self-reported questionnaire comprised of 22 items related to experiences with scoping studies, strengths and challenges, opinions on terminology, and methodological steps. We analyzed questionnaire data using descriptive statistics and content analytical techniques. Survey results were discussed during a multi-stakeholder consultation to identify key considerations in the conduct and reporting of scoping studies.

Results

Of the 83 invitations, 54 individuals (65 %) completed the scoping questionnaire, and 48 (58 %) attended the scoping study meeting from Canada, the United Kingdom and United States. Many scoping study strengths were dually identified as challenges including breadth of scope, and iterative process. No consensus on terminology emerged, however key defining features that comprised a working definition of scoping studies included the exploratory mapping of literature in a field; iterative process, inclusion of grey literature; no quality assessment of included studies, and an optional consultation phase. We offer considerations for the conduct and reporting of scoping studies for researchers, clinicians and knowledge users engaging in this methodology.

Conclusions

Lack of consensus on scoping terminology, definition and methodological steps persists. Reasons for this may be attributed to diversity of disciplines adopting this methodology for differing purposes. Further work is needed to establish guidelines on the reporting and methodological quality assessment of scoping studies.
Appendix
Available only for authorised users
Literature
1.
go back to reference Canadian Institutes of Health Research. A guide to knowledge synthesis. Canadian Institutes of Health Research. A guide to knowledge synthesis.
2.
go back to reference Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.CrossRef
3.
go back to reference Tricco AC, Lillie E, Zarin W, O’Brien K, Colquhoun H, Kastner M, Levac D, Ng C, Pearson Sharpe J, Wilson K, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16:15.CrossRefPubMedPubMedCentral Tricco AC, Lillie E, Zarin W, O’Brien K, Colquhoun H, Kastner M, Levac D, Ng C, Pearson Sharpe J, Wilson K, et al. A scoping review on the conduct and reporting of scoping reviews. BMC Med Res Methodol. 2016;16:15.CrossRefPubMedPubMedCentral
4.
go back to reference Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral
5.
go back to reference Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007;2(12), e1350.CrossRefPubMedPubMedCentral Shea BJ, Bouter LM, Peterson J, Boers M, Andersson N, Ortiz Z, Ramsay T, Bai A, Shukla VK, Grimshaw JM. External validation of a measurement tool to assess systematic reviews (AMSTAR). PLoS One. 2007;2(12), e1350.CrossRefPubMedPubMedCentral
6.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7), e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7), e1000097.CrossRefPubMedPubMedCentral
7.
go back to reference Brouwers MC, Kerkvliet K, Spithoff K, on behalf of the AGREE Next Steps Consortium. The AGREE Reporting Checklist: a tool to improve reporting of clinical practice guidelines. BMJ. 2016;352:i1152. doi:10.1136/bmj.i1152. Brouwers MC, Kerkvliet K, Spithoff K, on behalf of the AGREE Next Steps Consortium. The AGREE Reporting Checklist: a tool to improve reporting of clinical practice guidelines. BMJ. 2016;352:i1152. doi:10.​1136/​bmj.​i1152.
9.
go back to reference Daudt HM, van Mossel C, Scott SJ. Enhancing the scoping study methodology: a large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Med Res Methodol. 2013;13:48.CrossRefPubMedPubMedCentral Daudt HM, van Mossel C, Scott SJ. Enhancing the scoping study methodology: a large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Med Res Methodol. 2013;13:48.CrossRefPubMedPubMedCentral
10.
go back to reference Kastner M, Tricco AC, Soobiah C, Lillie E, Perrier L, Horsley T, Welch V, Cogo E, Antony J, Straus SE. What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review. BMC Med Res Methodol. 2012;12:114.CrossRefPubMedPubMedCentral Kastner M, Tricco AC, Soobiah C, Lillie E, Perrier L, Horsley T, Welch V, Cogo E, Antony J, Straus SE. What is the most appropriate knowledge synthesis method to conduct a review? Protocol for a scoping review. BMC Med Res Methodol. 2012;12:114.CrossRefPubMedPubMedCentral
11.
go back to reference Pham MT, Rajic A, Greig JD, Sargeant JM, Papadopoulos A, McEwen SA. A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Research Synthesis Methods. 2014;5(4):371–85.CrossRefPubMedPubMedCentral Pham MT, Rajic A, Greig JD, Sargeant JM, Papadopoulos A, McEwen SA. A scoping review of scoping reviews: advancing the approach and enhancing the consistency. Research Synthesis Methods. 2014;5(4):371–85.CrossRefPubMedPubMedCentral
12.
go back to reference Colquhoun HL, Levac D, O’Brien KK, Straus S, Tricco AC, Perrier L, Kastner M, Moher D. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.CrossRefPubMed Colquhoun HL, Levac D, O’Brien KK, Straus S, Tricco AC, Perrier L, Kastner M, Moher D. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol. 2014;67(12):1291–4.CrossRefPubMed
14.
go back to reference Dillman DA. Mail and internet surveys: the tailored design method. Second Edition. Hoboken: John Wiley & Sons, Inc; 2007. Dillman DA. Mail and internet surveys: the tailored design method. Second Edition. Hoboken: John Wiley & Sons, Inc; 2007.
16.
go back to reference Esyenbach G. Improving the quality of web surveys: the checklist for reporting results of Internet E-surveys (CHERRIES). J Med Internet Res. 2004;6(3), e34.CrossRef Esyenbach G. Improving the quality of web surveys: the checklist for reporting results of Internet E-surveys (CHERRIES). J Med Internet Res. 2004;6(3), e34.CrossRef
17.
go back to reference Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.CrossRefPubMed Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277–88.CrossRefPubMed
18.
go back to reference Davis K, Drey N, Gould D. What are scoping studies? A review of the nursing literature. Int J Nurs Stud 2009;46(10):1386–1400.CrossRefPubMed Davis K, Drey N, Gould D. What are scoping studies? A review of the nursing literature. Int J Nurs Stud 2009;46(10):1386–1400.CrossRefPubMed
19.
go back to reference Armstrong R, Hall BJ, Doyle J, Waters E. Cochrane Update. 'Scoping the scope' of a cochrane review. J Public Health (Oxf) 2011;33(1):147–150. Armstrong R, Hall BJ, Doyle J, Waters E. Cochrane Update. 'Scoping the scope' of a cochrane review. J Public Health (Oxf) 2011;33(1):147–150.
20.
go back to reference Anderson S, Allen P, Peckham S, Goodwin N. Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Res Policy Syst 2008;6:7.CrossRefPubMedPubMedCentral Anderson S, Allen P, Peckham S, Goodwin N. Asking the right questions: scoping studies in the commissioning of research on the organisation and delivery of health services. Health Res Policy Syst 2008;6:7.CrossRefPubMedPubMedCentral
21.
go back to reference Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci 2010;5:91.PubMed Wilson PM, Petticrew M, Calnan MW, Nazareth I. Disseminating research findings: what should researchers do? A systematic scoping review of conceptual frameworks. Implement Sci 2010;5:91.PubMed
23.
go back to reference Bragge P, Clavisi O, Turner T, Tavender E, Collie A, Gruen RL. The Global Evidence Mapping Initiative: scoping research in broad topic areas. BMC medical research methodology 2011;11:92.CrossRefPubMedPubMedCentral Bragge P, Clavisi O, Turner T, Tavender E, Collie A, Gruen RL. The Global Evidence Mapping Initiative: scoping research in broad topic areas. BMC medical research methodology 2011;11:92.CrossRefPubMedPubMedCentral
24.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.CrossRefPubMed Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol. 2009;62(10):1006–12.CrossRefPubMed
26.
go back to reference Chambers LA, Wilson MG, Rueda S, Gogolishvili D, Shi MQ, Rourke SB, Positive Aging Review T. Evidence informing the intersection of HIV, aging and health: a scoping review. AIDS Behav. 2014;18(4):661–75.CrossRefPubMed Chambers LA, Wilson MG, Rueda S, Gogolishvili D, Shi MQ, Rourke SB, Positive Aging Review T. Evidence informing the intersection of HIV, aging and health: a scoping review. AIDS Behav. 2014;18(4):661–75.CrossRefPubMed
27.
go back to reference Gough D, Oliver S, Thomas J. An introduction to systematic reviews, 2nd edn. Croydon: Sage Publications; CPI Group (UK) Ltd; 2016. Gough D, Oliver S, Thomas J. An introduction to systematic reviews, 2nd edn. Croydon: Sage Publications; CPI Group (UK) Ltd; 2016.
29.
go back to reference Peters MDJ, Godfrey CM, Khalil H, McInerney P, Parker D, Baldini Soares C. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–6.CrossRefPubMed Peters MDJ, Godfrey CM, Khalil H, McInerney P, Parker D, Baldini Soares C. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–6.CrossRefPubMed
Metadata
Title
Advancing scoping study methodology: a web-based survey and consultation of perceptions on terminology, definition and methodological steps
Authors
Kelly K. O’Brien
Heather Colquhoun
Danielle Levac
Larry Baxter
Andrea C. Tricco
Sharon Straus
Lisa Wickerson
Ayesha Nayar
David Moher
Lisa O’Malley
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2016
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-016-1579-z

Other articles of this Issue 1/2016

BMC Health Services Research 1/2016 Go to the issue