Skip to main content
Top
Published in: Systematic Reviews 1/2021

Open Access 01-12-2021 | Research

Paper 3: Selecting rapid review methods for complex questions related to health policy and system issues

Authors: Michael G. Wilson, Sandy Oliver, G. J. Melendez-Torres, John N. Lavis, Kerry Waddell, Kelly Dickson

Published in: Systematic Reviews | Issue 1/2021

Login to get access

Abstract

Approaches for rapid reviews that focus on streamlining systematic review methods are not always suitable for exploring complex policy questions, as developing and testing theories to explain these complexities requires configuring diverse qualitative, quantitative, and mixed methods studies. Our objective was therefore to provide a guide to selecting approaches for rapidly (i.e., within days to months) addressing complex questions related to health policy and system issues.
We provide a two-stage, transdisciplinary collaborative process to select a rapid review approach to address complex policy questions, which consists of scoping the breadth and depth of the literature and then selecting an optimal approach to synthesis. The first stage (scoping the literature) begins with a discussion with the stakeholders requesting evidence to identify and refine the question for the review, which is then used to conduct preliminary searches and conceptually map the documents identified. In the second stage (selection of an optimal approach), further stakeholder consultation is required to refine and tailor the question and approach to identifying relevant documents to include. The approach to synthesizing the included documents is then guided by the final question, the breadth and depth of the literature, and the time available and can include a static or evolving conceptual framework to code and analyze a range of evidence. For areas already covered extensively by existing systematic reviews, the focus can be on summarizing and integrating the review findings, resynthesizing the primary studies, or updating the search and reanalyzing one or more of the systematic reviews.
The choice of approaches for conducting rapid reviews is intertwined with decisions about how to manage projects, the amount of work to be done, and the knowledge already available, and our guide offers support to help make these strategic decisions.
Appendix
Available only for authorised users
Literature
1.
go back to reference Camillieri M, Gogolishvili D, Giliauskas D, Globerman J, Wilson M: Evaluation of an HIV-specific rapid response service for community-based organizations in Ontario, Canada. Health Res Policy Syst. 2019;17:80. Camillieri M, Gogolishvili D, Giliauskas D, Globerman J, Wilson M: Evaluation of an HIV-specific rapid response service for community-based organizations in Ontario, Canada. Health Res Policy Syst. 2019;17:80.
3.
go back to reference Mansilla C, Herrera C, Basagoitia A, Pantoja T. The Evidence-Informed Policy Network (EVIPNet) in Chile: lessons learned from a year of coordinated efforts. Rev Panam Salud Publica. 2018;41:36. Mansilla C, Herrera C, Basagoitia A, Pantoja T. The Evidence-Informed Policy Network (EVIPNet) in Chile: lessons learned from a year of coordinated efforts. Rev Panam Salud Publica. 2018;41:36.
4.
go back to reference Mijumbi RM, Oxman AD, Panisset U, Sewankambo NK. Feasibility of a rapid response mechanism to meet policymakers’ urgent needs for research evidence about health systems in a low income country: a case study. Implement Sci. 2014;9:114.CrossRef Mijumbi RM, Oxman AD, Panisset U, Sewankambo NK. Feasibility of a rapid response mechanism to meet policymakers’ urgent needs for research evidence about health systems in a low income country: a case study. Implement Sci. 2014;9:114.CrossRef
5.
go back to reference Mijumbi-Deve R, Rosenbaum SE, Oxman AD, Lavis JN, Sewankambo NK. Policymaker experiences with rapid response briefs to address health-system and technology questions in Uganda. Health Res Policy Syst. 2017;15:37.CrossRef Mijumbi-Deve R, Rosenbaum SE, Oxman AD, Lavis JN, Sewankambo NK. Policymaker experiences with rapid response briefs to address health-system and technology questions in Uganda. Health Res Policy Syst. 2017;15:37.CrossRef
6.
go back to reference Mijumbi-Deve R, Sewankambo NK. A process evaluation to assess contextual factors associated with the uptake of a rapid response service to support health systems’ decision-making in Uganda. Int J Health Policy Manag. 2017;6:561–71.CrossRef Mijumbi-Deve R, Sewankambo NK. A process evaluation to assess contextual factors associated with the uptake of a rapid response service to support health systems’ decision-making in Uganda. Int J Health Policy Manag. 2017;6:561–71.CrossRef
7.
go back to reference Polisena J, Garritty C, Kamel C, Stevens A, Abou-Setta AM. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4:26.CrossRef Polisena J, Garritty C, Kamel C, Stevens A, Abou-Setta AM. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4:26.CrossRef
8.
go back to reference Wilson MG, Lavis JN, Gauvin F-P. Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue. Syst Rev. 2015;4:25.CrossRef Wilson MG, Lavis JN, Gauvin F-P. Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue. Syst Rev. 2015;4:25.CrossRef
9.
go back to reference Abou-Setta AM, Jeyaraman M, Attia A, Al-Inany HG, Ferri M, Ansari MT, et al. Methods for developing evidence reviews in short periods of time: a scoping review. PLoS One. 2016;11:e0165903.CrossRef Abou-Setta AM, Jeyaraman M, Attia A, Al-Inany HG, Ferri M, Ansari MT, et al. Methods for developing evidence reviews in short periods of time: a scoping review. PLoS One. 2016;11:e0165903.CrossRef
10.
go back to reference Haby MM, Chapman E, Clark R, Barreto J, Reveiz L, Lavis JN. What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review. Health Res Policy Syst. 2016;14:83.CrossRef Haby MM, Chapman E, Clark R, Barreto J, Reveiz L, Lavis JN. What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review. Health Res Policy Syst. 2016;14:83.CrossRef
11.
go back to reference Oliver S, Wilson M, Melendez-Torres G, Bangpan M, Dickson K, Vigurs C: How can we select review methods for complex questions related to health policy and system improvements? . In Rapid reviews to strengthen health policy and systems: a practical guide. Edited by Tricco A, Langlois E, Straus S. Geneva, Switzerland: World Health Organization, Alliance for Health Policy and Systems Research; 2017: 55-67 Oliver S, Wilson M, Melendez-Torres G, Bangpan M, Dickson K, Vigurs C: How can we select review methods for complex questions related to health policy and system improvements? . In Rapid reviews to strengthen health policy and systems: a practical guide. Edited by Tricco A, Langlois E, Straus S. Geneva, Switzerland: World Health Organization, Alliance for Health Policy and Systems Research; 2017: 55-67
12.
go back to reference Anderson LM. Invetigating complexity in systematic review of interventions by using a spectrum of methods. J Clin Epidemiol. 2013;66:1223–9.CrossRef Anderson LM. Invetigating complexity in systematic review of interventions by using a spectrum of methods. J Clin Epidemiol. 2013;66:1223–9.CrossRef
13.
go back to reference Lavis J, Wilson M, Oxman A, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 4: using research evidence to clarify a problem. Health Res Policy Syst. 2009;7(Suppl 1):S4. Lavis J, Wilson M, Oxman A, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 4: using research evidence to clarify a problem. Health Res Policy Syst. 2009;7(Suppl 1):S4.
14.
go back to reference Lavis J, Wilson M, Oxman A, Grimshaw J, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 5: using research evidence to frame options to address a problem. Health Res Policy Syst. 2009;7(Suppl 1):S5. Lavis J, Wilson M, Oxman A, Grimshaw J, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 5: using research evidence to frame options to address a problem. Health Res Policy Syst. 2009;7(Suppl 1):S5.
16.
go back to reference Tricco AC, Langlois EV, Straus SE. Rapid reviews to strengthen health policy and systems: a practical guide. Geneva: World Health Organization; 2017. Tricco AC, Langlois EV, Straus SE. Rapid reviews to strengthen health policy and systems: a practical guide. Geneva: World Health Organization; 2017.
17.
go back to reference Brockis E, Marsden G, Cole A, Devlin N. A review of NICE Methods across health technology assessment programmes: differences, justifications and implications. London; 2016. Brockis E, Marsden G, Cole A, Devlin N. A review of NICE Methods across health technology assessment programmes: differences, justifications and implications. London; 2016.
18.
go back to reference Oliver S, Bangpan M, Dickson K. Producing policy relevant systematic reviews: navigating the policy-research interface. Evid Policy. 2018;14:197–220.CrossRef Oliver S, Bangpan M, Dickson K. Producing policy relevant systematic reviews: navigating the policy-research interface. Evid Policy. 2018;14:197–220.CrossRef
19.
go back to reference Wilson M: Rapid synthesis: Identifying the effects of home care on improving health outcomes, client satisfaction and health system sustainability. Hamilton; 2018. Wilson M: Rapid synthesis: Identifying the effects of home care on improving health outcomes, client satisfaction and health system sustainability. Hamilton; 2018.
21.
go back to reference Wilson M, Mattison C, Waddell K: Rapid synthesis: identifying performance measures, indicators and targets to monitor and evaluate dementia strategies. Hamilton; 2018. Wilson M, Mattison C, Waddell K: Rapid synthesis: identifying performance measures, indicators and targets to monitor and evaluate dementia strategies. Hamilton; 2018.
22.
go back to reference Sax Institute: Evidence check: informing policy and programs with evidence from research. Sydney: Sax Institute; 2019. Sax Institute: Evidence check: informing policy and programs with evidence from research. Sydney: Sax Institute; 2019.
23.
go back to reference Cardoso R, Zarin W, Nincic V, Barber SL, Gulmezoglu AM, Wilson C, et al. Evaluative reports on medical malpractice policies in obstetrics: a rapid scoping review. Syst Rev. 2017;6:181.CrossRef Cardoso R, Zarin W, Nincic V, Barber SL, Gulmezoglu AM, Wilson C, et al. Evaluative reports on medical malpractice policies in obstetrics: a rapid scoping review. Syst Rev. 2017;6:181.CrossRef
24.
go back to reference Waddell K, Scallan E, Wilson M: Rapid synthesis: understanding the use of and compensation for virtual-care services in primary care. Hamilton; 2018. Waddell K, Scallan E, Wilson M: Rapid synthesis: understanding the use of and compensation for virtual-care services in primary care. Hamilton; 2018.
25.
go back to reference Lavis JN, Gauvin F-P, Mattison C, Moat KA, Waddell K, Wilson MG, et al: Rapid synthesis: creating rapidlearning health systems in Canada. Hamilton; 2018. Lavis JN, Gauvin F-P, Mattison C, Moat KA, Waddell K, Wilson MG, et al: Rapid synthesis: creating rapidlearning health systems in Canada. Hamilton; 2018.
26.
go back to reference Langer L, Erasmus Y, Tannous N, Obuku E, Ravat Z, Chisoro C, et al. Women in wage labour: a systematic review of effects. England: Summary report London; 2018. Langer L, Erasmus Y, Tannous N, Obuku E, Ravat Z, Chisoro C, et al. Women in wage labour: a systematic review of effects. England: Summary report London; 2018.
27.
go back to reference Peters HE, Irvin-Erickson Y, Adelstein S, Malik A, Derrick-Mills T, Valido AED: Qualitative evidence on barriers to and facilitators of women’s participation in higher or growing productivity and male-dominated labour market sectors in low- and middle-income countries. London, England; 2019. Peters HE, Irvin-Erickson Y, Adelstein S, Malik A, Derrick-Mills T, Valido AED: Qualitative evidence on barriers to and facilitators of women’s participation in higher or growing productivity and male-dominated labour market sectors in low- and middle-income countries. London, England; 2019.
28.
go back to reference Dias T: From global to local: Discussing transferability and evidence informed policy for women’s economic empowerment in Brazil. UCL Institute of Education, 2019. Dias T: From global to local: Discussing transferability and evidence informed policy for women’s economic empowerment in Brazil. UCL Institute of Education, 2019.
29.
go back to reference Wilson M: Rapid Response Program: Summary of Service Timelines. Hamilton: McMaster Health Forum; 2018. Wilson M: Rapid Response Program: Summary of Service Timelines. Hamilton: McMaster Health Forum; 2018.
Metadata
Title
Paper 3: Selecting rapid review methods for complex questions related to health policy and system issues
Authors
Michael G. Wilson
Sandy Oliver
G. J. Melendez-Torres
John N. Lavis
Kerry Waddell
Kelly Dickson
Publication date
01-12-2021
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2021
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-021-01834-y

Other articles of this Issue 1/2021

Systematic Reviews 1/2021 Go to the issue