Skip to main content
Top
Published in: Health Research Policy and Systems 1/2015

Open Access 01-12-2016 | Review

What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review

Authors: Michelle M. Haby, Evelina Chapman, Rachel Clark, Jorge Barreto, Ludovic Reveiz, John N. Lavis

Published in: Health Research Policy and Systems | Issue 1/2015

Login to get access

Abstract

Background

Rapid reviews have the potential to overcome a key barrier to the use of research evidence in decision making, namely that of the lack of timely and relevant research. This rapid review of systematic reviews and primary studies sought to answer the question: What are the best methodologies to enable a rapid review of research evidence for evidence-informed decision making in health policy and practice?

Methods

This rapid review utilised systematic review methods and was conducted according to a pre-defined protocol including clear inclusion criteria (PROSPERO registration: CRD42015015998). A comprehensive search strategy was used, including published and grey literature, written in English, French, Portuguese or Spanish, from 2004 onwards. Eleven databases and two websites were searched. Two review authors independently applied the eligibility criteria. Data extraction was done by one reviewer and checked by a second. The methodological quality of included studies was assessed independently by two reviewers. A narrative summary of the results is presented.

Results

Five systematic reviews and one randomised controlled trial (RCT) that investigated methodologies for rapid reviews met the inclusion criteria. None of the systematic reviews were of sufficient quality to allow firm conclusions to be made. Thus, the findings need to be treated with caution. There is no agreed definition of rapid reviews in the literature and no agreed methodology for conducting rapid reviews. While a wide range of ‘shortcuts’ are used to make rapid reviews faster than a full systematic review, the included studies found little empirical evidence of their impact on the conclusions of either rapid or systematic reviews. There is some evidence from the included RCT (that had a low risk of bias) that rapid reviews may improve clarity and accessibility of research evidence for decision makers.

Conclusions

Greater care needs to be taken in improving the transparency of the methods used in rapid review products. There is no evidence available to suggest that rapid reviews should not be done or that they are misleading in any way. We offer an improved definition of rapid reviews to guide future research as well as clearer guidance for policy and practice.
Appendix
Available only for authorised users
Literature
2.
go back to reference World Health Organization. Bridging the “Know–Do” Gap: Meeting on Knowledge Translation in Global Health, 10–12 October 2005. 2006 Contract No. WHO/EIP/KMS/2006.2. Geneva: WHO; 2006. World Health Organization. Bridging the “Know–Do” Gap: Meeting on Knowledge Translation in Global Health, 10–12 October 2005. 2006 Contract No. WHO/EIP/KMS/2006.2. Geneva: WHO; 2006.
3.
go back to reference Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005;10 Suppl 1:35–48.CrossRefPubMed Lavis J, Davies H, Oxman A, Denis JL, Golden-Biddle K, Ferlie E. Towards systematic reviews that inform health care management and policy-making. J Health Serv Res Policy. 2005;10 Suppl 1:35–48.CrossRefPubMed
4.
go back to reference Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS ONE. 2013;8:e77404.CrossRefPubMedPubMedCentral Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS ONE. 2013;8:e77404.CrossRefPubMedPubMedCentral
5.
go back to reference Moore G, Redman S, Haines A, Todd A. What works to increase the use of research in population health policy and programmes: a review. Evid Policy A J Res Debate Pract. 2011;7:277–305.CrossRef Moore G, Redman S, Haines A, Todd A. What works to increase the use of research in population health policy and programmes: a review. Evid Policy A J Res Debate Pract. 2011;7:277–305.CrossRef
7.
go back to reference Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2.CrossRefPubMedPubMedCentral Oliver K, Innvar S, Lorenc T, Woodman J, Thomas J. A systematic review of barriers to and facilitators of the use of evidence by policymakers. BMC Health Serv Res. 2014;14:2.CrossRefPubMedPubMedCentral
8.
go back to reference Orton L, Lloyd-Williams F, Taylor-Robinson D, O'Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS ONE. 2011;6:e21704.CrossRefPubMedPubMedCentral Orton L, Lloyd-Williams F, Taylor-Robinson D, O'Flaherty M, Capewell S. The use of research evidence in public health decision making processes: systematic review. PLoS ONE. 2011;6:e21704.CrossRefPubMedPubMedCentral
9.
go back to reference World Health Organization. Knowledge Translation Framework for Ageing and Health. Geneva: Department of Ageing and Life-Course, WHO; 2012. World Health Organization. Knowledge Translation Framework for Ageing and Health. Geneva: Department of Ageing and Life-Course, WHO; 2012.
10.
go back to reference Lavis JN, Hammill AC, Gildiner A, McDonagh RJ, Wilson MG, Ross SE, et al. A systematic review of the factors that influence the use of research evidence by public policymakers. Final report submitted to the Canadian Population Health Initiative. Hamilton: McMaster University Program in Policy Decision-Making; 2005. Lavis JN, Hammill AC, Gildiner A, McDonagh RJ, Wilson MG, Ross SE, et al. A systematic review of the factors that influence the use of research evidence by public policymakers. Final report submitted to the Canadian Population Health Initiative. Hamilton: McMaster University Program in Policy Decision-Making; 2005.
11.
go back to reference Chalmers I. If evidence-informed policy works in practice, does it matter if it doesn't work in theory? Evid Policy A J Res Debate Pract. 2005;1:227–42.CrossRef Chalmers I. If evidence-informed policy works in practice, does it matter if it doesn't work in theory? Evid Policy A J Res Debate Pract. 2005;1:227–42.CrossRef
12.
go back to reference Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Pol Syst. 2009;7 Suppl 1:S13.CrossRef Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Pol Syst. 2009;7 Suppl 1:S13.CrossRef
13.
go back to reference Stephens JM, Handke B, Doshi JA, On behalf of the HTA Principles Working Group - part of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) HTA Special Interest Group (SIG). International survey of methods used in health technology assessment (HTA): does practice meet the principles proposed for good research? Comp Effectivness Res. 2012;2:29–44.CrossRef Stephens JM, Handke B, Doshi JA, On behalf of the HTA Principles Working Group - part of the International Society for Pharmacoeconomics and Outcomes Research (ISPOR) HTA Special Interest Group (SIG). International survey of methods used in health technology assessment (HTA): does practice meet the principles proposed for good research? Comp Effectivness Res. 2012;2:29–44.CrossRef
14.
go back to reference World Health Organization. WHO Handbook for Guideline Development. 2nd ed. Geneva: WHO; 2014. World Health Organization. WHO Handbook for Guideline Development. 2nd ed. Geneva: WHO; 2014.
16.
go back to reference Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: An emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30:20–7.CrossRefPubMed Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: An emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30:20–7.CrossRefPubMed
17.
go back to reference Polisena J, Garrity C, Kamel C, Stevens A, Abou-Setta AM. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4:26.CrossRefPubMedPubMedCentral Polisena J, Garrity C, Kamel C, Stevens A, Abou-Setta AM. Rapid review programs to support health care and policy decision making: a descriptive analysis of processes and methods. Syst Rev. 2015;4:26.CrossRefPubMedPubMedCentral
19.
go back to reference Abrami PC, Borokhovski E, Bernard RM, Wade CA, Tamim R, Persson T, et al. Issues in conducting and disseminating brief reviews of evidence. Evid Policy A J Res Debate Pract. 2010;6:371–89.CrossRef Abrami PC, Borokhovski E, Bernard RM, Wade CA, Tamim R, Persson T, et al. Issues in conducting and disseminating brief reviews of evidence. Evid Policy A J Res Debate Pract. 2010;6:371–89.CrossRef
21.
go back to reference Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid Based Healthc. 2012;10:397–410.CrossRefPubMed Harker J, Kleijnen J. What is a rapid review? A methodological exploration of rapid reviews in Health Technology Assessments. Int J Evid Based Healthc. 2012;10:397–410.CrossRefPubMed
22.
go back to reference Wilson MG, Lavis JN, Gauvin FP. Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue. Syst Rev. 2015;4:25.CrossRefPubMedPubMedCentral Wilson MG, Lavis JN, Gauvin FP. Developing a rapid-response program for health system decision-makers in Canada: findings from an issue brief and stakeholder dialogue. Syst Rev. 2015;4:25.CrossRefPubMedPubMedCentral
24.
go back to reference Haby MM, Chapman E, Clark R, Barreto J, Reveiz L, Lavis JN. Designing a rapid response program to support evidence-informed decision making in the Americas Region: using the best available evidence and case studies. Implement Sci. 2016;11:117.CrossRefPubMedPubMedCentral Haby MM, Chapman E, Clark R, Barreto J, Reveiz L, Lavis JN. Designing a rapid response program to support evidence-informed decision making in the Americas Region: using the best available evidence and case studies. Implement Sci. 2016;11:117.CrossRefPubMedPubMedCentral
25.
go back to reference Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.CrossRefPubMedPubMedCentral Moher D, Liberati A, Tetzlaff J, Altman DG, Group P. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6:e1000097.CrossRefPubMedPubMedCentral
27.
28.
go back to reference Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol. 2007;7:10.CrossRefPubMedPubMedCentral
29.
30.
go back to reference Cameron A, Watt A, Lathlean T, Sturm L. Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. ASERNIP-S Report No. 60. Adelaide: ASERNIP-S, Royal Australasian College of Surgeons; 2007. Cameron A, Watt A, Lathlean T, Sturm L. Rapid versus full systematic reviews: an inventory of current methods and practice in Health Technology Assessment. ASERNIP-S Report No. 60. Adelaide: ASERNIP-S, Royal Australasian College of Surgeons; 2007.
31.
go back to reference Featherstone RM, Dryden DM, Foisy M, Guise JM, Mitchell MD, Paynter RA, et al. Advancing knowledge of rapid reviews: an analysis of results, conclusions and recommendations from published review articles examining rapid reviews. Syst Rev. 2015;4:50.CrossRefPubMedPubMedCentral Featherstone RM, Dryden DM, Foisy M, Guise JM, Mitchell MD, Paynter RA, et al. Advancing knowledge of rapid reviews: an analysis of results, conclusions and recommendations from published review articles examining rapid reviews. Syst Rev. 2015;4:50.CrossRefPubMedPubMedCentral
32.
go back to reference Hartling L, Guise JM, Kato E, Anderson J, Aronson N, Belinson S, et al. EPC Methods: An Exploration of Methods and Context for the Production of Rapid Reviews. Research White Paper. Prepared by the Scientific Resource Center under Contract No. 290-2012-00004-C. AHRQ Publication No. 15-EHC008-EF. Rockville, MD: Agency for Healthcare Research and Quality; 2015. Hartling L, Guise JM, Kato E, Anderson J, Aronson N, Belinson S, et al. EPC Methods: An Exploration of Methods and Context for the Production of Rapid Reviews. Research White Paper. Prepared by the Scientific Resource Center under Contract No. 290-2012-00004-C. AHRQ Publication No. 15-EHC008-EF. Rockville, MD: Agency for Healthcare Research and Quality; 2015.
33.
go back to reference Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. Int J Technol Assess Health Care. 2008;24:133–9.CrossRefPubMed Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. Int J Technol Assess Health Care. 2008;24:133–9.CrossRefPubMed
34.
go back to reference Opiyo N, Shepperd S, Musila N, Allen E, Nyamai R, Fretheim A, et al. Comparison of alternative evidence summary and presentation formats in clinical guideline development: a mixed-method study. PLoS ONE. 2013;8:e55067.CrossRefPubMedPubMedCentral Opiyo N, Shepperd S, Musila N, Allen E, Nyamai R, Fretheim A, et al. Comparison of alternative evidence summary and presentation formats in clinical guideline development: a mixed-method study. PLoS ONE. 2013;8:e55067.CrossRefPubMedPubMedCentral
35.
go back to reference Van de Velde S, De Buck E, Dieltjens T, Aertgeerts B. Medicinal use of potato-derived products: conclusions of a rapid versus full systematic review. Phytother Res. 2011;25:787–8.CrossRefPubMed Van de Velde S, De Buck E, Dieltjens T, Aertgeerts B. Medicinal use of potato-derived products: conclusions of a rapid versus full systematic review. Phytother Res. 2011;25:787–8.CrossRefPubMed
36.
go back to reference Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid versus full systematic reviews: validity in clinical practice? Aust N Z J Surg. 2008;78:1037–40.CrossRef Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid versus full systematic reviews: validity in clinical practice? Aust N Z J Surg. 2008;78:1037–40.CrossRef
37.
go back to reference Tricco AC, Zarin W, Antony J, Hutton B, Moher D, Sherifali D, et al. An international survey and modified Delphi approach revealed numerous rapid review methods. J Clin Epidemiol. 2015;70:61–7.CrossRefPubMed Tricco AC, Zarin W, Antony J, Hutton B, Moher D, Sherifali D, et al. An international survey and modified Delphi approach revealed numerous rapid review methods. J Clin Epidemiol. 2015;70:61–7.CrossRefPubMed
38.
go back to reference Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62:1013–20.CrossRefPubMed Shea BJ, Hamel C, Wells GA, Bouter LM, Kristjansson E, Grimshaw J, et al. AMSTAR is a reliable and valid measurement tool to assess the methodological quality of systematic reviews. J Clin Epidemiol. 2009;62:1013–20.CrossRefPubMed
39.
go back to reference Song F, Parekh S, Hooper L, Loke YK, Ryder J. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):iii. ix–xi, 1–193.CrossRefPubMed Song F, Parekh S, Hooper L, Loke YK, Ryder J. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. 2010;14(8):iii. ix–xi, 1–193.CrossRefPubMed
Metadata
Title
What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review
Authors
Michelle M. Haby
Evelina Chapman
Rachel Clark
Jorge Barreto
Ludovic Reveiz
John N. Lavis
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Health Research Policy and Systems / Issue 1/2015
Electronic ISSN: 1478-4505
DOI
https://doi.org/10.1186/s12961-016-0155-7

Other articles of this Issue 1/2015

Health Research Policy and Systems 1/2015 Go to the issue