Skip to main content
Top
Published in: Systematic Reviews 1/2016

Open Access 01-12-2016 | Research

User survey finds rapid evidence reviews increased uptake of evidence by Veterans Health Administration leadership to inform fast-paced health-system decision-making

Authors: Kim Peterson, Nicole Floyd, Lauren Ferguson, Vivian Christensen, Mark Helfand

Published in: Systematic Reviews | Issue 1/2016

Login to get access

Abstract

Background

To provide evidence synthesis for faster-paced healthcare decision-making, rapid reviews have emerged as a streamlined alternative to standard systematic reviews. In 2012, the Veterans Affairs Evidence-based Synthesis Program (VA ESP) added rapid reviews to support Veterans Health Administration (VHA) operational partners’ more urgent decision-making needs. VHA operational partners play a substantial role in dissemination of ESP rapid reviews through a variety of routes, including posting on the VA ESP’s public website (http://​www.​hsrd.​research.​va.​gov/​publications/​esp/​). As demand for rapid reviews rises, much progress has been made in characterizing methods and practices. However, evidence synthesis organizations still seek to better understand how and when rapid reviews are being used.

Methods

The VA ESP administered an online survey to rapid review operational partners. The survey assessed the nature of decision-making needs, overall perception of review content, resulting actions, and implementation timeframe. We use descriptive statistics and narrative methods to summarize findings.

Results

Between October 2011 and April 2015, we completed 12 rapid reviews for 35 operational partners. Operational partners were primarily non-academic subject matter experts with VA operations’ decision-making authority. The most common topic categories reviewed were policy or system (50 %) or process of care (42 %) initiatives. Median report completion time was 14.5 weeks. Survey response rate was 46 %, with at least one operational partner responding for 92 % of reports. Reviews served multiple purposes including policy directive or regulation (72 %), supporting program development and evaluation (55 %), identifying future research needs (45 %), and determining implementation strategy (45 %). Overall, operational partners’ perception of report content was positive. A majority of rapid reviews were used immediately and informed actions ranking high on the Institute of Medicine’s Degrees of Impact framework: 45.4 % effected change, 18.2 % inspired action, 18.2 % informed the field, 9.1 % received recognition, and 9.1 % spread a message.

Conclusions

VA ESP rapid reviews have increased the VHA’s uptake of evidence to inform time-sensitive system-level decision-making. Key areas of interest for future evaluation include assessing user perception of our streamlined methods and the quality of our efforts to inform users of these methods, as well as comparing the usability and impact of our rapid and standard systematic reviews.
Appendix
Available only for authorised users
Literature
1.
go back to reference Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30(1):20–7.CrossRefPubMed Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care. 2014;30(1):20–7.CrossRefPubMed
4.
go back to reference Hartling LGJ, Kato E, Anderson J, Aronson N, Belinson S, Berliner E, Dryden D, Featherstone R, Foisy M, Mitchell M, Motu’apuaka M, Noorani H, Paynter R, Robinson K, Schoelles K, Umscheid C, Whitlock E. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015. doi:10.1016/j.jclinepi.2015.05.036. Hartling LGJ, Kato E, Anderson J, Aronson N, Belinson S, Berliner E, Dryden D, Featherstone R, Foisy M, Mitchell M, Motu’apuaka M, Noorani H, Paynter R, Robinson K, Schoelles K, Umscheid C, Whitlock E. A taxonomy of rapid reviews links report types and methods to specific decision-making contexts. J Clin Epidemiol. 2015. doi:10.​1016/​j.​jclinepi.​2015.​05.​036.
7.
go back to reference Hartling LGJ, Kato E, Anderson J, Aronson N, Belinson S, Berliner E, Dryden D, Featherstone R, Foisy M, Mitchell M, Motu’apuaka M, Noorani H, Paynter R, Robinson K, Schoelles K, Umscheild C, Whitlock E. EPC methods: an exploration of methods and context for the production of rapid reviews. Portland: Agency for Healthcare Research and Quality, Center SR; 2015. Hartling LGJ, Kato E, Anderson J, Aronson N, Belinson S, Berliner E, Dryden D, Featherstone R, Foisy M, Mitchell M, Motu’apuaka M, Noorani H, Paynter R, Robinson K, Schoelles K, Umscheild C, Whitlock E. EPC methods: an exploration of methods and context for the production of rapid reviews. Portland: Agency for Healthcare Research and Quality, Center SR; 2015.
8.
go back to reference Jayakumar KL, Lavenberg JA, Mitchell MD, Doshi JA, Leas B, Goldmann DR, et al. Evidence synthesis activities of a hospital evidence-based practice center and impact on hospital decision making. J Hosp Med. 2016;11(3):185–92.CrossRefPubMed Jayakumar KL, Lavenberg JA, Mitchell MD, Doshi JA, Leas B, Goldmann DR, et al. Evidence synthesis activities of a hospital evidence-based practice center and impact on hospital decision making. J Hosp Med. 2016;11(3):185–92.CrossRefPubMed
10.
go back to reference Perrier L, Persaud N, Thorpe KE, Straus SE. Using a systematic review in clinical decision making: a pilot parallel randomized controlled trial. Implement Sci. 2015;10(118):1–8. doi:10.1186/s13012-015-0303-4. Perrier L, Persaud N, Thorpe KE, Straus SE. Using a systematic review in clinical decision making: a pilot parallel randomized controlled trial. Implement Sci. 2015;10(118):1–8. doi:10.​1186/​s13012-015-0303-4.
11.
go back to reference Polisena J, Garritty C, Umscheid CA, Kamel C, Smith J, Samra K, et al. Rapid review summit: an overview and initiation of a research agenda. Syst Rev. 2015;4(111):1–6. doi:10.1186/s13643-015-0111-6. Polisena J, Garritty C, Umscheid CA, Kamel C, Smith J, Samra K, et al. Rapid review summit: an overview and initiation of a research agenda. Syst Rev. 2015;4(111):1–6. doi:10.​1186/​s13643-015-0111-6.
12.
go back to reference Hartling L, Guise J-M, Hempel S, Featherstone R, Mitchell MD, Motu’apuaka ML, et al. EPC methods: AHRQ end-user perspectives of rapid reviews: agency for healthcare research and quality. 2016. Hartling L, Guise J-M, Hempel S, Featherstone R, Mitchell MD, Motu’apuaka ML, et al. EPC methods: AHRQ end-user perspectives of rapid reviews: agency for healthcare research and quality. 2016.
13.
go back to reference Hailey D. A preliminary survey on the influence of rapid health technology assessments. Int J Technol Assess Health Care. 2009;25(3):415–8.CrossRefPubMed Hailey D. A preliminary survey on the influence of rapid health technology assessments. Int J Technol Assess Health Care. 2009;25(3):415–8.CrossRefPubMed
14.
go back to reference Hailey D, Corabian P, Harstall C, Schneider W. The use of impact of rapid health technology assessment. Int J Technol Assess Health Care. 2000;16(2):651–6.CrossRefPubMed Hailey D, Corabian P, Harstall C, Schneider W. The use of impact of rapid health technology assessment. Int J Technol Assess Health Care. 2000;16(2):651–6.CrossRefPubMed
15.
go back to reference McGregor M, Brophy JM. End-user involvement in health technology assessment (HTA) development: a way to increase impact. Int J Technol Assess Health Care. 2005;21(2):263–7.PubMed McGregor M, Brophy JM. End-user involvement in health technology assessment (HTA) development: a way to increase impact. Int J Technol Assess Health Care. 2005;21(2):263–7.PubMed
17.
go back to reference Mohr D, Cohen A, Chan J, Marsella S, Charns M. Evaluation of the HSR&D evidence-based synthesis program: HSR&D center for organization, leadership, and management research (COLMR). 2012. Mohr D, Cohen A, Chan J, Marsella S, Charns M. Evaluation of the HSR&D evidence-based synthesis program: HSR&D center for organization, leadership, and management research (COLMR). 2012.
24.
go back to reference Asch DA, Jedrziewski MK, Christakis N. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50(10):1129–36.CrossRefPubMed Asch DA, Jedrziewski MK, Christakis N. Response rates to mail surveys published in medical journals. J Clin Epidemiol. 1997;50(10):1129–36.CrossRefPubMed
Metadata
Title
User survey finds rapid evidence reviews increased uptake of evidence by Veterans Health Administration leadership to inform fast-paced health-system decision-making
Authors
Kim Peterson
Nicole Floyd
Lauren Ferguson
Vivian Christensen
Mark Helfand
Publication date
01-12-2016
Publisher
BioMed Central
Published in
Systematic Reviews / Issue 1/2016
Electronic ISSN: 2046-4053
DOI
https://doi.org/10.1186/s13643-016-0306-5

Other articles of this Issue 1/2016

Systematic Reviews 1/2016 Go to the issue