Skip to main content
Top
Published in: BMC Medical Research Methodology 1/2021

Open Access 01-12-2021 | Public Health | Research

Methods to support evidence-informed decision-making in the midst of COVID-19: creation and evolution of a rapid review service from the National Collaborating Centre for Methods and Tools

Authors: Sarah E. Neil-Sztramko, Emily Belita, Robyn L. Traynor, Emily Clark, Leah Hagerman, Maureen Dobbins

Published in: BMC Medical Research Methodology | Issue 1/2021

Login to get access

Abstract

Background

The COVID-19 public health crisis has produced an immense and quickly evolving body of evidence. This research speed and volume, along with variability in quality, could overwhelm public health decision-makers striving to make timely decisions based on the best available evidence. In response to this challenge, the National Collaborating Centre for Methods and Tools developed a Rapid Evidence Service, building on internationally accepted rapid review methodologies, to address priority COVID-19 public health questions.

Results

Each week, the Rapid Evidence Service team receives requests from public health decision-makers, prioritizes questions received, and frames the prioritized topics into searchable questions. We develop and conduct a comprehensive search strategy and critically appraise all relevant evidence using validated tools. We synthesize the findings into a final report that includes key messages, with a rating of the certainty of the evidence using GRADE, as well as an overview of evidence and remaining knowledge gaps. Rapid reviews are typically completed and disseminated within two weeks. From May 2020 to July 21, 2021, we have answered more than 31 distinct questions and completed 32 updates as new evidence emerged. Reviews receive an average of 213 downloads per week, with some reaching over 7700. To date reviews have been accessed and cited around the world, and a more fulsome evaluation of impact on decision-making is planned.

Conclusions

The development, evolution, and lessons learned from our process, presented here, provides a real-world example of how review-level evidence can be made available – rapidly and rigorously, and in response to decision-makers’ needs – during an unprecedented public health crisis.
Appendix
Available only for authorised users
Literature
1.
go back to reference Bowen S, Erickson T, Martens PJ, Crockett S. More than “using research”: the real challenges in promoting evidence-informed decision-making. Healthc Policy. 2009;4(3):87–102.PubMedPubMedCentral Bowen S, Erickson T, Martens PJ, Crockett S. More than “using research”: the real challenges in promoting evidence-informed decision-making. Healthc Policy. 2009;4(3):87–102.PubMedPubMedCentral
2.
go back to reference Majumder MS, Mandl KD. Early in the epidemic: impact of preprints on global discourse about COVID-19 transmissibility. The Lancet Global Health. 2020;8(5):e627–30.CrossRef Majumder MS, Mandl KD. Early in the epidemic: impact of preprints on global discourse about COVID-19 transmissibility. The Lancet Global Health. 2020;8(5):e627–30.CrossRef
3.
go back to reference Palayew A, Norgaard O, Safreed-Harmon K, Andersen TH, Rasmussen LN, Lazarus JV. Pandemic publishing poses a new COVID-19 challenge. Nature Human Behaviour. 2020;4(7):666–9.CrossRef Palayew A, Norgaard O, Safreed-Harmon K, Andersen TH, Rasmussen LN, Lazarus JV. Pandemic publishing poses a new COVID-19 challenge. Nature Human Behaviour. 2020;4(7):666–9.CrossRef
4.
go back to reference Teixeira da Silva JA, Tsigaris P, Erfanmanesh M: Publishing volumes in major databases related to Covid-19. Scientometrics 2020. Teixeira da Silva JA, Tsigaris P, Erfanmanesh M: Publishing volumes in major databases related to Covid-19. Scientometrics 2020.
5.
go back to reference Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415–23.CrossRef Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017;390(10092):415–23.CrossRef
6.
go back to reference Tricco AC, Tetzlaff J, Moher D. The art and science of knowledge synthesis. J Clin Epidemiol. 2011;64(1):11–20.CrossRef Tricco AC, Tetzlaff J, Moher D. The art and science of knowledge synthesis. J Clin Epidemiol. 2011;64(1):11–20.CrossRef
7.
go back to reference Dicenso A, Bayley L, Haynes RB. Accessing pre-appraised evidence: fine-tuning the 5S model into a 6S model. Evid Based Nurs. 2009;12(4):99–101.CrossRef Dicenso A, Bayley L, Haynes RB. Accessing pre-appraised evidence: fine-tuning the 5S model into a 6S model. Evid Based Nurs. 2009;12(4):99–101.CrossRef
8.
go back to reference Borah R, Brown AW, Capers PL, Kaiser KA. Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open. 2017;7(2):e012545.CrossRef Borah R, Brown AW, Capers PL, Kaiser KA. Analysis of the time and workers needed to conduct systematic reviews of medical interventions using data from the PROSPERO registry. BMJ Open. 2017;7(2):e012545.CrossRef
12.
go back to reference Hamel C, Michaud A, Thuku M, Skidmore B, Stevens A, Nussbaumer-Streit B, Garritty C. Defining rapid reviews: a systematic scoping review and thematic analysis of definitions and defining characteristics of rapid reviews. J Clin Epidemiol. 2020;129:74–85.CrossRef Hamel C, Michaud A, Thuku M, Skidmore B, Stevens A, Nussbaumer-Streit B, Garritty C. Defining rapid reviews: a systematic scoping review and thematic analysis of definitions and defining characteristics of rapid reviews. J Clin Epidemiol. 2020;129:74–85.CrossRef
13.
go back to reference Tricco AC, Zarin W, Antony J, Hutton B, Moher D, Sherifali D, Straus SE. An international survey and modified Delphi approach revealed numerous rapid review methods. J Clin Epidemiol. 2016;70:61–7.CrossRef Tricco AC, Zarin W, Antony J, Hutton B, Moher D, Sherifali D, Straus SE. An international survey and modified Delphi approach revealed numerous rapid review methods. J Clin Epidemiol. 2016;70:61–7.CrossRef
14.
go back to reference Reviews: Rapid! Rapid! Rapid! … and systematic. Systematic Reviews 2015, 4(1):4. Reviews: Rapid! Rapid! Rapid! … and systematic. Systematic Reviews 2015, 4(1):4.
15.
go back to reference Abou-Setta AM, Jeyaraman M, Attia A, Al-Inany HG, Ferri M, Ansari MT, Garritty CM, Bond K, Norris SL. Methods for Developing Evidence Reviews in Short Periods of Time: A Scoping Review. PLoS One. 2016;11(12):e0165903.CrossRef Abou-Setta AM, Jeyaraman M, Attia A, Al-Inany HG, Ferri M, Ansari MT, Garritty CM, Bond K, Norris SL. Methods for Developing Evidence Reviews in Short Periods of Time: A Scoping Review. PLoS One. 2016;11(12):e0165903.CrossRef
16.
go back to reference Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, Perrier L, Hutton B, Moher D, Straus SE. A scoping review of rapid review methods. BMC Med. 2015;13:224.CrossRef Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, Perrier L, Hutton B, Moher D, Straus SE. A scoping review of rapid review methods. BMC Med. 2015;13:224.CrossRef
17.
go back to reference Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, Affengruber L, Stevens A. Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2020;130:13–22.CrossRef Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, Affengruber L, Stevens A. Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2020;130:13–22.CrossRef
18.
go back to reference The Lancet Infectious D. The COVID-19 infodemic. Lancet Infect Dis. 2020;20(8):875.CrossRef The Lancet Infectious D. The COVID-19 infodemic. Lancet Infect Dis. 2020;20(8):875.CrossRef
20.
go back to reference Medlar B, Mowat D, Di Ruggiero E, Frank J. Introducing the National Collaborating Centres for Public Health. CMAJ. 2006;175(5):493–4.CrossRef Medlar B, Mowat D, Di Ruggiero E, Frank J. Introducing the National Collaborating Centres for Public Health. CMAJ. 2006;175(5):493–4.CrossRef
23.
go back to reference Tricco AC, Garritty CM, Boulos L, Lockwood C, Wilson M, McGowan J, McCaul M, Hutton B, Clement F, Mittmann N, et al. Rapid review methods more challenging during COVID-19: commentary with a focus on 8 knowledge synthesis steps. J Clin Epidemiol. 2020;126:177–83.CrossRef Tricco AC, Garritty CM, Boulos L, Lockwood C, Wilson M, McGowan J, McCaul M, Hutton B, Clement F, Mittmann N, et al. Rapid review methods more challenging during COVID-19: commentary with a focus on 8 knowledge synthesis steps. J Clin Epidemiol. 2020;126:177–83.CrossRef
25.
go back to reference Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, Norris S, Falck-Ytter Y, Glasziou P, deBeer H, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.CrossRef Guyatt G, Oxman AD, Akl EA, Kunz R, Vist G, Brozek J, Norris S, Falck-Ytter Y, Glasziou P, deBeer H, et al. GRADE guidelines: 1. Introduction—GRADE evidence profiles and summary of findings tables. J Clin Epidemiol. 2011;64(4):383–94.CrossRef
27.
go back to reference National Collaborating Centre for Methods and Tools: What is the effect of the COVID-19 pandemic on opioid and substance use and related harms? In.; 2020. National Collaborating Centre for Methods and Tools: What is the effect of the COVID-19 pandemic on opioid and substance use and related harms? In.; 2020.
28.
go back to reference Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.CrossRef Ouzzani M, Hammady H, Fedorowicz Z, Elmagarmid A. Rayyan-a web and mobile app for systematic reviews. Syst Rev. 2016;5(1):210.CrossRef
29.
go back to reference Tricco AC, Langlois EV, Straus SE. Rapid reviews to strengthen health policy and systems: a practical guide. In. Geneva: World Health Organization; 2017. Tricco AC, Langlois EV, Straus SE. Rapid reviews to strengthen health policy and systems: a practical guide. In. Geneva: World Health Organization; 2017.
30.
go back to reference Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007, 7(1):10.CrossRef Shea BJ, Grimshaw JM, Wells GA, Boers M, Andersson N, Hamel C, Porter AC, Tugwell P, Moher D, Bouter LM: Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007, 7(1):10.CrossRef
34.
go back to reference Schünemann HJ, Santesso N, Vist GE, Cuello C, Lotfi T, Flottorp S, Davoli M, Mustafa R, Meerpohl JJ, Alonso-Coello P, et al. Using GRADE in situations of emergencies and urgencies: certainty in evidence and recommendations matters during the COVID-19 pandemic, now more than ever and no matter what. J Clin Epidemiol. 2020;127:202–7.CrossRef Schünemann HJ, Santesso N, Vist GE, Cuello C, Lotfi T, Flottorp S, Davoli M, Mustafa R, Meerpohl JJ, Alonso-Coello P, et al. Using GRADE in situations of emergencies and urgencies: certainty in evidence and recommendations matters during the COVID-19 pandemic, now more than ever and no matter what. J Clin Epidemiol. 2020;127:202–7.CrossRef
35.
go back to reference Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009;7(Suppl 1):S13.CrossRef Lavis JN, Permanand G, Oxman AD, Lewin S, Fretheim A. SUPPORT Tools for evidence-informed health Policymaking (STP) 13: Preparing and using policy briefs to support evidence-informed policymaking. Health Res Policy Syst. 2009;7(Suppl 1):S13.CrossRef
36.
go back to reference Wallace J, Byrne C, Clarke M. Making evidence more wanted: a systematic review of facilitators to enhance the uptake of evidence from systematic reviews and meta-analyses. Int J Evid Based Healthc. 2012;10(4):338–46.CrossRef Wallace J, Byrne C, Clarke M. Making evidence more wanted: a systematic review of facilitators to enhance the uptake of evidence from systematic reviews and meta-analyses. Int J Evid Based Healthc. 2012;10(4):338–46.CrossRef
37.
go back to reference Petkovic J, Welch V, Jacob MH, Yoganathan M, Ayala AP, Cunningham H, Tugwell P. The effectiveness of evidence summaries on health policymakers and health system managers use of evidence from systematic reviews: a systematic review. Implement Sci. 2016;11(1):162.CrossRef Petkovic J, Welch V, Jacob MH, Yoganathan M, Ayala AP, Cunningham H, Tugwell P. The effectiveness of evidence summaries on health policymakers and health system managers use of evidence from systematic reviews: a systematic review. Implement Sci. 2016;11(1):162.CrossRef
38.
go back to reference National Collaborating Centre for Methods and Tools, National Collabroating Centre for Indigenous Health: Rapid review: what factors may help protect Indigenous peoples and communities in Canada and internationally from the COVID-19 pandemic and its impacts? In.; 2020. National Collaborating Centre for Methods and Tools, National Collabroating Centre for Indigenous Health: Rapid review: what factors may help protect Indigenous peoples and communities in Canada and internationally from the COVID-19 pandemic and its impacts? In.; 2020.
41.
go back to reference National Collaborating Centre for Methods and Tools: Living Rapid Review Update 12: What is the specific role of daycares and schools in COVID-19 transmission? In.; 2021. National Collaborating Centre for Methods and Tools: Living Rapid Review Update 12: What is the specific role of daycares and schools in COVID-19 transmission? In.; 2021.
42.
go back to reference Science M, Bitnun S, al. e: COVID-19: Guidance for School Operation during the Pandemic. In. Toronto, Canada: SickKids; 2021. Science M, Bitnun S, al. e: COVID-19: Guidance for School Operation during the Pandemic. In. Toronto, Canada: SickKids; 2021.
45.
go back to reference Biesty L, Meskell P, Glenton C, Delaney H, Smalle M, Booth A, Chan XHS, Devane D, Houghton C. A QuESt for speed: rapid qualitative evidence syntheses as a response to the COVID-19 pandemic. Systematic Reviews. 2020;9(1):256.CrossRef Biesty L, Meskell P, Glenton C, Delaney H, Smalle M, Booth A, Chan XHS, Devane D, Houghton C. A QuESt for speed: rapid qualitative evidence syntheses as a response to the COVID-19 pandemic. Systematic Reviews. 2020;9(1):256.CrossRef
46.
go back to reference McQuillan R, Dozier M, Theodoratou E, Nair H, McSwiggan E, Fowkes G, Campbell H: UNCOVER Rapid Review Group - What methodology should we use? In.; 2020. McQuillan R, Dozier M, Theodoratou E, Nair H, McSwiggan E, Fowkes G, Campbell H: UNCOVER Rapid Review Group - What methodology should we use? In.; 2020.
47.
go back to reference Fraser N, Brierley L, Dey G, Polka JK, Pálfy M, Nanni F, Coates JA: Preprinting the COVID-19 pandemic. bioRxiv 2020:2020.2005.2022.111294. Fraser N, Brierley L, Dey G, Polka JK, Pálfy M, Nanni F, Coates JA: Preprinting the COVID-19 pandemic. bioRxiv 2020:2020.2005.2022.111294.
48.
go back to reference Ioannidis JPA: Coronavirus disease 2019: The harms of exaggerated information and non-evidence-based measures. Eur J Clin Invest 2020, 50(4):e13222.CrossRef Ioannidis JPA: Coronavirus disease 2019: The harms of exaggerated information and non-evidence-based measures. Eur J Clin Invest 2020, 50(4):e13222.CrossRef
49.
go back to reference National Collaborating Centre for Methods and Tools: Rapid Review: What is the evidence for COVID-19 transmission in acute care settings? In.; 2020. National Collaborating Centre for Methods and Tools: Rapid Review: What is the evidence for COVID-19 transmission in acute care settings? In.; 2020.
50.
go back to reference Siemieniuk RA, Bartoszko JJ, Ge L, Zeraatkar D, Izcovich A, Kum E, Pardo-Hernandez H, Rochwerg B, Lamontagne F, Han MA et al: Drug treatments for covid-19: living systematic review and network meta-analysis. BMJ 2020, 370:m2980. Siemieniuk RA, Bartoszko JJ, Ge L, Zeraatkar D, Izcovich A, Kum E, Pardo-Hernandez H, Rochwerg B, Lamontagne F, Han MA et al: Drug treatments for covid-19: living systematic review and network meta-analysis. BMJ 2020, 370:m2980.
Metadata
Title
Methods to support evidence-informed decision-making in the midst of COVID-19: creation and evolution of a rapid review service from the National Collaborating Centre for Methods and Tools
Authors
Sarah E. Neil-Sztramko
Emily Belita
Robyn L. Traynor
Emily Clark
Leah Hagerman
Maureen Dobbins
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Medical Research Methodology / Issue 1/2021
Electronic ISSN: 1471-2288
DOI
https://doi.org/10.1186/s12874-021-01436-1

Other articles of this Issue 1/2021

BMC Medical Research Methodology 1/2021 Go to the issue