Skip to main content
Top
Published in: BMC Health Services Research 1/2024

Open Access 01-12-2024 | Stroke | Research

Is it possible to make ‘living’ guidelines? An evaluation of the Australian Living Stroke Guidelines

Authors: Louise Wiles, Peter D Hibbert, Yvonne Zurynski, Carolynn L. Smith, Gaston Arnolda, Louise A. Ellis, Rebecca Lake, Brona Nic Giolla Easpaig, Charlotte Molloy, Sandy Middleton, Jeffrey Braithwaite, Kelvin Hill, Tari Turner

Published in: BMC Health Services Research | Issue 1/2024

Login to get access

Abstract

Background

Keeping best practice guidelines up-to-date with rapidly emerging research evidence is challenging. ‘Living guidelines’ approaches enable continual incorporation of new research, assisting healthcare professionals to apply the latest evidence to their clinical practice. However, information about how living guidelines are developed, maintained and applied is limited. The Stroke Foundation in Australia was one of the first organisations to apply living guideline development methods for their Living Stroke Guidelines (LSGs), presenting a unique opportunity to evaluate the process and impact of this novel approach.

Methods

A mixed-methods study was conducted to understand the experience of LSGs developers and end-users. We used thematic analysis of one-on-one semi-structured interview and online survey data to determine the feasibility, acceptability, and facilitators and barriers of the LSGs. Website analytics data were also reviewed to understand usage.

Results

Overall, the living guidelines approach was both feasible and acceptable to developers and users. Facilitators to use included collaboration with multidisciplinary clinicians and stroke survivors or carers. Increased workload for developers, workload unpredictability, and limited information sharing, and interoperability of technological platforms were identified as barriers. Users indicated increased trust in the LSGs (69%), likelihood of following the LSGs (66%), and frequency of access (58%), compared with previous static versions. Web analytics data showed individual access by 16,517 users in 2016 rising to 53,154 users in 2020, a threefold increase. There was also a fourfold increase in unique LSG pageviews from 2016 to 2020.

Conclusions

This study, the first evaluation of living guidelines, demonstrates that this approach to stroke guideline development is feasible and acceptable, that these approaches may add value to developers and users, and may increase guideline use. Future evaluations should be embedded along with guideline implementation to capture data prospectively.
Appendix
Available only for authorised users
Literature
1.
go back to reference Elliott J, Lawrence R, Minx JC, et al. Decision makers need constantly updated evidence synthesis. Fund and use ‘living’ reviews of the latest data to steer research practice and policy. Nature. 2021;600:383–5.CrossRefPubMed Elliott J, Lawrence R, Minx JC, et al. Decision makers need constantly updated evidence synthesis. Fund and use ‘living’ reviews of the latest data to steer research practice and policy. Nature. 2021;600:383–5.CrossRefPubMed
3.
go back to reference Developing NICE Guidelines: the manual. UK: National Institute for Health and Care Excellence; 2020. Developing NICE Guidelines: the manual. UK: National Institute for Health and Care Excellence; 2020.
4.
go back to reference Baatiema LA-O, Otim ME, Mnatzaganian G, et al. Health professionals’ views on the barriers and enablers to evidence-based practice for acute stroke care: a systematic review. Implement Sci. 2017;12(1):74.CrossRefPubMedPubMedCentral Baatiema LA-O, Otim ME, Mnatzaganian G, et al. Health professionals’ views on the barriers and enablers to evidence-based practice for acute stroke care: a systematic review. Implement Sci. 2017;12(1):74.CrossRefPubMedPubMedCentral
5.
go back to reference Martínez García L, Sanabria AJ, García Alvarez E, et al. The validity of recommendations from clinical guidelines: a survival analysis. CMAJ. 2014;186(16):1211–9.CrossRefPubMed Martínez García L, Sanabria AJ, García Alvarez E, et al. The validity of recommendations from clinical guidelines: a survival analysis. CMAJ. 2014;186(16):1211–9.CrossRefPubMed
7.
go back to reference Cuker A, Tseng EK, Nieuwlaat R, et al. American Society of Hematology living guidelines on the use of anticoagulation for thromboprophylaxis in patients with COVID-19: July 2021 update on postdischarge thromboprophylaxis. Blood Adv. 2022;6(2):664–71.CrossRefPubMedPubMedCentral Cuker A, Tseng EK, Nieuwlaat R, et al. American Society of Hematology living guidelines on the use of anticoagulation for thromboprophylaxis in patients with COVID-19: July 2021 update on postdischarge thromboprophylaxis. Blood Adv. 2022;6(2):664–71.CrossRefPubMedPubMedCentral
8.
go back to reference Eshun-Wilson I, Ford N, Le Tourneau N, et al. A living database of HIV Implementation Research (LIVE project): protocol for rapid living reviews. JMIR Res Protoc. 2022;11(10):e37070.CrossRefPubMedPubMedCentral Eshun-Wilson I, Ford N, Le Tourneau N, et al. A living database of HIV Implementation Research (LIVE project): protocol for rapid living reviews. JMIR Res Protoc. 2022;11(10):e37070.CrossRefPubMedPubMedCentral
9.
go back to reference Hazlewood GS, Pardo JP, Barnabe C, et al. Canadian Rheumatology Association living guidelines for the pharmacological management of rheumatoid arthritis with disease-modifying antirheumatic drugs. J Rheumatol. 2022;49(10):1092–9.CrossRefPubMed Hazlewood GS, Pardo JP, Barnabe C, et al. Canadian Rheumatology Association living guidelines for the pharmacological management of rheumatoid arthritis with disease-modifying antirheumatic drugs. J Rheumatol. 2022;49(10):1092–9.CrossRefPubMed
10.
go back to reference Lithopoulos A, Bayley M, Curran D, et al. Protocol for a living systematic review for the management of concussion in adults. BMJ open. 2022;12(7):e061282.CrossRefPubMedPubMedCentral Lithopoulos A, Bayley M, Curran D, et al. Protocol for a living systematic review for the management of concussion in adults. BMJ open. 2022;12(7):e061282.CrossRefPubMedPubMedCentral
11.
go back to reference Marx N, Ryden L, Brosius F, et al. Towards living guidelines on cardiorenal outcomes in diabetes: a pilot project of the taskforce of the guideline workshop 2020. Diabetes Res Clin Pract. 2021;177:108870.CrossRefPubMed Marx N, Ryden L, Brosius F, et al. Towards living guidelines on cardiorenal outcomes in diabetes: a pilot project of the taskforce of the guideline workshop 2020. Diabetes Res Clin Pract. 2021;177:108870.CrossRefPubMed
12.
13.
14.
go back to reference Vogel JP, Dowswell T, Lewin S, et al. Developing and applying a’living guidelines’ approach to WHO recommendations on maternal and perinatal health. BMJ Glob Health. 2019;4(4):e001683.CrossRefPubMedPubMedCentral Vogel JP, Dowswell T, Lewin S, et al. Developing and applying a’living guidelines’ approach to WHO recommendations on maternal and perinatal health. BMJ Glob Health. 2019;4(4):e001683.CrossRefPubMedPubMedCentral
15.
go back to reference Akl EA, Meerpohl JJ, Elliott J, et al. Living systematic reviews: 4. Living guideline recommendations. J Clin Epidemiol. 2017;91:47–53.CrossRefPubMed Akl EA, Meerpohl JJ, Elliott J, et al. Living systematic reviews: 4. Living guideline recommendations. J Clin Epidemiol. 2017;91:47–53.CrossRefPubMed
16.
go back to reference Hill K, English C, Campbell BCV, et al. Feasibility of national living guideline methods: the Australian stroke guidelines. J Clin Epidemiol. 2022;142:184–93.CrossRefPubMed Hill K, English C, Campbell BCV, et al. Feasibility of national living guideline methods: the Australian stroke guidelines. J Clin Epidemiol. 2022;142:184–93.CrossRefPubMed
17.
go back to reference English C, Bayley M, Hill K, et al. Bringing stroke clinical guidelines to life. Int J Stroke. 2019;14(4):337–9.CrossRefPubMed English C, Bayley M, Hill K, et al. Bringing stroke clinical guidelines to life. Int J Stroke. 2019;14(4):337–9.CrossRefPubMed
18.
go back to reference Clinical Guidelines for Stroke Management.: Stroke Foundation. Stroke Foundation; 2021. Clinical Guidelines for Stroke Management.: Stroke Foundation. Stroke Foundation; 2021.
21.
go back to reference Pawson R. Realist Evaluation. Adapted from Pawson R & Tilley N. Realist evaluation London SAGE. Available online at British Cabinet Office: London; 1997. Pawson R. Realist Evaluation. Adapted from Pawson R & Tilley N. Realist evaluation London SAGE. Available online at British Cabinet Office: London; 1997.
22.
go back to reference Wiltshire G, Ronkainen N. A realist approach to thematic analysis: making sense of qualitative data through experiential, inferential and dispositional themes. J Crit Realism. 2021;20(2):159–80.CrossRef Wiltshire G, Ronkainen N. A realist approach to thematic analysis: making sense of qualitative data through experiential, inferential and dispositional themes. J Crit Realism. 2021;20(2):159–80.CrossRef
23.
go back to reference Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRefPubMed Tong A, Sainsbury P, Craig J. Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349–57.CrossRefPubMed
24.
go back to reference O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.CrossRefPubMed O’Cathain A, Murphy E, Nicholl J. Three techniques for integrating data in mixed methods studies. BMJ. 2010;341:c4587.CrossRefPubMed
25.
go back to reference Elliott JH, Synnot A, Turner T, et al. Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol. 2017;91:23–30.CrossRefPubMed Elliott JH, Synnot A, Turner T, et al. Living systematic review: 1. Introduction-the why, what, when, and how. J Clin Epidemiol. 2017;91:23–30.CrossRefPubMed
26.
go back to reference Alonso-Coello P, Schünemann HJ, Moberg J, et al. GRADE evidence to decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. Introduction BMJ. 2016;1:353. Alonso-Coello P, Schünemann HJ, Moberg J, et al. GRADE evidence to decision (EtD) frameworks: a systematic and transparent approach to making well informed healthcare choices. Introduction BMJ. 2016;1:353.
27.
go back to reference Lamontagne F, Agoritsas T, Siemieniuk R, et al. A living WHO guideline on drugs to prevent covid-19. BMJ. 2021;372:n526.CrossRefPubMed Lamontagne F, Agoritsas T, Siemieniuk R, et al. A living WHO guideline on drugs to prevent covid-19. BMJ. 2021;372:n526.CrossRefPubMed
28.
go back to reference Bragge P, Allison DJ, Mehta S, et al. A pilot living clinical practice guidelines approach was feasible and acceptable to guideline panel members. J Clin Epidemiol. 2022;143:22–9.CrossRefPubMed Bragge P, Allison DJ, Mehta S, et al. A pilot living clinical practice guidelines approach was feasible and acceptable to guideline panel members. J Clin Epidemiol. 2022;143:22–9.CrossRefPubMed
29.
go back to reference Sarkies MN, Bowles K-A, Skinner EH, et al. The effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare: a systematic review. Implement Sci. 2017;12(1):132.CrossRefPubMedPubMedCentral Sarkies MN, Bowles K-A, Skinner EH, et al. The effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare: a systematic review. Implement Sci. 2017;12(1):132.CrossRefPubMedPubMedCentral
30.
go back to reference El Mikati IK, Khabsa J, Harb T, et al. A Framework for the Development of Living Practice Guidelines in Health Care. Ann Intern Med. 2022;175(8):1154–60.CrossRefPubMed El Mikati IK, Khabsa J, Harb T, et al. A Framework for the Development of Living Practice Guidelines in Health Care. Ann Intern Med. 2022;175(8):1154–60.CrossRefPubMed
31.
go back to reference Australian Living Evidence Consortium. The Living guidelines Handbook: Guidance for the production and publication of living clinical practice guidelines 2022. 16– 7 p. Australian Living Evidence Consortium. The Living guidelines Handbook: Guidance for the production and publication of living clinical practice guidelines 2022. 16– 7 p.
33.
go back to reference Thomas J, Noel-Storr A, Marshall I, et al. Living systematic reviews: 2. Combining human and machine effort. J Clin Epidemiol. 2017;91:31–7.CrossRefPubMed Thomas J, Noel-Storr A, Marshall I, et al. Living systematic reviews: 2. Combining human and machine effort. J Clin Epidemiol. 2017;91:31–7.CrossRefPubMed
34.
go back to reference Marshall IJ, Wallace BC. Toward systematic review automation: a practical guide to using machine learning tools in research synthesis. Syst Rev. 2019;8(1):163.CrossRefPubMedPubMedCentral Marshall IJ, Wallace BC. Toward systematic review automation: a practical guide to using machine learning tools in research synthesis. Syst Rev. 2019;8(1):163.CrossRefPubMedPubMedCentral
35.
go back to reference Fux A, Soffer P, Peleg M. A layered computer-interpretable guideline model for easing the update of locally adapted clinical guidelines. Health Inf J. 2020;26(1):156–71.CrossRef Fux A, Soffer P, Peleg M. A layered computer-interpretable guideline model for easing the update of locally adapted clinical guidelines. Health Inf J. 2020;26(1):156–71.CrossRef
36.
go back to reference Kaiser K, Miksch S. Versioning computer-interpretable guidelines: semi-automatic modeling of ‘Living guidelines’ using an information extraction method. Artif Intell Med. 2009;46(1):55–66.CrossRefPubMed Kaiser K, Miksch S. Versioning computer-interpretable guidelines: semi-automatic modeling of ‘Living guidelines’ using an information extraction method. Artif Intell Med. 2009;46(1):55–66.CrossRefPubMed
37.
go back to reference Sanford BH, Labbad G, Hersh AR, et al. Leveraging American College of Obstetricians and gynecologists guidelines for Point-of-care decision support in obstetrics. Appl Clin Inf. 2021;12(4):800–7.CrossRef Sanford BH, Labbad G, Hersh AR, et al. Leveraging American College of Obstetricians and gynecologists guidelines for Point-of-care decision support in obstetrics. Appl Clin Inf. 2021;12(4):800–7.CrossRef
38.
go back to reference Gad El-Rab W, Zaïane OR, El-Hajj M. Formalizing clinical practice guideline for clinical decision support systems. Health Inf J. 2017;23(2):146–56.CrossRef Gad El-Rab W, Zaïane OR, El-Hajj M. Formalizing clinical practice guideline for clinical decision support systems. Health Inf J. 2017;23(2):146–56.CrossRef
39.
go back to reference Millard T, Synnot A, Elliott J, et al. Feasibility and acceptability of living systematic reviews: results from a mixed-methods evaluation. Syst Rev. 2019;8(1):325.CrossRefPubMedPubMedCentral Millard T, Synnot A, Elliott J, et al. Feasibility and acceptability of living systematic reviews: results from a mixed-methods evaluation. Syst Rev. 2019;8(1):325.CrossRefPubMedPubMedCentral
40.
go back to reference Tendal B, Vogel JP, McDonald S, et al. Weekly updates of national living evidence-based guidelines: methods for the Australian living guidelines for care of people with COVID-19. J Clin Epidemiol. 2021;131:11–21.CrossRefPubMed Tendal B, Vogel JP, McDonald S, et al. Weekly updates of national living evidence-based guidelines: methods for the Australian living guidelines for care of people with COVID-19. J Clin Epidemiol. 2021;131:11–21.CrossRefPubMed
41.
go back to reference Cho YI, Johnson TP, VanGeest JB. Enhancing surveys of Health Care professionals: a Meta-analysis of techniques to improve response. Eval Health Prof. 2013;36(3):382–407.CrossRefPubMed Cho YI, Johnson TP, VanGeest JB. Enhancing surveys of Health Care professionals: a Meta-analysis of techniques to improve response. Eval Health Prof. 2013;36(3):382–407.CrossRefPubMed
42.
go back to reference Hardigan PC, Popovici I, Carvajal MJ. Response rate, response time, and economic costs of survey research: a randomized trial of practicing pharmacists. Res Social Adm Pharm. 2016;12(1):141–8.CrossRefPubMed Hardigan PC, Popovici I, Carvajal MJ. Response rate, response time, and economic costs of survey research: a randomized trial of practicing pharmacists. Res Social Adm Pharm. 2016;12(1):141–8.CrossRefPubMed
43.
go back to reference Heerman WJ, Jackson N, Roumie CL, et al. Recruitment methods for survey research: findings from the Mid-south Clinical Data Research Network. Contemp Clin Trials. 2017;62:50–5.CrossRefPubMed Heerman WJ, Jackson N, Roumie CL, et al. Recruitment methods for survey research: findings from the Mid-south Clinical Data Research Network. Contemp Clin Trials. 2017;62:50–5.CrossRefPubMed
44.
go back to reference Harden SM, Gaglio B, Shoup JA, et al. Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review. Syst Rev. 2015;4:155.CrossRefPubMedPubMedCentral Harden SM, Gaglio B, Shoup JA, et al. Fidelity to and comparative results across behavioral interventions evaluated through the RE-AIM framework: a systematic review. Syst Rev. 2015;4:155.CrossRefPubMedPubMedCentral
Metadata
Title
Is it possible to make ‘living’ guidelines? An evaluation of the Australian Living Stroke Guidelines
Authors
Louise Wiles
Peter D Hibbert
Yvonne Zurynski
Carolynn L. Smith
Gaston Arnolda
Louise A. Ellis
Rebecca Lake
Brona Nic Giolla Easpaig
Charlotte Molloy
Sandy Middleton
Jeffrey Braithwaite
Kelvin Hill
Tari Turner
Publication date
01-12-2024
Publisher
BioMed Central
Keyword
Stroke
Published in
BMC Health Services Research / Issue 1/2024
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/s12913-024-10795-6

Other articles of this Issue 1/2024

BMC Health Services Research 1/2024 Go to the issue