Skip to main content
Top
Published in: Implementation Science 1/2017

Open Access 01-12-2017 | Research

Number and type of guideline implementation tools varies by guideline, clinical condition, country of origin, and type of developer organization: content analysis of guidelines

Authors: Laurel Liang, Jhoni Abi Safi, Anna R. Gagliardi, members of the Guidelines International Network Implementation Working Group

Published in: Implementation Science | Issue 1/2017

Login to get access

Abstract

Background

Guideline implementation tools (GI tools) can improve clinician behavior and patient outcomes. Analyses of guidelines published before 2010 found that many did not offer GI tools. Since 2010 standards, frameworks and instructions for GI tools have emerged. This study analyzed the number and types of GI tools offered by guidelines published in 2010 or later.

Methods

Content analysis and a published GI tool framework were used to categorize GI tools by condition, country, and type of organization. English-language guidelines on arthritis, asthma, colorectal cancer, depression, diabetes, heart failure, and stroke management were identified in the National Guideline Clearinghouse. Screening and data extraction were in triplicate. Findings were reported with summary statistics.

Results

Eighty-five (67.5%) of 126 eligible guidelines published between 2010 and 2017 offered one or more of a total of 464 GI tools. The mean number of GI tools per guideline was 5.5 (median 4.0, range 1 to 28) and increased over time. The majority of GI tools were for clinicians (239, 51.5%), few were for patients (113, 24.4%), and fewer still were to support implementation (66, 14.3%) or evaluation (46, 9.9%). Most clinician GI tools were guideline summaries (116, 48.5%), and most patient GI tools were condition-specific information (92, 81.4%). Government agencies (patient 23.5%, clinician 28.9%, implementation 24.1%, evaluation 23.5%) and developers in the UK (patient 18.5%, clinician 25.2%, implementation 27.2%, evaluation 29.1%) were more likely to generate guidelines that offered all four types of GI tools. Professional societies were more likely to generate guidelines that included clinician GI tools.

Conclusions

Many guidelines do not include any GI tools, or a variety of GI tools for different stakeholders that may be more likely to prompt guideline uptake (point-of-care forms or checklists for clinicians, decision-making or self-management tools for patients, implementation and evaluation tools for managers and policy-makers). While this may vary by country and type of organization, and suggests that developers could improve the range of GI tools they develop, further research is needed to identify determinants and potential solutions. Research is also needed to examine the cost-effectiveness of various types of GI tools so that developers know where to direct their efforts and scarce resources.
Literature
1.
go back to reference Shekelle P, Woolf S, Grimshaw JM, Schunemann H, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.CrossRefPubMedPubMedCentral Shekelle P, Woolf S, Grimshaw JM, Schunemann H, Eccles MP. Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012;7:62.CrossRefPubMedPubMedCentral
2.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8:1–72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, et al. Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004;8:1–72.CrossRef
3.
go back to reference Runciman WB, Hunt TD, Hannaford NA, Hibbert PD, Westbrook JI, Coiera EW, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197:100–5.CrossRefPubMed Runciman WB, Hunt TD, Hannaford NA, Hibbert PD, Westbrook JI, Coiera EW, et al. CareTrack: assessing the appropriateness of health care delivery in Australia. Med J Aust. 2012;197:100–5.CrossRefPubMed
4.
go back to reference McNamara RL, Chung SC, Jernberg T, Holmes D, Roe M, Timmis A, et al. International comparisons of the management of patients with non-ST segment elevation acute myocardial infarction in the United Kingdom, Sweden, and the United States. Int J Cardiol. 2014;175:240–7.CrossRefPubMedPubMedCentral McNamara RL, Chung SC, Jernberg T, Holmes D, Roe M, Timmis A, et al. International comparisons of the management of patients with non-ST segment elevation acute myocardial infarction in the United Kingdom, Sweden, and the United States. Int J Cardiol. 2014;175:240–7.CrossRefPubMedPubMedCentral
5.
go back to reference Hibbert PD, Hannaford NA, Hooper TD, Hindermarsh DM, Braithwaite J, Ramanathan SA, et al. Assessing the appropriateness of prevention and management of venous thromboembolism in Australia: a cross-sectional study. BMJ Open. 2016;6:e008618.CrossRefPubMedPubMedCentral Hibbert PD, Hannaford NA, Hooper TD, Hindermarsh DM, Braithwaite J, Ramanathan SA, et al. Assessing the appropriateness of prevention and management of venous thromboembolism in Australia: a cross-sectional study. BMJ Open. 2016;6:e008618.CrossRefPubMedPubMedCentral
6.
go back to reference Canadian Institutes of Health Research. Canada’s Strategy for Patient-Oriented Research. Ottawa; 2011. Canadian Institutes of Health Research. Canada’s Strategy for Patient-Oriented Research. Ottawa; 2011.
7.
go back to reference Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:1–11.CrossRef Flottorp SA, Oxman AD, Krause J, Musila NR, Wensing M, Godycki-Cwirko M, et al. A checklist for identifying determinants of practice: a systematic review and synthesis of frameworks and taxonomies of factors that prevent or enable improvements in healthcare professional practice. Implement Sci. 2013;8:1–11.CrossRef
8.
go back to reference Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9:102.CrossRefPubMedPubMedCentral Krause J, Van Lieshout J, Klomp R, Huntink E, Aakhus E, Flottorp S, et al. Identifying determinants for tailoring implementation in chronic diseases: an evaluation of different methods. Implement Sci. 2014;9:102.CrossRefPubMedPubMedCentral
9.
go back to reference Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. Continuing medical education meetings and workshops: effects on professional practice and health care. Cochrane Database Syst Rev. 2009;2:CD003030. Forsetlund L, Bjorndal A, Rashidian A, Jamtvedt G, O’Brien MA, Wolf F, et al. Continuing medical education meetings and workshops: effects on professional practice and health care. Cochrane Database Syst Rev. 2009;2:CD003030.
10.
go back to reference Aakhus E, Granlund I, Odgaard-Jensen J, Oxman AD, Flottorp SA. A tailored intervention to implement guideline recommendations for elderly patients with depression in primary care: a pragmatic cluster randomised trial. Implement Sci. 2016;11:32.CrossRefPubMedPubMedCentral Aakhus E, Granlund I, Odgaard-Jensen J, Oxman AD, Flottorp SA. A tailored intervention to implement guideline recommendations for elderly patients with depression in primary care: a pragmatic cluster randomised trial. Implement Sci. 2016;11:32.CrossRefPubMedPubMedCentral
11.
go back to reference Van Lieshout J, Huntink E, Koetsenruijter J, Wensing M. Tailored implementation of cardiovascular risk management in general practice: a cluster randomized trial. Implement Sci. 2016;11:115.CrossRefPubMedPubMedCentral Van Lieshout J, Huntink E, Koetsenruijter J, Wensing M. Tailored implementation of cardiovascular risk management in general practice: a cluster randomized trial. Implement Sci. 2016;11:115.CrossRefPubMedPubMedCentral
12.
go back to reference Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G, et al. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005;5:23–10.CrossRefPubMedPubMedCentral Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G, et al. The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005;5:23–10.CrossRefPubMedPubMedCentral
13.
go back to reference Mickan S, Burls A, Glasziou P. Patterns of “leakage” in the utilization of clinical guidelines: a systematic review. Postgrad Med J. 2011;87:670–9.CrossRefPubMedPubMedCentral Mickan S, Burls A, Glasziou P. Patterns of “leakage” in the utilization of clinical guidelines: a systematic review. Postgrad Med J. 2011;87:670–9.CrossRefPubMedPubMedCentral
14.
go back to reference McKillop A, Crisp J, Walsh K. Practice guidelines need to address the ‘how’ and the ‘what’ of implementation. Primary Health Care Res Develop. 2012;13:48–59.CrossRef McKillop A, Crisp J, Walsh K. Practice guidelines need to address the ‘how’ and the ‘what’ of implementation. Primary Health Care Res Develop. 2012;13:48–59.CrossRef
15.
go back to reference Gagliardi AR. “More bang for the buck”: exploring optimal approaches for guideline implementation through interviews with international developers. BMC Health Serv Res. 2012;12:404.CrossRefPubMedPubMedCentral Gagliardi AR. “More bang for the buck”: exploring optimal approaches for guideline implementation through interviews with international developers. BMC Health Serv Res. 2012;12:404.CrossRefPubMedPubMedCentral
16.
go back to reference Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6:26.CrossRefPubMedPubMedCentral Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM. How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011;6:26.CrossRefPubMedPubMedCentral
17.
go back to reference Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3:CD005470. Baker R, Camosso-Stefinovic J, Gillies C, Shaw EJ, Cheater F, Flottorp S, et al. Tailored interventions to overcome identified barriers to change: effects on professional practice and health care outcomes. Cochrane Database Syst Rev. 2010;3:CD005470.
18.
go back to reference Greenhalgh T, Howick J, Maskrey N. Evidence based medicine: a movement in crisis? BMJ. 2014;348:g37225.CrossRef Greenhalgh T, Howick J, Maskrey N. Evidence based medicine: a movement in crisis? BMJ. 2014;348:g37225.CrossRef
19.
20.
go back to reference Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010;182:e839–42.CrossRefPubMedPubMedCentral Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, et al. AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010;182:e839–42.CrossRefPubMedPubMedCentral
21.
go back to reference Institute of Medicine Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington DC: National Academies Press; 2011. Institute of Medicine Committee on Standards for Developing Trustworthy Clinical Practice Guidelines. Clinical practice guidelines we can trust. Washington DC: National Academies Press; 2011.
22.
go back to reference Schunemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186:E123–42.CrossRefPubMedPubMedCentral Schunemann HJ, Wiercioch W, Etxeandia I, Falavigna M, Santesso N, Mustafa R, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186:E123–42.CrossRefPubMedPubMedCentral
23.
go back to reference Gagliardi AR, Marshall C, Huckson S, James R, Moore V. Developing a checklist for guideline implementation planning: review and synthesis of guideline development and implementation advice. Implement Sci. 2015;10:19.CrossRefPubMedPubMedCentral Gagliardi AR, Marshall C, Huckson S, James R, Moore V. Developing a checklist for guideline implementation planning: review and synthesis of guideline development and implementation advice. Implement Sci. 2015;10:19.CrossRefPubMedPubMedCentral
24.
go back to reference Flodgren G, Hall AM, Goulding L, Eccles MP, Grimshaw JM, Leng GC, et al. Tools developed and disseminated by guideline producers to promote the uptake of their guidelines. Cochrane Database Syst Rev. 2016;8:CD010669. Flodgren G, Hall AM, Goulding L, Eccles MP, Grimshaw JM, Leng GC, et al. Tools developed and disseminated by guideline producers to promote the uptake of their guidelines. Cochrane Database Syst Rev. 2016;8:CD010669.
25.
go back to reference Gagliardi AR, Brouwers MC, Bhattacharyya OK. A framework of the desirable features of guideline implementation tools: Delphi survey and assessment of GI tools. Implement Sci. 2014;9:98.CrossRefPubMedPubMedCentral Gagliardi AR, Brouwers MC, Bhattacharyya OK. A framework of the desirable features of guideline implementation tools: Delphi survey and assessment of GI tools. Implement Sci. 2014;9:98.CrossRefPubMedPubMedCentral
26.
27.
go back to reference Gagliardi AR, Brouwers MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability BMJ Open. 2015;5:e007047.PubMed Gagliardi AR, Brouwers MC. Do guidelines offer implementation advice to target users? A systematic review of guideline applicability BMJ Open. 2015;5:e007047.PubMed
28.
29.
go back to reference Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.CrossRefPubMed Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.CrossRefPubMed
30.
go back to reference Armstrong JJ, Goldfarb AM, Instrum RS, MacDermid JC. Improvement evidence but still necessary in clinical practice guideline quality: a systematic review. J Clin Epidemiol. 2017;81:13–21.CrossRefPubMed Armstrong JJ, Goldfarb AM, Instrum RS, MacDermid JC. Improvement evidence but still necessary in clinical practice guideline quality: a systematic review. J Clin Epidemiol. 2017;81:13–21.CrossRefPubMed
31.
go back to reference Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293:1223–38.CrossRefPubMed Garg AX, Adhikari NK, McDonald H, Rosas-Arellano MP, Devereaux PJ, Beyene J, et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. JAMA. 2005;293:1223–38.CrossRefPubMed
32.
go back to reference Gagliardi AR, Légaré F, Brouwers MC, Webster F, Badley E, Straus S. Patient-mediated knowledge translation (PKT) interventions for clinical encounters: a systematic review. Implement Sci. 2016;11:26.CrossRefPubMedPubMedCentral Gagliardi AR, Légaré F, Brouwers MC, Webster F, Badley E, Straus S. Patient-mediated knowledge translation (PKT) interventions for clinical encounters: a systematic review. Implement Sci. 2016;11:26.CrossRefPubMedPubMedCentral
33.
go back to reference Vernooij RW, Willson M, Gagliardi AR, Members of the Guidelines International Network Implementation Working Group. Characterizing patient-oriented tools that could be packaged with guidelines to promote self-management and guideline adoption: a meta-review. Implement Sci. 2016;11:52.CrossRefPubMedPubMedCentral Vernooij RW, Willson M, Gagliardi AR, Members of the Guidelines International Network Implementation Working Group. Characterizing patient-oriented tools that could be packaged with guidelines to promote self-management and guideline adoption: a meta-review. Implement Sci. 2016;11:52.CrossRefPubMedPubMedCentral
34.
go back to reference Stacey D, Legare F, Lewis K, Barry MJ, Bennett CL, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Thomson R, Trevena L. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017;4:CD001431. Stacey D, Legare F, Lewis K, Barry MJ, Bennett CL, Eden KB, Holmes-Rovner M, Llewellyn-Thomas H, Lyddiatt A, Thomson R, Trevena L. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2017;4:CD001431.
35.
go back to reference Goodman SM, Miller AS, Turgunbaev M, Guyatt G, Yates A, Springer B, Singh JA. Clinical practice guidelines: incorporating input from a patient panel. Arthritis Care Res. 2017;69:1125–30.CrossRef Goodman SM, Miller AS, Turgunbaev M, Guyatt G, Yates A, Springer B, Singh JA. Clinical practice guidelines: incorporating input from a patient panel. Arthritis Care Res. 2017;69:1125–30.CrossRef
36.
go back to reference Bernhardsson S, Johansson K, Nilsen P, Oberg B, Larsson MEH. Determinants of guideline use in primary care physical therapy: a cross-sectional survey of attitudes, knowledge and behaviour. Phys Ther. 2014;94:343–54.CrossRefPubMed Bernhardsson S, Johansson K, Nilsen P, Oberg B, Larsson MEH. Determinants of guideline use in primary care physical therapy: a cross-sectional survey of attitudes, knowledge and behaviour. Phys Ther. 2014;94:343–54.CrossRefPubMed
37.
go back to reference Armstrong MJ, Rueda JD, Gronseth GS, Mullins CD. Framework for enhancing clinical practice guidelines through continuous patient engagement. Health Expect. 2016;20:3–10.CrossRefPubMedPubMedCentral Armstrong MJ, Rueda JD, Gronseth GS, Mullins CD. Framework for enhancing clinical practice guidelines through continuous patient engagement. Health Expect. 2016;20:3–10.CrossRefPubMedPubMedCentral
38.
go back to reference Fearns N, Kelly J, Callaghan M, Graham K, Loudon K, Harbour R, et al. What do patients and the public know about clinical practice guidelines and what do they want from them? A qualitative study. BMC Health Serv Res. 2016;16:74.CrossRefPubMedPubMedCentral Fearns N, Kelly J, Callaghan M, Graham K, Loudon K, Harbour R, et al. What do patients and the public know about clinical practice guidelines and what do they want from them? A qualitative study. BMC Health Serv Res. 2016;16:74.CrossRefPubMedPubMedCentral
39.
Metadata
Title
Number and type of guideline implementation tools varies by guideline, clinical condition, country of origin, and type of developer organization: content analysis of guidelines
Authors
Laurel Liang
Jhoni Abi Safi
Anna R. Gagliardi
members of the Guidelines International Network Implementation Working Group
Publication date
01-12-2017
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2017
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/s13012-017-0668-7

Other articles of this Issue 1/2017

Implementation Science 1/2017 Go to the issue