Skip to main content
Top
Published in: Implementation Science 1/2012

Open Access 01-12-2012 | Research

Integrating guideline development and implementation: analysis of guideline development manual instructions for generating implementation advice

Authors: Anna R Gagliardi, Melissa C Brouwers

Published in: Implementation Science | Issue 1/2012

Login to get access

Abstract

Background

Guidelines are important tools that inform healthcare delivery based on best available research evidence. Guideline use is in part based on quality of the guidelines, which includes advice for implementation and has been shown to vary. Others hypothesized this is due to limited instructions in guideline development manuals. The purpose of this study was to examine manual instructions for implementation advice.

Methods

We used a directed and summative content analysis approach based on an established framework of guideline implementability. Six manuals identified by another research group were examined to enumerate implementability domains and elements.

Results

Manuals were similar in content but lacked sufficient detail in particular domains. Most frequently this was Accomodation, which includes information that would help guideline users anticipate and/or overcome organizational and system level barriers. In more than one manual, information was also lacking for Communicability, information that would educate patients or facilitate their involvement in shared decision making, and Applicability, or clinical parameters to help clinicians tailor recommendations for individual patients.

Discussion

Most manuals that direct guideline development lack complete information about incorporating implementation advice. These findings can be used by those who developed the manuals to consider expanding their content in these domains. It can also be used by guideline developers as they plan the content and implementation of their guidelines so that the two are integrated. New approaches for guideline development and implementation may need to be developed. Use of guidelines might be improved if they included implementation advice, but this must be evaluated through ongoing research.
Literature
1.
go back to reference Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L: Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med. 2006, 21 (Suppl 2): S14-S20.PubMedPubMedCentral Grimshaw J, Eccles M, Thomas R, MacLennan G, Ramsay C, Fraser C, Vale L: Toward evidence-based quality improvement. Evidence (and its limitations) of the effectiveness of guideline dissemination and implementation strategies 1966–1998. J Gen Intern Med. 2006, 21 (Suppl 2): S14-S20.PubMedPubMedCentral
2.
go back to reference Browman GP, Levine MN, Mohide A, Hayward RSA, Pritchard KI, Gafni A, Laupacis A: The practice guidelines development cycle: A conceptual tool for practice guidelines development and implementation. J Clin Oncol. 1995, 13 (2): 502-512.PubMed Browman GP, Levine MN, Mohide A, Hayward RSA, Pritchard KI, Gafni A, Laupacis A: The practice guidelines development cycle: A conceptual tool for practice guidelines development and implementation. J Clin Oncol. 1995, 13 (2): 502-512.PubMed
3.
go back to reference McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. NEJM. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A, Kerr EA: The quality of health care delivered to adults in the United States. NEJM. 2003, 348 (26): 2635-2645. 10.1056/NEJMsa022615.CrossRefPubMed
4.
go back to reference FitzGerald JM, Boulet LP, McIvor RA, Zimmerman S, Chapman KR: Asthma control in Canada remains suboptimal: the Reality of Asthma Control (TRAC) study. Can Respir J. 2006, 13 (5): 253-259.CrossRefPubMedPubMedCentral FitzGerald JM, Boulet LP, McIvor RA, Zimmerman S, Chapman KR: Asthma control in Canada remains suboptimal: the Reality of Asthma Control (TRAC) study. Can Respir J. 2006, 13 (5): 253-259.CrossRefPubMedPubMedCentral
5.
go back to reference Brown LC, Johnson JA, Majumdar SR, Tsuyuki RT, McAlister FA: Evidence of suboptimal management of cardiovascular risk in patients with type 2 diabetes mellitus and symptomatic atherosclerosis. CMAJ. 2004, 171 (10): 1189-1192. 10.1503/cmaj.1031965.CrossRefPubMedPubMedCentral Brown LC, Johnson JA, Majumdar SR, Tsuyuki RT, McAlister FA: Evidence of suboptimal management of cardiovascular risk in patients with type 2 diabetes mellitus and symptomatic atherosclerosis. CMAJ. 2004, 171 (10): 1189-1192. 10.1503/cmaj.1031965.CrossRefPubMedPubMedCentral
6.
go back to reference Roberts VI, Esler CN, Harper WM: What impact have NICE guidelines had on the trends of hip arthroplasty since their publication?. J Bone Joint Surg. 2007, 89 (7): 864-867. 10.1302/0301-620X.89B7.18593.CrossRef Roberts VI, Esler CN, Harper WM: What impact have NICE guidelines had on the trends of hip arthroplasty since their publication?. J Bone Joint Surg. 2007, 89 (7): 864-867. 10.1302/0301-620X.89B7.18593.CrossRef
7.
go back to reference Milchak JL, Carter BL, James PA, Ardery G: Measuring adherence to practice guidelines for management of hypertension. Hypertension. 2004, 44: 602-608. 10.1161/01.HYP.0000144100.29945.5e.CrossRefPubMedPubMedCentral Milchak JL, Carter BL, James PA, Ardery G: Measuring adherence to practice guidelines for management of hypertension. Hypertension. 2004, 44: 602-608. 10.1161/01.HYP.0000144100.29945.5e.CrossRefPubMedPubMedCentral
8.
go back to reference Using Knowledge and Evidence in Health Care. Multidisciplinary Perspectives. Edited by: Louise L-C, Francois C. 2004, University of Toronto, Toronto, Press Using Knowledge and Evidence in Health Care. Multidisciplinary Perspectives. Edited by: Louise L-C, Francois C. 2004, University of Toronto, Toronto, Press
9.
go back to reference Francke AL, Smit MC, de Veer AJE, Mistiaen P: Factors influencing the implementation of clinical guidelines for health care professionals. BMC Med Inform Dec Mak. 2008, 8: 38-10.1186/1472-6947-8-38.CrossRef Francke AL, Smit MC, de Veer AJE, Mistiaen P: Factors influencing the implementation of clinical guidelines for health care professionals. BMC Med Inform Dec Mak. 2008, 8: 38-10.1186/1472-6947-8-38.CrossRef
10.
go back to reference Baiardini I, Braido F, Bonini M: Why do doctors and patients not follow guidelines?. Curr Opin Allergy Clin Immunol. 2009, 9: 228-233. 10.1097/ACI.0b013e32832b4651.CrossRefPubMed Baiardini I, Braido F, Bonini M: Why do doctors and patients not follow guidelines?. Curr Opin Allergy Clin Immunol. 2009, 9: 228-233. 10.1097/ACI.0b013e32832b4651.CrossRefPubMed
11.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.CrossRef
12.
go back to reference Davis DA, Taylor-Vaisey A: Translating guidelines into practice: A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997, 157 (4): 408-416.PubMedPubMedCentral Davis DA, Taylor-Vaisey A: Translating guidelines into practice: A systematic review of theoretic concepts, practical experience and research evidence in the adoption of clinical practice guidelines. CMAJ. 1997, 157 (4): 408-416.PubMedPubMedCentral
13.
go back to reference Grilli R, Magrini N, Penna A, Mura G, Liberati A: Practice guidelines developed by speciality societies: the need for critical appraisal. Lancet. 2000, 355: 103-106. 10.1016/S0140-6736(99)02171-6.CrossRefPubMed Grilli R, Magrini N, Penna A, Mura G, Liberati A: Practice guidelines developed by speciality societies: the need for critical appraisal. Lancet. 2000, 355: 103-106. 10.1016/S0140-6736(99)02171-6.CrossRefPubMed
14.
go back to reference Ward JE, Grieco V: Why we need guidelines for guidelines: a study of the quality of clinical practice guidelines in Australia. Med J Aust. 1996, 156: 574-576. Ward JE, Grieco V: Why we need guidelines for guidelines: a study of the quality of clinical practice guidelines in Australia. Med J Aust. 1996, 156: 574-576.
15.
go back to reference Collaboration AGREE: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines. Qual Saf Health Care. 2003, 12 (1): 18-23.CrossRef Collaboration AGREE: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines. Qual Saf Health Care. 2003, 12 (1): 18-23.CrossRef
16.
go back to reference Brouwers M, Kho ME, Browman GP: on behalf of the AGREE Next Steps Consortium. AGREE II: Advancing guideline development, reporting and evaluation in health care. CMAJ. 2010, 182 (18): E839-E842. 10.1503/cmaj.090449.CrossRefPubMedPubMedCentral Brouwers M, Kho ME, Browman GP: on behalf of the AGREE Next Steps Consortium. AGREE II: Advancing guideline development, reporting and evaluation in health care. CMAJ. 2010, 182 (18): E839-E842. 10.1503/cmaj.090449.CrossRefPubMedPubMedCentral
17.
go back to reference Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G, O’Connell R: The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005, 5: 23-10.1186/1472-6947-5-23.CrossRefPubMedPubMedCentral Shiffman RN, Dixon J, Brandt C, Essaihi A, Hsiao A, Michel G, O’Connell R: The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation. BMC Med Inform Decis Mak. 2005, 5: 23-10.1186/1472-6947-5-23.CrossRefPubMedPubMedCentral
18.
go back to reference Shaneyfelt TM, Mayo-Smith MF, Rothwangl J: Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA. 1999, 281 (20): 1900-1905. 10.1001/jama.281.20.1900.CrossRefPubMed Shaneyfelt TM, Mayo-Smith MF, Rothwangl J: Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA. 1999, 281 (20): 1900-1905. 10.1001/jama.281.20.1900.CrossRefPubMed
19.
go back to reference Burgers JS, Cluzeau FA, Hanna SE, Hunt C, Grol R: Characteristics of high-quality guidelines: evaluation of 86 clinical guidelines developed in ten European countries and Canada. Int J Technol Assess Health Care. 2003, 19 (1): 148-157.CrossRefPubMed Burgers JS, Cluzeau FA, Hanna SE, Hunt C, Grol R: Characteristics of high-quality guidelines: evaluation of 86 clinical guidelines developed in ten European countries and Canada. Int J Technol Assess Health Care. 2003, 19 (1): 148-157.CrossRefPubMed
20.
go back to reference Turner T, Misso M, Harris C, Green S: Development of evidence based clinical practice guidelines: comparing approaches. Implement Sci. 2008, 3: 45-10.1186/1748-5908-3-45.CrossRefPubMedPubMedCentral Turner T, Misso M, Harris C, Green S: Development of evidence based clinical practice guidelines: comparing approaches. Implement Sci. 2008, 3: 45-10.1186/1748-5908-3-45.CrossRefPubMedPubMedCentral
21.
go back to reference Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell : Lost in knowledge translation: time for a map?. J Cont Ed Health Prof. 2006, 26: 13-24. 10.1002/chp.47.CrossRef Graham ID, Logan J, Harrison MB, Straus SE, Tetroe J, Caswell : Lost in knowledge translation: time for a map?. J Cont Ed Health Prof. 2006, 26: 13-24. 10.1002/chp.47.CrossRef
22.
go back to reference Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM: How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011, 6: 26-10.1186/1748-5908-6-26.CrossRefPubMedPubMedCentral Gagliardi AR, Brouwers MC, Palda VA, Lemieux-Charles L, Grimshaw JM: How can we improve guideline use? A conceptual framework of implementability. Implement Sci. 2011, 6: 26-10.1186/1748-5908-6-26.CrossRefPubMedPubMedCentral
23.
go back to reference Elo S, Kyngas H: The qualitative content analysis process. J Adv Nurs. 2008, 62 (1): 107-115. 10.1111/j.1365-2648.2007.04569.x.CrossRefPubMed Elo S, Kyngas H: The qualitative content analysis process. J Adv Nurs. 2008, 62 (1): 107-115. 10.1111/j.1365-2648.2007.04569.x.CrossRefPubMed
24.
go back to reference Hsieh HF, Shannon SE: Three approaches to qualitative content analysis. Qual Health Res. 2005, 15 (9): 1277-1288. 10.1177/1049732305276687.CrossRefPubMed Hsieh HF, Shannon SE: Three approaches to qualitative content analysis. Qual Health Res. 2005, 15 (9): 1277-1288. 10.1177/1049732305276687.CrossRefPubMed
31.
go back to reference Legare F, Boivin A, van der Weijden T: Patient and public involvement in clinical practice guidelines. Med Decis Making. 2011, 31 (6): E45-E74. 10.1177/0272989X11424401.CrossRefPubMed Legare F, Boivin A, van der Weijden T: Patient and public involvement in clinical practice guidelines. Med Decis Making. 2011, 31 (6): E45-E74. 10.1177/0272989X11424401.CrossRefPubMed
32.
go back to reference Kryworuchko J, Stacey D, Bai N, Graham ID: Twelve years of clinical practice guideline development, dissemination and evaluation in Canada (1994 to 2005). Imp Sci. 2009, 4: 49-10.1186/1748-5908-4-49.CrossRef Kryworuchko J, Stacey D, Bai N, Graham ID: Twelve years of clinical practice guideline development, dissemination and evaluation in Canada (1994 to 2005). Imp Sci. 2009, 4: 49-10.1186/1748-5908-4-49.CrossRef
33.
go back to reference Lavis JN, Oxman AD, Moynihan R, Paulsen EJ: Evidence-informed health policy – interviews with the directors of organizations that support the use of research evidence. Implement Sci. 2008, 3: 55-10.1186/1748-5908-3-55.CrossRefPubMedPubMedCentral Lavis JN, Oxman AD, Moynihan R, Paulsen EJ: Evidence-informed health policy – interviews with the directors of organizations that support the use of research evidence. Implement Sci. 2008, 3: 55-10.1186/1748-5908-3-55.CrossRefPubMedPubMedCentral
35.
go back to reference Schunemann HJ, Fretheim A, Oxman AD: Improving the use of research evidence in guideline development: Guidelines for guidelines. Health Research Policy and Systems. 2006, 4: 13-10.1186/1478-4505-4-13.CrossRefPubMedPubMedCentral Schunemann HJ, Fretheim A, Oxman AD: Improving the use of research evidence in guideline development: Guidelines for guidelines. Health Research Policy and Systems. 2006, 4: 13-10.1186/1478-4505-4-13.CrossRefPubMedPubMedCentral
Metadata
Title
Integrating guideline development and implementation: analysis of guideline development manual instructions for generating implementation advice
Authors
Anna R Gagliardi
Melissa C Brouwers
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2012
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-7-67

Other articles of this Issue 1/2012

Implementation Science 1/2012 Go to the issue