Skip to main content
Top
Published in: Implementation Science 1/2014

Open Access 01-12-2014 | Systematic review

Guidance for updating clinical practice guidelines: a systematic review of methodological handbooks

Authors: Robin WM Vernooij, Andrea Juliana Sanabria, Ivan Solà, Pablo Alonso-Coello, Laura Martínez García

Published in: Implementation Science | Issue 1/2014

Login to get access

Abstract

Background

Updating clinical practice guidelines (CPGs) is a crucial process for maintaining the validity of recommendations. Methodological handbooks should provide guidance on both developing and updating CPGs. However, little is known about the updating guidance provided by these handbooks.

Methods

We conducted a systematic review to identify and describe the updating guidance provided by CPG methodological handbooks and included handbooks that provide updating guidance for CPGs. We searched in the Guidelines International Network library, US National Guidelines Clearinghouse and MEDLINE (PubMed) from 1966 to September 2013. Two authors independently selected the handbooks and extracted the data. We used descriptive statistics to analyze the extracted data and conducted a narrative synthesis.

Results

We included 35 handbooks. Most handbooks (97.1%) focus mainly on developing CPGs, including variable degrees of information about updating. Guidance on identifying new evidence and the methodology of assessing the need for an update is described in 11 (31.4%) and eight handbooks (22.8%), respectively. The period of time between two updates is described in 25 handbooks (71.4%), two to three years being the most frequent (40.0%). The majority of handbooks do not provide guidance for the literature search, evidence selection, assessment, synthesis, and external review of the updating process.

Conclusions

Guidance for updating CPGs is poorly described in methodological handbooks. This guidance should be more rigorous and explicit. This could lead to a more optimal updating process, and, ultimately to valid trustworthy guidelines.
Appendix
Available only for authorised users
Literature
1.
go back to reference IOM (Institute of Medicine): Clinical Practice Guideline We Can Trust. 2011, Washington, DC: The National Academies Press IOM (Institute of Medicine): Clinical Practice Guideline We Can Trust. 2011, Washington, DC: The National Academies Press
2.
go back to reference Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.CrossRef Grimshaw JM, Thomas RE, MacLennan G, Fraser C, Ramsay CR, Vale L, Whitty P, Eccles MP, Matowe L, Shirran L, Wensing M, Dijkstra R, Donaldson C: Effectiveness and efficiency of guideline dissemination and implementation strategies. Health Technol Assess. 2004, 8 (6): 1-72.CrossRef
3.
go back to reference Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines: potential benefits, limitations and harms of clinical guidelines. BMJ. 1999, 318 (7182): 527-530. 10.1136/bmj.318.7182.527.CrossRefPubMedPubMedCentral Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines: potential benefits, limitations and harms of clinical guidelines. BMJ. 1999, 318 (7182): 527-530. 10.1136/bmj.318.7182.527.CrossRefPubMedPubMedCentral
4.
go back to reference European Observatory on Health Systems and Policies: Clinical guidelines for chronic conditions in the European Union. 2013, Geneva: World Health Organisation European Observatory on Health Systems and Policies: Clinical guidelines for chronic conditions in the European Union. 2013, Geneva: World Health Organisation
5.
go back to reference Working Group on CPG Updates: Updating Clinical Practice Guidelines in the Spanish National Health System: Methodology Handbook. 2009, Madrid: National Plan for the National Health System of the Spanish Ministry for Health and Social Policy; Aragon Health Sciences Institute (I+CS) Working Group on CPG Updates: Updating Clinical Practice Guidelines in the Spanish National Health System: Methodology Handbook. 2009, Madrid: National Plan for the National Health System of the Spanish Ministry for Health and Social Policy; Aragon Health Sciences Institute (I+CS)
6.
go back to reference National Institute for Health and Clinical Excellence: The guidelines manual. London: National Institute for Health and Clinical Excellence. 2012 National Institute for Health and Clinical Excellence: The guidelines manual. London: National Institute for Health and Clinical Excellence. 2012
7.
go back to reference Shekelle P, Woolf S, Grimshaw JM, Schünemann HJ, Eccles MP: Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012, 7: 62-10.1186/1748-5908-7-62.CrossRefPubMedPubMedCentral Shekelle P, Woolf S, Grimshaw JM, Schünemann HJ, Eccles MP: Developing clinical practice guidelines: reviewing, reporting, and publishing guidelines; updating guidelines; and the emerging issues of enhancing guideline implementability and accounting for comorbid conditions in guideline development. Implement Sci. 2012, 7: 62-10.1186/1748-5908-7-62.CrossRefPubMedPubMedCentral
8.
go back to reference Martínez Garcia L, Arévalo-Rodríguez I, Solà I, Haynes RB, Vandvik PO, Alonso-Coello P, Updating Guidelines Working Group: Strategies for monitoring and updating clinical practice guidelines: a systematic review. Implement Sci. 2012, 7 (1): 109-10.1186/1748-5908-7-109.CrossRefPubMedPubMedCentral Martínez Garcia L, Arévalo-Rodríguez I, Solà I, Haynes RB, Vandvik PO, Alonso-Coello P, Updating Guidelines Working Group: Strategies for monitoring and updating clinical practice guidelines: a systematic review. Implement Sci. 2012, 7 (1): 109-10.1186/1748-5908-7-109.CrossRefPubMedPubMedCentral
9.
10.
go back to reference Banzi R, Cinquini M, Liberati A, Moschetti I, Pecoraro V, Tagliabue L, Moja L: Speed of updating online evidence based point of care summaries: prospective cohort analysis. BMJ. 2011, 343: d5856-10.1136/bmj.d5856.CrossRefPubMedPubMedCentral Banzi R, Cinquini M, Liberati A, Moschetti I, Pecoraro V, Tagliabue L, Moja L: Speed of updating online evidence based point of care summaries: prospective cohort analysis. BMJ. 2011, 343: d5856-10.1136/bmj.d5856.CrossRefPubMedPubMedCentral
11.
go back to reference Gartlehner G, West SL, Lohr KN, Kahwati L, Johnson JG, Harris RP, Whitener L, Voisin CE, Sutton S: Assessing the need to update prevention guidelines: a comparison of two methods. Int J Qual Health Care. 2004, 16 (5): 399-406. 10.1093/intqhc/mzh081.CrossRefPubMed Gartlehner G, West SL, Lohr KN, Kahwati L, Johnson JG, Harris RP, Whitener L, Voisin CE, Sutton S: Assessing the need to update prevention guidelines: a comparison of two methods. Int J Qual Health Care. 2004, 16 (5): 399-406. 10.1093/intqhc/mzh081.CrossRefPubMed
12.
go back to reference Alonso-Coello P, Martínez García L, Carrasco Gimeno JM, Solà I, Qureshi S, Burgers JS, Díaz del Campo P, Estrada MD, Gracia J, Mengual J, Rico Iturrioz R, Rotaeche del Campo R, Salcedo-Fernandez F: The updating of clinical practice guidelines: insights from an international survey. Implement Sci. 2011, 6: 107-10.1186/1748-5908-6-107.CrossRefPubMedPubMedCentral Alonso-Coello P, Martínez García L, Carrasco Gimeno JM, Solà I, Qureshi S, Burgers JS, Díaz del Campo P, Estrada MD, Gracia J, Mengual J, Rico Iturrioz R, Rotaeche del Campo R, Salcedo-Fernandez F: The updating of clinical practice guidelines: insights from an international survey. Implement Sci. 2011, 6: 107-10.1186/1748-5908-6-107.CrossRefPubMedPubMedCentral
13.
go back to reference Shekelle P, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, Woolf SH: Validity of the agency for healthcare research and quality clinical practice guidelines: how quickly do guidelines become outdated?. JAMA. 2001, 286 (12): 1461-1467. 10.1001/jama.286.12.1461.CrossRefPubMed Shekelle P, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, Woolf SH: Validity of the agency for healthcare research and quality clinical practice guidelines: how quickly do guidelines become outdated?. JAMA. 2001, 286 (12): 1461-1467. 10.1001/jama.286.12.1461.CrossRefPubMed
14.
go back to reference Scottish Intercollegiate Guidelines Network: SIGN 50: A guideline developer’s handbook. 2011, Edinburgh: Scottish Intercollegiate Guidelines Network Scottish Intercollegiate Guidelines Network: SIGN 50: A guideline developer’s handbook. 2011, Edinburgh: Scottish Intercollegiate Guidelines Network
15.
go back to reference Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P, Makarski J, Zitzelsberger L, AGREE Next Steps Consortium: AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010, 182: 839-842. 10.1503/cmaj.090449.CrossRef Brouwers M, Kho ME, Browman GP, Burgers JS, Cluzeau F, Feder G, Fervers B, Graham ID, Grimshaw J, Hanna SE, Littlejohns P, Makarski J, Zitzelsberger L, AGREE Next Steps Consortium: AGREE II: advancing guideline development, reporting and evaluation in healthcare. CMAJ. 2010, 182: 839-842. 10.1503/cmaj.090449.CrossRef
16.
go back to reference Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A: GRADE guidelines: a new series of articles in the journal of clinical epidemiology. J Clin Epidemiol. 2011, 64 (4): 380-382. 10.1016/j.jclinepi.2010.09.011.CrossRefPubMed Guyatt GH, Oxman AD, Schünemann HJ, Tugwell P, Knottnerus A: GRADE guidelines: a new series of articles in the journal of clinical epidemiology. J Clin Epidemiol. 2011, 64 (4): 380-382. 10.1016/j.jclinepi.2010.09.011.CrossRefPubMed
17.
go back to reference Kung J, Miller RR, Mackowiak PA: Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, progress. Arch Intern Med. 2012, 172 (21): 1628-1633. 10.1001/2013.jamainternmed.56.CrossRefPubMed Kung J, Miller RR, Mackowiak PA: Failure of clinical practice guidelines to meet institute of medicine standards: two more decades of little, if any, progress. Arch Intern Med. 2012, 172 (21): 1628-1633. 10.1001/2013.jamainternmed.56.CrossRefPubMed
18.
go back to reference Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H: The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010, 19 (6): e58-PubMed Alonso-Coello P, Irfan A, Solà I, Gich I, Delgado-Noguera M, Rigau D, Tort S, Bonfill X, Burgers J, Schunemann H: The quality of clinical practice guidelines over the last two decades: a systematic review of guideline appraisal studies. Qual Saf Health Care. 2010, 19 (6): e58-PubMed
19.
go back to reference Turner T, Misso M, Harris C, Green S: Development of evidence-based clinical practice guidelines (CPGs): comparing approaches. Implement Sci. 2008, 3: 45-10.1186/1748-5908-3-45.CrossRefPubMedPubMedCentral Turner T, Misso M, Harris C, Green S: Development of evidence-based clinical practice guidelines (CPGs): comparing approaches. Implement Sci. 2008, 3: 45-10.1186/1748-5908-3-45.CrossRefPubMedPubMedCentral
20.
go back to reference Ansari S, Rashidian A: Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One. 2012, 7 (11): e49864-10.1371/journal.pone.0049864.CrossRefPubMedPubMedCentral Ansari S, Rashidian A: Guidelines for guidelines: are they up to the task? A comparative assessment of clinical practice guideline development handbooks. PLoS One. 2012, 7 (11): e49864-10.1371/journal.pone.0049864.CrossRefPubMedPubMedCentral
21.
go back to reference de Santé HA: Élaboration de recommandations de bonne pratique. 2010, Saint-Denis: Haute Autorité de Santé de Santé HA: Élaboration de recommandations de bonne pratique. 2010, Saint-Denis: Haute Autorité de Santé
23.
go back to reference Kwaliteitsinstituut voor de Gezondheidszorg CBO: Evidence-based Richtlijnontwikkeling Handleiding voor werkgroepleden. 2007, Utrecht: Kwaliteitsinstituut voor de Gezondheidszorg Kwaliteitsinstituut voor de Gezondheidszorg CBO: Evidence-based Richtlijnontwikkeling Handleiding voor werkgroepleden. 2007, Utrecht: Kwaliteitsinstituut voor de Gezondheidszorg
24.
go back to reference Van Der WP, Mead J: Framework for Clinical Guideline Development in Physiotherapy. 2004, Limassol: European Region of the World Confederation for Physical Therapy Van Der WP, Mead J: Framework for Clinical Guideline Development in Physiotherapy. 2004, Limassol: European Region of the World Confederation for Physical Therapy
26.
go back to reference Schubert I, Lelgemann M, Kirchner H, von Ferber C, von Ferber L, Ollenschläger G: Handbuch zur Entwicklung regionaler Leitlinien. 2006, Berlin: Ärztliches Zentrum für Qualität in der Medizin Schubert I, Lelgemann M, Kirchner H, von Ferber C, von Ferber L, Ollenschläger G: Handbuch zur Entwicklung regionaler Leitlinien. 2006, Berlin: Ärztliches Zentrum für Qualität in der Medizin
27.
go back to reference Arzneimittelkommission der deutschen Ärzteschaft: Leitfaden für die Erstellung von Therapieempfehlungen. 2011, Berlin: Arzneimittelkommission der deutschen Ärzteschaft Arzneimittelkommission der deutschen Ärzteschaft: Leitfaden für die Erstellung von Therapieempfehlungen. 2011, Berlin: Arzneimittelkommission der deutschen Ärzteschaft
28.
go back to reference Bundesärztekammer: National Disease Management Guidelines. 2002, Berlin: Bundesärztekammer Bundesärztekammer: National Disease Management Guidelines. 2002, Berlin: Bundesärztekammer
29.
go back to reference Dumonceau JM, Hassan C, Riphaus A, Ponchon T: European society of gastrointestinal endoscopy (ESGE) guideline development policy. Endoscopy. 2012, 44 (6): 626-629.CrossRefPubMed Dumonceau JM, Hassan C, Riphaus A, Ponchon T: European society of gastrointestinal endoscopy (ESGE) guideline development policy. Endoscopy. 2012, 44 (6): 626-629.CrossRefPubMed
30.
go back to reference Iorio A, Ageno W, Cosmi B, Imberti D, Lussana F, Siragusa S, Tormene D, Tosetto A, Cattaneo M: Objectives and methodology: guidelines of the Italian society for haemostasis and thrombosis (SISET). Thromb Res. 2009, 124 (5): 1-5. 10.1016/j.thromres.2009.05.014.CrossRef Iorio A, Ageno W, Cosmi B, Imberti D, Lussana F, Siragusa S, Tormene D, Tosetto A, Cattaneo M: Objectives and methodology: guidelines of the Italian society for haemostasis and thrombosis (SISET). Thromb Res. 2009, 124 (5): 1-5. 10.1016/j.thromres.2009.05.014.CrossRef
31.
go back to reference Ärztliche Zentralstelle Qualitätssicherung: National Disease Management Guidelines: Method Report. 2002, Köln: Ärztliche Zentralstelle Qualitätssicherung Ärztliche Zentralstelle Qualitätssicherung: National Disease Management Guidelines: Method Report. 2002, Köln: Ärztliche Zentralstelle Qualitätssicherung
32.
go back to reference Kunnamo I: Duodecim Medical Publications Ltd. Preface: What is Evidence-Based Medicine Guidelines. 2008 Kunnamo I: Duodecim Medical Publications Ltd. Preface: What is Evidence-Based Medicine Guidelines. 2008
33.
go back to reference Society DFM: Submitted NHS Evidence Accreditation Application. 2001, Helsinki: Duodecim Finnish Medical Society Society DFM: Submitted NHS Evidence Accreditation Application. 2001, Helsinki: Duodecim Finnish Medical Society
34.
go back to reference Chevalier P, de Sutter A, Dirven K, Paulus D, Peremans L, van Royen P, van Welde A: Algemeen Stramien voor de Ontwikkeling van Aanbevelingen van Goede Medische Praktijkvoering. 2007, Antwerpen: Domus Medical Flemish College of General Practitioners Chevalier P, de Sutter A, Dirven K, Paulus D, Peremans L, van Royen P, van Welde A: Algemeen Stramien voor de Ontwikkeling van Aanbevelingen van Goede Medische Praktijkvoering. 2007, Antwerpen: Domus Medical Flemish College of General Practitioners
35.
go back to reference World Health Organization: Guidelines for WHO Guidelines. 2003, Geneva: World Health Organization World Health Organization: Guidelines for WHO Guidelines. 2003, Geneva: World Health Organization
36.
go back to reference National Health and Medical Research Council: A guide to the development, implementation and evaluation of clinical practice guidelines. 1998, Canberra: National Health and Medical Research Council National Health and Medical Research Council: A guide to the development, implementation and evaluation of clinical practice guidelines. 1998, Canberra: National Health and Medical Research Council
37.
go back to reference American Society of Clinical Oncology: American Society of Clinical Oncology Guideline Procedures Manual. 2001, Alexandria: American Society of Clinical Oncology American Society of Clinical Oncology: American Society of Clinical Oncology Guideline Procedures Manual. 2001, Alexandria: American Society of Clinical Oncology
38.
go back to reference Rosenfeld RM, Shiffman RN, Robertson P: Clinical practice guideline development manual, third edition: a quality-driven approach for translating evidence into action. Otolaryngol Head Neck Surg. 2013, 148 (1 Suppl): S1-S55. 10.1177/0194599812467004.CrossRef Rosenfeld RM, Shiffman RN, Robertson P: Clinical practice guideline development manual, third edition: a quality-driven approach for translating evidence into action. Otolaryngol Head Neck Surg. 2013, 148 (1 Suppl): S1-S55. 10.1177/0194599812467004.CrossRef
39.
go back to reference Harris JS, Sinnott PL, Holland JP, Ording J, Turkelson C, Weiss M, Hegmann KT: Methodology to update the practice recommendations in the American college of occupational and environmental medicine’s occupational medicine practice guidelines, Second Edition. J Occup Environ Med. 2008, 50 (3): 282-295. 10.1097/JOM.0b013e3181651613.CrossRefPubMed Harris JS, Sinnott PL, Holland JP, Ording J, Turkelson C, Weiss M, Hegmann KT: Methodology to update the practice recommendations in the American college of occupational and environmental medicine’s occupational medicine practice guidelines, Second Edition. J Occup Environ Med. 2008, 50 (3): 282-295. 10.1097/JOM.0b013e3181651613.CrossRefPubMed
40.
go back to reference Qaseem A, Snow V, Owens DK, Shekelle P: The development of clinical practice guidelines and guidance statements of the American college of physicians: summary of methods. Ann Intern Med. 2010, 153 (3): 194-199. 10.7326/0003-4819-153-3-201008030-00010.CrossRefPubMed Qaseem A, Snow V, Owens DK, Shekelle P: The development of clinical practice guidelines and guidance statements of the American college of physicians: summary of methods. Ann Intern Med. 2010, 153 (3): 194-199. 10.7326/0003-4819-153-3-201008030-00010.CrossRefPubMed
41.
go back to reference American Urological Association Education and Research: Overview: Standard Operating Procedures. 2011, Linthicum: American Urological Association American Urological Association Education and Research: Overview: Standard Operating Procedures. 2011, Linthicum: American Urological Association
42.
go back to reference Guidelines and Protocols Advisory Committee: GPAC Handbook. 2011, Victoria: Guidelines and Protocols Advisory Committee Guidelines and Protocols Advisory Committee: GPAC Handbook. 2011, Victoria: Guidelines and Protocols Advisory Committee
43.
go back to reference U.S. Preventive Services Task Force: U.S. Preventive Services Task Force Procedure Manual. 2008, Rockville: Agency for Healthcare Research and Quality U.S. Preventive Services Task Force: U.S. Preventive Services Task Force Procedure Manual. 2008, Rockville: Agency for Healthcare Research and Quality
44.
go back to reference American College of Cardiology Foundation and American Heart Association: Methodology Manual and Policies From the ACCF/AHA Task Force on Practice Guidelines. 2010, Washington DC: American College of Cardiology Foundation American College of Cardiology Foundation and American Heart Association: Methodology Manual and Policies From the ACCF/AHA Task Force on Practice Guidelines. 2010, Washington DC: American College of Cardiology Foundation
45.
go back to reference Joanna Briggs Institute Synthesis Science Unit: Best Practice Information Sheet (BPIS) Procedures. Adelaide: Joanna Briggs Institute Joanna Briggs Institute Synthesis Science Unit: Best Practice Information Sheet (BPIS) Procedures. Adelaide: Joanna Briggs Institute
46.
go back to reference Canadian Medical Association: Handbook on Clinical Practice Guidelines. 2007, Ottawa: Canadian Medical Association Canadian Medical Association: Handbook on Clinical Practice Guidelines. 2007, Ottawa: Canadian Medical Association
48.
go back to reference Caring for Australasians with Renal Impairment: A Guide for Writers. 2009, Concord: Caring for Australasians with Renal Impairment Caring for Australasians with Renal Impairment: A Guide for Writers. 2009, Concord: Caring for Australasians with Renal Impairment
49.
go back to reference New Zealand Guidelines Group: Handbook for the Preparation of Explicit Evidence-base Clinical Practice Guidelines. 2001, Wellington: New Zealand Guidelines Group New Zealand Guidelines Group: Handbook for the Preparation of Explicit Evidence-base Clinical Practice Guidelines. 2001, Wellington: New Zealand Guidelines Group
50.
go back to reference Gupta S, Bhattacharyya OK, Brouwers MC, Estey EA, Harrison MB, Hernandez P, Palda VA, Boulet LP: Canadian thoracic society: presenting a new process for clinical practice guideline production. Can Respir J. 2009, 16 (6): 62-68.CrossRef Gupta S, Bhattacharyya OK, Brouwers MC, Estey EA, Harrison MB, Hernandez P, Palda VA, Boulet LP: Canadian thoracic society: presenting a new process for clinical practice guideline production. Can Respir J. 2009, 16 (6): 62-68.CrossRef
52.
go back to reference Murad MH, Montori VM, Sidawy AN, Ascher E, Meissner MH, Chaikof EL, Gloviczki P: Guideline methodology of the society for vascular surgery including the experience with the GRADE framework. J Vasc Surg. 2011, 53 (5): 1375-1380. 10.1016/j.jvs.2011.01.036.CrossRefPubMed Murad MH, Montori VM, Sidawy AN, Ascher E, Meissner MH, Chaikof EL, Gloviczki P: Guideline methodology of the society for vascular surgery including the experience with the GRADE framework. J Vasc Surg. 2011, 53 (5): 1375-1380. 10.1016/j.jvs.2011.01.036.CrossRefPubMed
Metadata
Title
Guidance for updating clinical practice guidelines: a systematic review of methodological handbooks
Authors
Robin WM Vernooij
Andrea Juliana Sanabria
Ivan Solà
Pablo Alonso-Coello
Laura Martínez García
Publication date
01-12-2014
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2014
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-9-3

Other articles of this Issue 1/2014

Implementation Science 1/2014 Go to the issue