Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on medication adherence

LIVE: Thursday 27th June 2024, 18:00-19:30 (CEST)
Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.
ADVANCED SEARCH
Log in
Top
BMC Health Services Research
Published in: BMC Health Services Research 1/2009

Open Access 01-12-2009 | Research article

The Systematic Guideline Review: Method, rationale, and test on chronic heart failure

Authors: Christiane Muth, Jochen Gensichen, Martin Beyer, Allen Hutchinson, Ferdinand M Gerlach

Published in: BMC Health Services Research | Issue 1/2009

Login to get access

Abstract

Background

Evidence-based guidelines have the potential to improve healthcare. However, their de-novo-development requires substantial resources – especially for complex conditions, and adaptation may be biased by contextually influenced recommendations in source guidelines. In this paper we describe a new approach to guideline development – the systematic guideline review method (SGR), and its application in the development of an evidence-based guideline for family physicians on chronic heart failure (CHF).

Methods

A systematic search for guidelines was carried out. Evidence-based guidelines on CHF management in adults in ambulatory care published in English or German between the years 2000 and 2004 were included. Guidelines on acute or right heart failure were excluded. Eligibility was assessed by two reviewers, methodological quality of selected guidelines was appraised using the AGREE instrument, and a framework of relevant clinical questions for diagnostics and treatment was derived. Data were extracted into evidence tables, systematically compared by means of a consistency analysis and synthesized in a preliminary draft. Most relevant primary sources were re-assessed to verify the cited evidence. Evidence and recommendations were summarized in a draft guideline.

Results

Of 16 included guidelines five were of good quality. A total of 35 recommendations were systematically compared: 25/35 were consistent, 9/35 inconsistent, and 1/35 un-rateable (derived from a single guideline). Of the 25 consistencies, 14 were based on consensus, seven on evidence and four differed in grading. Major inconsistencies were found in 3/9 of the inconsistent recommendations. We re-evaluated the evidence for 17 recommendations (evidence-based, differing evidence levels and minor inconsistencies) – the majority was congruent. Incongruity was found where the stated evidence could not be verified in the cited primary sources, or where the evaluation in the source guidelines focused on treatment benefits and underestimated the risks. The draft guideline was completed in 8.5 man-months. The main limitation to this study was the lack of a second reviewer.

Conclusion

The systematic guideline review including framework development, consistency analysis and validation is an effective, valid, and resource saving-approach to the development of evidence-based guidelines.
Appendix
Available only for authorised users
Literature
1.
Thomas L, Cullum N, McColl E, Rousseau N, Soutter J, Steen N: Guidelines in professions allied to medicine. The Cochrane Database of Systematic Reviews. 1999, Art. No.: CD000349.-DOI: 10.1002/14651858.CD000349., 1
2.
Woolf SH, Grol R, Hutchinson A, Eccles M, Grimshaw J: Clinical guidelines. Potential benefits, limitations, and harms of clinical guidelines. BMJ. 1999, 318: 527-530.CrossRefPubMedPubMedCentral
3.
Komajda M, Lapuerta P, Hermans N, Gonzalez-Juanatey JR, van Veldhuisen DJ, et al: Adherence to guidelines is a predictor of outcome in chronic heart failure: the MAHLER survey. Eur Heart J. 2005, 26: 1653-1659. 10.1093/eurheartj/ehi251.CrossRefPubMed
4.
5.
6.
Woolf SH: The meaning of translational research and why it matters. JAMA. 2008, 299: 211-213. 10.1001/jama.2007.26.PubMed
7.
Emanuel EJ, Fuchs VR, Garber AM: Essential elements of a technology and outcomes assessment initiative. JAMA. 2007, 298: 1323-1325. 10.1001/jama.298.11.1323.CrossRefPubMed
8.
Council of Europe: Developing a methodology for drawing up guidelines on best medical practices. (Recommendation (2001)13 and explanatory memorandum). 2002, ISBN 92-871-4788-4., [https://​wcd.​coe.​int/​]
9.
Glasier A, Brechin S, Raine R, Penney G: A consensus process to adapt the World Health Organization selected practice recommendations for UK use. Contraception. 2003, 68: 327-333. 10.1016/j.contraception.2003.07.007.CrossRefPubMed
10.
Wabitsch R, Margolis CZ, Malkin JE, Abu-Saad K, Waksman J: Evaluating the process of tailoring the global HIV/AIDS practice guidelines for use in developing countries. Int J Qual Health Care. 1998, 10: 147-154. 10.1093/intqhc/10.2.147.CrossRefPubMed
11.
MacLeod FE, Harrison MB, Graham ID: The process of developing best practice guidelines for nurses in Ontario: risk assessment and prevention of pressure ulcers. Ostomy Wound Manage. 2002, 48: 30-32. 34–38.PubMed
12.
Voellinger R, Berney A, Baumann P, Annoni JM, Bryois C, et al: Major depressive disorder in the general hospital: adaptation of clinical practice guidelines. Gen Hosp Psychiatry. 2003, 25: 185-193. 10.1016/S0163-8343(03)00009-4.CrossRefPubMed
13.
Graham ID, Harrison MB, Lorimer K, Piercianowski T, Friedberg E, et al: Adapting national and international leg ulcer practice guidelines for local use: the Ontario Leg Ulcer Community Care Protocol. Adv Skin Wound Care. 2005, 18: 307-318. 10.1097/00129334-200507000-00011.CrossRefPubMed
14.
Van Tulder M, Becker A, Bekkering T, Breen A, Gil del Real MT, Hutchinson A, on behalf of the COST B13 Working Group on Guidelines for the Management of Acute Low Back Pain in Primary Care, et al: European guidelines for the management of acute nonspecific low back pain in primary care. 2006. Accessed January 28, 2008., [http://​www.​backpaineurope.​org/​web/​files/​WG1_​Guidelines.​pdf]
15.
Shaneyfelt TM, Mayo-Smith MF, Rothwangl J: Are guidelines following guidelines? The methodological quality of clinical practice guidelines in the peer-reviewed medical literature. JAMA. 1999, 281: 1900-1905. 10.1001/jama.281.20.1900.CrossRefPubMed
16.
Burgers JS, Bailey JV, Klazinga NS, Bij Van Der AK, Grol R, Feder G, AGREE Collaboration: Inside guidelines: comparative analysis of recommendations and evidence in diabetes guidelines from 13 countries. Diabetes Care. 2002, 25: 1933-1939. 10.2337/diacare.25.11.1933.CrossRefPubMed
17.
Thomson R, McElroy H, Sudlow M: Guidelines on anticoagulant treatment in atrial fibrillation in Great Britain: variation in content and implications for treatment. BMJ. 1998, 316: 509-513.CrossRefPubMedPubMedCentral
18.
Beck C, Cody M, Souder E, Zhang M, Small GW: Dementia diagnostic guidelines: methodologies, results and implementation costs. J Am Geriatr Soc. 2000, 48: 1195-1203.CrossRefPubMed
19.
Silagy CA, Stead LF, Lancaster T: Use of systematic review in clinical practice guidelines: case study of smoking cessation. BMJ. 2001, 323: 833-836. 10.1136/bmj.323.7317.833.CrossRefPubMedPubMedCentral
20.
Ravago TS, Mosniam J, Alem F: Evaluation of community acquired pneumonia guidelines. J Med Sys. 2000, 24: 289-296. 10.1023/A:1005592225244.CrossRef
21.
McIntosh A: Guidance: what role should consensus play in guideline development?. Making use of guidelines in clinical practice. Edited by: Hutchinson A, Baker R. 1999, Oxon: Radcliff Medical Press Ltd, 63-81.
22.
Choudhry NK, Stelfox HT, Detsky AS: Relationships between authors of clinical practice guidelines and the pharmaceutical industry. JAMA. 2002, 287: 612-617. 10.1001/jama.287.5.612.CrossRefPubMed
23.
Taylor R, Giles J: Cash interests taint drug advise. Nature. 2005, 437: 1070-1071. 10.1038/4371070a.CrossRefPubMed
24.
Molewijk AC, Stiggelbout AM, Otten W, Dupuis HM, Kievit J: Implicit normativity in evidence-based medicine: a plea for integrated empirical ethics research. Health Care Anal. 2003, 11: 69-92. 10.1023/A:1025390030467.CrossRefPubMed
25.
DeMaeseneer J, Derese A: European general practice guidelines: a step too far?. Eur J Gen Pract. 1999, 5: 86-87.CrossRef
26.
Aldrich R, Kemp L, Williams JS, Harris E, Simpson S, et al: Using socioeconomic evidence in clinical practice guidelines. BMJ. 2003, 327: 1283-1285. 10.1136/bmj.327.7426.1283.CrossRefPubMedPubMedCentral
27.
Berg M, Ter Meulen R, Burg Van Den M: Guidelines for appropriate care: the importance of empirical normative analysis. Health Care Anal. 2001, 9: 77-99. 10.1023/A:1011307112091.CrossRefPubMed
28.
Eisinger F, Geller G, Burke W, Holtzman NA: Cultural basis for differences between US and French clinical recommendations for women at increased risk of breast and ovarian cancer. Lancet. 1999, 353: 919-920. 10.1016/S0140-6736(98)07516-3.CrossRefPubMed
29.
Christiaens T, De Backer D, Burgers J, Baerheim A: Guidelines, evidence, and cultural factors. Comparison of four European guidelines on uncomplicated cystitis. Scand J Prim Health Care. 2004, 22: 141-145. 10.1080/02813430410006521.CrossRefPubMed
30.
Jonsen AR, Siegler M, Winslade WJ: Clinical ethics. A practical approach to ethical decisions in clinical medicine. 2006, New York, NY: McGraw-Hill Medical Publishing Division, 6
31.
Relman AS: Medical professionalism in a commercialized health care market. JAMA. 2007, 298: 2668-2670. 10.1001/jama.298.22.2668.CrossRefPubMed
32.
Welle DA, Ross RS, Detsky AS: What is the different about the market for health care?. JAMA. 2007, 298: 2785-2787. 10.1001/jama.298.23.2785.CrossRef
33.
Budetti PP: Market justice and US health care. JAMA. 2008, 299: 92-94. 10.1001/jama.2007.27.PubMed
34.
Dixon J, Chantler C, Billings J: Competition on outcomes and physician leadership are not enough to reform health care. JAMA. 2007, 298: 1445-1447. 10.1001/jama.298.12.1445.CrossRefPubMed
35.
Fervers B, Burgers JS, Haugh MC, Latreille J, Mlika-Cabanne N, et al: Adaptation of clinical guidelines: literature review and proposition for a framework and procedure. Int J Qual Health Care. 2006, 18: 167-176. 10.1093/intqhc/mzi108.CrossRefPubMed
36.
Gerlach FM, Beyer M, Berndt M, Szecsenyi J, Abholz HH, et al: The DEGAM-concept – development, dissemination, implementation and evaluation of guidelines for general practice. [German] Z Arztl Fortbild Qualitatssich. 1999, 93: 111-20.PubMed
37.
38.
Cohen J: A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960, 20: 37-46. 10.1177/001316446002000104.CrossRef
39.
40.
The AGREE Collaboration: Development and validation of an international appraisal instrument for assessing the quality of clinical practice guidelines: the AGREE project. Quality and Safety in Health Care. 2003, 12: 18-23. 10.1136/qhc.12.1.18.CrossRef
41.
Graham ID, Harrison MB: Evaluation and adaptation of clinical practice guidelines. Evid Based Nurs. 2005, 8: 68-72. 10.1136/ebn.8.3.68.CrossRefPubMed
42.
Watine J, Friedberg B, Nagy E, Onody R, Oosterhuis W, et al: Conflict between guideline methodologic quality and recommendation validity: a potential problem for practitioners. Clin Chem. 2006, 52: 65-72. 10.1373/clinchem.2005.056952.CrossRefPubMed
43.
44.
Siebert U, Muth C, Sroczynski G, Velasco-Garrido M, Gerhardus A, Gibis B: [Liquid-based slide preparations and automated devices in examining cervical smears – systematic review of medical efficacy and health economics, and decision analysis]. Health Technology Assessment 35. 2003, Sankt Augustin: Asgard-Verlag, ISBN 3-537-27035-6.
45.
Arzneimittelkommission der deutschen Aerzteschaft: Chronische Herzinsuffizienz. Empfehlungen zur Therapie der chronischen Herzinsuffizienz. Gemeinsame Empfehlung mit der Deutschen Gesellschaft fuer Kardiologie – Herz- und Kreislaufforschung. AVP-Sonderheft Therapieempfehlungen. 2001
46.
Hoppe UC, Erdmann E, Kommission Klinische Kardiologie: [Guidelines for the treatment of chronic heart failure. Issued by the Executive Committee of the German Society of Cardiology – Heart and Circulation Research, compiled on behalf of the Commission of Clinical Cardiology in cooperation with Pharmaceutic Commission of the German Physicians' Association]. Z Kardiol. 2001, 90: 218-237. 10.1007/s003920170187.CrossRefPubMed
47.
48.
Schubert I, General Practitioners' Guideline Group of Hessen: [Guideline report of the Guideline Group of Hessen – general practice therapy circle: management of chronic heart failure]. Z Arztl Fortbild Qualitatssich. 2003, 97: 145-150.PubMed
49.
50.
Hunt SA, Baker DW, Chin MH, Cinquegrani MP, Feldman AM, Francis GS, et al: ACC/AHA guidelines for the evaluation and management of chronic heart failure in the adult: a report of the American College of Cardiology/American Heart Association Task Force on Practice guidelines (Committee to Revise the 1995 Guidelines for the Evaluation and Management of Heart Failure). Circulation. 2001, 104: 2996-10.1161/hc4901.102568.CrossRefPubMed
51.
Department of Veterans Affairs & Veterans Health Administration: Pharmacy Benefits Management Strategic Healthcare Group and the Medical Advisory Panel. The pharmacologic management of chronic heart failure. 2001, Washington, DC: Veterans Health Administration, Department of Veterans Affairs. Updated December 2002. PBM-MAP Publication No. 00-0015, Accessed March 15, 2004., [http://​www.​oqp.​med.​va.​gov/​cpg/​CHF/​CHF_​Base.​htm]
52.
53.
Chavey WE, Blaum CS, Bleske BE, Harrison RV, Kesterson S, Nicklas JM, American Heart Association: Guideline for the management of heart failure caused by systolic dysfunction: Part I. Guideline development, etiology and diagnosis. Am Fam Physician. 2001, 64: 769-774.PubMed
54.
Chavey WE, Blaum CS, Bleske BE, Harrison RV, Kesterson S, Nicklas JM, American Heart Association: Guideline for the management of heart failure caused by systolic dysfunction: Part II. Treatment. Am Fam Physician. 2001, 64: 1045-1054.PubMed
55.
56.
Canadian Cardiovascular Society: The 2001 Canadian Cardiovascular Society consensus guideline update for the management and prevention of heart failure. Printed version: Can J Cardiol. 2001, 17 (Suppl E): 5E-25E.
57.
58.
59.
60.
61.
The National Collaborating Centre for Chronic Conditions: Chronic heart failure. National clinical guideline for diagnosis and management in primary and secondary care. NICE Guideline No. 5. National Institute for Clinical Excellence; ISBN: 1-84257-324-1. 2003, Accessed March 17, 2004., [http://​www.​nice.​org.​uk]
62.
Remme WJ, Swedberg K: Guidelines for the diagnosis and treatment of chronic heart failure. Eur Heart J. 2001, 22: 1527-1560. 10.1053/euhj.2001.2783. Erratum in Eur Heart J 2001, 22: 2217–2218.CrossRefPubMed
63.
Piepoli MF, Davos C, Francis DP, Coats AJ, ExTraMATCH Collaborative: Exercise training meta-analysis of trials in patients with chronic heart failure (ExTraMATCH). BMJ. 2004, 328 (7433): 189-10.1136/bmj.37938.645220.EE.CrossRefPubMed
64.
Lijmer JG, Mol BW, Heisterkamp S, Bonsel GJ, Prins MH, et al: Empirical evidence of design-related bias in studies of diagnostic tests. JAMA. 1999, 282: 1061-1066. 10.1001/jama.282.11.1061.CrossRefPubMed
65.
66.
Doust JA, Glasziou PP, Pietrzak E, Dobson AJ: A systematic review of the diagnostic accuracy of natriuretic peptides for heart failure. Arch Int Med. 2004, 164: 1978-1984. 10.1001/archinte.164.18.1978.CrossRef
67.
68.
69.
Alehagen U, Lindstedt G, Eriksson H, Dahlstrom U: Utility of the aminoterminal fragment of pro-brain natriuretic peptide in plasma for the evaluation of cardiac dysfunction in elderly patients in primary health care. Clin Chem. 2003, 49 (8): 1337-1346. 10.1373/49.8.1337.CrossRefPubMed
70.
Davenport C, Cheng EY, Kwok YT, Lai AH, Wakabayashi T, et al: Assessing the diagnostic test accuracy of natriuretic peptides and ECG in the diagnosis of left ventricular systolic dysfunction: a systematic review and meta-analysis. Br J Gen Pract. 2006, 56: 48-56.PubMedPubMedCentral
71.
Battaglia M, Pewsner D, Jüni P, Egger M, Bucher HC, Bachmann LM: Accuracy of B-type natriuretic peptide tests to exclude congestive heart failure: systematic review of test accuracy studies. Arch Intern Med. 2006, 166: 1073-1080. 10.1001/archinte.166.10.1073.CrossRefPubMed
72.
Banta D, Luce B: Health technology and its assessment. 1993, Oxford: Oxford University Press, 35 ff-65 ff.
73.
Naylor CD: Grey zones of clinical practice: some limits to evidence-based medicine. Lancet. 1995, 345: 840-842. 10.1016/S0140-6736(95)92969-X.CrossRefPubMed
74.
Shekelle P, Rich M, Morton S, et al: Pharmacologic management of heart failure and left ventricular systolic dysfunction: Effect in female, black, and diabetic patients, and cost effectiveness. Evidence Report/Technology Assessment No. 82 (Prepared by the Southern California-RAND Evidence-based Center under Contract No 290-97-0001). 2003, AHRQ Publication No. 03-E045. Rockville, MD: Agency for Healthcare Research and Quality, Accessed March 19, 2004., [http://​www.​ahrq.​gov]
75.
Faris R, Flather M, Purcell H, Henein M, Poole-Wilson P, Coats A: Current evidence supporting the role of diuretics in heart failure: a meta-analysis of randomized controlled trials. Int J Cardiol. 2002, 82: 149-58. 10.1016/S0167-5273(01)00600-3.CrossRefPubMed
76.
Phillips CO, Kashani A, Ko DK, Francis G, Krumholz HM: Adverse effects of combination of angiotensin II receptor blockers plus angiotensin-converting enzyme inhibitors for left ventricular dysfunction. Arch Intern Med. 2007, 167: 1930-1936. 10.1001/archinte.167.18.1930.CrossRefPubMed
77.
Juurlink DN, Mamdani MM, Lee DS, Kopp A, Austin PC, et al: Rates of hyperkalemia after publication of the randomized aldactone evaluation study. N Engl J Med. 2004, 351: 543-551. 10.1056/NEJMoa040135.CrossRefPubMed
78.
Qaseem A, Vijan S, Snow V, Cross T, Weiss KB, Owens DK: Clinical Efficacy Assessment Subcommittee of the American College of Physicians. Glycemic control and type 2 diabetes mellitus: the optimal hemoglobin A1c targets. A guidance statement from the American College of Physicians. Ann Intern Med. 2007, 147: 417-22.CrossRefPubMed
79.
Fervers B, Remy-Stockinger M, Graham ID, Burnand B, Harrison M, et al: Guideline adaptation: an appealing alternative to de novo guideline development. Ann Intern Med. 2008, 148: 563-4.CrossRefPubMed
80.
Adams KF: Developing clinical practice guidelines for heart failure: creative process and practice implications. Pharmacother. 2000, 20 (11 Pt 2): 379S-384S. 10.1592/phco.20.18.379S.34610.CrossRef
81.
Oosterhuis WP, Bruns DE, Watine J, Sandberg S, Horvath AR: Evidence-based guidelines in laboratory medicine: Principles and methods. Clin Chem. 2004, 50: 806-818. 10.1373/clinchem.2003.025528.CrossRefPubMed
82.
83.
Richardson WS, Wilson MC, Nishikawa J, Hayward RSA: The well-built clinical question: a key to evidence-based decisions. ACP J Club. 1995, 123: A-12.
84.
Helou A, Perleth M, Schwartz FW: [Determining priorities in the development of medical guidelines. 1: Criteria, procedures and actors: a methodological review of international experiences]. Z Arztl Fortbild Qualitatssich. 2000, 94: 53-60.PubMed
85.
Hadorn DC, Baker D: Development of the AHCPR-sponsored heart failure guideline: methodological and procedural issues. Jt Comm J Qual Patient Saf. 1994, 20: 539-47.
86.
Kulig M, Schulte E, Willich SN: Comparing methodological quality and consistency of international guidelines for the management of patients with chronic heart failure. Eur J Heart Failure. 2003, 5: 327-335. 10.1016/S1388-9842(03)00040-0.CrossRef
87.
McAlister FA, van Diepen S, Padwal RS, Johnson JA, Majumdar SR: How evidence-based are the recommendations in evidence-based guidelines?. PLoS Med. 2007, 4: e250-10.1371/journal.pmed.0040250.CrossRefPubMedPubMedCentral
88.
Watine JC, Bunting PS: Mass colorectal cancer screening: Methodological quality of practice guidelines is not related to their content validity. Clin Biochem. 2008, 41: 459-66. 10.1016/j.clinbiochem.2007.12.020.CrossRefPubMed
89.
GRADE Working Group: Grading quality of evidence and strength of recommendations. BMJ. 2004, 328: 1490-10.1136/bmj.328.7454.1490.CrossRefPubMedCentral
90.
91.
92.
93.
Ashcroft R: What is clinical effectiveness?. Stud Hist Phil Biol & Biomed Sci. 2002, 33: 219-233. 10.1016/S0039-3681(02)00020-1.CrossRef
94.
Foy R, Ramsay CR, Grimshaw JM, Penney GC, Vale L, Thomson A, Greer IA: The impact of guidelines on mild hypertension in pregnancy: time series analysis. BJOG. 2004, 111: 765-70. 10.1111/j.1471-0528.2004.00212.x.CrossRefPubMed
95.
96.
Shekelle PG, Ortiz E, Rhodes S, Morton SC, Eccles MP, Grimshaw JM, Woolf SH: Validity of the Agency for Healthcare Research and Quality clinical practice guidelines: how quickly do guidelines become outdated?. JAMA. 2001, 286: 1461-7. 10.1001/jama.286.12.1461.CrossRefPubMed
97.
98.
99.
100.
Van Doorslaer E, Masseria C: OECD Health Equity Research Group. Income-related inequality in the use of medical care in 21 OECD countries. Towards high-performing health systems: policy studies. 2004, Paris: OECD, 109-66. Accessed February 22, 2006., [http://​www.​oecd.​org]
Metadata
Title
The Systematic Guideline Review: Method, rationale, and test on chronic heart failure
Authors
Christiane Muth
Jochen Gensichen
Martin Beyer
Allen Hutchinson
Ferdinand M Gerlach
Publication date
01-12-2009
Publisher
BioMed Central
Published in
BMC Health Services Research / Issue 1/2009
Electronic ISSN: 1472-6963
DOI
https://doi.org/10.1186/1472-6963-9-74

Other articles of this Issue 1/2009

BMC Health Services Research 1/2009 Go to the issue

Research article

The economic costs and health-related quality of life of people with HIV/AIDS in the Canary Islands, Spain

Research article

An ecological study on the relationship between supply of beds in long-term care institutions in Italy and potential care needs for the elderly

Study protocol

Comparison of a one-time educational intervention to a teach-to-goal educational intervention for self-management of heart failure: design of a randomized controlled trial

Research article

Adherence to anti-tuberculosis treatment among pulmonary tuberculosis patients: a qualitative and quantitative study

Research article

Comparison of distance measures in spatial analytical modeling for health service planning

Research article

The use of evidence in public governmental reports on health policy: an analysis of 17 Norwegian official reports (NOU)