Skip to main content
Top
Published in: Implementation Science 1/2012

Open Access 01-12-2012 | Systematic review

Methods for the guideline-based development of quality indicators--a systematic review

Authors: Thomas Kötter, Eva Blozik, Martin Scherer

Published in: Implementation Science | Issue 1/2012

Login to get access

Abstract

Background

Quality indicators (QIs) are used in many healthcare settings to measure, compare, and improve quality of care. For the efficient development of high-quality QIs, rigorous, approved, and evidence-based development methods are needed. Clinical practice guidelines are a suitable source to derive QIs from, but no gold standard for guideline-based QI development exists. This review aims to identify, describe, and compare methodological approaches to guideline-based QI development.

Methods

We systematically searched medical literature databases (Medline, EMBASE, and CINAHL) and grey literature. Two researchers selected publications reporting methodological approaches to guideline-based QI development. In order to describe and compare methodological approaches used in these publications, we extracted detailed information on common steps of guideline-based QI development (topic selection, guideline selection, extraction of recommendations, QI selection, practice test, and implementation) to predesigned extraction tables.

Results

From 8,697 hits in the database search and several grey literature documents, we selected 48 relevant references. The studies were of heterogeneous type and quality. We found no randomized controlled trial or other studies comparing the ability of different methodological approaches to guideline-based development to generate high-quality QIs. The relevant publications featured a wide variety of methodological approaches to guideline-based QI development, especially regarding guideline selection and extraction of recommendations. Only a few studies reported patient involvement.

Conclusions

Further research is needed to determine which elements of the methodological approaches identified, described, and compared in this review are best suited to constitute a gold standard for guideline-based QI development. For this research, we provide a comprehensive groundwork.
Appendix
Available only for authorised users
Literature
1.
2.
go back to reference Lohr KN: Medicare: a strategy for quality assurance. 1990, Washington, D.C.: National Academy Press Lohr KN: Medicare: a strategy for quality assurance. 1990, Washington, D.C.: National Academy Press
3.
go back to reference Brook RH, McGlynn EA, Cleary PD: Quality of health care. Part 2: measuring quality of care. N Eng J Med. 1996, 335: 966-970. 10.1056/NEJM199609263351311.CrossRef Brook RH, McGlynn EA, Cleary PD: Quality of health care. Part 2: measuring quality of care. N Eng J Med. 1996, 335: 966-970. 10.1056/NEJM199609263351311.CrossRef
5.
go back to reference Mainz J: Quality indicators: essential for quality improvement. Int J Qual Health Care. 2004, 16: i1-i2. 10.1093/intqhc/mzh036.CrossRef Mainz J: Quality indicators: essential for quality improvement. Int J Qual Health Care. 2004, 16: i1-i2. 10.1093/intqhc/mzh036.CrossRef
6.
go back to reference McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14: 14-21. 10.1016/S0749-3797(97)00032-9.CrossRefPubMed McGlynn EA, Asch SM: Developing a clinical performance measure. Am J Prev Med. 1998, 14: 14-21. 10.1016/S0749-3797(97)00032-9.CrossRefPubMed
7.
go back to reference Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11: 358-364. 10.1136/qhc.11.4.358.CrossRefPubMedPubMedCentral Campbell SM, Braspenning J, Hutchinson A, Marshall M: Research methods used in developing and applying quality indicators in primary care. Qual Saf Health Care. 2002, 11: 358-364. 10.1136/qhc.11.4.358.CrossRefPubMedPubMedCentral
8.
go back to reference Sens B, Fischer B, Bastek A, Eckard J, Kaczmarek D, Paschen U, Pietsch B, Rath S, Ruprecht T, Thomeczek C: Begriffe und Konzepte des Qualitätsmanagements. GMS Med Inform Biom Epidemiol. 2007, 3: Doc05- Sens B, Fischer B, Bastek A, Eckard J, Kaczmarek D, Paschen U, Pietsch B, Rath S, Ruprecht T, Thomeczek C: Begriffe und Konzepte des Qualitätsmanagements. GMS Med Inform Biom Epidemiol. 2007, 3: Doc05-
9.
go back to reference McGlynn EA: Selecting common measures of quality and system performance. Medical Care. 2003, 41: I-39-I-47. McGlynn EA: Selecting common measures of quality and system performance. Medical Care. 2003, 41: I-39-I-47.
10.
go back to reference Wollersheim H, Hermens R, Hulscher M, Braspenning J, Ouwens M, Schouten J, Marres H, Dijkstra R, Grol R: Clinical indicators: development and applications. Neth J Med. 2007, 65: 15-22.PubMed Wollersheim H, Hermens R, Hulscher M, Braspenning J, Ouwens M, Schouten J, Marres H, Dijkstra R, Grol R: Clinical indicators: development and applications. Neth J Med. 2007, 65: 15-22.PubMed
11.
go back to reference Scinto JD, Galusha DH, Krumholz HM, Meehan TP: The case for comprehensive quality indicator reliability assessment. J Clin Epidemiol. 2001, 54: 1103-1111. 10.1016/S0895-4356(01)00381-X.CrossRefPubMed Scinto JD, Galusha DH, Krumholz HM, Meehan TP: The case for comprehensive quality indicator reliability assessment. J Clin Epidemiol. 2001, 54: 1103-1111. 10.1016/S0895-4356(01)00381-X.CrossRefPubMed
12.
go back to reference Brook RH, McGlynn EA, Shekelle PG: Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000, 12: 281-295. 10.1093/intqhc/12.4.281.CrossRefPubMed Brook RH, McGlynn EA, Shekelle PG: Defining and measuring quality of care: a perspective from US researchers. Int J Qual Health Care. 2000, 12: 281-295. 10.1093/intqhc/12.4.281.CrossRefPubMed
13.
go back to reference Hearnshaw HM, Harker RM, Cheater FM, Baker RH, Grimshaw GM: Expert consensus on the desirable characteristics of review criteria for improvement of health care quality. Qual Health Care. 2001, 10: 173-178. 10.1136/qhc.0100173.CrossRefPubMedPubMedCentral Hearnshaw HM, Harker RM, Cheater FM, Baker RH, Grimshaw GM: Expert consensus on the desirable characteristics of review criteria for improvement of health care quality. Qual Health Care. 2001, 10: 173-178. 10.1136/qhc.0100173.CrossRefPubMedPubMedCentral
14.
go back to reference Mainz J: Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003, 15: 523-530. 10.1093/intqhc/mzg081.CrossRefPubMed Mainz J: Defining and classifying clinical indicators for quality improvement. Int J Qual Health Care. 2003, 15: 523-530. 10.1093/intqhc/mzg081.CrossRefPubMed
15.
go back to reference Mainz J: Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care. 2003, 15: i5-i11. 10.1093/intqhc/mzg084.CrossRefPubMed Mainz J: Developing evidence-based clinical indicators: a state of the art methods primer. Int J Qual Health Care. 2003, 15: i5-i11. 10.1093/intqhc/mzg084.CrossRefPubMed
16.
go back to reference Campbell SM, Shield T, Rogers A, Gask L: How do stakeholder groups vary in a Delphi technique about primary mental health care and what factors influence their ratings?. Qual Saf Health Care. 2004, 13: 428-434. 10.1136/qshc.2003.007815.CrossRefPubMedPubMedCentral Campbell SM, Shield T, Rogers A, Gask L: How do stakeholder groups vary in a Delphi technique about primary mental health care and what factors influence their ratings?. Qual Saf Health Care. 2004, 13: 428-434. 10.1136/qshc.2003.007815.CrossRefPubMedPubMedCentral
17.
go back to reference Marshall MN, Shekelle PG, McGlynn EA, Campbell SM, Brook RH, Roland MO: Can health care quality indicators be transferred between countries?. Qual Saf Health Care. 2010, 12: 8-12.CrossRef Marshall MN, Shekelle PG, McGlynn EA, Campbell SM, Brook RH, Roland MO: Can health care quality indicators be transferred between countries?. Qual Saf Health Care. 2010, 12: 8-12.CrossRef
18.
go back to reference Frijling BD, Spies TH, Lobo CM, Hulscher MEJL, Van D, Braspenning JCC, Prins A, Van Der Wouden JC, Grol RPTM: Blood pressure control in treated hypertensive patients: clinical performance of general practitioners. Br J Gen Pract. 2001, 51: 9-14.PubMedPubMedCentral Frijling BD, Spies TH, Lobo CM, Hulscher MEJL, Van D, Braspenning JCC, Prins A, Van Der Wouden JC, Grol RPTM: Blood pressure control in treated hypertensive patients: clinical performance of general practitioners. Br J Gen Pract. 2001, 51: 9-14.PubMedPubMedCentral
19.
go back to reference Hutchinson A, McIntosh A, Anderson JL, Gilbert C, Field R: Developing primary care review criteria from evidence-based guidelines: coronary heart disease as a model. Br J Gen Pract. 2003, 53: 690-696.PubMedPubMedCentral Hutchinson A, McIntosh A, Anderson JL, Gilbert C, Field R: Developing primary care review criteria from evidence-based guidelines: coronary heart disease as a model. Br J Gen Pract. 2003, 53: 690-696.PubMedPubMedCentral
20.
go back to reference Blozik E, Nothacker M, Bunk T, Szecsenyi J, Ollenschläger G, Scherer M: Simultaneous Development of Guidelines and Quality Indicators--How Do Guideline Groups Act? A Worldwide Survey. International Journal of Health Care Quality Assurance. 2010, Blozik E, Nothacker M, Bunk T, Szecsenyi J, Ollenschläger G, Scherer M: Simultaneous Development of Guidelines and Quality Indicators--How Do Guideline Groups Act? A Worldwide Survey. International Journal of Health Care Quality Assurance. 2010,
21.
go back to reference Kötter T, Schaefer F, Blozik E, Scherer M: Developing quality indicators: background, methods and problems. Z Evid Fortbild Qual Gesundh wesen (ZEFQ). 2011, 105: 7-12. 10.1016/j.zefq.2010.11.002.CrossRef Kötter T, Schaefer F, Blozik E, Scherer M: Developing quality indicators: background, methods and problems. Z Evid Fortbild Qual Gesundh wesen (ZEFQ). 2011, 105: 7-12. 10.1016/j.zefq.2010.11.002.CrossRef
22.
go back to reference Light K: How to find research before publication. J Health Serv Res Policy. 2009, 14: 62-64. 10.1258/jhsrp.2008.008152.CrossRef Light K: How to find research before publication. J Health Serv Res Policy. 2009, 14: 62-64. 10.1258/jhsrp.2008.008152.CrossRef
23.
go back to reference AHCPR: Designing and implementing guidelines-based performance measures. Agency for Health Care Policy and Research. Qual Lett Healthc Lead. 1995, 7: 21-23. AHCPR: Designing and implementing guidelines-based performance measures. Agency for Health Care Policy and Research. Qual Lett Healthc Lead. 1995, 7: 21-23.
24.
go back to reference AHRQ: Using clinical practice guidelines to evaluate the quality of care--Volume 2: Methods. 1995, Rockville: US Dept. of Health and Human Sciences AHRQ: Using clinical practice guidelines to evaluate the quality of care--Volume 2: Methods. 1995, Rockville: US Dept. of Health and Human Sciences
25.
go back to reference AQUA-Institut: Allgemeine Methoden im Rahmen der sektorenübergreifenden Qualitätssicherung im Gesundheitswesen nach §137a SGB V. 2010, Version 2.0 AQUA-Institut: Allgemeine Methoden im Rahmen der sektorenübergreifenden Qualitätssicherung im Gesundheitswesen nach §137a SGB V. 2010, Version 2.0
26.
go back to reference ÄZQ (Ärztliches Zentrum für Qualität in der Medizin): Qualitätsindikatoren--Manual für Autoren. 2009, Neukirchen: Make a book ÄZQ (Ärztliches Zentrum für Qualität in der Medizin): Qualitätsindikatoren--Manual für Autoren. 2009, Neukirchen: Make a book
27.
go back to reference Bergman DA: Evidence-based guidelines and critical pathways for quality improvement. Pediatrics. 1999, 103: 225-232.PubMed Bergman DA: Evidence-based guidelines and critical pathways for quality improvement. Pediatrics. 1999, 103: 225-232.PubMed
28.
go back to reference Califf RM, Peterson ED, Gibbons RJ, Garson A, Brindis RG, Beller GA, Smith SC, American College of Cardiology, American Heart Association: Integrating quality into the cycle of therapeutic development. J Am Coll Cardiol. 2002, 40: 1895-1901. 10.1016/S0735-1097(02)02537-8.CrossRefPubMed Califf RM, Peterson ED, Gibbons RJ, Garson A, Brindis RG, Beller GA, Smith SC, American College of Cardiology, American Heart Association: Integrating quality into the cycle of therapeutic development. J Am Coll Cardiol. 2002, 40: 1895-1901. 10.1016/S0735-1097(02)02537-8.CrossRefPubMed
29.
go back to reference Graham WJ: Criterion-based clinical audit in obstetrics: bridging the quality gap?. Best Pract Res Clin Obstet Gynaecol. 2009, 23: 375-388. 10.1016/j.bpobgyn.2009.01.017.CrossRefPubMed Graham WJ: Criterion-based clinical audit in obstetrics: bridging the quality gap?. Best Pract Res Clin Obstet Gynaecol. 2009, 23: 375-388. 10.1016/j.bpobgyn.2009.01.017.CrossRefPubMed
30.
go back to reference Spertus JA, Eagle KA, Krumholz HM, Mitchell KR, Normand SL: American College of Cardiology and American Heart Association methodology for the selection and creation of performance measures for quantifying the quality of cardiovascular care. Circulation. 2005, 111: 1703-1712. 10.1161/01.CIR.0000157096.95223.D7.CrossRefPubMed Spertus JA, Eagle KA, Krumholz HM, Mitchell KR, Normand SL: American College of Cardiology and American Heart Association methodology for the selection and creation of performance measures for quantifying the quality of cardiovascular care. Circulation. 2005, 111: 1703-1712. 10.1161/01.CIR.0000157096.95223.D7.CrossRefPubMed
31.
go back to reference Bonow RO, Bennett S, Casey DE, Ganiats TG, Hlatky MA, Konstam MA, Lambrew CT, Normand SL, Pina IL, Radford MJ: ACC/AHA clinical performance measures for adults with chronic heart failure: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Heart Failure Clinical Performance Measures) endorsed by the Heart Failure Society of America. J Am Coll Cardiol. 2005, 46: 1144-1178. 10.1016/j.jacc.2005.07.012.CrossRefPubMed Bonow RO, Bennett S, Casey DE, Ganiats TG, Hlatky MA, Konstam MA, Lambrew CT, Normand SL, Pina IL, Radford MJ: ACC/AHA clinical performance measures for adults with chronic heart failure: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Heart Failure Clinical Performance Measures) endorsed by the Heart Failure Society of America. J Am Coll Cardiol. 2005, 46: 1144-1178. 10.1016/j.jacc.2005.07.012.CrossRefPubMed
32.
go back to reference Burge FI, Bower K, Putnam W, Cox JL: Quality indicators for cardiovascular primary care. Can J Cardiol. 2007, 23: 383-388. 10.1016/S0828-282X(07)70772-9.CrossRefPubMedPubMedCentral Burge FI, Bower K, Putnam W, Cox JL: Quality indicators for cardiovascular primary care. Can J Cardiol. 2007, 23: 383-388. 10.1016/S0828-282X(07)70772-9.CrossRefPubMedPubMedCentral
33.
go back to reference Campbell SM, Roland MO, Shekelle PG, Cantrill JA, Buetow SA, Cragg DK: Development of review criteria for assessing the quality of management of stable angina, adult asthma, and non-insulin dependent diabetes mellitus in general practice. Qual Health Care. 1999, 8: 6-15. 10.1136/qshc.8.1.6.CrossRefPubMedPubMedCentral Campbell SM, Roland MO, Shekelle PG, Cantrill JA, Buetow SA, Cragg DK: Development of review criteria for assessing the quality of management of stable angina, adult asthma, and non-insulin dependent diabetes mellitus in general practice. Qual Health Care. 1999, 8: 6-15. 10.1136/qshc.8.1.6.CrossRefPubMedPubMedCentral
34.
go back to reference Desch CE, McNiff KK, Schneider EC, Schrag D, McClure J, Lepisto E, Donaldson MS, Kahn KL, Weeks JC, Ko CY: American Society of Clinical Oncology/National Comprehensive Cancer Network quality measures. J Clin Oncol. 2008, 26: 3631-3637. 10.1200/JCO.2008.16.5068.CrossRefPubMed Desch CE, McNiff KK, Schneider EC, Schrag D, McClure J, Lepisto E, Donaldson MS, Kahn KL, Weeks JC, Ko CY: American Society of Clinical Oncology/National Comprehensive Cancer Network quality measures. J Clin Oncol. 2008, 26: 3631-3637. 10.1200/JCO.2008.16.5068.CrossRefPubMed
35.
go back to reference Draskovic I, Vernooij-Dassen M, Verhey F, Scheltens P, Rikkert MO: Development of quality indicators for memory clinics. Int J Geriatr Psychiatry. 2008, 23: 119-128. 10.1002/gps.1848.CrossRefPubMed Draskovic I, Vernooij-Dassen M, Verhey F, Scheltens P, Rikkert MO: Development of quality indicators for memory clinics. Int J Geriatr Psychiatry. 2008, 23: 119-128. 10.1002/gps.1848.CrossRefPubMed
36.
go back to reference Estes NA, Halperin JL, Calkins H, Ezekowitz MD, Gitman P, Go AS, McNamara RL, Messer JV, Ritchie JL, Romeo SJ: ACC/AHA/Physician Consortium 2008 Clinical Performance Measures for Adults with Nonvalvular Atrial Fibrillation or Atrial Flutter: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures and the Physician Consortium for Performance Improvement (Writing Committee to Develop Clinical Performance Measures for Atrial Fibrillation) Developed in Collaboration with the Heart Rhythm Society. J Am Coll Cardiol. 2008, 51: 865-884. 10.1016/j.jacc.2008.01.006.CrossRefPubMed Estes NA, Halperin JL, Calkins H, Ezekowitz MD, Gitman P, Go AS, McNamara RL, Messer JV, Ritchie JL, Romeo SJ: ACC/AHA/Physician Consortium 2008 Clinical Performance Measures for Adults with Nonvalvular Atrial Fibrillation or Atrial Flutter: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures and the Physician Consortium for Performance Improvement (Writing Committee to Develop Clinical Performance Measures for Atrial Fibrillation) Developed in Collaboration with the Heart Rhythm Society. J Am Coll Cardiol. 2008, 51: 865-884. 10.1016/j.jacc.2008.01.006.CrossRefPubMed
37.
go back to reference Forbes SA, Duncan PW, Zimmerman MK: Review criteria for stroke rehabilitation outcomes. Arch Phys Med Rehabil. 1997, 78: 1112-1116. 10.1016/S0003-9993(97)90137-4.CrossRefPubMed Forbes SA, Duncan PW, Zimmerman MK: Review criteria for stroke rehabilitation outcomes. Arch Phys Med Rehabil. 1997, 78: 1112-1116. 10.1016/S0003-9993(97)90137-4.CrossRefPubMed
38.
go back to reference Giesen P, Willekens M, Mokkink H, Braspenning J, Van den Bosch W, Grol R: Out-of-hours primary care: development of indicators for prescribing and referring. Int J Qual Health Care. 2007, 19: 289-295. 10.1093/intqhc/mzm027.CrossRefPubMed Giesen P, Willekens M, Mokkink H, Braspenning J, Van den Bosch W, Grol R: Out-of-hours primary care: development of indicators for prescribing and referring. Int J Qual Health Care. 2007, 19: 289-295. 10.1093/intqhc/mzm027.CrossRefPubMed
39.
go back to reference Hadorn DC, Baker DW, Kamberg CJ, Brooks RH: Phase II of the AHCPR-sponsored heart failure guideline: translating practice recommendations into review criteria. Jt Comm J Qual Improv. 1996, 22: 265-276.PubMed Hadorn DC, Baker DW, Kamberg CJ, Brooks RH: Phase II of the AHCPR-sponsored heart failure guideline: translating practice recommendations into review criteria. Jt Comm J Qual Improv. 1996, 22: 265-276.PubMed
40.
go back to reference Hardy AM, Hadley RA: CCQE (Center for Clinical Quality Evaluation) develops quality measures for AHCPR pain guideline. QRC Advis. 1995, 11: 1-8.PubMed Hardy AM, Hadley RA: CCQE (Center for Clinical Quality Evaluation) develops quality measures for AHCPR pain guideline. QRC Advis. 1995, 11: 1-8.PubMed
41.
go back to reference Hermanides HS, Hulscher ME, Schouten JA, Prins JM, Geerlings SE: Development of quality indicators for the antibiotic treatment of complicated urinary tract infections: a first step to measure and improve care. Clin Infect Dis. 2008, 46: 703-711. 10.1086/527384.CrossRefPubMed Hermanides HS, Hulscher ME, Schouten JA, Prins JM, Geerlings SE: Development of quality indicators for the antibiotic treatment of complicated urinary tract infections: a first step to measure and improve care. Clin Infect Dis. 2008, 46: 703-711. 10.1086/527384.CrossRefPubMed
42.
go back to reference Hermens RPMG, Ouwens MMTJ, Vonk-Okhuijsen SY, van der Wel Y, Tjan-Heijnen VCG, van den Broek LD, Ho VKY, Janssen-Heijnen MLG, Groen HJM, Grol RPTM, Wollersheim HCH: Development of quality indicators for diagnosis and treatment of patients with non-small cell lung cancer: a first step toward implementing a multidisciplinary, evidence-based guideline. Lung Cancer. 2006, 54: 117-124. 10.1016/j.lungcan.2006.07.001.CrossRefPubMed Hermens RPMG, Ouwens MMTJ, Vonk-Okhuijsen SY, van der Wel Y, Tjan-Heijnen VCG, van den Broek LD, Ho VKY, Janssen-Heijnen MLG, Groen HJM, Grol RPTM, Wollersheim HCH: Development of quality indicators for diagnosis and treatment of patients with non-small cell lung cancer: a first step toward implementing a multidisciplinary, evidence-based guideline. Lung Cancer. 2006, 54: 117-124. 10.1016/j.lungcan.2006.07.001.CrossRefPubMed
43.
go back to reference James PA, Cowan TM, Graham RP, Majeroni BA, Fox CH, Jaen CR: Using a clinical practice guideline to measure physician practice: translating a guideline for the management of heart failure. J Am Board Fam Pract. 1997, 10: 206-212.PubMed James PA, Cowan TM, Graham RP, Majeroni BA, Fox CH, Jaen CR: Using a clinical practice guideline to measure physician practice: translating a guideline for the management of heart failure. J Am Board Fam Pract. 1997, 10: 206-212.PubMed
44.
go back to reference Kongnyuy EJ, van den Broek N: Criteria for clinical audit of women friendly care and providers' perception in Malawi. BMC Pregnancy Childbirth. 2008, 8: 28-10.1186/1471-2393-8-28.CrossRefPubMedPubMedCentral Kongnyuy EJ, van den Broek N: Criteria for clinical audit of women friendly care and providers' perception in Malawi. BMC Pregnancy Childbirth. 2008, 8: 28-10.1186/1471-2393-8-28.CrossRefPubMedPubMedCentral
45.
go back to reference Krumholz HM, Anderson JL, Brooks NH, Fesmire FM, Lambrew CT, Landrum MB, Weaver WD, Whyte J, Bonow RO, Bennett SJ: ACC/AHA clinical performance measures for adults with ST-elevation and non-ST-elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Performance Measures on ST-Elevation and Non-ST-Elevation Myocardial Infarction). Circulation. 2006, 113: 732-761. 10.1161/CIRCULATIONAHA.106.172860.CrossRefPubMed Krumholz HM, Anderson JL, Brooks NH, Fesmire FM, Lambrew CT, Landrum MB, Weaver WD, Whyte J, Bonow RO, Bennett SJ: ACC/AHA clinical performance measures for adults with ST-elevation and non-ST-elevation myocardial infarction: a report of the American College of Cardiology/American Heart Association Task Force on Performance Measures (Writing Committee to Develop Performance Measures on ST-Elevation and Non-ST-Elevation Myocardial Infarction). Circulation. 2006, 113: 732-761. 10.1161/CIRCULATIONAHA.106.172860.CrossRefPubMed
46.
go back to reference Lee DS, Tran C, Flintoft V, Grant FC, Liu PP, Tu JV, Canadian Cardiovascular Outcomes Research Team/Canadian Cardiovascular Society: CCORT/CCS quality indicators for congestive heart failure care. Can J Cardiol. 2003, 19: 357-364.PubMed Lee DS, Tran C, Flintoft V, Grant FC, Liu PP, Tu JV, Canadian Cardiovascular Outcomes Research Team/Canadian Cardiovascular Society: CCORT/CCS quality indicators for congestive heart failure care. Can J Cardiol. 2003, 19: 357-364.PubMed
47.
go back to reference MacLean CH, Saag KG, Solomon DH, Morton SC, Sampsel S, Klippel JH: Measuring quality in arthritis care: methods for developing the arthritis foundation's quality indicator set. Arthritis Care Res. 2004, 51: 193-202. 10.1002/art.20248.CrossRef MacLean CH, Saag KG, Solomon DH, Morton SC, Sampsel S, Klippel JH: Measuring quality in arthritis care: methods for developing the arthritis foundation's quality indicator set. Arthritis Care Res. 2004, 51: 193-202. 10.1002/art.20248.CrossRef
48.
go back to reference Martirosyan L, Braspenning J, Denig P, de Grauw WJ, Bouma M, Storms F, Haaijer-Ruskamp FM: Prescribing quality indicators of type 2 diabetes mellitus ambulatory care. Qual Saf Health Care. 2008, 17: 318-323. 10.1136/qshc.2007.024224.CrossRefPubMed Martirosyan L, Braspenning J, Denig P, de Grauw WJ, Bouma M, Storms F, Haaijer-Ruskamp FM: Prescribing quality indicators of type 2 diabetes mellitus ambulatory care. Qual Saf Health Care. 2008, 17: 318-323. 10.1136/qshc.2007.024224.CrossRefPubMed
49.
go back to reference Mourad SM, Hermens RPMG, Nelen WLDM, Braat DDM, Grol RPTM, Kremer JAM: Guideline-based development of quality indicators for subfertility care. Hum Reprod. 2007, 22: 2665-2672. 10.1093/humrep/dem215.CrossRefPubMed Mourad SM, Hermens RPMG, Nelen WLDM, Braat DDM, Grol RPTM, Kremer JAM: Guideline-based development of quality indicators for subfertility care. Hum Reprod. 2007, 22: 2665-2672. 10.1093/humrep/dem215.CrossRefPubMed
50.
go back to reference Nijkrake MJ, Keus SH, Ewalds H, Overeem S, Braspenning JC, Oostendorp RA, Hendriks EJ, Bloem BR, Munneke M: Quality indicators for physiotherapy in Parkinson's disease. Eur J Phys Rehabil Med. 2009, 45: 239-245.PubMed Nijkrake MJ, Keus SH, Ewalds H, Overeem S, Braspenning JC, Oostendorp RA, Hendriks EJ, Bloem BR, Munneke M: Quality indicators for physiotherapy in Parkinson's disease. Eur J Phys Rehabil Med. 2009, 45: 239-245.PubMed
51.
go back to reference Ouwens M, Hermens R, Hulscher M, Vonk-Okhuijsen S, Tjan-Heijnen V, Termeer R, Marres H, Wollersheim H, Grol R: Development of indicators for patient-centred cancer care. Support Care Cancer. 2010, 18: 121-130. 10.1007/s00520-009-0638-y.CrossRefPubMed Ouwens M, Hermens R, Hulscher M, Vonk-Okhuijsen S, Tjan-Heijnen V, Termeer R, Marres H, Wollersheim H, Grol R: Development of indicators for patient-centred cancer care. Support Care Cancer. 2010, 18: 121-130. 10.1007/s00520-009-0638-y.CrossRefPubMed
52.
go back to reference Ouwens MM, Marres HA, Hermens RR, Hulscher MM, van den Hoogen FJ, Grol RP, Wollersheim HC: Quality of integrated care for patients with head and neck cancer: development and measurement of clinical indicators. Head Neck. 2007, 29: 378-386. 10.1002/hed.20532.CrossRefPubMed Ouwens MM, Marres HA, Hermens RR, Hulscher MM, van den Hoogen FJ, Grol RP, Wollersheim HC: Quality of integrated care for patients with head and neck cancer: development and measurement of clinical indicators. Head Neck. 2007, 29: 378-386. 10.1002/hed.20532.CrossRefPubMed
53.
go back to reference Radtke MA, Reich K, Blome C, Kopp I, Rustenbach SJ, Schafer I, Augustin M: Evaluation of quality of care and guideline-compliant treatment in psoriasis. Development of a new system of quality indicators. Dermatology. 2009, 219: 54-58. 10.1159/000218161.CrossRefPubMed Radtke MA, Reich K, Blome C, Kopp I, Rustenbach SJ, Schafer I, Augustin M: Evaluation of quality of care and guideline-compliant treatment in psoriasis. Development of a new system of quality indicators. Dermatology. 2009, 219: 54-58. 10.1159/000218161.CrossRefPubMed
54.
go back to reference Redberg RF, Benjamin EJ, Braun LT, Goff DC, Havas S, Labarthe DR, Limacher MC, Lloyd-Jones DM, Mora S, Pearson TA, Radford MJ, Smetana GW, Spertus JA, Swegler EW, American Academy of Family Physicians, American Association of Cardiovascular and Pulmonary Rehabilitation, Preventive Cardiovascular Nurses Society for Women's Health Research: ACCF/AHA 2009 performance measures for primary prevention of cardiovascular disease in adults: A report of the american college of cardiology foundation/american heart association task force on performance measures (writing committee to develop performance measures for primary prevention of cardiovascular disease): Developed in collaboration with the american academy of family physicians. Circulation. 2009, 120: 1296-1336.CrossRefPubMed Redberg RF, Benjamin EJ, Braun LT, Goff DC, Havas S, Labarthe DR, Limacher MC, Lloyd-Jones DM, Mora S, Pearson TA, Radford MJ, Smetana GW, Spertus JA, Swegler EW, American Academy of Family Physicians, American Association of Cardiovascular and Pulmonary Rehabilitation, Preventive Cardiovascular Nurses Society for Women's Health Research: ACCF/AHA 2009 performance measures for primary prevention of cardiovascular disease in adults: A report of the american college of cardiology foundation/american heart association task force on performance measures (writing committee to develop performance measures for primary prevention of cardiovascular disease): Developed in collaboration with the american academy of family physicians. Circulation. 2009, 120: 1296-1336.CrossRefPubMed
55.
go back to reference Schouten JA, Hulscher ME, Wollersheim H, Braspennning J, Kullberg BJ, van der Meer JW, Grol RP: Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it?. Clin Infect Dis. 2005, 41: 450-460. 10.1086/431983.CrossRefPubMed Schouten JA, Hulscher ME, Wollersheim H, Braspennning J, Kullberg BJ, van der Meer JW, Grol RP: Quality of antibiotic use for lower respiratory tract infections at hospitals: (how) can we measure it?. Clin Infect Dis. 2005, 41: 450-460. 10.1086/431983.CrossRefPubMed
56.
go back to reference Sugarman JR, Frederick PR, Frankenfield DL, Owen WF, McClellan WM: Dialysis outcomes quality initiative clinical practice guidelines: Developing clinical performance measures based on the dialysis outcomes quality initiative clinical practice guidelines: process, outcomes, and implications. Am J Kidney Dis. 2003, 42: 806-812. 10.1016/S0272-6386(03)00867-9.CrossRefPubMed Sugarman JR, Frederick PR, Frankenfield DL, Owen WF, McClellan WM: Dialysis outcomes quality initiative clinical practice guidelines: Developing clinical performance measures based on the dialysis outcomes quality initiative clinical practice guidelines: process, outcomes, and implications. Am J Kidney Dis. 2003, 42: 806-812. 10.1016/S0272-6386(03)00867-9.CrossRefPubMed
57.
go back to reference Thomas RJ, King M, Lui K, Oldridge N, Pina IL, Spertus J: AACVPR/ACC/AHA 2007 performance measures on cardiac rehabilitation for referral to and delivery of cardiac rehabilitation/secondary prevention services. Circulation. 2007, 116: 1611-1642.CrossRefPubMed Thomas RJ, King M, Lui K, Oldridge N, Pina IL, Spertus J: AACVPR/ACC/AHA 2007 performance measures on cardiac rehabilitation for referral to and delivery of cardiac rehabilitation/secondary prevention services. Circulation. 2007, 116: 1611-1642.CrossRefPubMed
58.
go back to reference Tu JV, Khalid L, Donovan LR, Ko DT: Indicators of quality of care for patients with acute myocardial infarction. Can Med Assoc J. 2008, 179: 909-915. 10.1503/cmaj.080749.CrossRef Tu JV, Khalid L, Donovan LR, Ko DT: Indicators of quality of care for patients with acute myocardial infarction. Can Med Assoc J. 2008, 179: 909-915. 10.1503/cmaj.080749.CrossRef
59.
go back to reference Van Den Boogaard E, Goddijn M, Leschot NJ, van der Veen F, Kremer JAM, Hermens RPMG: Development of guideline-based quality indicators for recurrent miscarriage. Reprod Biomed Online. 2010, 20: 267-273. 10.1016/j.rbmo.2009.11.016.CrossRefPubMed Van Den Boogaard E, Goddijn M, Leschot NJ, van der Veen F, Kremer JAM, Hermens RPMG: Development of guideline-based quality indicators for recurrent miscarriage. Reprod Biomed Online. 2010, 20: 267-273. 10.1016/j.rbmo.2009.11.016.CrossRefPubMed
60.
go back to reference van Hulst LT, Fransen J, den Broeder AA, Grol R, van Riel PL, Hulscher ME: Development of quality indicators for monitoring of the disease course in rheumatoid arthritis. Ann Rheum Dis. 2009, 68: 1805-1810. 10.1136/ard.2009.108555.CrossRefPubMed van Hulst LT, Fransen J, den Broeder AA, Grol R, van Riel PL, Hulscher ME: Development of quality indicators for monitoring of the disease course in rheumatoid arthritis. Ann Rheum Dis. 2009, 68: 1805-1810. 10.1136/ard.2009.108555.CrossRefPubMed
61.
go back to reference Wang CJ, McGlynn EA, Brook RH, Leonard CH, Piecuch RE, Hsueh SI, Schuster MA: Quality-of-care indicators for the neurodevelopmental follow-up of very low birth weight children: results of an expert panel process. Pediatrics. 2006, 117: 2080-2092. 10.1542/peds.2005-1904.CrossRefPubMed Wang CJ, McGlynn EA, Brook RH, Leonard CH, Piecuch RE, Hsueh SI, Schuster MA: Quality-of-care indicators for the neurodevelopmental follow-up of very low birth weight children: results of an expert panel process. Pediatrics. 2006, 117: 2080-2092. 10.1542/peds.2005-1904.CrossRefPubMed
62.
go back to reference Yazdany J, Panopalis P, Gillis JZ, Schmajuk G, MacLean CH, Wofsy D, Yelin E: A quality indicator set for systemic lupus erythematosus. Arthritis Rheum. 2009, 61: 370-377. 10.1002/art.24356.CrossRefPubMedPubMedCentral Yazdany J, Panopalis P, Gillis JZ, Schmajuk G, MacLean CH, Wofsy D, Yelin E: A quality indicator set for systemic lupus erythematosus. Arthritis Rheum. 2009, 61: 370-377. 10.1002/art.24356.CrossRefPubMedPubMedCentral
63.
go back to reference Advani A, Goldstein M, Shahar Y, Musen MA: Developing quality indicators and auditing protocols from formal guideline models: knowledge representation and transformations. AMIA Annual Symposium Proceedings. 2003, 11-15. Advani A, Goldstein M, Shahar Y, Musen MA: Developing quality indicators and auditing protocols from formal guideline models: knowledge representation and transformations. AMIA Annual Symposium Proceedings. 2003, 11-15.
64.
go back to reference Duffy FF, Narrow W, West JC, Fochtmann LJ, Kahn DA, Suppes T, Oldham JM, McIntyre JS, Manderscheid RW, Sirovatka P, Regier D: Quality of care measures for the treatment of bipolar disorder. Psychiatr Q. 2005, 76: 213-230. 10.1007/s11126-005-2975-4.CrossRefPubMed Duffy FF, Narrow W, West JC, Fochtmann LJ, Kahn DA, Suppes T, Oldham JM, McIntyre JS, Manderscheid RW, Sirovatka P, Regier D: Quality of care measures for the treatment of bipolar disorder. Psychiatr Q. 2005, 76: 213-230. 10.1007/s11126-005-2975-4.CrossRefPubMed
65.
go back to reference Golden WE, Hermann RC, Jewell M, Brewster C: Development of evidence-based performance measures for bipolar disorder: overview of methodology. J Psychiatr Pract. 2008, 14 (Suppl 2): 18-30.CrossRefPubMed Golden WE, Hermann RC, Jewell M, Brewster C: Development of evidence-based performance measures for bipolar disorder: overview of methodology. J Psychiatr Pract. 2008, 14 (Suppl 2): 18-30.CrossRefPubMed
66.
go back to reference LaClair BJ, Reker DM, Duncan PW, Horner RD, Hoenig H: Stroke care: a method for measuring compliance with AHCPR guidelines. Am J Phys Med Rehabil. 2001, 80: 235-242. 10.1097/00002060-200103000-00017.CrossRefPubMed LaClair BJ, Reker DM, Duncan PW, Horner RD, Hoenig H: Stroke care: a method for measuring compliance with AHCPR guidelines. Am J Phys Med Rehabil. 2001, 80: 235-242. 10.1097/00002060-200103000-00017.CrossRefPubMed
68.
go back to reference Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE: A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986, 2: 53-63. 10.1017/S0266462300002774.CrossRefPubMed Brook RH, Chassin MR, Fink A, Solomon DH, Kosecoff J, Park RE: A method for the detailed assessment of the appropriateness of medical technologies. Int J Technol Assess Health Care. 1986, 2: 53-63. 10.1017/S0266462300002774.CrossRefPubMed
69.
go back to reference Brook RH: Assessing the appropriateness of care - its time has come. JAMA. 2009, 302: 997-998. 10.1001/jama.2009.1279.CrossRefPubMed Brook RH: Assessing the appropriateness of care - its time has come. JAMA. 2009, 302: 997-998. 10.1001/jama.2009.1279.CrossRefPubMed
70.
go back to reference Kopp IB, Selbmann HK, Koller M: Consensus development in evidence-based guidelines: from myths to rational strategies. Z ärztl Fortbild Qual Gesundh wes. 2007, 101: 89-95. Kopp IB, Selbmann HK, Koller M: Consensus development in evidence-based guidelines: from myths to rational strategies. Z ärztl Fortbild Qual Gesundh wes. 2007, 101: 89-95.
71.
go back to reference Center for Reviews and Dissemination: Systematic Reviews CRD's Guidance for Undertaking Systematic Reviews in Health Care. 2009, York: CRD, University of York Center for Reviews and Dissemination: Systematic Reviews CRD's Guidance for Undertaking Systematic Reviews in Health Care. 2009, York: CRD, University of York
Metadata
Title
Methods for the guideline-based development of quality indicators--a systematic review
Authors
Thomas Kötter
Eva Blozik
Martin Scherer
Publication date
01-12-2012
Publisher
BioMed Central
Published in
Implementation Science / Issue 1/2012
Electronic ISSN: 1748-5908
DOI
https://doi.org/10.1186/1748-5908-7-21

Other articles of this Issue 1/2012

Implementation Science 1/2012 Go to the issue