Skip to main content
Top
Published in: Journal of General Internal Medicine 4/2012

01-04-2012 | Original Research

Unintended Consequences of Implementing a National Performance Measurement System into Local Practice

Authors: Adam A. Powell, PhD, Katie M. White, EdD, Melissa R. Partin, PhD, Krysten Halek, MA, Jon B. Christianson, PhD, Brian Neil, MD, Sylvia J. Hysong, PhD, Edwin J. Zarling, MD, Hanna E. Bloomfield, MD

Published in: Journal of General Internal Medicine | Issue 4/2012

Login to get access

ABSTRACT

BACKGROUND

Although benefits of performance measurement (PM) systems have been well documented, there is little research on negative unintended consequences of performance measurement systems in primary care. To optimize PM systems, a better understanding is needed of the types of negative unintended consequences that occur and of their causal antecedents.

OBJECTIVES

(1) Identify unintended negative consequences of PM systems for patients. (2) Develop a conceptual framework of hypothesized relationships between PM systems, facility-level variables (local implementation strategies, primary care staff attitudes and behaviors), and unintended negative effects on patients.

DESIGN, PARTICIPANTS, APPROACH

Qualitative study design using dissimilar cases sampling. A series of 59 in-person individual semi-structured interviews at four Veterans Health Administration (VHA) facilities was conducted between February and July 2009. Participants included members of primary care staff and facility leaders. Sites were selected to assure variability in the number of veterans served and facility scores on national VHA performance measures. Interviews were recorded, transcribed and content coded to identify thematic categories and relationships.

RESULTS

Participants noted both positive effects and negative unintended consequences of PM. We report three negative unintended consequences for patients. Performance measurement can (1) lead to inappropriate clinical care, (2) decrease provider focus on patient concerns and patient service, and (3) compromise patient education and autonomy. We also illustrate examples of negative consequences on primary care team dynamics. In many instances these problems originate from local implementation strategies developed in response to national PM definitions and policies.

CONCLUSIONS

Facility-level strategies undertaken to implement national PM systems may result in inappropriate clinical care, can distract providers from patient concerns, and may have a negative effect on patient education and autonomy. Further research is needed to ascertain how features of centralized PM systems influence whether measures are translated locally by facilities into more or less patient-centered policies and processes.
Appendix
Available only for authorised users
Literature
1.
go back to reference Asch SM, McGlynn EA, Hogan MM, Hayward RA, Shekelle P, Rubenstein L, et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Ann Intern Med. 2004;141(12):938–945.PubMed Asch SM, McGlynn EA, Hogan MM, Hayward RA, Shekelle P, Rubenstein L, et al. Comparison of quality of care for patients in the Veterans Health Administration and patients in a national sample. Ann Intern Med. 2004;141(12):938–945.PubMed
2.
go back to reference Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M. Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009;361(4):368–378.PubMedCrossRef Campbell SM, Reeves D, Kontopantelis E, Sibbald B, Roland M. Effects of pay for performance on the quality of primary care in England. N Engl J Med. 2009;361(4):368–378.PubMedCrossRef
3.
go back to reference Lindenauer PK, Remus D, Roman S, Rothberg MB, Benjamin EM, Ma A, et al. Public reporting and pay for performance in hospital quality improvement. N Engl J Med. 2007;356(5):486–496.PubMedCrossRef Lindenauer PK, Remus D, Roman S, Rothberg MB, Benjamin EM, Ma A, et al. Public reporting and pay for performance in hospital quality improvement. N Engl J Med. 2007;356(5):486–496.PubMedCrossRef
4.
go back to reference Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. JAMA. 2005;294(14):1788–1793.PubMedCrossRef Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. JAMA. 2005;294(14):1788–1793.PubMedCrossRef
5.
go back to reference Davies M, Spears W, Pugh J. What VA providers really think about clinical practice guidelines. Federal Practitioner. 2004;15. Davies M, Spears W, Pugh J. What VA providers really think about clinical practice guidelines. Federal Practitioner. 2004;15.
6.
7.
go back to reference Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348(22):2218–2227.PubMedCrossRef Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348(22):2218–2227.PubMedCrossRef
8.
go back to reference Casalino LP. The unintended consequences of measuring quality on the quality of medical care. N Engl J Med. 1999;341(15):1147–1150.PubMedCrossRef Casalino LP. The unintended consequences of measuring quality on the quality of medical care. N Engl J Med. 1999;341(15):1147–1150.PubMedCrossRef
9.
go back to reference Sheldon T. Promoting health care quality: what role performance indicators? Qual Health Care. 1998;7(Suppl):S45–S50.PubMed Sheldon T. Promoting health care quality: what role performance indicators? Qual Health Care. 1998;7(Suppl):S45–S50.PubMed
10.
go back to reference Wachter RM, Flanders SA, Fee C, Pronovost PJ. Public reporting of antibiotic timing in patients with pneumonia: lessons from a flawed performance measure. Ann Intern Med. 2008;149(1):29–32.PubMed Wachter RM, Flanders SA, Fee C, Pronovost PJ. Public reporting of antibiotic timing in patients with pneumonia: lessons from a flawed performance measure. Ann Intern Med. 2008;149(1):29–32.PubMed
11.
go back to reference Snyder L, Neubauer RL. Pay-for-performance principles that promote patient-centered care: an ethics manifesto. Ann Intern Med. 2007;147(11):792–794.PubMed Snyder L, Neubauer RL. Pay-for-performance principles that promote patient-centered care: an ethics manifesto. Ann Intern Med. 2007;147(11):792–794.PubMed
12.
go back to reference Eddy DM. Performance measurement: problems and solutions. Health Aff (Millwood). 1998;17(4):7–25.CrossRef Eddy DM. Performance measurement: problems and solutions. Health Aff (Millwood). 1998;17(4):7–25.CrossRef
13.
go back to reference Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA. 2005;294(6):716–724.PubMedCrossRef Boyd CM, Darer J, Boult C, Fried LP, Boult L, Wu AW. Clinical practice guidelines and quality of care for older patients with multiple comorbid diseases: implications for pay for performance. JAMA. 2005;294(6):716–724.PubMedCrossRef
14.
go back to reference McDonald R, White J, Marmor TR. Paying for performance in primary medical care: learning about and learning from "success" and "failure" in England and California. J Health Polit Policy Law. 2009;34(5):747–776.PubMedCrossRef McDonald R, White J, Marmor TR. Paying for performance in primary medical care: learning about and learning from "success" and "failure" in England and California. J Health Polit Policy Law. 2009;34(5):747–776.PubMedCrossRef
15.
go back to reference Blumenthal D. The vital role of professionalism in health care reform. Health Aff (Millwood). 1994;13(1):252–256.CrossRef Blumenthal D. The vital role of professionalism in health care reform. Health Aff (Millwood). 1994;13(1):252–256.CrossRef
16.
go back to reference Bokhour BG, Burgess JF Jr, Hook JM, White B, Berlowitz D, Guldin MR, et al. Incentive implementation in physician practices: A qualitative study of practice executive perspectives on pay for performance. Med Care Res Rev. 2006;63(1 Suppl):73S–95S.PubMedCrossRef Bokhour BG, Burgess JF Jr, Hook JM, White B, Berlowitz D, Guldin MR, et al. Incentive implementation in physician practices: A qualitative study of practice executive perspectives on pay for performance. Med Care Res Rev. 2006;63(1 Suppl):73S–95S.PubMedCrossRef
17.
go back to reference Fisher ES. Paying for performance–risks and recommendations. N Engl J Med. 2006;355(18):1845–1847.PubMedCrossRef Fisher ES. Paying for performance–risks and recommendations. N Engl J Med. 2006;355(18):1845–1847.PubMedCrossRef
18.
go back to reference Sittig DF, Krall MA, Dykstra RH, Russell A, Chin HL. A survey of factors affecting clinician acceptance of clinical decision support. BMC Med Inform Decis Mak. 2006;6:6.PubMedCrossRef Sittig DF, Krall MA, Dykstra RH, Russell A, Chin HL. A survey of factors affecting clinician acceptance of clinical decision support. BMC Med Inform Decis Mak. 2006;6:6.PubMedCrossRef
20.
go back to reference Chassin MR, Loeb JM, Schmaltz SP, Wachter RM. Accountability measures–using measurement to promote quality improvement. N Engl J Med. 2010;363(7):683–688.PubMedCrossRef Chassin MR, Loeb JM, Schmaltz SP, Wachter RM. Accountability measures–using measurement to promote quality improvement. N Engl J Med. 2010;363(7):683–688.PubMedCrossRef
21.
go back to reference Shen Y. Selection incentives in a performance-based contracting system. Health Serv Res. 2003;38(2):535–552.PubMedCrossRef Shen Y. Selection incentives in a performance-based contracting system. Health Serv Res. 2003;38(2):535–552.PubMedCrossRef
22.
go back to reference Werner RM, Asch DA, Polsky D. Racial profiling: the unintended consequences of coronary artery bypass graft report cards. Circulation. 2005;111(10):1257–1263.PubMedCrossRef Werner RM, Asch DA, Polsky D. Racial profiling: the unintended consequences of coronary artery bypass graft report cards. Circulation. 2005;111(10):1257–1263.PubMedCrossRef
23.
go back to reference Patton MQ. Qualitative Research and Evaluation Methods. 3rd ed. Thousand Oaks, CA: Sage; 2002. Patton MQ. Qualitative Research and Evaluation Methods. 3rd ed. Thousand Oaks, CA: Sage; 2002.
24.
go back to reference Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–72.PubMedCrossRef Bradley EH, Curry LA, Devers KJ. Qualitative data analysis for health services research: developing taxonomy, themes, and theory. Health Serv Res. 2007;42(4):1758–72.PubMedCrossRef
25.
go back to reference Lipton HL, Bero LA, Bird JA, McPhee SJ. The impact of clinical pharmacists' consultations on physicians' geriatric drug prescribing. A randomized controlled trial. Med Care. 1992;30(7):646–658.PubMedCrossRef Lipton HL, Bero LA, Bird JA, McPhee SJ. The impact of clinical pharmacists' consultations on physicians' geriatric drug prescribing. A randomized controlled trial. Med Care. 1992;30(7):646–658.PubMedCrossRef
26.
go back to reference Jyrkka J, Enlund H, Korhonen MJ, Sulkava R, Hartikainen S. Polypharmacy status as an indicator of mortality in an elderly population. Drugs Aging. 2009;26(12):1039–1048.PubMedCrossRef Jyrkka J, Enlund H, Korhonen MJ, Sulkava R, Hartikainen S. Polypharmacy status as an indicator of mortality in an elderly population. Drugs Aging. 2009;26(12):1039–1048.PubMedCrossRef
27.
go back to reference Flaherty JH, Perry HM III, Lynchard GS, Morley JE. Polypharmacy and hospitalization among older home care patients. J Gerontol A Biol Sci Med Sci. 2000;55(10):M554–M559.PubMedCrossRef Flaherty JH, Perry HM III, Lynchard GS, Morley JE. Polypharmacy and hospitalization among older home care patients. J Gerontol A Biol Sci Med Sci. 2000;55(10):M554–M559.PubMedCrossRef
28.
go back to reference Espino DV, Bazaldua OV, Palmer RF, Mouton CP, Parchman ML, Miles TP, et al. Suboptimal medication use and mortality in an older adult community-based cohort: results from the Hispanic EPESE Study. J Gerontol A Biol Sci Med Sci. 2006;61(2):170–175.PubMedCrossRef Espino DV, Bazaldua OV, Palmer RF, Mouton CP, Parchman ML, Miles TP, et al. Suboptimal medication use and mortality in an older adult community-based cohort: results from the Hispanic EPESE Study. J Gerontol A Biol Sci Med Sci. 2006;61(2):170–175.PubMedCrossRef
29.
go back to reference Iwata M, Kuzuya M, Kitagawa Y, Suzuki Y, Iguchi A. Underappreciated predictors for postdischarge mortality in acute hospitalized oldest-old patients. Gerontology. 2006;52(2):92–98.PubMedCrossRef Iwata M, Kuzuya M, Kitagawa Y, Suzuki Y, Iguchi A. Underappreciated predictors for postdischarge mortality in acute hospitalized oldest-old patients. Gerontology. 2006;52(2):92–98.PubMedCrossRef
30.
go back to reference Thomas WI, Thomas DS. The child in America: Behavior problems and programs. New York: Knopf; 1928:571–2. Thomas WI, Thomas DS. The child in America: Behavior problems and programs. New York: Knopf; 1928:571–2.
31.
go back to reference Wilkinson EK, McColl A, Exworthy M, Roderick P, Smith H, Moore M, et al. Reactions to the use of evidence-based performance indicators in primary care: a qualitative study. Qual Health Care. 2000;9(3):166–174.PubMedCrossRef Wilkinson EK, McColl A, Exworthy M, Roderick P, Smith H, Moore M, et al. Reactions to the use of evidence-based performance indicators in primary care: a qualitative study. Qual Health Care. 2000;9(3):166–174.PubMedCrossRef
32.
go back to reference Kerr EA, Krein SL, Vijan S, Hofer TP, Hayward RA. Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures. Am J Manag Care. 2001;7(11):1033–1043.PubMed Kerr EA, Krein SL, Vijan S, Hofer TP, Hayward RA. Avoiding pitfalls in chronic disease quality measurement: a case for the next generation of technical quality measures. Am J Manag Care. 2001;7(11):1033–1043.PubMed
33.
go back to reference Kerr EA, Smith DM, Hogan MM, Hofer TP, Krein SL, Bermann M, et al. Building a better quality measure: are some patients with 'poor quality' actually getting good care? Med Care. 2003;41(10):1173–1182.PubMedCrossRef Kerr EA, Smith DM, Hogan MM, Hofer TP, Krein SL, Bermann M, et al. Building a better quality measure: are some patients with 'poor quality' actually getting good care? Med Care. 2003;41(10):1173–1182.PubMedCrossRef
34.
go back to reference Epstein AM. Paying for performance in the United States and abroad. N Engl J Med. 2006;355(4):406–408.PubMedCrossRef Epstein AM. Paying for performance in the United States and abroad. N Engl J Med. 2006;355(4):406–408.PubMedCrossRef
35.
go back to reference Doran T, Fullwood C, Gravelle H, Reeves D, Kontopantelis E, Hiroeh U, et al. Pay-for-performance programs in family practices in the United Kingdom. N Engl J Med. 2006;355(4):375–384.PubMedCrossRef Doran T, Fullwood C, Gravelle H, Reeves D, Kontopantelis E, Hiroeh U, et al. Pay-for-performance programs in family practices in the United Kingdom. N Engl J Med. 2006;355(4):375–384.PubMedCrossRef
Metadata
Title
Unintended Consequences of Implementing a National Performance Measurement System into Local Practice
Authors
Adam A. Powell, PhD
Katie M. White, EdD
Melissa R. Partin, PhD
Krysten Halek, MA
Jon B. Christianson, PhD
Brian Neil, MD
Sylvia J. Hysong, PhD
Edwin J. Zarling, MD
Hanna E. Bloomfield, MD
Publication date
01-04-2012
Publisher
Springer-Verlag
Published in
Journal of General Internal Medicine / Issue 4/2012
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-011-1906-3

Other articles of this Issue 4/2012

Journal of General Internal Medicine 4/2012 Go to the issue

Healing Arts: Materia Medica

Natural Causes

Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.