Skip to main content
Top
Published in: Journal of General Internal Medicine 11/2008

01-11-2008 | Original Article

Quality Monitoring of Physicians: Linking Patients’ Experiences of Care to Clinical Quality and Outcomes

Authors: Thomas D. Sequist, MD MPH, Eric C. Schneider, MD MSc, Michael Anastario, PhD, Esosa G. Odigie, MBBS, MSc, Richard Marshall, MD, William H. Rogers, PhD, Dana Gelb Safran, ScD

Published in: Journal of General Internal Medicine | Issue 11/2008

Login to get access

Abstract

Background

Physicians are increasingly asked to improve the delivery of clinical services and patient experiences of care.

Objective

We evaluated the association between clinical performance and patient experiences in a statewide sample of physician practice sites and a sample of physicians within a large physician group.

Design, Setting, Participants

We separately identified 373 practice sites and 119 individual primary care physicians in Massachusetts.

Measurements

Using Health Plan Employer Data and Information Set data, we produced two composites addressing processes of care (prevention, disease management) and one composite addressing outcomes. Using Ambulatory Care Experiences Survey data, we produced seven composite measures summarizing the quality of clinical interactions and organizational features of care. For each sample (practice site and individual physician), we calculated adjusted Spearman correlation coefficients to assess the relationship between the composites summarizing patient experiences of care and those summarizing clinical performance.

Results

Among 42 possible correlations (21 correlations involving practice sites and 21 involving individual physicians), the majority were positive in site level (71%) and physician level (67%) analyses. For the 28 possible correlations involving patient experiences and clinical process composites, 8 (29%) were significant and positive, and only 2 (7%) were significant and negative. The magnitude of the significant positive correlations ranged from 0.13 to 0.19 at the site level and from 0.28 to 0.51 at the physician level. There were no significant correlations between patient experiences and the clinical outcome composite.

Conclusions

The modest correlations suggest that clinical quality and patient experience are distinct, but related domains that may require separate measurement and improvement initiatives.
Literature
1.
go back to reference McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.PubMedCrossRef McGlynn EA, Asch SM, Adams J, et al. The quality of health care delivered to adults in the United States. N Engl J Med. 2003;348:2635–45.PubMedCrossRef
2.
go back to reference Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348:2218–27.PubMedCrossRef Jha AK, Perlin JB, Kizer KW, Dudley RA. Effect of the transformation of the Veterans Affairs Health Care System on the quality of care. N Engl J Med. 2003;348:2218–27.PubMedCrossRef
3.
go back to reference Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med. 2005;353:692–700.PubMedCrossRef Trivedi AN, Zaslavsky AM, Schneider EC, Ayanian JZ. Trends in the quality of care and racial disparities in Medicare managed care. N Engl J Med. 2005;353:692–700.PubMedCrossRef
4.
go back to reference Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003;289:305–12.PubMedCrossRef Jencks SF, Huff ED, Cuerdon T. Change in the quality of care delivered to Medicare beneficiaries, 1998–1999 to 2000–2001. JAMA. 2003;289:305–12.PubMedCrossRef
5.
go back to reference Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. Jama. 2000;283:1866–74.PubMedCrossRef Marshall MN, Shekelle PG, Leatherman S, Brook RH. The public release of performance data: what do we expect to gain? A review of the evidence. Jama. 2000;283:1866–74.PubMedCrossRef
7.
go back to reference Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148:111–23.PubMed Fung CH, Lim YW, Mattke S, Damberg C, Shekelle PG. Systematic review: the evidence that publishing patient care performance data improves quality of care. Ann Intern Med. 2008;148:111–23.PubMed
8.
go back to reference Rosenthal MB, Landon BE, Normand SL, Frank RG, Epstein AM. Pay for performance in commercial HMOs. N Engl J Med. 2006;355:1895–902.PubMedCrossRef Rosenthal MB, Landon BE, Normand SL, Frank RG, Epstein AM. Pay for performance in commercial HMOs. N Engl J Med. 2006;355:1895–902.PubMedCrossRef
9.
go back to reference Doran T, Fullwood C, Gravelle H, et al. Pay-for-performance programs in family practices in the United Kingdom. N Engl J Med. 2006;355:375–84.PubMedCrossRef Doran T, Fullwood C, Gravelle H, et al. Pay-for-performance programs in family practices in the United Kingdom. N Engl J Med. 2006;355:375–84.PubMedCrossRef
10.
go back to reference Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. Jama. 2005;294:1788–93.PubMedCrossRef Rosenthal MB, Frank RG, Li Z, Epstein AM. Early experience with pay-for-performance: from concept to practice. Jama. 2005;294:1788–93.PubMedCrossRef
11.
go back to reference Institute of Medicine. Primary Care: America’s Health in a New Era. Washington, DC: National Academy Press; 1996. Institute of Medicine. Primary Care: America’s Health in a New Era. Washington, DC: National Academy Press; 1996.
12.
go back to reference Safran DG, Karp M, Coltin K, et al. Measuring patients’ experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med. 2006;21:13–21.PubMedCrossRef Safran DG, Karp M, Coltin K, et al. Measuring patients’ experiences with individual primary care physicians. Results of a statewide demonstration project. J Gen Intern Med. 2006;21:13–21.PubMedCrossRef
13.
go back to reference Audet AM, Davis K, Schoenbaum SC. Adoption of patient-centered care practices by physicians: results from a national survey. Arch Intern Med. 2006;166:754–9.PubMedCrossRef Audet AM, Davis K, Schoenbaum SC. Adoption of patient-centered care practices by physicians: results from a national survey. Arch Intern Med. 2006;166:754–9.PubMedCrossRef
14.
15.
go back to reference Hasnain-Wynia R. Is evidence-based medicine patient-centered and is patient-centered care evidence-based? Health Serv Res. 2006;41:1–8.PubMedCrossRef Hasnain-Wynia R. Is evidence-based medicine patient-centered and is patient-centered care evidence-based? Health Serv Res. 2006;41:1–8.PubMedCrossRef
16..
go back to reference Friedberg MW, Coltin KL, Pearson SD, et al. Does Affiliation of Physician Groups with One Another Produce Higher Quality Primary Care? J Gen Intern Med. 2007. Friedberg MW, Coltin KL, Pearson SD, et al. Does Affiliation of Physician Groups with One Another Produce Higher Quality Primary Care? J Gen Intern Med. 2007.
17.
go back to reference Dillman DA. Mail and Telephone Surveys: The Total Design Method. New York: John Wiley; 1978. Dillman DA. Mail and Telephone Surveys: The Total Design Method. New York: John Wiley; 1978.
18.
go back to reference Barton MB, Dayhoff DA, Soumerai SB, Rosenbach ML, Fletcher RH. Measuring access to effective care among elderly medicare enrollees in managed and Fee-for-Service care: a retrospective cohort study. BMC Health Serv Res. 2001;1:11.PubMedCrossRef Barton MB, Dayhoff DA, Soumerai SB, Rosenbach ML, Fletcher RH. Measuring access to effective care among elderly medicare enrollees in managed and Fee-for-Service care: a retrospective cohort study. BMC Health Serv Res. 2001;1:11.PubMedCrossRef
19.
go back to reference Pereira AG, Kleinman KP, Pearson SD. Leaving the practice: effects of primary care physician departure on patient care. Arch Intern Med. 2003;163:2733–6.PubMedCrossRef Pereira AG, Kleinman KP, Pearson SD. Leaving the practice: effects of primary care physician departure on patient care. Arch Intern Med. 2003;163:2733–6.PubMedCrossRef
20.
go back to reference Sequist TD, Marshall R, Lampert S, Buechler EJ, Lee TH. Missed opportunities in the primary care management of early acute ischemic heart disease. Arch Intern Med. 2006;166:2237–43.PubMedCrossRef Sequist TD, Marshall R, Lampert S, Buechler EJ, Lee TH. Missed opportunities in the primary care management of early acute ischemic heart disease. Arch Intern Med. 2006;166:2237–43.PubMedCrossRef
21.
go back to reference Sequist TD, Adams A, Zhang F, Ross-Degnan D, Ayanian JZ. Effect of quality improvement on racial disparities in diabetes care. Arch Intern Med. 2006;166:675–81.PubMedCrossRef Sequist TD, Adams A, Zhang F, Ross-Degnan D, Ayanian JZ. Effect of quality improvement on racial disparities in diabetes care. Arch Intern Med. 2006;166:675–81.PubMedCrossRef
22.
go back to reference Sequist TD, Fitzmaurice GM, Marshall R, Shaykevich S, Safran DG, Ayanian JZ. Physician performance and racial disparities in diabetes mellitus care. Arch Intern Med. 2008;168:1145–51.PubMedCrossRef Sequist TD, Fitzmaurice GM, Marshall R, Shaykevich S, Safran DG, Ayanian JZ. Physician performance and racial disparities in diabetes mellitus care. Arch Intern Med. 2008;168:1145–51.PubMedCrossRef
23.
go back to reference National Center for Quality Assurance. HEDIS 2005 Volume 1: Narrative - What’s in it and why it matters.; 2004. National Center for Quality Assurance. HEDIS 2005 Volume 1: Narrative - What’s in it and why it matters.; 2004.
24.
go back to reference Donabedian A. The definition of quality and approaches to its assessment. Ann Arbor: Health Administration Press; 1980. Donabedian A. The definition of quality and approaches to its assessment. Ann Arbor: Health Administration Press; 1980.
25.
go back to reference Nunnally JC, Bernstein IH. Psychometric Theory. New York: McGraw Hilll; 1994. Nunnally JC, Bernstein IH. Psychometric Theory. New York: McGraw Hilll; 1994.
26.
go back to reference Davis K, Schoenbaum SC, Audet AM. A 2020 vision of patient-centered primary care. J Gen Intern Med. 2005;20:953–7.PubMedCrossRef Davis K, Schoenbaum SC, Audet AM. A 2020 vision of patient-centered primary care. J Gen Intern Med. 2005;20:953–7.PubMedCrossRef
27.
go back to reference Safran DG. Defining the future of primary care: what can we learn from patients? Ann Intern Med. 2003;138:248–55.PubMed Safran DG. Defining the future of primary care: what can we learn from patients? Ann Intern Med. 2003;138:248–55.PubMed
28.
go back to reference Schneider EC, Zaslavsky AM, Landon BE, Lied TR, Sheingold S, Cleary PD. National quality monitoring of Medicare health plans: the relationship between enrollees’ reports and the quality of clinical care. Med Care. 2001;39:1313–25.PubMedCrossRef Schneider EC, Zaslavsky AM, Landon BE, Lied TR, Sheingold S, Cleary PD. National quality monitoring of Medicare health plans: the relationship between enrollees’ reports and the quality of clinical care. Med Care. 2001;39:1313–25.PubMedCrossRef
29.
go back to reference Fung CH, Elliott MN, Hays RD, et al. Patients’ preferences for technical versus interpersonal quality when selecting a primary care physician. Health Serv Res. 2005;40:957–77.PubMedCrossRef Fung CH, Elliott MN, Hays RD, et al. Patients’ preferences for technical versus interpersonal quality when selecting a primary care physician. Health Serv Res. 2005;40:957–77.PubMedCrossRef
30.
go back to reference Montgomery JE, Irish JT, Wilson IB, et al. Primary care experiences of medicare beneficiaries, 1998 to 2000. J Gen Intern Med. 2004;19:991–8.PubMedCrossRef Montgomery JE, Irish JT, Wilson IB, et al. Primary care experiences of medicare beneficiaries, 1998 to 2000. J Gen Intern Med. 2004;19:991–8.PubMedCrossRef
31.
go back to reference Kahn KL, Schneider EC, Malin JL, Adams JL, Epstein AM. Patient centered experiences in breast cancer: predicting long-term adherence to tamoxifen use. Med Care. 2007;45:431–9.PubMedCrossRef Kahn KL, Schneider EC, Malin JL, Adams JL, Epstein AM. Patient centered experiences in breast cancer: predicting long-term adherence to tamoxifen use. Med Care. 2007;45:431–9.PubMedCrossRef
32.
go back to reference Kahn KL, Tisnado DM, Adams JL, et al. Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease? Health Serv Res. 2007;42:63–83.PubMedCrossRef Kahn KL, Tisnado DM, Adams JL, et al. Does ambulatory process of care predict health-related quality of life outcomes for patients with chronic disease? Health Serv Res. 2007;42:63–83.PubMedCrossRef
33.
go back to reference Safran DG, Taira DA, Rogers WH, Kosinski M, Ware JE, Tarlov AR. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–20.PubMed Safran DG, Taira DA, Rogers WH, Kosinski M, Ware JE, Tarlov AR. Linking primary care performance to outcomes of care. J Fam Pract. 1998;47:213–20.PubMed
34.
35.
go back to reference DiMatteo MR, Sherbourne CD, Hays RD, et al. Physicians’ characteristics influence patients’ adherence to medical treatment: results from the Medical Outcomes Study. Health Psychol. 1993;12:93–102.PubMedCrossRef DiMatteo MR, Sherbourne CD, Hays RD, et al. Physicians’ characteristics influence patients’ adherence to medical treatment: results from the Medical Outcomes Study. Health Psychol. 1993;12:93–102.PubMedCrossRef
36.
go back to reference Werner RM, Bradlow ET. Relationship between Medicare’s hospital compare performance measures and mortality rates. Jama. 2006;296:2694–702.PubMedCrossRef Werner RM, Bradlow ET. Relationship between Medicare’s hospital compare performance measures and mortality rates. Jama. 2006;296:2694–702.PubMedCrossRef
Metadata
Title
Quality Monitoring of Physicians: Linking Patients’ Experiences of Care to Clinical Quality and Outcomes
Authors
Thomas D. Sequist, MD MPH
Eric C. Schneider, MD MSc
Michael Anastario, PhD
Esosa G. Odigie, MBBS, MSc
Richard Marshall, MD
William H. Rogers, PhD
Dana Gelb Safran, ScD
Publication date
01-11-2008
Publisher
Springer-Verlag
Published in
Journal of General Internal Medicine / Issue 11/2008
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-008-0760-4

Other articles of this Issue 11/2008

Journal of General Internal Medicine 11/2008 Go to the issue