Skip to main content
Top
Published in: Journal of General Internal Medicine 12/2015

01-12-2015 | Original Research

Evaluating a Model to Predict Primary Care Physician-Defined Complexity in a Large Academic Primary Care Practice-Based Research Network

Authors: Clemens S. Hong, MD MPH, Steven J. Atlas, MD MPH, Jeffrey M. Ashburner, MPH, Yuchiao Chang, PhD, Wei He, MPH, Timothy G. Ferris, MD MPH, Richard W. Grant, MD MPH

Published in: Journal of General Internal Medicine | Issue 12/2015

Login to get access

ABSTRACT

BACKGROUND

Improving the ability to risk-stratify patients is critical for efficiently allocating resources within healthcare systems.

OBJECTIVE

The purpose of this study was to evaluate a physician-defined complexity prediction model against outpatient Charlson score (OCS) and a commercial risk predictor (CRP).

DESIGN

Using a cohort in which primary care physicians reviewed 4302 of their adult patients, we developed a predictive model for estimated physician-defined complexity (ePDC) and categorized our population using ePDC, OCS and CRP.

PARTICIPANTS

143,372 primary care patients in a practice-based research network participated in the study.

MAIN MEASURES

For all patients categorized as complex in 2007 by one or more risk-stratification method, we calculated the percentage of total person time from 2008–2011 for which eligible cancer screening was incomplete, HbA1c was ≥ 9 %, and LDL was ≥ 130 mg/dl (in patients with cardiovascular disease). We also calculated the number of emergency department (ED) visits and hospital admissions per person year (ppy).

KEY RESULTS

There was modest agreement among individuals classified as complex using ePDC compared with OCS (36.7 %) and CRP (39.6 %). Over 4 follow-up years, eligible ePDC-complex patients had higher proportions (p < 0.001) of time with: incomplete cervical (17.8 % vs. 13.3 % for OCS; 19.4 % vs. 11.2 % for CRP), breast (21.4 % vs. 14.9 % for OCS; 22.7 % vs. 15.0 % for CRP), and colon (25.9 % vs. 18.7 % for OCS; 27.0 % vs. 18.2 % for CRP) cancer screening; HbA1c ≥ 9 % (15.6 % vs. 8.1 % for OCS; 15.9 % vs. 6.9 % for CRP); and LDL ≥ 130 mg/dl (12.4 % vs. 7.9 % for OCS; 11.8 % vs 9.0 % for CRP). ePDC-complex patients had higher rates (p < 0.003) of: ED visits (0.21 vs. 0.11 ppy for OCS; 0.17 vs. 0.15 ppy for CRP), and admissions in patients 45–64 and ≥ 65 years old (0.11 vs. 0.10 ppy AND 0.24 vs. 0.21 ppy for OCS).

CONCLUSION

Our measure for estimated physician-defined complexity compared favorably to commonly used risk-prediction approaches in identifying future suboptimal quality and utilization outcomes.
Appendix
Available only for authorised users
Literature
1.
go back to reference AHRQ, Agency for Healthcare Research and Quality. Closing the quality gap: A critical analysis of quality improvement strategies. 2007;7. AHRQ, Agency for Healthcare Research and Quality. Closing the quality gap: A critical analysis of quality improvement strategies. 2007;7.
3.
go back to reference Bell J, Mancuso D, and Krupski TE. A. A randomized controlled trial of king county partners' rethinking care intervention: Health and social outcomes up to two years post-randomization. 2012. Bell J, Mancuso D, and Krupski TE. A. A randomized controlled trial of king county partners' rethinking care intervention: Health and social outcomes up to two years post-randomization. 2012.
4.
go back to reference Bielaszka-DuVernay C. Vermont’s blueprint for medical homes, community health teams, and better health at lower cost. Health Affairs (Project Hope). 2011;30(3):383–386.CrossRef Bielaszka-DuVernay C. Vermont’s blueprint for medical homes, community health teams, and better health at lower cost. Health Affairs (Project Hope). 2011;30(3):383–386.CrossRef
5.
go back to reference Cohen SB, Yu W. The concentration and persistence in the level of health expenditures over time: Estimated the U.S. population, 2008–2009. Med Expenditure Panel Surv. 2012;Statistical Brief #354. Cohen SB, Yu W. The concentration and persistence in the level of health expenditures over time: Estimated the U.S. population, 2008–2009. Med Expenditure Panel Surv. 2012;Statistical Brief #354.
6.
go back to reference Brown RS, Peikes D, Peterson G, Schore J, Razafindrakoto CM. Six features of medicare coordinated care demonstration programs that cut hospital admissions of high-risk patients. Health Aff (Millwood). 2012;31(6):1156–1166.CrossRef Brown RS, Peikes D, Peterson G, Schore J, Razafindrakoto CM. Six features of medicare coordinated care demonstration programs that cut hospital admissions of high-risk patients. Health Aff (Millwood). 2012;31(6):1156–1166.CrossRef
7.
go back to reference Dorr DA, Wilcox A, Donnelly SM, Burns L, Clayton PD. Impact of generalist care managers on patients with diabetes. Health Serv Res. 2005;40:1400–1421.PubMedCentralCrossRefPubMed Dorr DA, Wilcox A, Donnelly SM, Burns L, Clayton PD. Impact of generalist care managers on patients with diabetes. Health Serv Res. 2005;40:1400–1421.PubMedCentralCrossRefPubMed
8.
go back to reference Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among medicare beneficiaries: 15 randomized trials. JAMA. 2009;301(6):603–618.CrossRefPubMed Peikes D, Chen A, Schore J, Brown R. Effects of care coordination on hospitalization, quality of care, and health care expenditures among medicare beneficiaries: 15 randomized trials. JAMA. 2009;301(6):603–618.CrossRefPubMed
9.
go back to reference McCall N, Cromwell J, Urato C. Evaluation of medicare care management for high cost beneficiaries (CMHCB) demonstration: Massachusetts general hospital and massachusetts general physicians organization. 2010;RTI Project Number 0207964.025.000.001. McCall N, Cromwell J, Urato C. Evaluation of medicare care management for high cost beneficiaries (CMHCB) demonstration: Massachusetts general hospital and massachusetts general physicians organization. 2010;RTI Project Number 0207964.025.000.001.
10.
go back to reference Boult C, Reider L, Leff B, et al. The effect of guided care teams on the use of health services: Results from a cluster- randomized controlled trial. Arch Intern Med. 2011;171:460–466.PubMedCentralCrossRefPubMed Boult C, Reider L, Leff B, et al. The effect of guided care teams on the use of health services: Results from a cluster- randomized controlled trial. Arch Intern Med. 2011;171:460–466.PubMedCentralCrossRefPubMed
11.
go back to reference Counsell SR, Callahan CM, Clark DO, et al. Geriatric care management for low-income seniors: A randomized controlled trial. JAMA. 2007;298(22):2623–2633.CrossRefPubMed Counsell SR, Callahan CM, Clark DO, et al. Geriatric care management for low-income seniors: A randomized controlled trial. JAMA. 2007;298(22):2623–2633.CrossRefPubMed
12.
go back to reference Waxmonsky JA, Glese A, McGinnis GF, et al. Colorado access’ enhanced care management for high-cost, high-need medicaid members. J Ambul Care Manag. 2011;34(2):183–191.CrossRef Waxmonsky JA, Glese A, McGinnis GF, et al. Colorado access’ enhanced care management for high-cost, high-need medicaid members. J Ambul Care Manag. 2011;34(2):183–191.CrossRef
13.
go back to reference Pattison M, Romer AL. Improving care through the end of life: Launching a primary care clinic-based program. J Palliat Med. 2001;4:249–254.CrossRefPubMed Pattison M, Romer AL. Improving care through the end of life: Launching a primary care clinic-based program. J Palliat Med. 2001;4:249–254.CrossRefPubMed
14.
go back to reference Moss AH, Lunney JR, Culp S, et al. Prognostic significance of the “surprise” question in cancer patients. J Palliat Med. 2010;13(7):837–840.CrossRefPubMed Moss AH, Lunney JR, Culp S, et al. Prognostic significance of the “surprise” question in cancer patients. J Palliat Med. 2010;13(7):837–840.CrossRefPubMed
15.
go back to reference Moss AH, Ganjoo J, Sharma S, et al. Utility of the “surprise” question to identify dialysis patients with high mortality. Clin J Am Soc Nephrol. 2008;1:1379–1384.CrossRef Moss AH, Ganjoo J, Sharma S, et al. Utility of the “surprise” question to identify dialysis patients with high mortality. Clin J Am Soc Nephrol. 2008;1:1379–1384.CrossRef
16.
go back to reference Cohen LM, Ruthazer R, Moss AH, Germain MJ. Predicting six month mortality for patients who are on maintenance hemodialysis. Clin J Am Soc Nephrol. 2010;5(1):72–79.PubMedCentralCrossRefPubMed Cohen LM, Ruthazer R, Moss AH, Germain MJ. Predicting six month mortality for patients who are on maintenance hemodialysis. Clin J Am Soc Nephrol. 2010;5(1):72–79.PubMedCentralCrossRefPubMed
17.
go back to reference Olfson M, Mechanic D, Boyer CA, Hansell S, Walkup J, Weiden PJ. Assessing clinical predictions of early rehospitalization in schizophrenia. J Nery Ment Dis. 1999;187(12):721–729.CrossRef Olfson M, Mechanic D, Boyer CA, Hansell S, Walkup J, Weiden PJ. Assessing clinical predictions of early rehospitalization in schizophrenia. J Nery Ment Dis. 1999;187(12):721–729.CrossRef
18.
go back to reference Allaudeen N, Schnipper JL, Orav EJ, Wachter RM, Vidyarthi AR. Inability of providers to predict unplanned readmissions. J Gen Intern Med. 2011;26(7):771–776.PubMedCentralCrossRefPubMed Allaudeen N, Schnipper JL, Orav EJ, Wachter RM, Vidyarthi AR. Inability of providers to predict unplanned readmissions. J Gen Intern Med. 2011;26(7):771–776.PubMedCentralCrossRefPubMed
19.
go back to reference Pope GC, Ellis RP, Ash AS, Ayanian JZ, Bates DW, Burstin H, Iezzoni LI, Marcantonio E, Wu B. Diagnostic cost group hierarchical condidtion category models for Medicare risk adjustment. Health Care Financ Adm. 2000. Pope GC, Ellis RP, Ash AS, Ayanian JZ, Bates DW, Burstin H, Iezzoni LI, Marcantonio E, Wu B. Diagnostic cost group hierarchical condidtion category models for Medicare risk adjustment. Health Care Financ Adm. 2000.
20.
go back to reference Hughes JS, Averil RF, Eisenhandler J, Goldfield NI, Muldoon J, Neff JM, Gay JC. Clinical Risk Groups (CRGs): a classification system for risk-adjusted capitation-based payment and health care management. Med Care. 2004;42(1):81–90.CrossRefPubMed Hughes JS, Averil RF, Eisenhandler J, Goldfield NI, Muldoon J, Neff JM, Gay JC. Clinical Risk Groups (CRGs): a classification system for risk-adjusted capitation-based payment and health care management. Med Care. 2004;42(1):81–90.CrossRefPubMed
21.
go back to reference Stam PJ, van Vilet RC, van de Ven WP. Diagnostic Pharmacy-based, and Self-reported Health Measures in Risk Equalization Models. Med Care. 2010;48(5):448–457.CrossRefPubMed Stam PJ, van Vilet RC, van de Ven WP. Diagnostic Pharmacy-based, and Self-reported Health Measures in Risk Equalization Models. Med Care. 2010;48(5):448–457.CrossRefPubMed
22.
go back to reference Freund T, Mahler C, Erler A, Gensichen J, Ose D, Szecsenyi J, Peters-Klimm F. Identification of patients likely to benefit from care management programs. Am J Manag Care. 2011;17(5):345–352.PubMed Freund T, Mahler C, Erler A, Gensichen J, Ose D, Szecsenyi J, Peters-Klimm F. Identification of patients likely to benefit from care management programs. Am J Manag Care. 2011;17(5):345–352.PubMed
23.
go back to reference Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, Kripalani S. Risk prediction models for hospital readmission: a systematic review. J Am Med Assoc. 2011;306(15):1688–1698.CrossRef Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, Kripalani S. Risk prediction models for hospital readmission: a systematic review. J Am Med Assoc. 2011;306(15):1688–1698.CrossRef
24.
go back to reference Grant RW, Ashburner JM, Hong CS, Chang Y, Barry MJ, Atlas SJ. Defining patient complexity from the primary care physician’s perspective: A cohort study. Ann Intern Med. 2011;155(12):797–804.CrossRefPubMed Grant RW, Ashburner JM, Hong CS, Chang Y, Barry MJ, Atlas SJ. Defining patient complexity from the primary care physician’s perspective: A cohort study. Ann Intern Med. 2011;155(12):797–804.CrossRefPubMed
25.
go back to reference Grant RW, Wexler DJ, Ashburner JM, Hong CS, Atlas SJ. Characteristics of “complex” patients with type 2 diabetes mellitus according to their primary care physicians. Arch Intern Med. 2012;172(10):821–823.CrossRefPubMed Grant RW, Wexler DJ, Ashburner JM, Hong CS, Atlas SJ. Characteristics of “complex” patients with type 2 diabetes mellitus according to their primary care physicians. Arch Intern Med. 2012;172(10):821–823.CrossRefPubMed
26.
go back to reference Charlson ME, Charlson RE, Peterson JC, Marinopoulos SS, Briggs WM, Hollenburg JP. The charlson comorbidity index is adapted to predict costs of chronic disease in primary care patients. J Clin Epidemiol. 2008;61(12):1234–1240.CrossRefPubMed Charlson ME, Charlson RE, Peterson JC, Marinopoulos SS, Briggs WM, Hollenburg JP. The charlson comorbidity index is adapted to predict costs of chronic disease in primary care patients. J Clin Epidemiol. 2008;61(12):1234–1240.CrossRefPubMed
27.
go back to reference Dang DK, Pont JM, Portmoy MA. Episode treatment groups: An illness classification and episode building system–part II. Med Interface. 1996;9(4):122–128.PubMed Dang DK, Pont JM, Portmoy MA. Episode treatment groups: An illness classification and episode building system–part II. Med Interface. 1996;9(4):122–128.PubMed
28.
go back to reference Dang DK, Pont JM, Portnoy MA. Episode treatment groups: An illness classification and episode building system–part I. Med Interface. 1996;9(3):118–122.PubMed Dang DK, Pont JM, Portnoy MA. Episode treatment groups: An illness classification and episode building system–part I. Med Interface. 1996;9(3):118–122.PubMed
29.
go back to reference Kansagara D, Englander H, Salanitro A, et al. Risk prediction models for hospital readmission: A systematic review. JAMA: J Am Med Assoc. 2011;306(15):1688–1698.CrossRef Kansagara D, Englander H, Salanitro A, et al. Risk prediction models for hospital readmission: A systematic review. JAMA: J Am Med Assoc. 2011;306(15):1688–1698.CrossRef
30.
go back to reference Kronick R, Dreyfus T, Lee L, Zhou Z. Diagnostic risk adjustment for medicaid: The disability payment system. Health Care Financ Rev. 1996;17(3):7–33.PubMedCentralPubMed Kronick R, Dreyfus T, Lee L, Zhou Z. Diagnostic risk adjustment for medicaid: The disability payment system. Health Care Financ Rev. 1996;17(3):7–33.PubMedCentralPubMed
31.
go back to reference Ash AS, Zhao Y, Ellis RP, Schlein KM. Finding future high-cost cases: Comparing prior cost versus diagnosis-based methods. Health Serv Res. 2001;36:194–206.PubMedCentralPubMed Ash AS, Zhao Y, Ellis RP, Schlein KM. Finding future high-cost cases: Comparing prior cost versus diagnosis-based methods. Health Serv Res. 2001;36:194–206.PubMedCentralPubMed
32.
go back to reference Petersen LA, Byrne MM, Daw CN, Hasche J, Reis B, Pietz K. Relationship between clinical conditions and use of veterans affairs health care among medicare-enrolled veterans. Health Serv Res. 2010;45(3):762–791.PubMedCentralCrossRefPubMed Petersen LA, Byrne MM, Daw CN, Hasche J, Reis B, Pietz K. Relationship between clinical conditions and use of veterans affairs health care among medicare-enrolled veterans. Health Serv Res. 2010;45(3):762–791.PubMedCentralCrossRefPubMed
33.
go back to reference Wahls TL, Barnett MJ, Rosenthal GE. Predicting resource utilization in a veterans health administration primary care population: comparison of methods based on diagnoses and medications. Med Care. 2004;42(2):123–128.CrossRefPubMed Wahls TL, Barnett MJ, Rosenthal GE. Predicting resource utilization in a veterans health administration primary care population: comparison of methods based on diagnoses and medications. Med Care. 2004;42(2):123–128.CrossRefPubMed
34.
go back to reference Rosen AK, Loveland SA, Anderson JJ, Hankin CS, Breckenridge JN, Berlowitz DR. Diagnostic cost groups (DCGs) and concurrent utilization among patients with substance abuse disorders. Health Serv Res. 2002;37(4):1079–1103.PubMedCentralCrossRefPubMed Rosen AK, Loveland SA, Anderson JJ, Hankin CS, Breckenridge JN, Berlowitz DR. Diagnostic cost groups (DCGs) and concurrent utilization among patients with substance abuse disorders. Health Serv Res. 2002;37(4):1079–1103.PubMedCentralCrossRefPubMed
35.
go back to reference Haas LR, Takahashi PY, Shah ND, Stroebel RJ, Bernard ME, Finnie DM, Naessens JM. Risk-stratification methods for identifying patients for care coordination. Am J Manag Care. 2013;19(9):725–732.PubMed Haas LR, Takahashi PY, Shah ND, Stroebel RJ, Bernard ME, Finnie DM, Naessens JM. Risk-stratification methods for identifying patients for care coordination. Am J Manag Care. 2013;19(9):725–732.PubMed
36.
go back to reference Lemke KW, Weiner JP, Clark JM. Development and validation of a model for predicting inpatient hospitalization. Med Care. 2012;50(2):131–139.CrossRefPubMed Lemke KW, Weiner JP, Clark JM. Development and validation of a model for predicting inpatient hospitalization. Med Care. 2012;50(2):131–139.CrossRefPubMed
37.
go back to reference Donnan PT, Dorward DW, Mutch D, Morris AD. Development and validation of a model for predicting emergency admissions over the next year (PEONY): a UK historical cohort sutdy. Arch Intern Med. 2008;168(13):1416–1422.CrossRefPubMed Donnan PT, Dorward DW, Mutch D, Morris AD. Development and validation of a model for predicting emergency admissions over the next year (PEONY): a UK historical cohort sutdy. Arch Intern Med. 2008;168(13):1416–1422.CrossRefPubMed
Metadata
Title
Evaluating a Model to Predict Primary Care Physician-Defined Complexity in a Large Academic Primary Care Practice-Based Research Network
Authors
Clemens S. Hong, MD MPH
Steven J. Atlas, MD MPH
Jeffrey M. Ashburner, MPH
Yuchiao Chang, PhD
Wei He, MPH
Timothy G. Ferris, MD MPH
Richard W. Grant, MD MPH
Publication date
01-12-2015
Publisher
Springer US
Published in
Journal of General Internal Medicine / Issue 12/2015
Print ISSN: 0884-8734
Electronic ISSN: 1525-1497
DOI
https://doi.org/10.1007/s11606-015-3357-8

Other articles of this Issue 12/2015

Journal of General Internal Medicine 12/2015 Go to the issue

Clinical Practice: Exercises in Clinical Reasoning

Diagnostic Scheming

Clinical Practice: Clinical Images

Chest-Wall Metastasis of Prostate Cancer

Letter to the Editor

Health Literacy During Aging

Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.