Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2014

Open Access 01-12-2014 | Research article

Diagnosis-specific readmission risk prediction using electronic health data: a retrospective cohort study

Authors: Courtney Hebert, Chaitanya Shivade, Randi Foraker, Jared Wasserman, Caryn Roth, Hagop Mekhjian, Stanley Lemeshow, Peter Embi

Published in: BMC Medical Informatics and Decision Making | Issue 1/2014

Login to get access

Abstract

Background

Readmissions after hospital discharge are a common occurrence and are costly for both hospitals and patients. Previous attempts to create universal risk prediction models for readmission have not met with success. In this study we leveraged a comprehensive electronic health record to create readmission-risk models that were institution- and patient- specific in an attempt to improve our ability to predict readmission.

Methods

This is a retrospective cohort study performed at a large midwestern tertiary care medical center. All patients with a primary discharge diagnosis of congestive heart failure, acute myocardial infarction or pneumonia over a two-year time period were included in the analysis.
The main outcome was 30-day readmission. Demographic, comorbidity, laboratory, and medication data were collected on all patients from a comprehensive information warehouse. Using multivariable analysis with stepwise removal we created three risk disease-specific risk prediction models and a combined model. These models were then validated on separate cohorts.

Results

3572 patients were included in the derivation cohort. Overall there was a 16.2% readmission rate. The acute myocardial infarction and pneumonia readmission-risk models performed well on a random sample validation cohort (AUC range 0.73 to 0.76) but less well on a historical validation cohort (AUC 0.66 for both). The congestive heart failure model performed poorly on both validation cohorts (AUC 0.63 and 0.64).

Conclusions

The readmission-risk models for acute myocardial infarction and pneumonia validated well on a contemporary cohort, but not as well on a historical cohort, suggesting that models such as these need to be continuously trained and adjusted to respond to local trends. The poor performance of the congestive heart failure model may suggest that for chronic disease conditions social and behavioral variables are of greater importance and improved documentation of these variables within the electronic health record should be encouraged.
Appendix
Available only for authorised users
Literature
1.
go back to reference Zaya M, Phan A, Schwarz ER: The dilemma, causes and approaches to avoid recurrent hospital readmissions for patients with chronic heart failure. Heart Fail Rev. 2012, 17 (3): 345-353.CrossRefPubMed Zaya M, Phan A, Schwarz ER: The dilemma, causes and approaches to avoid recurrent hospital readmissions for patients with chronic heart failure. Heart Fail Rev. 2012, 17 (3): 345-353.CrossRefPubMed
2.
go back to reference Bernheim SM, Grady JN, Lin Z, Wang Y, Wang Y, Savage SV, Bhat KR, Ross JS, Desai MM, Merrill AR, Han LF, Rapp MT, Drye EE, Normand S-LT, Krumholz HM: National patterns of risk-standardized mortality and readmission for acute myocardial infarction and heart failure. Circ Cardiovasc Qual Outcomes. 2010, 3 (5): 459-467.CrossRefPubMedPubMedCentral Bernheim SM, Grady JN, Lin Z, Wang Y, Wang Y, Savage SV, Bhat KR, Ross JS, Desai MM, Merrill AR, Han LF, Rapp MT, Drye EE, Normand S-LT, Krumholz HM: National patterns of risk-standardized mortality and readmission for acute myocardial infarction and heart failure. Circ Cardiovasc Qual Outcomes. 2010, 3 (5): 459-467.CrossRefPubMedPubMedCentral
3.
go back to reference Brand C, Sundararajan V, Jones C, Hutchinson A, Campbell D: Readmission patterns in patients with chronic obstructive pulmonary disease, chronic heart failure and diabetes mellitus: an administrative dataset analysis. Intern Med J. 2005, 35 (5): 296-299.CrossRefPubMed Brand C, Sundararajan V, Jones C, Hutchinson A, Campbell D: Readmission patterns in patients with chronic obstructive pulmonary disease, chronic heart failure and diabetes mellitus: an administrative dataset analysis. Intern Med J. 2005, 35 (5): 296-299.CrossRefPubMed
4.
go back to reference Ross JS, Chen J, Lin Z, Bueno H, Curtis JP, Keenan PS, Normand S-LT, Schreiner G, Spertus JA, Vidán MT, Wang Y, Wang Y, Krumholz HM: Recent national trends in readmission rates after heart failure hospitalization. Circ Heart Fail. 2010, 3 (1): 97-103.CrossRefPubMed Ross JS, Chen J, Lin Z, Bueno H, Curtis JP, Keenan PS, Normand S-LT, Schreiner G, Spertus JA, Vidán MT, Wang Y, Wang Y, Krumholz HM: Recent national trends in readmission rates after heart failure hospitalization. Circ Heart Fail. 2010, 3 (1): 97-103.CrossRefPubMed
7.
go back to reference Hauptman PJ, Swindle J, Burroughs TE, Schnitzler MA: Resource utilization in patients hospitalized with heart failure: Insights from a contemporary national hospital database. Am Heart J. 2008, 155 (6): 978-985. e971CrossRefPubMed Hauptman PJ, Swindle J, Burroughs TE, Schnitzler MA: Resource utilization in patients hospitalized with heart failure: Insights from a contemporary national hospital database. Am Heart J. 2008, 155 (6): 978-985. e971CrossRefPubMed
8.
go back to reference Krumholz HM, Merrill AR, Schone EM, Schreiner GC, Chen J, Bradley EH, Wang Y, Wang Y, Lin Z, Straube BM, Rapp MT, Normand S-LT, Drye EE: Patterns of hospital performance in acute myocardial infarction and heart failure 30-day mortality and readmission. Circ Cardiovasc Qual Outcomes. 2009, 2: 407-413.CrossRefPubMed Krumholz HM, Merrill AR, Schone EM, Schreiner GC, Chen J, Bradley EH, Wang Y, Wang Y, Lin Z, Straube BM, Rapp MT, Normand S-LT, Drye EE: Patterns of hospital performance in acute myocardial infarction and heart failure 30-day mortality and readmission. Circ Cardiovasc Qual Outcomes. 2009, 2: 407-413.CrossRefPubMed
9.
go back to reference Luthi JC, Burnand B, McClellan WM, Pitts SR, Flanders WD: Is readmission to hospital an indicator of poor process of care for patients with heart failure?. Qual Saf Health Care. 2004, 13 (1): 46-51.CrossRefPubMedPubMedCentral Luthi JC, Burnand B, McClellan WM, Pitts SR, Flanders WD: Is readmission to hospital an indicator of poor process of care for patients with heart failure?. Qual Saf Health Care. 2004, 13 (1): 46-51.CrossRefPubMedPubMedCentral
10.
go back to reference McDonald K, Ledwidge M, Cahill J, Kelly J, Quigley P, Maurer B, Begley F, Ryder M, Travers B, Timmons L, Burke T: Elimination of early rehospitalization in a randomized, controlled trial of multidisciplinary care in a high-risk, elderly heart failure population: the potential contributions of specialist care, clinical stability and optimal angiotensin-converting enzyme inhibitor dose at discharge. Eur J Heart Fail. 2001, 3 (2): 209-215.CrossRefPubMed McDonald K, Ledwidge M, Cahill J, Kelly J, Quigley P, Maurer B, Begley F, Ryder M, Travers B, Timmons L, Burke T: Elimination of early rehospitalization in a randomized, controlled trial of multidisciplinary care in a high-risk, elderly heart failure population: the potential contributions of specialist care, clinical stability and optimal angiotensin-converting enzyme inhibitor dose at discharge. Eur J Heart Fail. 2001, 3 (2): 209-215.CrossRefPubMed
11.
go back to reference Mosterd A, Hoes AW: Reducing hospitalizations for heart failure. Eur Heart J. 2002, 23 (11): 842-845.CrossRefPubMed Mosterd A, Hoes AW: Reducing hospitalizations for heart failure. Eur Heart J. 2002, 23 (11): 842-845.CrossRefPubMed
12.
go back to reference Rich MW, Beckham V, Wittenberg C, Leven CL, Freedland KE, Carney RM: A multidisciplinary intervention to prevent the readmission of elderly patients with congestive heart failure. N Engl J Med. 1995, 333 (18): 1190-1195.CrossRefPubMed Rich MW, Beckham V, Wittenberg C, Leven CL, Freedland KE, Carney RM: A multidisciplinary intervention to prevent the readmission of elderly patients with congestive heart failure. N Engl J Med. 1995, 333 (18): 1190-1195.CrossRefPubMed
13.
go back to reference Riegel B, Naylor M, Stewart S, McMurray JJV, Rich MW: Interventions to prevent readmission for congestive heart failure. JAMA. 2004, 291 (23): 2816-PubMed Riegel B, Naylor M, Stewart S, McMurray JJV, Rich MW: Interventions to prevent readmission for congestive heart failure. JAMA. 2004, 291 (23): 2816-PubMed
14.
go back to reference Vavouranakis I, Lambrogiannakis E, Markakis G, Dermitzakis A, Haroniti Z, Ninidaki C, Borbantonaki A, Tsoutsoumanou K: Effect of home-based intervention on hospital readmission and quality of life in middle-aged patients with severe congestive heart failure: a 12-month follow up study. Eur J Cardiovasc Nurs. 2003, 2 (2): 105-111.CrossRefPubMed Vavouranakis I, Lambrogiannakis E, Markakis G, Dermitzakis A, Haroniti Z, Ninidaki C, Borbantonaki A, Tsoutsoumanou K: Effect of home-based intervention on hospital readmission and quality of life in middle-aged patients with severe congestive heart failure: a 12-month follow up study. Eur J Cardiovasc Nurs. 2003, 2 (2): 105-111.CrossRefPubMed
15.
go back to reference Allaudeen N, Schnipper JL, Orav EJ, Wachter RM, Vidyarthi AR: Inability of providers to predict unplanned readmissions. J Gen Intern Med. 2011, 26 (7): 771-776.CrossRefPubMedPubMedCentral Allaudeen N, Schnipper JL, Orav EJ, Wachter RM, Vidyarthi AR: Inability of providers to predict unplanned readmissions. J Gen Intern Med. 2011, 26 (7): 771-776.CrossRefPubMedPubMedCentral
16.
go back to reference Ahmed A, Thornton P, Perry GJ, Allman RM, DeLong JF: Impact of atrial fibrillation on mortality and readmission in older adults hospitalized with heart failure. Eur J Heart Fail. 2004, 6 (4): 421-426.CrossRefPubMed Ahmed A, Thornton P, Perry GJ, Allman RM, DeLong JF: Impact of atrial fibrillation on mortality and readmission in older adults hospitalized with heart failure. Eur J Heart Fail. 2004, 6 (4): 421-426.CrossRefPubMed
17.
go back to reference Dungan KM, Osei K, Nagaraja HN, Schuster D, Binkley P: Relationship between glycemic control and readmission rates in patients hospitalized with congestive heart failure during the implementation of hospital-wide initiatives. Endocr Pract. 2010, 16 (6): 945-951.CrossRefPubMedPubMedCentral Dungan KM, Osei K, Nagaraja HN, Schuster D, Binkley P: Relationship between glycemic control and readmission rates in patients hospitalized with congestive heart failure during the implementation of hospital-wide initiatives. Endocr Pract. 2010, 16 (6): 945-951.CrossRefPubMedPubMedCentral
18.
go back to reference Patel UD, Greiner MA, Fonarow GC, Phatak H, Hernandez AF, Curtis LH: Associations between worsening renal function and 30-day outcomes among Medicare beneficiaries hospitalized with heart failure. Am Heart J. 2010, 160 (1): 132-138. e131CrossRefPubMedPubMedCentral Patel UD, Greiner MA, Fonarow GC, Phatak H, Hernandez AF, Curtis LH: Associations between worsening renal function and 30-day outcomes among Medicare beneficiaries hospitalized with heart failure. Am Heart J. 2010, 160 (1): 132-138. e131CrossRefPubMedPubMedCentral
19.
go back to reference Shenkman HJ, Zareba W, Bisognano JD: Comparison of prognostic significance of amino-terminal pro-brain natriuretic peptide versus blood urea nitrogen for predicting events in patients hospitalized for heart failure. Am J Cardiol. 2007, 99 (8): 1143-1145.CrossRefPubMed Shenkman HJ, Zareba W, Bisognano JD: Comparison of prognostic significance of amino-terminal pro-brain natriuretic peptide versus blood urea nitrogen for predicting events in patients hospitalized for heart failure. Am J Cardiol. 2007, 99 (8): 1143-1145.CrossRefPubMed
20.
go back to reference Song EK, Lennie TA, Moser DK: Depressive symptoms increase risk of rehospitalisation in heart failure patients with preserved systolic function. J Clin Nurs. 2009, 18 (13): 1871-1877.CrossRefPubMedPubMedCentral Song EK, Lennie TA, Moser DK: Depressive symptoms increase risk of rehospitalisation in heart failure patients with preserved systolic function. J Clin Nurs. 2009, 18 (13): 1871-1877.CrossRefPubMedPubMedCentral
21.
go back to reference Goldfield NI, McCullough EC, Hughes JS, Tang AM, Eastman B, Rawlins LK, Averill RF: Identifying potentially preventable readmission. Health Care Finance Rev. 2008, 30: 75-91. Goldfield NI, McCullough EC, Hughes JS, Tang AM, Eastman B, Rawlins LK, Averill RF: Identifying potentially preventable readmission. Health Care Finance Rev. 2008, 30: 75-91.
22.
go back to reference Shu CC, Lin YF, Hsu NC, Ko WJ: Risk factors for 30-day readmission in general medical patients admitted from the emergency department: a single centre study. Intern Med J. 2012, 42 (6): 677-682.CrossRefPubMed Shu CC, Lin YF, Hsu NC, Ko WJ: Risk factors for 30-day readmission in general medical patients admitted from the emergency department: a single centre study. Intern Med J. 2012, 42 (6): 677-682.CrossRefPubMed
23.
go back to reference Amarasingham R, Moore BJ, Tabak YP, Drazner MH, Clark CA, Zhang S, Reed WG, Swanson TS, Ma Y, Halm EA: An automated model to identify heart failure patients at risk for 30-day readmission or death using electronic medical record data. Med Care. 2010, 48 (11): 981-988.CrossRefPubMed Amarasingham R, Moore BJ, Tabak YP, Drazner MH, Clark CA, Zhang S, Reed WG, Swanson TS, Ma Y, Halm EA: An automated model to identify heart failure patients at risk for 30-day readmission or death using electronic medical record data. Med Care. 2010, 48 (11): 981-988.CrossRefPubMed
24.
go back to reference Hamner JB, Ellison KJ: Predictors of hospital readmission after discharge in patients with congestive heart failure. Heart Lung. 2005, 34 (4): 231-239.CrossRefPubMed Hamner JB, Ellison KJ: Predictors of hospital readmission after discharge in patients with congestive heart failure. Heart Lung. 2005, 34 (4): 231-239.CrossRefPubMed
25.
go back to reference Philbin EF, DiSalvo TG: Prediction of hospital readmission for heart failure: development of a simple risk score based on administrative data. J Am Coll Cardiol. 1999, 33 (6): 1560-1566.CrossRefPubMed Philbin EF, DiSalvo TG: Prediction of hospital readmission for heart failure: development of a simple risk score based on administrative data. J Am Coll Cardiol. 1999, 33 (6): 1560-1566.CrossRefPubMed
26.
go back to reference Ross JS, Mulvey GK, Stauffer B, Patlolla V, Bernheim SM, Keenan PS, Krumholz HM: Statistical models and patient predictors of readmission for heart failure: a systematic review. Arch Intern Med. 2008, 168 (13): 1371-1386.CrossRefPubMed Ross JS, Mulvey GK, Stauffer B, Patlolla V, Bernheim SM, Keenan PS, Krumholz HM: Statistical models and patient predictors of readmission for heart failure: a systematic review. Arch Intern Med. 2008, 168 (13): 1371-1386.CrossRefPubMed
27.
go back to reference Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, Kripalani S: Risk prediction models for hospital readmission: a systematic review. JAMA. 2011, 306 (15): 1688-1698.CrossRefPubMedPubMedCentral Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, Kripalani S: Risk prediction models for hospital readmission: a systematic review. JAMA. 2011, 306 (15): 1688-1698.CrossRefPubMedPubMedCentral
29.
go back to reference Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43 (11): 1130-1139.CrossRefPubMed Quan H, Sundararajan V, Halfon P, Fong A, Burnand B, Luthi JC, Saunders LD, Beck CA, Feasby TE, Ghali WA: Coding algorithms for defining comorbidities in ICD-9-CM and ICD-10 administrative data. Med Care. 2005, 43 (11): 1130-1139.CrossRefPubMed
30.
go back to reference McGregor JC, Kim PW, Perencevich EN, Bradham DD, Furuno JP, Kaye KS, Fink JC, Langenberg P, Roghmann MC, Harris AD: Utility of the chronic disease score and charlson comorbidity index as comorbidity measures for use in epidemiologic studies of antibiotic-resistant organisms. Am J Epidemiol. 2005, 161 (5): 483-493.CrossRefPubMed McGregor JC, Kim PW, Perencevich EN, Bradham DD, Furuno JP, Kaye KS, Fink JC, Langenberg P, Roghmann MC, Harris AD: Utility of the chronic disease score and charlson comorbidity index as comorbidity measures for use in epidemiologic studies of antibiotic-resistant organisms. Am J Epidemiol. 2005, 161 (5): 483-493.CrossRefPubMed
31.
go back to reference Pregibon D: Logistic-regression diagnostics. Ann Stat. 1981, 9 (4): 705-724.CrossRef Pregibon D: Logistic-regression diagnostics. Ann Stat. 1981, 9 (4): 705-724.CrossRef
32.
go back to reference Philbin EF, DiSalvo TG: Managed care for congestive heart failure: Influence of payer status on process of care, resource utilization, and short-term outcomes. Am Heart J. 1998, 136 (3): 553-561.CrossRefPubMed Philbin EF, DiSalvo TG: Managed care for congestive heart failure: Influence of payer status on process of care, resource utilization, and short-term outcomes. Am Heart J. 1998, 136 (3): 553-561.CrossRefPubMed
34.
go back to reference Jiang HJ, Andrews R, Stryer D, Friedman B: Racial/ethnic disparities in potentially preventable readmissions: the case of diabetes. Am J Public Health. 2005, 95 (9): 1561-1567.CrossRefPubMedPubMedCentral Jiang HJ, Andrews R, Stryer D, Friedman B: Racial/ethnic disparities in potentially preventable readmissions: the case of diabetes. Am J Public Health. 2005, 95 (9): 1561-1567.CrossRefPubMedPubMedCentral
35.
go back to reference Mejhert M, Kahan T, Persson H, Edner M: Predicting readmissions and cardiovascular events in heart failure patients. Int J Cardiol. 2006, 109 (1): 108-113.CrossRefPubMed Mejhert M, Kahan T, Persson H, Edner M: Predicting readmissions and cardiovascular events in heart failure patients. Int J Cardiol. 2006, 109 (1): 108-113.CrossRefPubMed
36.
go back to reference Khand AU, Gemmell I, Rankin AC, Cleland JGF: Clinical events leading to the progression of heart failure: insights from a national database of hospital discharges. Eur Heart J. 2001, 22 (2): 153-164.CrossRefPubMed Khand AU, Gemmell I, Rankin AC, Cleland JGF: Clinical events leading to the progression of heart failure: insights from a national database of hospital discharges. Eur Heart J. 2001, 22 (2): 153-164.CrossRefPubMed
37.
go back to reference Foraker RE, Rose KM, Suchindran CM, Chang PP, McNeill AM, Rosamond WD: Socioeconomic status, medicaid coverage, clinical comorbidity, and rehospitalization or death after an incident heart failure hospitalization/clinical perspective. Circ Heart Fail. 2011, 4 (3): 308-316.CrossRefPubMedPubMedCentral Foraker RE, Rose KM, Suchindran CM, Chang PP, McNeill AM, Rosamond WD: Socioeconomic status, medicaid coverage, clinical comorbidity, and rehospitalization or death after an incident heart failure hospitalization/clinical perspective. Circ Heart Fail. 2011, 4 (3): 308-316.CrossRefPubMedPubMedCentral
38.
go back to reference Budnitz DS, Lovegrove MC, Shehab N, Richards CL: Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med. 2011, 365 (21): 2002-2012.CrossRefPubMed Budnitz DS, Lovegrove MC, Shehab N, Richards CL: Emergency hospitalizations for adverse drug events in older Americans. N Engl J Med. 2011, 365 (21): 2002-2012.CrossRefPubMed
39.
go back to reference Ruiz B, Garcia M, Aguirre U, Aguirre C: Factors predicting hospital readmissions related to adverse drug reactions. Eur J Clin Pharmacol. 2008, 64 (7): 715-722.CrossRefPubMed Ruiz B, Garcia M, Aguirre U, Aguirre C: Factors predicting hospital readmissions related to adverse drug reactions. Eur J Clin Pharmacol. 2008, 64 (7): 715-722.CrossRefPubMed
40.
go back to reference Nasir K, Lin Z, Bueno H, Normand SL, Drye EE, Keenan PS, Krumholz HM: Is same-hospital readmission rate a good surrogate for all-hospital readmission rate?. Med Care. 2010, 48 (5): 477-481.CrossRefPubMed Nasir K, Lin Z, Bueno H, Normand SL, Drye EE, Keenan PS, Krumholz HM: Is same-hospital readmission rate a good surrogate for all-hospital readmission rate?. Med Care. 2010, 48 (5): 477-481.CrossRefPubMed
Metadata
Title
Diagnosis-specific readmission risk prediction using electronic health data: a retrospective cohort study
Authors
Courtney Hebert
Chaitanya Shivade
Randi Foraker
Jared Wasserman
Caryn Roth
Hagop Mekhjian
Stanley Lemeshow
Peter Embi
Publication date
01-12-2014
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2014
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/1472-6947-14-65

Other articles of this Issue 1/2014

BMC Medical Informatics and Decision Making 1/2014 Go to the issue