Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2019

Open Access 01-12-2019 | Research article

Identifying patients at highest-risk: the best timing to apply a readmission predictive model

Authors: Natalie Flaks-Manov, Maxim Topaz, Moshe Hoshen, Ran D. Balicer, Efrat Shadmi

Published in: BMC Medical Informatics and Decision Making | Issue 1/2019

Login to get access

Abstract

Background

Most of readmission prediction models are implemented at the time of patient discharge. However, interventions which include an early in-hospital component are critical in reducing readmissions and improving patient outcomes. Thus, at-discharge high-risk identification may be too late for effective intervention. Nonetheless, the tradeoff between early versus at-discharge prediction and the optimal timing of the risk prediction model application remains to be determined. We examined a high-risk patient selection process with readmission prediction models using data available at two time points: at admission and at the time of hospital discharge.

Methods

An historical prospective study of hospitalized adults (≥65 years) discharged alive from internal medicine units in Clalit’s (the largest integrated payer-provider health fund in Israel) general hospitals in 2015. The outcome was all-cause 30-day emergency readmissions to any internal medicine ward at any hospital. We used the previously validated Preadmission Readmission Detection Model (PREADM) and developed a new model incorporating PREADM with hospital data (PREADM-H). We compared the percentage of overlap between the models and calculated the positive predictive value (PPV) for the subgroups identified by each model separately and by both models.

Results

The final cohort included 35,156 index hospital admissions. The PREADM-H model included 17 variables with a C-statistic of 0.68 (95% CI: 0.67–0.70) and PPV of 43.0% in the highest-risk categories. Of patients categorized by the PREADM-H in the highest-risk decile, 78% were classified similarly by the PREADM. The 22% (n = 229) classified by the PREADM-H at the highest decile, but not by the PREADM, had a PPV of 37%. Conversely, those classified by the PREADM into the highest decile but not by the PREADM-H (n = 218) had a PPV of 31%.

Conclusions

The timing of readmission risk prediction makes a difference in terms of the population identified at each prediction time point – at-admission or at-discharge. Our findings suggest that readmission risk identification should incorporate a two time-point approach in which preadmission data is used to identify high-risk patients as early as possible during the index admission and an “all-hospital” model is applied at discharge to identify those that incur risk during the hospital stay.
Literature
1.
go back to reference Kansagara D, Englander H, Salanitro A, et al. Risk prediction models for hospital readmission: a systematic review. Jama. 2011;306(15):1688–98.CrossRef Kansagara D, Englander H, Salanitro A, et al. Risk prediction models for hospital readmission: a systematic review. Jama. 2011;306(15):1688–98.CrossRef
2.
go back to reference Zhou H, Della PR, Roberts P, et al. Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review. BMJ Open. 2016;6(6):e011060.CrossRef Zhou H, Della PR, Roberts P, et al. Utility of models to predict 28-day or 30-day unplanned hospital readmissions: an updated systematic review. BMJ Open. 2016;6(6):e011060.CrossRef
3.
go back to reference Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med. 2011;155(8):520–8.CrossRef Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med. 2011;155(8):520–8.CrossRef
4.
go back to reference Goldstein BA, Navar AM, Pencina MJ, et al. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J Am Med Inform Assoc. 2017;24(1):198–208.CrossRef Goldstein BA, Navar AM, Pencina MJ, et al. Opportunities and challenges in developing risk prediction models with electronic health records data: a systematic review. J Am Med Inform Assoc. 2017;24(1):198–208.CrossRef
5.
go back to reference Vest JR, Kern LM, Silver MD, et al. The potential for community-based health information exchange systems to reduce hospital readmissions. J Am Med Inform Assoc. 2015;22(2):435–42.CrossRef Vest JR, Kern LM, Silver MD, et al. The potential for community-based health information exchange systems to reduce hospital readmissions. J Am Med Inform Assoc. 2015;22(2):435–42.CrossRef
6.
go back to reference Shadmi E, Flaks-Manov N, Hoshen M, et al. Predicting 30-day readmissions with preadmission electronic health record data. Med Care. 2015;53(3):283–9.CrossRef Shadmi E, Flaks-Manov N, Hoshen M, et al. Predicting 30-day readmissions with preadmission electronic health record data. Med Care. 2015;53(3):283–9.CrossRef
7.
go back to reference Amarasingham R, Velasco F, Xie B, et al. Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing models. BMC Med Inform Decis Mak. 2015;15:39.CrossRef Amarasingham R, Velasco F, Xie B, et al. Electronic medical record-based multicondition models to predict the risk of 30 day readmission or death among adult medicine patients: validation and comparison to existing models. BMC Med Inform Decis Mak. 2015;15:39.CrossRef
8.
go back to reference Nguyen OK, Makam AN, Clark C, et al. Predicting all-cause readmissions using electronic health record data from the entire hospitalization: model development and comparison. J Hosp Med. 2016;11(7):473–80.CrossRef Nguyen OK, Makam AN, Clark C, et al. Predicting all-cause readmissions using electronic health record data from the entire hospitalization: model development and comparison. J Hosp Med. 2016;11(7):473–80.CrossRef
9.
go back to reference Donze J, Aujesky D, Williams D, et al. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med. 2013;173(8):632–8.CrossRef Donze J, Aujesky D, Williams D, et al. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med. 2013;173(8):632–8.CrossRef
10.
go back to reference Donze JD, Williams MV, Robinson EJ, et al. International validity of the HOSPITAL score to predict 30-day potentially avoidable hospital readmissions. JAMA Intern Med. 2016;176(4):496–502.CrossRef Donze JD, Williams MV, Robinson EJ, et al. International validity of the HOSPITAL score to predict 30-day potentially avoidable hospital readmissions. JAMA Intern Med. 2016;176(4):496–502.CrossRef
11.
go back to reference Hanley JA, Negassa A, Edwardes MD, et al. Statistical analysis of correlated data using generalized estimating equations: an orientation. Am J Epidemiol. 2003;157(4):364–75.CrossRef Hanley JA, Negassa A, Edwardes MD, et al. Statistical analysis of correlated data using generalized estimating equations: an orientation. Am J Epidemiol. 2003;157(4):364–75.CrossRef
12.
go back to reference Rennke S, Nguyen OK, Shoeb MH, et al. Hospital-initiated transitional care interventions as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158(5 Pt 2):433–40.CrossRef Rennke S, Nguyen OK, Shoeb MH, et al. Hospital-initiated transitional care interventions as a patient safety strategy: a systematic review. Ann Intern Med. 2013;158(5 Pt 2):433–40.CrossRef
13.
go back to reference Jayakody A, Bryant J, Carey M, et al. Effectiveness of interventions utilising telephone follow up in reducing hospital readmission within 30 days for individuals with chronic disease: a systematic review. BMC Health Serv Res. 2016;16(1):403.CrossRef Jayakody A, Bryant J, Carey M, et al. Effectiveness of interventions utilising telephone follow up in reducing hospital readmission within 30 days for individuals with chronic disease: a systematic review. BMC Health Serv Res. 2016;16(1):403.CrossRef
14.
go back to reference Coleman EA, Smith JD, Frank JC, et al. Preparing patients and caregivers to participate in care delivered across settings: the care transitions intervention. J Am Geriatr Soc. 2004;52(11):1817–25.CrossRef Coleman EA, Smith JD, Frank JC, et al. Preparing patients and caregivers to participate in care delivered across settings: the care transitions intervention. J Am Geriatr Soc. 2004;52(11):1817–25.CrossRef
15.
go back to reference Coleman EA, Parry C, Chalmers S, et al. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006;166(17):1822–8.CrossRef Coleman EA, Parry C, Chalmers S, et al. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006;166(17):1822–8.CrossRef
16.
go back to reference Jack BW, Chetty VK, Anthony D, et al. A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Intern Med. 2009;150(3):178–87.CrossRef Jack BW, Chetty VK, Anthony D, et al. A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Intern Med. 2009;150(3):178–87.CrossRef
17.
go back to reference Naylor M, Brooten D, Jones R, et al. Comprehensive discharge planning for the hospitalized elderly. A randomized clinical trial. Ann Intern Med. 1994;120(12):999–1006.CrossRef Naylor M, Brooten D, Jones R, et al. Comprehensive discharge planning for the hospitalized elderly. A randomized clinical trial. Ann Intern Med. 1994;120(12):999–1006.CrossRef
18.
go back to reference Casucci S, Lin L, Hewner S, et al. Estimating the causal effects of chronic disease combinations on 30-day hospital readmissions based on observational Medicaid data. J Am Med Inform Assoc. 2017;25(6):670–8.CrossRef Casucci S, Lin L, Hewner S, et al. Estimating the causal effects of chronic disease combinations on 30-day hospital readmissions based on observational Medicaid data. J Am Med Inform Assoc. 2017;25(6):670–8.CrossRef
19.
go back to reference Beck AF, Huang B, Auger KA, et al. Explaining racial disparities in child asthma readmission using a causal inference approach. JAMA Pediatr. 2016;170(7):695–703.CrossRef Beck AF, Huang B, Auger KA, et al. Explaining racial disparities in child asthma readmission using a causal inference approach. JAMA Pediatr. 2016;170(7):695–703.CrossRef
20.
go back to reference Preyde M, Brassard K. Evidence-based risk factors for adverse health outcomes in older patients after discharge home and assessment tools: a systematic review. J Evid Based Soc Work. 2011;8:445–68.CrossRef Preyde M, Brassard K. Evidence-based risk factors for adverse health outcomes in older patients after discharge home and assessment tools: a systematic review. J Evid Based Soc Work. 2011;8:445–68.CrossRef
21.
go back to reference Escobar GJ, Ragins A, Scheirer P, et al. Nonelective rehospitalizations and postdischarge mortality: predictive models suitable for use in real time. Med Care. 2015;53(11):916.CrossRef Escobar GJ, Ragins A, Scheirer P, et al. Nonelective rehospitalizations and postdischarge mortality: predictive models suitable for use in real time. Med Care. 2015;53(11):916.CrossRef
22.
go back to reference Cai X, Perez-Concha O, Coiera E, et al. Real-time prediction of mortality, readmission, and length of stay using electronic health record data. J Am Med Inform Assoc. 2016;23(3):553–61.CrossRef Cai X, Perez-Concha O, Coiera E, et al. Real-time prediction of mortality, readmission, and length of stay using electronic health record data. J Am Med Inform Assoc. 2016;23(3):553–61.CrossRef
Metadata
Title
Identifying patients at highest-risk: the best timing to apply a readmission predictive model
Authors
Natalie Flaks-Manov
Maxim Topaz
Moshe Hoshen
Ran D. Balicer
Efrat Shadmi
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2019
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-0836-6

Other articles of this Issue 1/2019

BMC Medical Informatics and Decision Making 1/2019 Go to the issue