Skip to main content
Top
Published in: BMC Emergency Medicine 1/2016

Open Access 01-12-2016 | Research article

Prospective stratification of patients at risk for emergency department revisit: resource utilization and population management strategy implications

Authors: Bo Jin, Yifan Zhao, Shiying Hao, Andrew Young Shin, Yue Wang, Chunqing Zhu, Zhongkai Hu, Changlin Fu, Jun Ji, Yong Wang, Yingzhen Zhao, Yunliang Jiang, Dorothy Dai, Devore S. Culver, Shaun T. Alfreds, Todd Rogow, Frank Stearns, Karl G. Sylvester, Eric Widen, Xuefeng B. Ling

Published in: BMC Emergency Medicine | Issue 1/2016

Login to get access

Abstract

Background

Estimating patient risk of future emergency department (ED) revisits can guide the allocation of resources, e.g. local primary care and/or specialty, to better manage ED high utilization patient populations and thereby improve patient life qualities.

Methods

We set to develop and validate a method to estimate patient ED revisit risk in the subsequent 6 months from an ED discharge date. An ensemble decision-tree-based model with Electronic Medical Record (EMR) encounter data from HealthInfoNet (HIN), Maine’s Health Information Exchange (HIE), was developed and validated, assessing patient risk for a subsequent 6 month return ED visit based on the ED encounter-associated demographic and EMR clinical history data. A retrospective cohort of 293,461 ED encounters that occurred between January 1, 2012 and December 31, 2012, was assembled with the associated patients’ 1-year clinical histories before the ED discharge date, for model training and calibration purposes. To validate, a prospective cohort of 193,886 ED encounters that occurred between January 1, 2013 and June 30, 2013 was constructed.

Results

Statistical learning that was utilized to construct the prediction model identified 152 variables that included the following data domains: demographics groups (12), different encounter history (104), care facilities (12), primary and secondary diagnoses (10), primary and secondary procedures (2), chronic disease condition (1), laboratory test results (2), and outpatient prescription medications (9). The c-statistics for the retrospective and prospective cohorts were 0.742 and 0.730 respectively. Total medical expense and ED utilization by risk score 6 months after the discharge were analyzed. Cluster analysis identified discrete subpopulations of high-risk patients with distinctive resource utilization patterns, suggesting the need for diversified care management strategies.

Conclusions

Integration of our method into the HIN secure statewide data system in real time prospectively validated its performance. It promises to provide increased opportunity for high ED utilization identification, and optimized resource and population management.
Appendix
Available only for authorised users
Literature
1.
go back to reference Pines JM, Mutter RL, Zocchi MS. Variation in emergency department admission rates across the United States. Med Care Res Rev. 2013;70(2):218–31.CrossRefPubMed Pines JM, Mutter RL, Zocchi MS. Variation in emergency department admission rates across the United States. Med Care Res Rev. 2013;70(2):218–31.CrossRefPubMed
2.
3.
go back to reference Wu CL, Wang FT, Chiang YC, Chiu YF, Lin TG, Fu LF, et al. Unplanned emergency department revisits within 72 hours to a secondary teaching referral hospital in Taiwan. J Emerg Med. 2010;38(4):512–7.CrossRefPubMed Wu CL, Wang FT, Chiang YC, Chiu YF, Lin TG, Fu LF, et al. Unplanned emergency department revisits within 72 hours to a secondary teaching referral hospital in Taiwan. J Emerg Med. 2010;38(4):512–7.CrossRefPubMed
4.
go back to reference Arendts G, Fitzhardinge S, Pronk K, Hutton M, Nagree Y, Donaldson M. Derivation of a nomogram to estimate probability of revisit in at-risk older adults discharged from the emergency department. Intern Emerg Med. 2013;8(3):249–54.CrossRefPubMed Arendts G, Fitzhardinge S, Pronk K, Hutton M, Nagree Y, Donaldson M. Derivation of a nomogram to estimate probability of revisit in at-risk older adults discharged from the emergency department. Intern Emerg Med. 2013;8(3):249–54.CrossRefPubMed
5.
go back to reference Doupe MB, Palatnick W, Day S, Chateau D, Soodeen RA, Burchill C, et al. Frequent users of emergency departments: developing standard definitions and defining prominent risk factors. Ann Emerg Med. 2012;60(1):24–32.CrossRefPubMed Doupe MB, Palatnick W, Day S, Chateau D, Soodeen RA, Burchill C, et al. Frequent users of emergency departments: developing standard definitions and defining prominent risk factors. Ann Emerg Med. 2012;60(1):24–32.CrossRefPubMed
6.
go back to reference Taubman SL, Allen HL, Wright BJ, Baicker K, Finkelstein AN. Medicaid increases emergency-department use: evidence from Oregon’s Health Insurance Experiment. Science. 2014;343(6168):263–8.CrossRefPubMedPubMedCentral Taubman SL, Allen HL, Wright BJ, Baicker K, Finkelstein AN. Medicaid increases emergency-department use: evidence from Oregon’s Health Insurance Experiment. Science. 2014;343(6168):263–8.CrossRefPubMedPubMedCentral
7.
go back to reference Billings J. Case finding for patients at risk of readmission to hospital: development of algorithm to identify high risk patients. BMJ. 2006;333(7563):327.CrossRefPubMedPubMedCentral Billings J. Case finding for patients at risk of readmission to hospital: development of algorithm to identify high risk patients. BMJ. 2006;333(7563):327.CrossRefPubMedPubMedCentral
8.
go back to reference Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, et al. Risk prediction models for hospital readmission: a systematic review. JAMA. 2011;306(15):1688–98.CrossRefPubMedPubMedCentral Kansagara D, Englander H, Salanitro A, Kagen D, Theobald C, Freeman M, et al. Risk prediction models for hospital readmission: a systematic review. JAMA. 2011;306(15):1688–98.CrossRefPubMedPubMedCentral
9.
go back to reference LaMantia MA, Platts-Mills TF, Biese K, Khandelwal C, Forbach C, Cairns CB, et al. Predicting hospital admission and returns to the emergency department for elderly patients. Acad Emerg Med. 2010;17(3):252–9.CrossRefPubMed LaMantia MA, Platts-Mills TF, Biese K, Khandelwal C, Forbach C, Cairns CB, et al. Predicting hospital admission and returns to the emergency department for elderly patients. Acad Emerg Med. 2010;17(3):252–9.CrossRefPubMed
10.
go back to reference Hastings SN, Smith VA, Weinberger M, Oddone EZ, Olsen MK, Schmader KE. Health services use of older veterans treated and released from veterans affairs medical center emergency departments. J Am Geriatr Soc. 2013;61(9):1515–21.CrossRefPubMed Hastings SN, Smith VA, Weinberger M, Oddone EZ, Olsen MK, Schmader KE. Health services use of older veterans treated and released from veterans affairs medical center emergency departments. J Am Geriatr Soc. 2013;61(9):1515–21.CrossRefPubMed
11.
go back to reference Hastings SN, Whitson HE, Sloane R, Landerman LR, Horney C, Johnson KS. Using the past to predict the future: latent class analysis of patterns of health service use of older adults in the emergency department. J Am Geriatr Soc. 2014;62(4):711–5.CrossRefPubMedPubMedCentral Hastings SN, Whitson HE, Sloane R, Landerman LR, Horney C, Johnson KS. Using the past to predict the future: latent class analysis of patterns of health service use of older adults in the emergency department. J Am Geriatr Soc. 2014;62(4):711–5.CrossRefPubMedPubMedCentral
12.
go back to reference Meldon SW, Mion LC, Palmer RM, Drew BL, Connor JT, Lewicki LJ, et al. A brief risk-stratification tool to predict repeat emergency department visits and hospitalizations in older patients discharged from the emergency department. Acad Emerg Med. 2003;10(3):224–32.CrossRefPubMed Meldon SW, Mion LC, Palmer RM, Drew BL, Connor JT, Lewicki LJ, et al. A brief risk-stratification tool to predict repeat emergency department visits and hospitalizations in older patients discharged from the emergency department. Acad Emerg Med. 2003;10(3):224–32.CrossRefPubMed
13.
go back to reference Mion LC, Palmer RM, Meldon SW, Bass DM, Singer ME, Payne SM, et al. Case finding and referral model for emergency department elders: a randomized clinical trial. Ann Emerg Med. 2003;41(1):57–68.CrossRefPubMed Mion LC, Palmer RM, Meldon SW, Bass DM, Singer ME, Payne SM, et al. Case finding and referral model for emergency department elders: a randomized clinical trial. Ann Emerg Med. 2003;41(1):57–68.CrossRefPubMed
14.
go back to reference Hustey FM, Mion LC, Connor JT, Emerman CL, Campbell J, Palmer RM. A brief risk stratification tool to predict functional decline in older adults discharged from emergency departments. J Am Geriatr Soc. 2007;55(8):1269–74.CrossRefPubMed Hustey FM, Mion LC, Connor JT, Emerman CL, Campbell J, Palmer RM. A brief risk stratification tool to predict functional decline in older adults discharged from emergency departments. J Am Geriatr Soc. 2007;55(8):1269–74.CrossRefPubMed
15.
go back to reference Barrett M, Steiner C, Andrews R, Kassed C, Nagamine M. Methodological Issues when Studying Readmissions and Revisits using Hospital Administrative Data. 2011. HCUP Methods Series Report # 2011-01. In: US Agency for Healthcare Research and Quality. 2011. Barrett M, Steiner C, Andrews R, Kassed C, Nagamine M. Methodological Issues when Studying Readmissions and Revisits using Hospital Administrative Data. 2011. HCUP Methods Series Report # 2011-01. In: US Agency for Healthcare Research and Quality. 2011.
16.
go back to reference Graf CE, Zekry D, Giannelli S, Michel JP, Chevalley T. Efficiency and applicability of comprehensive geriatric assessment in the emergency department: a systematic review. Aging Clin Exp Res. 2011;23(4):244–54.CrossRefPubMed Graf CE, Zekry D, Giannelli S, Michel JP, Chevalley T. Efficiency and applicability of comprehensive geriatric assessment in the emergency department: a systematic review. Aging Clin Exp Res. 2011;23(4):244–54.CrossRefPubMed
17.
go back to reference Roland M, Dusheiko M, Gravelle H, Parker S. Follow up of people aged 65 and over with a history of emergency admissions: analysis of routine admission data. BMJ. 2005;330(7486):289–92.CrossRefPubMedPubMedCentral Roland M, Dusheiko M, Gravelle H, Parker S. Follow up of people aged 65 and over with a history of emergency admissions: analysis of routine admission data. BMJ. 2005;330(7486):289–92.CrossRefPubMedPubMedCentral
18.
go back to reference Di Bari M, Salvi F, Roberts AT, Balzi D, Lorenzetti B, Morichi V, et al. Prognostic stratification of elderly patients in the emergency department: a comparison between the “Identification of Seniors at Risk” and the “Silver Code”. J Gerontol Ser A Biol Med Sci. 2012;67(5):544–50.CrossRef Di Bari M, Salvi F, Roberts AT, Balzi D, Lorenzetti B, Morichi V, et al. Prognostic stratification of elderly patients in the emergency department: a comparison between the “Identification of Seniors at Risk” and the “Silver Code”. J Gerontol Ser A Biol Med Sci. 2012;67(5):544–50.CrossRef
19.
go back to reference McCusker J, Bellavance F, Cardin S, Belzile E, Verdon J. Prediction of hospital utilization among elderly patients during the 6 months after an emergency department visit. Ann Emerg Med. 2000;36(5):438–45.PubMed McCusker J, Bellavance F, Cardin S, Belzile E, Verdon J. Prediction of hospital utilization among elderly patients during the 6 months after an emergency department visit. Ann Emerg Med. 2000;36(5):438–45.PubMed
20.
go back to reference Sin DD, Man SF. Low-dose inhaled corticosteroid therapy and risk of emergency department visits for asthma. Arch Intern Med. 2002;162(14):1591–5.CrossRefPubMed Sin DD, Man SF. Low-dose inhaled corticosteroid therapy and risk of emergency department visits for asthma. Arch Intern Med. 2002;162(14):1591–5.CrossRefPubMed
21.
go back to reference Shelton P, Sager MA, Schraeder C. The community assessment risk screen (CARS): identifying elderly persons at risk for hospitalization or emergency department visit. Am J Manag Care. 2000;6(8):925–33.PubMed Shelton P, Sager MA, Schraeder C. The community assessment risk screen (CARS): identifying elderly persons at risk for hospitalization or emergency department visit. Am J Manag Care. 2000;6(8):925–33.PubMed
22.
go back to reference Hao S, Jin B, Shin AY, Zhao Y, Zhu C, Li Z, et al. Risk prediction of emergency department revisit 30 days post discharge: a prospective study. PLoS One. 2014;9(11):e112944.CrossRefPubMedPubMedCentral Hao S, Jin B, Shin AY, Zhao Y, Zhu C, Li Z, et al. Risk prediction of emergency department revisit 30 days post discharge: a prospective study. PLoS One. 2014;9(11):e112944.CrossRefPubMedPubMedCentral
23.
go back to reference Hernandez AF, Greiner MA, Fonarow GC, Hammill BG, Heidenreich PA, Yancy CW, et al. Relationship between early physician follow-up and 30-day readmission among Medicare beneficiaries hospitalized for heart failure. JAMA. 2010;303(17):1716–22.CrossRefPubMed Hernandez AF, Greiner MA, Fonarow GC, Hammill BG, Heidenreich PA, Yancy CW, et al. Relationship between early physician follow-up and 30-day readmission among Medicare beneficiaries hospitalized for heart failure. JAMA. 2010;303(17):1716–22.CrossRefPubMed
24.
go back to reference Khan NU, Razzak JA, Saleem AF, Khan UR, Mir MU, Aashiq B. Unplanned return visit to emergency department: a descriptive study from a tertiary care hospital in a low-income country. Eur J Emerg Med. 2011;18(5):276–8.CrossRefPubMed Khan NU, Razzak JA, Saleem AF, Khan UR, Mir MU, Aashiq B. Unplanned return visit to emergency department: a descriptive study from a tertiary care hospital in a low-income country. Eur J Emerg Med. 2011;18(5):276–8.CrossRefPubMed
25.
go back to reference Nunez S, Hexdall A, Aguirre-Jaime A. Unscheduled returns to the emergency department: an outcome of medical errors? Qual Saf Health Care. 2006;15(2):102–8.CrossRefPubMedPubMedCentral Nunez S, Hexdall A, Aguirre-Jaime A. Unscheduled returns to the emergency department: an outcome of medical errors? Qual Saf Health Care. 2006;15(2):102–8.CrossRefPubMedPubMedCentral
26.
go back to reference He X, Ji M, Zhang C, Bao H. A Variance Minimization Criterion to Feature Selection using Laplacian Regularization. In: IEEE transactions on pattern analysis and machine intelligence. 2011. He X, Ji M, Zhang C, Bao H. A Variance Minimization Criterion to Feature Selection using Laplacian Regularization. In: IEEE transactions on pattern analysis and machine intelligence. 2011.
28.
29.
go back to reference Tibshirani R, Hastie T, Narasimhan B, Chu G. Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc Natl Acad Sci U S A. 2002;99(10):6567–72.CrossRefPubMedPubMedCentral Tibshirani R, Hastie T, Narasimhan B, Chu G. Diagnosis of multiple cancer types by shrunken centroids of gene expression. Proc Natl Acad Sci U S A. 2002;99(10):6567–72.CrossRefPubMedPubMedCentral
30.
go back to reference Sing T, Sander O, Beerenwinkel N, Lengauer T. ROCR: visualizing classifier performance in R. Bioinformatics. 2005;21(20):3940–1.CrossRefPubMed Sing T, Sander O, Beerenwinkel N, Lengauer T. ROCR: visualizing classifier performance in R. Bioinformatics. 2005;21(20):3940–1.CrossRefPubMed
31.
go back to reference Horney C, Schmader K, Sanders LL, Heflin M, Ragsdale L, McConnell E, et al. Health care utilization before and after an outpatient ED visit in older people. Am J Emerg Med. 2012;30(1):135–42.CrossRefPubMed Horney C, Schmader K, Sanders LL, Heflin M, Ragsdale L, McConnell E, et al. Health care utilization before and after an outpatient ED visit in older people. Am J Emerg Med. 2012;30(1):135–42.CrossRefPubMed
32.
go back to reference Salvi F, Morichi V, Grilli A, Lancioni L, Spazzafumo L, Polonara S, et al. Screening for frailty in elderly emergency department patients by using the Identification of Seniors At Risk (ISAR). J Nutr Health Aging. 2012;16(4):313–8.CrossRefPubMed Salvi F, Morichi V, Grilli A, Lancioni L, Spazzafumo L, Polonara S, et al. Screening for frailty in elderly emergency department patients by using the Identification of Seniors At Risk (ISAR). J Nutr Health Aging. 2012;16(4):313–8.CrossRefPubMed
33.
go back to reference Salvi F, Morichi V, Lorenzetti B, Rossi L, Spazzafumo L, Luzi R, et al. Risk stratification of older patients in the emergency department: comparison between the Identification of Seniors at Risk and Triage Risk Screening Tool. Rejuvenation Res. 2012;15(3):288–94.CrossRefPubMed Salvi F, Morichi V, Lorenzetti B, Rossi L, Spazzafumo L, Luzi R, et al. Risk stratification of older patients in the emergency department: comparison between the Identification of Seniors at Risk and Triage Risk Screening Tool. Rejuvenation Res. 2012;15(3):288–94.CrossRefPubMed
34.
go back to reference Di Bari M, Balzi D, Roberts AT, Barchielli A, Fumagalli S, Ungar A, et al. Prognostic stratification of older persons based on simple administrative data: development and validation of the “Silver Code,” to be used in emergency department triage. J Gerontol Ser A Biol Med Sci. 2010;65(2):159–64.CrossRef Di Bari M, Balzi D, Roberts AT, Barchielli A, Fumagalli S, Ungar A, et al. Prognostic stratification of older persons based on simple administrative data: development and validation of the “Silver Code,” to be used in emergency department triage. J Gerontol Ser A Biol Med Sci. 2010;65(2):159–64.CrossRef
35.
go back to reference Gruneir A, Dhalla IA, van Walraven C, Fischer HD, Camacho X, Rochon PA, et al. Unplanned readmissions after hospital discharge among patients identified as being at high risk for readmission using a validated predictive algorithm. Open Med. 2011;5(2):e104–11.PubMedPubMedCentral Gruneir A, Dhalla IA, van Walraven C, Fischer HD, Camacho X, Rochon PA, et al. Unplanned readmissions after hospital discharge among patients identified as being at high risk for readmission using a validated predictive algorithm. Open Med. 2011;5(2):e104–11.PubMedPubMedCentral
36.
go back to reference Edmans J, Bradshaw L, Gladman JR, Franklin M, Berdunov V, Elliott R, et al. The Identification of Seniors at Risk (ISAR) score to predict clinical outcomes and health service costs in older people discharged from UK acute medical units. Age Ageing. 2013;42(6):747–53.CrossRefPubMedPubMedCentral Edmans J, Bradshaw L, Gladman JR, Franklin M, Berdunov V, Elliott R, et al. The Identification of Seniors at Risk (ISAR) score to predict clinical outcomes and health service costs in older people discharged from UK acute medical units. Age Ageing. 2013;42(6):747–53.CrossRefPubMedPubMedCentral
37.
go back to reference Hastings SN, Horney C, Landerman LR, Sanders LL, Hocker MB, Schmader KE. Exploring patterns of health service use in older emergency department patients. Acad Emerg Med. 2010;17(10):1086–92.CrossRefPubMed Hastings SN, Horney C, Landerman LR, Sanders LL, Hocker MB, Schmader KE. Exploring patterns of health service use in older emergency department patients. Acad Emerg Med. 2010;17(10):1086–92.CrossRefPubMed
38.
go back to reference Wolinsky FD, Liu L, Miller TR, An H, Geweke JF, Kaskie B, et al. Emergency department utilization patterns among older adults. J Gerontol Ser A Biol Med Sci. 2008;63(2):204–9.CrossRef Wolinsky FD, Liu L, Miller TR, An H, Geweke JF, Kaskie B, et al. Emergency department utilization patterns among older adults. J Gerontol Ser A Biol Med Sci. 2008;63(2):204–9.CrossRef
Metadata
Title
Prospective stratification of patients at risk for emergency department revisit: resource utilization and population management strategy implications
Authors
Bo Jin
Yifan Zhao
Shiying Hao
Andrew Young Shin
Yue Wang
Chunqing Zhu
Zhongkai Hu
Changlin Fu
Jun Ji
Yong Wang
Yingzhen Zhao
Yunliang Jiang
Dorothy Dai
Devore S. Culver
Shaun T. Alfreds
Todd Rogow
Frank Stearns
Karl G. Sylvester
Eric Widen
Xuefeng B. Ling
Publication date
01-12-2016
Publisher
BioMed Central
Published in
BMC Emergency Medicine / Issue 1/2016
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/s12873-016-0074-5

Other articles of this Issue 1/2016

BMC Emergency Medicine 1/2016 Go to the issue