Skip to main content
Top
Published in:

Open Access 01-12-2024 | Dementia | Research

Developing a prediction model for cognitive impairment in older adults following critical illness

Authors: Ashley E. Eisner, Lauren Witek, Nicholas M. Pajewski, Stephanie P. Taylor, Richa Bundy, Jeff D. Williamson, Byron C. Jaeger, Jessica A. Palakshappa

Published in: BMC Geriatrics | Issue 1/2024

Login to get access

Abstract

Background

New or worsening cognitive impairment or dementia is common in older adults following an episode of critical illness, and screening post-discharge is recommended for those at increased risk. There is a need for prediction models of post-ICU cognitive impairment to guide delivery of screening and support resources to those in greatest need. We sought to develop and internally validate a machine learning model for new cognitive impairment or dementia in older adults after critical illness using electronic health record (EHR) data.

Methods

Our cohort included patients > 60 years of age admitted to a large academic health system ICU in North Carolina between 2015 and 2021. Patients were included in the cohort if they were admitted to the ICU for  48 h with  2 ambulatory visits prior to hospitalization and at least one visit in the post-discharge year. We used a machine learning model, oblique random survival forests (ORSF), to examine the multivariable association of 54 structured data elements available by 3 months after discharge with incident diagnoses of cognitive impairment or dementia over 1-year.

Results

In this cohort of 8,299 adults, 22% died and 4.9% were diagnosed with dementia or cognitive impairment within one year. The ORSF model showed reasonable discrimination (c-statistic = 0.83) and stability with little difference in the model’s c-statistic across time.

Conclusion

Machine learning using readily available EHR data can predict new cognitive impairment or dementia at 1-year post-ICU discharge in older adults with acceptable accuracy. Further studies are needed to understand how this tool may impact screening for cognitive impairment in the post-discharge period.
Appendix
Available only for authorised users
Literature
1.
go back to reference Angus DC, Kelley MA, Schmitz RJ, White A, Popovich J. Jr. Caring for the critically ill patient. Current and projected workforce requirements for care of the critically ill and patients with pulmonary disease: can we meet the requirements of an aging population? JAMA. 2000;284(21):2762–70.CrossRefPubMed Angus DC, Kelley MA, Schmitz RJ, White A, Popovich J. Jr. Caring for the critically ill patient. Current and projected workforce requirements for care of the critically ill and patients with pulmonary disease: can we meet the requirements of an aging population? JAMA. 2000;284(21):2762–70.CrossRefPubMed
2.
go back to reference Wunsch H, Guerra C, Barnato AE, Angus DC, Li G, Linde-Zwirble WT. Three-year outcomes for Medicare beneficiaries who survive intensive care. JAMA. 2010;303(9):849–56.CrossRefPubMed Wunsch H, Guerra C, Barnato AE, Angus DC, Li G, Linde-Zwirble WT. Three-year outcomes for Medicare beneficiaries who survive intensive care. JAMA. 2010;303(9):849–56.CrossRefPubMed
3.
go back to reference Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29(7):1303–10.CrossRefPubMed Angus DC, Linde-Zwirble WT, Lidicker J, Clermont G, Carcillo J, Pinsky MR. Epidemiology of severe sepsis in the United States: analysis of incidence, outcome, and associated costs of care. Crit Care Med. 2001;29(7):1303–10.CrossRefPubMed
4.
go back to reference Iwashyna TJ. Survivorship will be the defining challenge of critical care in the 21st century. Ann Intern Med. 2010;153(3):204–5.CrossRefPubMed Iwashyna TJ. Survivorship will be the defining challenge of critical care in the 21st century. Ann Intern Med. 2010;153(3):204–5.CrossRefPubMed
5.
go back to reference Iwashyna TJ, Cooke CR, Wunsch H, Kahn JM. Population burden of long-term survivorship after severe sepsis in older americans. J Am Geriatr Soc. 2012;60(6):1070–7.CrossRefPubMedPubMedCentral Iwashyna TJ, Cooke CR, Wunsch H, Kahn JM. Population burden of long-term survivorship after severe sepsis in older americans. J Am Geriatr Soc. 2012;60(6):1070–7.CrossRefPubMedPubMedCentral
6.
go back to reference Pandharipande PP, Girard TD, Ely EW. Long-term cognitive impairment after critical illness. N Engl J Med. 2014;370(2):185–6.PubMed Pandharipande PP, Girard TD, Ely EW. Long-term cognitive impairment after critical illness. N Engl J Med. 2014;370(2):185–6.PubMed
7.
go back to reference Elman JA, Jak AJ, Panizzon MS, Tu XM, Chen T, Reynolds CA, et al. Underdiagnosis of mild cognitive impairment: a consequence of ignoring practice effects. Alzheimers Dement (Amst). 2018;10:372–81.CrossRefPubMed Elman JA, Jak AJ, Panizzon MS, Tu XM, Chen T, Reynolds CA, et al. Underdiagnosis of mild cognitive impairment: a consequence of ignoring practice effects. Alzheimers Dement (Amst). 2018;10:372–81.CrossRefPubMed
8.
go back to reference Mikkelsen ME, Still M, Anderson BJ, Bienvenu OJ, Brodsky MB, Brummel N et al. Society of Critical Care Medicine’s International Consensus Conference on Prediction and Identification of Long-Term Impairments After Critical Illness. Crit Care Med. 2020;48(11):1670-9. Mikkelsen ME, Still M, Anderson BJ, Bienvenu OJ, Brodsky MB, Brummel N et al. Society of Critical Care Medicine’s International Consensus Conference on Prediction and Identification of Long-Term Impairments After Critical Illness. Crit Care Med. 2020;48(11):1670-9.
9.
go back to reference Porter J, Boyd C, Skandari MR, Laiteerapong N. Revisiting the Time needed to provide adult primary care. J Gen Intern Med. 2023;38(1):147–55.CrossRefPubMed Porter J, Boyd C, Skandari MR, Laiteerapong N. Revisiting the Time needed to provide adult primary care. J Gen Intern Med. 2023;38(1):147–55.CrossRefPubMed
10.
go back to reference Owens DK, Davidson KW, Krist AH, Barry MJ, Cabana M, Caughey AB, et al. Screening for cognitive impairment in older adults: US Preventive Services Task Force Recommendation Statement. JAMA. 2020;323(8):757–63.CrossRefPubMed Owens DK, Davidson KW, Krist AH, Barry MJ, Cabana M, Caughey AB, et al. Screening for cognitive impairment in older adults: US Preventive Services Task Force Recommendation Statement. JAMA. 2020;323(8):757–63.CrossRefPubMed
11.
go back to reference Lind KE, Hildreth K, Lindrooth R, Morrato E, Crane LA, Perraillon MC. The effect of direct cognitive assessment in the Medicare annual wellness visit on dementia diagnosis rates. Health Serv Res. 2021;56(2):193–203.CrossRefPubMedPubMedCentral Lind KE, Hildreth K, Lindrooth R, Morrato E, Crane LA, Perraillon MC. The effect of direct cognitive assessment in the Medicare annual wellness visit on dementia diagnosis rates. Health Serv Res. 2021;56(2):193–203.CrossRefPubMedPubMedCentral
12.
go back to reference Thunell JA, Jacobson M, Joe EB, Zissimopoulos JM. Medicare’s Annual Wellness visit and diagnoses of dementias and cognitive impairment. Alzheimers Dement (Amst). 2022;14(1):e12357.CrossRefPubMed Thunell JA, Jacobson M, Joe EB, Zissimopoulos JM. Medicare’s Annual Wellness visit and diagnoses of dementias and cognitive impairment. Alzheimers Dement (Amst). 2022;14(1):e12357.CrossRefPubMed
13.
go back to reference Fowler NR, Campbell NL, Pohl GM, Munsie LM, Kirson NY, Desai U, et al. One-year effect of the Medicare Annual Wellness Visit on detection of cognitive impairment: a Cohort Study. J Am Geriatr Soc. 2018;66(5):969–75.CrossRefPubMed Fowler NR, Campbell NL, Pohl GM, Munsie LM, Kirson NY, Desai U, et al. One-year effect of the Medicare Annual Wellness Visit on detection of cognitive impairment: a Cohort Study. J Am Geriatr Soc. 2018;66(5):969–75.CrossRefPubMed
14.
go back to reference Haines KJ, Hibbert E, McPeake J, Anderson BJ, Bienvenu OJ, Andrews A, et al. Prediction models for physical, cognitive, and Mental Health impairments after critical illness: a systematic review and critical Appraisal. Crit Care Med. 2020;48(12):1871–80.CrossRefPubMedPubMedCentral Haines KJ, Hibbert E, McPeake J, Anderson BJ, Bienvenu OJ, Andrews A, et al. Prediction models for physical, cognitive, and Mental Health impairments after critical illness: a systematic review and critical Appraisal. Crit Care Med. 2020;48(12):1871–80.CrossRefPubMedPubMedCentral
15.
go back to reference Barnes DE, Zhou J, Walker RL, Larson EB, Lee SJ, Boscardin WJ, et al. Development and Validation of eRADAR: a Tool using EHR Data to detect unrecognized dementia. J Am Geriatr Soc. 2020;68(1):103–11.CrossRefPubMed Barnes DE, Zhou J, Walker RL, Larson EB, Lee SJ, Boscardin WJ, et al. Development and Validation of eRADAR: a Tool using EHR Data to detect unrecognized dementia. J Am Geriatr Soc. 2020;68(1):103–11.CrossRefPubMed
16.
go back to reference Ehlenbach WJ, Hough CL, Crane PK, Haneuse SJ, Carson SS, Curtis JR, et al. Association between acute care and critical illness hospitalization and cognitive function in older adults. JAMA. 2010;303(8):763–70.CrossRefPubMedPubMedCentral Ehlenbach WJ, Hough CL, Crane PK, Haneuse SJ, Carson SS, Curtis JR, et al. Association between acute care and critical illness hospitalization and cognitive function in older adults. JAMA. 2010;303(8):763–70.CrossRefPubMedPubMedCentral
17.
go back to reference Guerra C, Hua M, Wunsch H. Risk of a diagnosis of Dementia for Elderly Medicare beneficiaries after Intensive Care. Anesthesiology. 2015;123(5):1105–12.CrossRefPubMed Guerra C, Hua M, Wunsch H. Risk of a diagnosis of Dementia for Elderly Medicare beneficiaries after Intensive Care. Anesthesiology. 2015;123(5):1105–12.CrossRefPubMed
19.
go back to reference Jaeger BCWS, Lenoir K, Pajewski NM. Aorsf: an R package for supervised learning using the oblique random survival forest. J Open Source Softw 2022 Sept(8;7(77):4705). Jaeger BCWS, Lenoir K, Pajewski NM. Aorsf: an R package for supervised learning using the oblique random survival forest. J Open Source Softw 2022 Sept(8;7(77):4705).
20.
go back to reference Jaeger BCWS, Lenoir K, Speiser JL, Segar MW, Pandey A, Pajewski NM. Accelerated and interpretable oblique random survival forests. J Comput Graphical Stat 2023 Aug(3:1–6). Jaeger BCWS, Lenoir K, Speiser JL, Segar MW, Pandey A, Pajewski NM. Accelerated and interpretable oblique random survival forests. J Comput Graphical Stat 2023 Aug(3:1–6).
21.
go back to reference Chen TGCX. A scalable tree boosting system. InProceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. 2016 Aug 13 785 – 94. Chen TGCX. A scalable tree boosting system. InProceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. 2016 Aug 13 785 – 94.
22.
go back to reference Simon NFJ, Hastie T, Tibshirani R. Regularization paths for Cox’s proportional hazards model via coordinate descent. J Stat Softw 2011 Mar(39(5):1). Simon NFJ, Hastie T, Tibshirani R. Regularization paths for Cox’s proportional hazards model via coordinate descent. J Stat Softw 2011 Mar(39(5):1).
23.
go back to reference Shan G. Monte Carlo cross-validation for a study with binary outcome and limited sample size. BMC Med Inf Decis Mak. 2022;22(1):270.CrossRef Shan G. Monte Carlo cross-validation for a study with binary outcome and limited sample size. BMC Med Inf Decis Mak. 2022;22(1):270.CrossRef
24.
go back to reference Westreich D, Cole SR, Funk MJ, Brookhart MA, Stürmer T. The role of the c-statistic in variable selection for propensity score models. Pharmacoepidemiol Drug Saf. 2011;20(3):317–20.CrossRefPubMed Westreich D, Cole SR, Funk MJ, Brookhart MA, Stürmer T. The role of the c-statistic in variable selection for propensity score models. Pharmacoepidemiol Drug Saf. 2011;20(3):317–20.CrossRefPubMed
25.
26.
go back to reference James G, Witten D, Hastie T, Tibshirani R. N introduction to statistical learning with applications in R. Springer; 2013. James G, Witten D, Hastie T, Tibshirani R. N introduction to statistical learning with applications in R. Springer; 2013.
27.
go back to reference Jaeger BCWS, Lenoir K, Pajewski NM. J Open Source Softw 2022 Sept(28;7(77):4705). Jaeger BCWS, Lenoir K, Pajewski NM. J Open Source Softw 2022 Sept(28;7(77):4705).
28.
go back to reference Fong TG, Davis D, Growdon ME, Albuquerque A, Inouye SK. The interface between delirium and dementia in elderly adults. Lancet Neurol. 2015;14(8):823–32.CrossRefPubMedPubMedCentral Fong TG, Davis D, Growdon ME, Albuquerque A, Inouye SK. The interface between delirium and dementia in elderly adults. Lancet Neurol. 2015;14(8):823–32.CrossRefPubMedPubMedCentral
29.
go back to reference Woon FL, Dunn CB, Hopkins RO. Predicting cognitive sequelae in survivors of critical illness with cognitive screening tests. Am J Respir Crit Care Med. 2012;186(4):333–40.CrossRefPubMed Woon FL, Dunn CB, Hopkins RO. Predicting cognitive sequelae in survivors of critical illness with cognitive screening tests. Am J Respir Crit Care Med. 2012;186(4):333–40.CrossRefPubMed
30.
go back to reference Girard TD, Jackson JC, Pandharipande PP, Pun BT, Thompson JL, Shintani AK, et al. Delirium as a predictor of long-term cognitive impairment in survivors of critical illness. Crit Care Med. 2010;38(7):1513–20.CrossRefPubMedPubMedCentral Girard TD, Jackson JC, Pandharipande PP, Pun BT, Thompson JL, Shintani AK, et al. Delirium as a predictor of long-term cognitive impairment in survivors of critical illness. Crit Care Med. 2010;38(7):1513–20.CrossRefPubMedPubMedCentral
31.
go back to reference Hou Y, Dan X, Babbar M, Wei Y, Hasselbalch SG, Croteau DL, et al. Ageing as a risk factor for neurodegenerative disease. Nat Rev Neurol. 2019;15(10):565–81.CrossRefPubMed Hou Y, Dan X, Babbar M, Wei Y, Hasselbalch SG, Croteau DL, et al. Ageing as a risk factor for neurodegenerative disease. Nat Rev Neurol. 2019;15(10):565–81.CrossRefPubMed
32.
go back to reference Niu H, Alvarez-Alvarez I, Guillen-Grima F, Aguinaga-Ontoso I. Prevalence and incidence of Alzheimer’s disease in Europe: a meta-analysis. Neurologia. 2017;32(8):523–32.CrossRefPubMed Niu H, Alvarez-Alvarez I, Guillen-Grima F, Aguinaga-Ontoso I. Prevalence and incidence of Alzheimer’s disease in Europe: a meta-analysis. Neurologia. 2017;32(8):523–32.CrossRefPubMed
33.
go back to reference 2020 Alzheimer’s disease facts and figures. Alzheimers Dement. 2020. 2020 Alzheimer’s disease facts and figures. Alzheimers Dement. 2020.
34.
go back to reference Tsoy E, Kiekhofer RE, Guterman EL, Tee BL, Windon CC, Dorsman KA, et al. Assessment of Racial/Ethnic disparities in timeliness and comprehensiveness of Dementia diagnosis in California. JAMA Neurol. 2021;78(6):657–65.CrossRefPubMed Tsoy E, Kiekhofer RE, Guterman EL, Tee BL, Windon CC, Dorsman KA, et al. Assessment of Racial/Ethnic disparities in timeliness and comprehensiveness of Dementia diagnosis in California. JAMA Neurol. 2021;78(6):657–65.CrossRefPubMed
35.
go back to reference Coley RY, Smith JJ, Karliner L, Idu AE, Lee SJ, Fuller S, et al. External validation of the eRADAR risk score for detecting undiagnosed dementia in two real-World Healthcare systems. J Gen Intern Med. 2023;38(2):351–60.CrossRefPubMed Coley RY, Smith JJ, Karliner L, Idu AE, Lee SJ, Fuller S, et al. External validation of the eRADAR risk score for detecting undiagnosed dementia in two real-World Healthcare systems. J Gen Intern Med. 2023;38(2):351–60.CrossRefPubMed
36.
go back to reference Taylor B, Barboi C, Boustani M. Passive digital markers for Alzheimer’s disease and other related dementias: a systematic evidence review. J Am Geriatr Soc. 2023;71(9):2966–74.CrossRefPubMed Taylor B, Barboi C, Boustani M. Passive digital markers for Alzheimer’s disease and other related dementias: a systematic evidence review. J Am Geriatr Soc. 2023;71(9):2966–74.CrossRefPubMed
37.
go back to reference Chodosh J, Petitti DB, Elliott M, Hays RD, Crooks VC, Reuben DB, et al. Physician recognition of cognitive impairment: evaluating the need for improvement. J Am Geriatr Soc. 2004;52(7):1051–9.CrossRefPubMed Chodosh J, Petitti DB, Elliott M, Hays RD, Crooks VC, Reuben DB, et al. Physician recognition of cognitive impairment: evaluating the need for improvement. J Am Geriatr Soc. 2004;52(7):1051–9.CrossRefPubMed
Metadata
Title
Developing a prediction model for cognitive impairment in older adults following critical illness
Authors
Ashley E. Eisner
Lauren Witek
Nicholas M. Pajewski
Stephanie P. Taylor
Richa Bundy
Jeff D. Williamson
Byron C. Jaeger
Jessica A. Palakshappa
Publication date
01-12-2024
Publisher
BioMed Central
Keywords
Dementia
Dementia
Published in
BMC Geriatrics / Issue 1/2024
Electronic ISSN: 1471-2318
DOI
https://doi.org/10.1186/s12877-024-05567-0

Keynote series | Spotlight on menopause

Menopause can have a significant impact on the body, with effects ranging beyond the endocrine and reproductive systems. Learn about the broader systemic effects of menopause, so you can help patients in your clinics through the transition.

Launching: Thursday 12th December 2024
 

Prof. Martha Hickey
Dr. Claudia Barth
Dr. Samar El Khoudary
Developed by: Springer Medicine
Register your interest now

Keynote webinar | Spotlight on adolescent vaping

  • Live
  • Webinar | 29-01-2025 | 18:00 (CET)

Growing numbers of young people are using e-cigarettes, despite warnings of respiratory effects and addiction. How can doctors tackle the epidemic, and what health effects should you prepare to manage in your clinics?

Watch it live: Wednesday 29th January, 18:00-19:30 CET
 

Prof. Ann McNeill
Dr. Debbie Robson
Benji Horwell
Developed by: Springer Medicine
Join the webinar

Keynote webinar | Spotlight on modern management of frailty

Frailty has a significant impact on health and wellbeing, especially in older adults. Our experts explain the factors that contribute to the development of frailty and how you can manage the condition and reduce the risk of disability, dependency, and mortality in your patients.

Prof. Alfonso Cruz-Jentoft
Prof. Barbara C. van Munster
Prof. Mirko Petrovic
Developed by: Springer Medicine
Watch now

A quick guide to ECGs

Improve your ECG interpretation skills with this comprehensive, rapid, interactive course. Expert advice provides detailed feedback as you work through 50 ECGs covering the most common cardiac presentations to ensure your practice stays up to date. 

PD Dr. Carsten W. Israel
Developed by: Springer Medizin
Start the cases

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine
Read more