Top

BMC Medical Informatics and Decision Making

Published in:

Open Access 01-12-2023 | Research

Application of a practice-based approach in variable selection for a prediction model development study of hospital-induced delirium

Authors: Urszula A. Snigurska, Sarah E. Ser, Laurence M. Solberg, Mattia Prosperi, Tanja Magoc, Zhaoyi Chen, Jiang Bian, Ragnhildur I. Bjarnadottir, Robert J. Lucero

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Abstract

Background

Prognostic models of hospital-induced delirium, that include potential predisposing and precipitating factors, may be used to identify vulnerable patients and inform the implementation of tailored preventive interventions. It is recommended that, in prediction model development studies, candidate predictors are selected on the basis of existing knowledge, including knowledge from clinical practice. The purpose of this article is to describe the process of identifying and operationalizing candidate predictors of hospital-induced delirium for application in a prediction model development study using a practice-based approach.

Methods

This study is part of a larger, retrospective cohort study that is developing prognostic models of hospital-induced delirium for medical-surgical older adult patients using structured data from administrative and electronic health records. First, we conducted a review of the literature to identify clinical concepts that had been used as candidate predictors in prognostic model development-and-validation studies of hospital-induced delirium. Then, we consulted a multidisciplinary task force of nine members who independently judged whether each clinical concept was associated with hospital-induced delirium. Finally, we mapped the clinical concepts to the administrative and electronic health records and operationalized our candidate predictors.

Results

In the review of 34 studies, we identified 504 unique clinical concepts. Two-thirds of the clinical concepts (337/504) were used as candidate predictors only once. The most common clinical concepts included age (31/34), sex (29/34), and alcohol use (22/34). 96% of the clinical concepts (484/504) were judged to be associated with the development of hospital-induced delirium by at least two members of the task force. All of the task force members agreed that 47 or 9% of the 504 clinical concepts were associated with hospital-induced delirium.

Conclusions

Heterogeneity among candidate predictors of hospital-induced delirium in the literature suggests a still evolving list of factors that contribute to the development of this complex phenomenon. We demonstrated a practice-based approach to variable selection for our model development study of hospital-induced delirium. Expert judgement of variables enabled us to categorize the variables based on the amount of agreement among the experts and plan for the development of different models, including an expert-model and data-driven model.

Available only for authorised users

Leslie DL, Marcantonio ER, Zhang Y, Leo-Summers L, Inouye SK. One-year health care costs associated with delirium in the elderly population. Arch Intern Med. 2008;168(1):27–32. https://doi.org/10.1001/archinternmed.2007.4.CrossRefPubMedPubMedCentral

American Psychiatric Association. Neurocognitive disorders. In: Diagnostic and Statistical Manual of Mental Disorders. 5th ed., text rev. American Psychiatric Association;2022. Accessed January 24., 2023. https://doi.org/10.1176/appi.books.9780890425787.

Inouye SK, Westendorp RG, Saczynski JS. Delirium in elderly people. Lancet. 2014;383(9920):911–22. https://doi.org/10.1016/S0140-6736(13)60688-1.CrossRefPubMed

Aung Thein MZ, Pereira JV, Nitchingham A, Caplan GA. A call to action for delirium research: Meta-analysis and regression of delirium associated mortality. BMC Geriatr. 2020;20(1):325. https://doi.org/10.1186/s12877-020-01723-4. Published 2020 Sep 7.CrossRefPubMedPubMedCentral

Inouye SK, Bogardus ST Jr, Charpentier PA, et al. A multicomponent intervention to prevent delirium in hospitalized older patients. N Engl J Med. 1999;340(9):669–76. https://doi.org/10.1056/NEJM199903043400901.CrossRefPubMed

Carrasco MP, Villarroel L, Andrade M, Calderón J, González M. Development and validation of a delirium predictive score in older people. Age Ageing. 2014;43(3):346–51. https://doi.org/10.1093/ageing/aft141.CrossRefPubMed

de Wit HA, Winkens B, Mestres Gonzalvo C, et al. The development of an automated ward independent delirium risk prediction model. Int J Clin Pharm. 2016;38(4):915–23. https://doi.org/10.1007/s11096-016-0312-7.CrossRefPubMed

Inouye SK, Viscoli CM, Horwitz RI, Hurst LD, Tinetti ME. A predictive model for delirium in hospitalized elderly medical patients based on admission characteristics. Ann Intern Med. 1993;119(6):474–81. https://doi.org/10.7326/0003-4819-119-6-199309150-00005.CrossRefPubMed

Inouye SK, Charpentier PA. Precipitating factors for delirium in hospitalized elderly persons. Predictive model and interrelationship with baseline vulnerability. JAMA. 1996;275(11):852–7.CrossRefPubMed

10.

Ji MT, Xing SP, Yang Y. Pathophysiological factors of delirium among critically ill elders after non-cardiac surgery based on artificial neural networks: a pilot study. Anaesth Pain & Intensive care. 2018;22(4):424–30.

11.

Jones RN, Marcantonio ER, Saczynski JS, et al. Preoperative cognitive performance dominates risk for delirium among older adults. J Geriatr Psychiatry Neurol. 2016;29(6):320–7. https://doi.org/10.1177/0891988716666380.CrossRefPubMedPubMedCentral

12.

Kim MY, Park UJ, Kim HT, Cho WH. Delirium prediction based on hospital information (Delphi) in general surgery patients. Med (Baltim). 2016;95(12):e3072. https://doi.org/10.1097/MD.0000000000003072.CrossRef

13.

Leung JM, Sands LP, Wang Y, et al. Apolipoprotein E e4 allele increases the risk of early postoperative delirium in older patients undergoing noncardiac surgery. Anesthesiology. 2007;107(3):406–11. https://doi.org/10.1097/01.anes.0000278905.07899.df.CrossRefPubMed

14.

Levkoff SE, Safran C, Cleary PD, Gallop J, Phillips RS. Identification of factors associated with the diagnosis of delirium in elderly hospitalized patients. J Am Geriatr Soc. 1988;36(12):1099–104. https://doi.org/10.1111/j.1532-5415.1988.tb04396.x.CrossRefPubMed

15.

O’Keeffe ST, Lavan JN. Predicting delirium in elderly patients: development and validation of a risk-stratification model. Age Ageing. 1996;25(4):317–21. https://doi.org/10.1093/ageing/25.4.317.CrossRefPubMed

16.

Pisani MA, Murphy TE, Van Ness PH, Araujo KL, Inouye SK. Characteristics associated with delirium in older patients in a medical intensive care unit. Arch Intern Med. 2007;167(15):1629–34. https://doi.org/10.1001/archinte.167.15.1629.CrossRefPubMed

17.

Pompei P, Foreman M, Rudberg MA, Inouye SK, Braund V, Cassel CK. Delirium in hospitalized older persons: outcomes and predictors. J Am Geriatr Soc. 1994;42(8):809–15. https://doi.org/10.1111/j.1532-5415.1994.tb06551.x.CrossRefPubMed

18.

Roijers JP, Rakké YS, Hopmans CJ, et al. Incidence and risk factors for delirium in elderly patients with critical limb ischaemia. Eur J Vasc Endovasc Surg. 2020;59(4):598–605. https://doi.org/10.1016/j.ejvs.2019.11.029.CrossRefPubMed

19.

Rudolph JL, Jones RN, Levkoff SE, et al. Derivation and validation of a preoperative prediction rule for delirium after cardiac surgery. Circulation. 2009;119(2):229–36. https://doi.org/10.1161/CIRCULATIONAHA.108.795260.CrossRefPubMed

20.

Zhan L, Wang XQ, Zhang LX. Nomogram model for predicting risk of postoperative delirium after deep brain stimulation surgery in patients older than 50 years with Parkinson disease. World Neurosurg. 2020;139:e127–35. https://doi.org/10.1016/j.wneu.2020.03.160.CrossRefPubMed

21.

Lindroth H, Bratzke L, Purvis S, et al. Systematic review of prediction models for delirium in the older adult inpatient. BMJ Open. 2018;8(4):e019223. https://doi.org/10.1136/bmjopen-2017-019223. Published 2018 Apr 28.CrossRefPubMedPubMedCentral

22.

Moons KGM, Wolff RF, Riley RD, et al. PROBAST: a tool to assess risk of bias and applicability of prediction model studies: explanation and elaboration. Ann Intern Med. 2019;170(1):W1–W33. https://doi.org/10.7326/M18-1377.CrossRefPubMed

23.

Chowdhury MZI, Turin TC. Variable selection strategies and its importance in clinical prediction modelling. Fam Med Community Health. 2020;8(1):e000262. https://doi.org/10.1136/fmch-2019-000262. Published 2020 Feb 16.CrossRefPubMedPubMedCentral

24.

Moons KG, Altman DG, Reitsma JB, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): explanation and elaboration. Ann Intern Med. 2015;162(1):W1–W73. https://doi.org/10.7326/M14-0698.CrossRefPubMed

25.

Moons KG, de Groot JA, Bouwmeester W et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: The CHARMS Checklist. PLoS Med. 2014;11(10):e1001744. Published 2014 Oct 14. https://doi.org/10.1371/journal.pmed.1001744.

26.

Böhner H, Hummel TC, Habel U, et al. Predicting delirium after vascular surgery: a model based on pre- and intraoperative data. Ann Surg. 2003;238(1):149–56. https://doi.org/10.1097/01.sla.0000077920.38307.5f.CrossRefPubMedPubMedCentral

27.

Sun J, Hu J, Luo D, et al. Combining knowledge and data driven insights for identifying risk factors using electronic health records. AMIA Annu Symp Proc. 2012;2012:901–10.PubMedPubMedCentral

28.

Kelly L, Vincent D. The dimensions of nursing surveillance: a concept analysis. J Adv Nurs. 2011;67(3):652–61. https://doi.org/10.1111/j.1365-2648.2010.05525.x.CrossRefPubMed

29.

Hosmer DW, Lemeshow S. Assessing the fit of the model. In: Hosmer DW, Lemeshow S, editors. Applied Logistic Regression. 2nd ed. John Wiley & Sons; 2000. pp. 143–202.

30.

Nakagami G, Yokota S, Kitamura A, et al. Supervised machine learning-based prediction for in-hospital pressure injury development using electronic health records: a retrospective observational cohort study in a university hospital in Japan. Int J Nurs Stud. 2021;119:103932. https://doi.org/10.1016/j.ijnurstu.2021.103932.CrossRefPubMed

31.

Capurro D, Yetisgen M, van Eaton E, Black R, Tarczy-Hornoch P. Availability of structured and unstructured clinical data for comparative effectiveness research and quality improvement: A multisite assessment. EGEMS (Wash DC). 2014;2(1):1079. Published 2014 Jul 11. https://doi.org/10.13063/2327-9214.1079.

32.

Bjarnadottir RI, Lucero RJ. What can we learn about fall risk factors from EHR nursing notes? A text mining study. EGEMS (Wash DC). 2018;6(1):21. https://doi.org/10.5334/egems.237. Published 2018 Sep 20.CrossRefPubMed

Title: Application of a practice-based approach in variable selection for a prediction model development study of hospital-induced delirium
Authors: Urszula A. Snigurska
Sarah E. Ser
Laurence M. Solberg
Mattia Prosperi
Tanja Magoc
Zhaoyi Chen
Jiang Bian
Ragnhildur I. Bjarnadottir
Robert J. Lucero
Publication date: 01-12-2023
Publisher: BioMed Central
Published in: BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI: https://doi.org/10.1186/s12911-023-02278-1

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Application of a practice-based approach in variable selection for a prediction model development study of hospital-induced delirium

Abstract

Background

Methods

Results

Conclusions

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Background

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2023

MNCLCDA: predicting circRNA-drug sensitivity associations by using mixed neighbourhood information and contrastive learning

A mobile health application for patients eligible for statin therapy: app development and qualitative feedback on design and usability

A deep learning-based automated algorithm for labeling coronary arteries in computed tomography angiography images

The factors affecting implementing shared decision-making in clinical trials: a cross-sectional survey of clinical research coordinators’ perceptions in Japan

Understanding cancer patient cohorts in virtual reality environment for better clinical decisions: a usability study

Proposal of neural network model for neurocognitive rehabilitation and its comparison with fuzzy expert system model