Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Research

Application of artificial neural network in daily prediction of bleeding in ICU patients treated with anti-thrombotic therapy

Authors: Daonan Chen, Rui Wang, Yihan Jiang, Zijian Xing, Qiuyang Sheng, Xiaoqing Liu, Ruilan Wang, Hui Xie, Lina Zhao

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Objectives

Anti-thrombotic therapy is the basis of thrombosis prevention and treatment. Bleeding is the main adverse event of anti-thrombosis. Existing laboratory indicators cannot accurately reflect the real-time coagulation function. It is necessary to develop tools to dynamically evaluate the risk and benefits of anti-thrombosis to prescribe accurate anti-thrombotic therapy.

Methods

The prediction model,daily prediction of bleeding risk in ICU patients treated with anti-thrombotic therapy, was built using deep learning algorithm recurrent neural networks, and the model results and performance were compared with clinicians.

Results

There was no significant statistical discrepancy in the baseline. ROC curves of the four models in the validation and test set were drawn, respectively. One-layer GRU of the validation set had a larger AUC (0.9462; 95%CI, 0.9147–0.9778). Analysis was conducted in the test set, and the ROC curve showed the superiority of two layers LSTM over one-layer GRU, while the former AUC was 0.8391(95%CI, 0.7786–0.8997). One-layer GRU in the test set possessed a better specificity (sensitivity 0.5942; specificity 0.9300). The Fleiss’ k of junior clinicians, senior clinicians, and machine learning classifiers is 0.0984, 0.4562, and 0.8012, respectively.

Conclusions

Recurrent neural networks were first applied for daily prediction of bleeding risk in ICU patients treated with anti-thrombotic therapy. Deep learning classifiers are more reliable and consistent than human classifiers. The machine learning classifier suggested strong reliability. The deep learning algorithm significantly outperformed human classifiers in prediction time.
Literature
1.
go back to reference Levi M, Sivapalaratnam S. Hemostatic abnormalities in critically ill patients. Intern Emerg Med. 2014;10:287–96.CrossRef Levi M, Sivapalaratnam S. Hemostatic abnormalities in critically ill patients. Intern Emerg Med. 2014;10:287–96.CrossRef
2.
go back to reference Marks PW. Coagulation Disorders in the ICU. Clin Chest Med. 2009;30:123–9.CrossRef Marks PW. Coagulation Disorders in the ICU. Clin Chest Med. 2009;30:123–9.CrossRef
3.
go back to reference Chodakowski JD, Courtney DM. Pulmonary embolism critical care update. Curr Opin Crit Care. 2018;24:540–6.CrossRef Chodakowski JD, Courtney DM. Pulmonary embolism critical care update. Curr Opin Crit Care. 2018;24:540–6.CrossRef
4.
go back to reference Hollist M, Morgan L, Cabatbat R, Au K, Kirmani MF, Kirmani BF. Acute Stroke Management: overview and recent updates. Aging Dis. 2021;12:1000.CrossRefPubMedCentral Hollist M, Morgan L, Cabatbat R, Au K, Kirmani MF, Kirmani BF. Acute Stroke Management: overview and recent updates. Aging Dis. 2021;12:1000.CrossRefPubMedCentral
6.
go back to reference Spahn DR, Bouillon B, Cerny V, Duranteau J, Filipescu D, Hunt BJ, et al. The european guideline on management of major bleeding and coagulopathy following trauma: fifth edition. Crit Care. 2019;23:98.CrossRefPubMedPubMedCentral Spahn DR, Bouillon B, Cerny V, Duranteau J, Filipescu D, Hunt BJ, et al. The european guideline on management of major bleeding and coagulopathy following trauma: fifth edition. Crit Care. 2019;23:98.CrossRefPubMedPubMedCentral
7.
go back to reference Villar J, Pérez-Méndez L, Kacmarek RM. The Berlin definition met our needs: no. Intensive Care Med. 2016;42:648–50.CrossRef Villar J, Pérez-Méndez L, Kacmarek RM. The Berlin definition met our needs: no. Intensive Care Med. 2016;42:648–50.CrossRef
8.
go back to reference Saner FH, Bezinover D. Assessment and management of coagulopathy in critically-ill patients with liver failure. Curr Opin Crit Care. 2019;25:179–86.CrossRef Saner FH, Bezinover D. Assessment and management of coagulopathy in critically-ill patients with liver failure. Curr Opin Crit Care. 2019;25:179–86.CrossRef
9.
go back to reference Sauro KM, Soo A, Kramer A, Couillard P, Kromm J, Zygun D, et al. Venous thromboembolism Prophylaxis in Neurocritical Care Patients: Are Current Practices. Best Practices? Neurocrit Care. 2018;30:355–63.CrossRef Sauro KM, Soo A, Kramer A, Couillard P, Kromm J, Zygun D, et al. Venous thromboembolism Prophylaxis in Neurocritical Care Patients: Are Current Practices. Best Practices? Neurocrit Care. 2018;30:355–63.CrossRef
10.
go back to reference Farr S, Toor H, Patchana T, Podkovik S, Wiginton JG, Sweiss R, et al. Risks, benefits, and the optimal time to resume deep vein thrombosis Prophylaxis in patients with intracranial hemorrhage. Cureus. 2019;11:e5827.PubMedCentral Farr S, Toor H, Patchana T, Podkovik S, Wiginton JG, Sweiss R, et al. Risks, benefits, and the optimal time to resume deep vein thrombosis Prophylaxis in patients with intracranial hemorrhage. Cureus. 2019;11:e5827.PubMedCentral
11.
go back to reference Schulman S, Piran S. Thromboprophylaxis in patients with Acute spinal cord Injury: a narrative review. Semin Thromb Hemost. 2019;45:150–6.CrossRef Schulman S, Piran S. Thromboprophylaxis in patients with Acute spinal cord Injury: a narrative review. Semin Thromb Hemost. 2019;45:150–6.CrossRef
12.
go back to reference Rayes HA, Subat YW, Weister T, Johnson MQ, Hanson A, Schulte PJ, et al. Concomitant aspirin and anticoagulation is Associated with increased risk for major bleeding in Surgical Patients requiring postoperative intensive care. Crit Care Medicine. 2020;48:985–92.CrossRef Rayes HA, Subat YW, Weister T, Johnson MQ, Hanson A, Schulte PJ, et al. Concomitant aspirin and anticoagulation is Associated with increased risk for major bleeding in Surgical Patients requiring postoperative intensive care. Crit Care Medicine. 2020;48:985–92.CrossRef
13.
go back to reference Eikelboom JW, Mehta SR, Anand SS, Xie C, Fox KAA, Yusuf S. Adverse impact of bleeding on prognosis in patients with Acute Coronary Syndromes. Circulation. 2006;114:774–82.CrossRef Eikelboom JW, Mehta SR, Anand SS, Xie C, Fox KAA, Yusuf S. Adverse impact of bleeding on prognosis in patients with Acute Coronary Syndromes. Circulation. 2006;114:774–82.CrossRef
14.
go back to reference LEVI M, KAMPHUISEN EERENBERGE. Bleeding risk and reversal strategies for old and new anticoagulants and antiplatelet agents. J Thromb Haemost. 2011;9:1705–12.CrossRef LEVI M, KAMPHUISEN EERENBERGE. Bleeding risk and reversal strategies for old and new anticoagulants and antiplatelet agents. J Thromb Haemost. 2011;9:1705–12.CrossRef
15.
go back to reference Kearon C, Akl EA, Comerota AJ, Prandoni P, Bounameaux H, Goldhaber SZ, et al. Antithrombotic therapy for VTE Disease. Chest. 2012;141:e419S–96.CrossRefPubMedCentral Kearon C, Akl EA, Comerota AJ, Prandoni P, Bounameaux H, Goldhaber SZ, et al. Antithrombotic therapy for VTE Disease. Chest. 2012;141:e419S–96.CrossRefPubMedCentral
16.
go back to reference Abraham NS, Barkun AN, Sauer BG, Douketis J, Laine L, Noseworthy PA, et al. American College of Gastroenterology-Canadian Association of Gastroenterology Clinical Practice Guideline: management of Anticoagulants and Antiplatelets during Acute gastrointestinal bleeding and the Periendoscopic Period. Am J Gastroenterol. 2022;117:542–58.CrossRefPubMedCentral Abraham NS, Barkun AN, Sauer BG, Douketis J, Laine L, Noseworthy PA, et al. American College of Gastroenterology-Canadian Association of Gastroenterology Clinical Practice Guideline: management of Anticoagulants and Antiplatelets during Acute gastrointestinal bleeding and the Periendoscopic Period. Am J Gastroenterol. 2022;117:542–58.CrossRefPubMedCentral
17.
go back to reference Chen Y, Yoon JH, Pinsky MR, Ma T, Clermont G. Development of hemorrhage identification model using non-invasive vital signs. Physiol Meas. 2020;41:055010.CrossRefPubMedCentral Chen Y, Yoon JH, Pinsky MR, Ma T, Clermont G. Development of hemorrhage identification model using non-invasive vital signs. Physiol Meas. 2020;41:055010.CrossRefPubMedCentral
18.
go back to reference de Winter MA, van Es N, Büller HR, Visseren FLJ, Nijkeuter M. Prediction models for recurrence and bleeding in patients with venous thromboembolism: a systematic review and critical appraisal. Thromb Res. 2021;199:85–96.CrossRef de Winter MA, van Es N, Büller HR, Visseren FLJ, Nijkeuter M. Prediction models for recurrence and bleeding in patients with venous thromboembolism: a systematic review and critical appraisal. Thromb Res. 2021;199:85–96.CrossRef
19.
go back to reference Barnett-Griness O, Stein N, Kotler A, Saliba W, Gronich N. Novel bleeding prediction model in atrial fibrillation patients on new oral anticoagulants. Heart. 2021;108:266–73.CrossRef Barnett-Griness O, Stein N, Kotler A, Saliba W, Gronich N. Novel bleeding prediction model in atrial fibrillation patients on new oral anticoagulants. Heart. 2021;108:266–73.CrossRef
20.
go back to reference Lipton ZC. A Critical Review of Recurrent Neural Networks for Sequence Learning. arXiv.org. 2015. Lipton ZC. A Critical Review of Recurrent Neural Networks for Sequence Learning. arXiv.org. 2015.
21.
go back to reference Johnson AEW, Stone DJ, Celi LA, Pollard TJ. The MIMIC Code Repository: enabling reproducibility in critical care research. J Am Med Inform Assoc. 2017;25:32–9.CrossRefPubMedCentral Johnson AEW, Stone DJ, Celi LA, Pollard TJ. The MIMIC Code Repository: enabling reproducibility in critical care research. J Am Med Inform Assoc. 2017;25:32–9.CrossRefPubMedCentral
22.
go back to reference Johnson AEW, Pollard TJ, Shen L, Lehman LH, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035.CrossRefPubMedCentral Johnson AEW, Pollard TJ, Shen L, Lehman LH, Feng M, Ghassemi M, et al. MIMIC-III, a freely accessible critical care database. Sci Data. 2016;3:160035.CrossRefPubMedCentral
23.
go back to reference Taggart M, Chapman WW, Steinberg BA, Ruckel S, Pregenzer-Wenzler A, Du Y, et al. Comparison of 2 Natural Language Processing methods for identification of bleeding among critically ill patients. JAMA Netw Open. 2018;1:e183451.CrossRefPubMedCentral Taggart M, Chapman WW, Steinberg BA, Ruckel S, Pregenzer-Wenzler A, Du Y, et al. Comparison of 2 Natural Language Processing methods for identification of bleeding among critically ill patients. JAMA Netw Open. 2018;1:e183451.CrossRefPubMedCentral
24.
go back to reference Darzi AJ, Karam SG, Charide R, Etxeandia-Ikobaltzeta I, Cushman M, Gould MK, et al. Prognostic factors for VTE and bleeding in hospitalized medical patients: a systematic review and meta-analysis. Blood. 2020;135:1788–810.CrossRefPubMedPubMedCentral Darzi AJ, Karam SG, Charide R, Etxeandia-Ikobaltzeta I, Cushman M, Gould MK, et al. Prognostic factors for VTE and bleeding in hospitalized medical patients: a systematic review and meta-analysis. Blood. 2020;135:1788–810.CrossRefPubMedPubMedCentral
25.
go back to reference Darzi AJ, Karam SG, Spencer FA, Spyropoulos AC, Mbuagbaw L, Woller SC, et al. Risk models for VTE and bleeding in medical inpatients: systematic identification and expert assessment. Blood Adv. 2020;4:2557–66.CrossRefPubMedCentral Darzi AJ, Karam SG, Spencer FA, Spyropoulos AC, Mbuagbaw L, Woller SC, et al. Risk models for VTE and bleeding in medical inpatients: systematic identification and expert assessment. Blood Adv. 2020;4:2557–66.CrossRefPubMedCentral
26.
go back to reference McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22:276–82.CrossRef McHugh ML. Interrater reliability: the kappa statistic. Biochem Med. 2012;22:276–82.CrossRef
28.
go back to reference Shung D, Huang J, Castro E, Tay JK, Simonov M, Laine L, et al. Neural network predicts need for red blood cell transfusion for patients with acute gastrointestinal bleeding admitted to the intensive care unit. Sci Rep. 2021;11:8827.CrossRefPubMedCentral Shung D, Huang J, Castro E, Tay JK, Simonov M, Laine L, et al. Neural network predicts need for red blood cell transfusion for patients with acute gastrointestinal bleeding admitted to the intensive care unit. Sci Rep. 2021;11:8827.CrossRefPubMedCentral
31.
go back to reference Kha Q-H, Ho Q-T, Le NQK. Identifying SNARE Proteins using an alignment-free Method based on Multiscan Convolutional neural network and PSSM Profiles. J Chem Inf Model. 2022;62:4820–6.CrossRefPubMedCentral Kha Q-H, Ho Q-T, Le NQK. Identifying SNARE Proteins using an alignment-free Method based on Multiscan Convolutional neural network and PSSM Profiles. J Chem Inf Model. 2022;62:4820–6.CrossRefPubMedCentral
32.
go back to reference Adams R, Henry KE, Sridharan A, Soleimani H, Zhan A, Rawat N, et al. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis. Nat Med. 2022;28:1455–60.CrossRef Adams R, Henry KE, Sridharan A, Soleimani H, Zhan A, Rawat N, et al. Prospective, multi-site study of patient outcomes after implementation of the TREWS machine learning-based early warning system for sepsis. Nat Med. 2022;28:1455–60.CrossRef
33.
go back to reference Kha Q-H, Le V-H, Hung TNK, Nguyen NTK, Le NQK. Development and validation of an explainable machine learning-based prediction model for drug–food interactions from Chemical Structures. Sensors. 2023;23:3962.CrossRefPubMedCentral Kha Q-H, Le V-H, Hung TNK, Nguyen NTK, Le NQK. Development and validation of an explainable machine learning-based prediction model for drug–food interactions from Chemical Structures. Sensors. 2023;23:3962.CrossRefPubMedCentral
34.
go back to reference Shrikumar A, Greenside P, Kundaje A. Learning Important Features Through Propagating Activation Differences. International Conference on Machine Learning. 2017;70:3145–53. Shrikumar A, Greenside P, Kundaje A. Learning Important Features Through Propagating Activation Differences. International Conference on Machine Learning. 2017;70:3145–53.
Metadata
Title
Application of artificial neural network in daily prediction of bleeding in ICU patients treated with anti-thrombotic therapy
Authors
Daonan Chen
Rui Wang
Yihan Jiang
Zijian Xing
Qiuyang Sheng
Xiaoqing Liu
Ruilan Wang
Hui Xie
Lina Zhao
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02274-5

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue