Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2021

Open Access 01-12-2021 | Care | Research article

Machine learning predicts mortality based on analysis of ventilation parameters of critically ill patients: multi-centre validation

Authors: Behrooz Mamandipoor, Fernando Frutos-Vivar, Oscar Peñuelas, Richard Rezar, Konstantinos Raymondos, Alfonso Muriel, Bin Du, Arnaud W. Thille, Fernando Ríos, Marco González, Lorenzo del-Sorbo, Maria del Carmen Marín, Bruno Valle Pinheiro, Marco Antonio Soares, Nicolas Nin, Salvatore M. Maggiore, Andrew Bersten, Malte Kelm, Raphael Romano Bruno, Pravin Amin, Nahit Cakar, Gee Young Suh, Fekri Abroug, Manuel Jibaja, Dimitros Matamis, Amine Ali Zeggwagh, Yuda Sutherasan, Antonio Anzueto, Bernhard Wernly, Andrés Esteban, Christian Jung, Venet Osmani

Published in: BMC Medical Informatics and Decision Making | Issue 1/2021

Login to get access

Abstract

Background

Mechanical Ventilation (MV) is a complex and central treatment process in the care of critically ill patients. It influences acid–base balance and can also cause prognostically relevant biotrauma by generating forces and liberating reactive oxygen species, negatively affecting outcomes. In this work we evaluate the use of a Recurrent Neural Network (RNN) modelling to predict outcomes of mechanically ventilated patients, using standard mechanical ventilation parameters.

Methods

We performed our analysis on VENTILA dataset, an observational, prospective, international, multi-centre study, performed to investigate the effect of baseline characteristics and management changes over time on the all-cause mortality rate in mechanically ventilated patients in ICU. Our cohort includes 12,596 adult patients older than 18, associated with 12,755 distinct admissions in ICUs across 37 countries and receiving invasive and non-invasive mechanical ventilation. We carry out four different analysis. Initially we select typical mechanical ventilation parameters and evaluate the machine learning model on both, the overall cohort and a subgroup of patients admitted with respiratory disorders. Furthermore, we carry out sensitivity analysis to evaluate whether inclusion of variables related to the function of other organs, improve the predictive performance of the model for both the overall cohort as well as the subgroup of patients with respiratory disorders.

Results

Predictive performance of RNN-based model was higher with Area Under the Receiver Operating Characteristic (ROC) Curve (AUC) of 0.72 (± 0.01) and Average Precision (AP) of 0.57 (± 0.01) in comparison to RF and LR for the overall patient dataset. Higher predictive performance was recorded in the subgroup of patients admitted with respiratory disorders with AUC of 0.75 (± 0.02) and AP of 0.65 (± 0.03). Inclusion of function of other organs further improved the performance to AUC of 0.79 (± 0.01) and AP 0.68 (± 0.02) for the overall patient dataset and AUC of 0.79 (± 0.01) and AP 0.72 (± 0.02) for the subgroup with respiratory disorders.

Conclusion

The RNN-based model demonstrated better performance than RF and LR in patients in mechanical ventilation and its subgroup admitted with respiratory disorders. Clinical studies are needed to evaluate whether it impacts decision-making and patient outcomes.
Trial registration: NCT02731898 (https://​clinicaltrials.​gov/​ct2/​show/​NCT02731898), prospectively registered on April 8, 2016.
Literature
21.
go back to reference Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR. Improving neural networks by preventing co-adaptation of feature detectors. arXiv Prepr. arXiv1207.0580, 2012. Hinton GE, Srivastava N, Krizhevsky A, Sutskever I, Salakhutdinov RR. Improving neural networks by preventing co-adaptation of feature detectors. arXiv Prepr. arXiv1207.0580, 2012.
22.
go back to reference Paszke A, et al. PyTorch: an imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems 32. Neural information processing systems foundation. 2019. Paszke A, et al. PyTorch: an imperative style, high-performance deep learning library. In: Advances in Neural Information Processing Systems 32. Neural information processing systems foundation. 2019.
25.
go back to reference Sundararajan M, Taly A, Yan Q. Axiomatic attribution for deep networks. In: 34th International Conference on Machine Learning (ICML), International Machine Learning Society (IMLS). 2017;7:5109–18. Sundararajan M, Taly A, Yan Q. Axiomatic attribution for deep networks. In: 34th International Conference on Machine Learning (ICML), International Machine Learning Society (IMLS). 2017;7:5109–18.
26.
go back to reference Guo C, Pleiss G, Sun Y, Weinberger KQ. On calibration of modern neural networks. In: 34th International Conference on Machine Learning (ICML), International Machine Learning Society (IMLS). 2017;3:2130–43. Guo C, Pleiss G, Sun Y, Weinberger KQ. On calibration of modern neural networks. In: 34th International Conference on Machine Learning (ICML), International Machine Learning Society (IMLS). 2017;3:2130–43.
29.
go back to reference Mamandipoor B, Majd M, Moz M, Osmani V. Blood lactate concentration prediction in critical care patients: handling missing values. 2019. arXiv:1910.01473. Mamandipoor B, Majd M, Moz M, Osmani V. Blood lactate concentration prediction in critical care patients: handling missing values. 2019. arXiv:​1910.​01473.
Metadata
Title
Machine learning predicts mortality based on analysis of ventilation parameters of critically ill patients: multi-centre validation
Authors
Behrooz Mamandipoor
Fernando Frutos-Vivar
Oscar Peñuelas
Richard Rezar
Konstantinos Raymondos
Alfonso Muriel
Bin Du
Arnaud W. Thille
Fernando Ríos
Marco González
Lorenzo del-Sorbo
Maria del Carmen Marín
Bruno Valle Pinheiro
Marco Antonio Soares
Nicolas Nin
Salvatore M. Maggiore
Andrew Bersten
Malte Kelm
Raphael Romano Bruno
Pravin Amin
Nahit Cakar
Gee Young Suh
Fekri Abroug
Manuel Jibaja
Dimitros Matamis
Amine Ali Zeggwagh
Yuda Sutherasan
Antonio Anzueto
Bernhard Wernly
Andrés Esteban
Christian Jung
Venet Osmani
Publication date
01-12-2021
Publisher
BioMed Central
Keyword
Care
Published in
BMC Medical Informatics and Decision Making / Issue 1/2021
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-021-01506-w

Other articles of this Issue 1/2021

BMC Medical Informatics and Decision Making 1/2021 Go to the issue