Skip to main content
Top
Published in:

Open Access 01-12-2024 | Triage | Systematic Review

Improving triage performance in emergency departments using machine learning and natural language processing: a systematic review

Author: Bruno Matos Porto

Published in: BMC Emergency Medicine | Issue 1/2024

Login to get access

Abstract

Background

In Emergency Departments (EDs), triage is crucial for determining patient severity and prioritizing care, typically using the Manchester Triage Scale (MTS). Traditional triage systems, reliant on human judgment, are prone to under-triage and over-triage, resulting in variability, bias, and incorrect patient classification. Studies suggest that Machine Learning (ML) and Natural Language Processing (NLP) could enhance triage accuracy and consistency. This review analyzes studies on ML and/or NLP algorithms for ED patient triage.

Methods

Following Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) guidelines, we conducted a systematic review across five databases: Web of Science, PubMed, Scopus, IEEE Xplore, and ACM Digital Library, from their inception of each database to October 2023. The risk of bias was assessed using the Prediction model Risk of Bias Assessment Tool (PROBAST). Only articles employing at least one ML and/or NLP method for patient triage classification were included.

Results

Sixty studies covering 57 ML algorithms were included. Logistic Regression (LR) was the most used model, while eXtreme Gradient Boosting (XGBoost), decision tree-based algorithms with Gradient Boosting (GB), and Deep Neural Networks (DNNs) showed superior performance. Frequent predictive variables included demographics and vital signs, with oxygen saturation, chief complaints, systolic blood pressure, age, and mode of arrival being the most retained. The ML algorithms showed significant bias risk due to critical bias assessment in classification models.

Conclusion

NLP methods improved ML algorithms' classification capability using triage nursing and medical notes and structured clinical data compared to algorithms using only structured data. Feature engineering (FE) and class imbalance correction methods enhanced ML workflows' performance, but FE and eXplainable Artificial Intelligence (XAI) were underexplored in this field.
Registration and funding.
This systematic review has been registered (registration number: CRD42024604529) in the International Prospective Register of Systematic Reviews (PROSPERO) and can be accessed online at the following URL: https://​www.​crd.​york.​ac.​uk/​prospero/​display_​record.​php?​RecordID=​604529. Funding for this work was provided by the National Council for Scientific and Technological Development (CNPq), Brazil.
Appendix
Available only for authorised users
Literature
2.
go back to reference M. Fernandes, S. M. Vieira, F. Leite, C. Palos, S. Finkelstein, and J. M. C. Sousa, “Clinical Decision Support Systems for Triage in the Emergency Department using Intelligent Systems: a Review,” Artif. Intell. Med., vol. 102, no. February 2019, p. 101762, Jan. 2020, https://doi.org/10.1016/j.artmed.2019.101762. M. Fernandes, S. M. Vieira, F. Leite, C. Palos, S. Finkelstein, and J. M. C. Sousa, “Clinical Decision Support Systems for Triage in the Emergency Department using Intelligent Systems: a Review,” Artif. Intell. Med., vol. 102, no. February 2019, p. 101762, Jan. 2020, https://​doi.​org/​10.​1016/​j.​artmed.​2019.​101762.
12.
21.
go back to reference Ruiz C, Tello I, Yoo SG. Improvement of the triage process using process automatization and machine learning. Int J Appl Eng Res. 2017;12(15):4989–99. Ruiz C, Tello I, Yoo SG. Improvement of the triage process using process automatization and machine learning. Int J Appl Eng Res. 2017;12(15):4989–99.
38.
go back to reference T.-L. Chen, J. C. Chen, W.-H. Chang, W. Tsai, M.-C. Shih, and A. Wildan Nabila, “Imbalanced prediction of emergency department admission using natural language processing and deep neural network,” J. Biomed. Inform., vol. 133, no. August, p. 104171, Sep. 2022, https://doi.org/10.1016/j.jbi.2022.104171. T.-L. Chen, J. C. Chen, W.-H. Chang, W. Tsai, M.-C. Shih, and A. Wildan Nabila, “Imbalanced prediction of emergency department admission using natural language processing and deep neural network,” J. Biomed. Inform., vol. 133, no. August, p. 104171, Sep. 2022, https://​doi.​org/​10.​1016/​j.​jbi.​2022.​104171.
45.
go back to reference D. Kim, J. Oh, H. Im, M. Yoon, J. Park, and J. Lee, “Automatic Classification of the Korean Triage Acuity Scale in Simulated Emergency Rooms Using Speech Recognition and Natural Language Processing: a Proof of Concept Study,” J. Korean Med. Sci., vol. 36, no. 27, 2021, https://doi.org/10.3346/jkms.2021.36.e175. D. Kim, J. Oh, H. Im, M. Yoon, J. Park, and J. Lee, “Automatic Classification of the Korean Triage Acuity Scale in Simulated Emergency Rooms Using Speech Recognition and Natural Language Processing: a Proof of Concept Study,” J. Korean Med. Sci., vol. 36, no. 27, 2021, https://​doi.​org/​10.​3346/​jkms.​2021.​36.​e175.
50.
go back to reference F. Gao, B. Boukebous, M. Pozzar, E. Alaoui, B. Sano, and S. Bayat-Makoei, “Predictive Models for Emergency Department Triage using Machine Learning: A Systematic Review,” Obstet. Gynecol. Res., vol. 05, no. 02, 2022, https://doi.org/10.26502/ogr085. F. Gao, B. Boukebous, M. Pozzar, E. Alaoui, B. Sano, and S. Bayat-Makoei, “Predictive Models for Emergency Department Triage using Machine Learning: A Systematic Review,” Obstet. Gynecol. Res., vol. 05, no. 02, 2022, https://​doi.​org/​10.​26502/​ogr085.
54.
go back to reference Saaiq M, Ashraf B. Modifying ‘Pico’ question into ‘Picos’ model for more robust and reproducible presentation of the methodology employed in a scientific study. World J Plast Surg. 2017;6(3):390–2.PubMedPubMedCentral Saaiq M, Ashraf B. Modifying ‘Pico’ question into ‘Picos’ model for more robust and reproducible presentation of the methodology employed in a scientific study. World J Plast Surg. 2017;6(3):390–2.PubMedPubMedCentral
77.
go back to reference Lee S, Kang WS, Seo S, Kim DW, Ko H. Model for predicting in-hospital mortality of physical trauma patients using artificial intelligence techniques: nationwide population-based study in Korea. J Med Internet Res. 2022;24(12):1–18. https://doi.org/10.2196/43757.CrossRef Lee S, Kang WS, Seo S, Kim DW, Ko H. Model for predicting in-hospital mortality of physical trauma patients using artificial intelligence techniques: nationwide population-based study in Korea. J Med Internet Res. 2022;24(12):1–18. https://​doi.​org/​10.​2196/​43757.CrossRef
81.
92.
go back to reference A. Madevska Bogdanova, B. Koteska, T. Vićentić, S. D. Ilić, M. Tomić, and M. Spasenović, “Blood Oxygen Saturation Estimation with Laser-Induced Graphene Respiration Sensor,” J. Sensors, vol. 2024, pp. 1–10, Jan. 2024, https://doi.org/10.1155/2024/4696031. A. Madevska Bogdanova, B. Koteska, T. Vićentić, S. D. Ilić, M. Tomić, and M. Spasenović, “Blood Oxygen Saturation Estimation with Laser-Induced Graphene Respiration Sensor,” J. Sensors, vol. 2024, pp. 1–10, Jan. 2024, https://​doi.​org/​10.​1155/​2024/​4696031.
Metadata
Title
Improving triage performance in emergency departments using machine learning and natural language processing: a systematic review
Author
Bruno Matos Porto
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Emergency Medicine / Issue 1/2024
Electronic ISSN: 1471-227X
DOI
https://doi.org/10.1186/s12873-024-01135-2