Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Telemedicine | Research article

Enhancing efficiency and capacity of telehealth services with intelligent triage: a bidirectional LSTM neural network model employing character embedding

Authors: Jinming Shi, Ming Ye, Haotian Chen, Yaoen Lu, Zhongke Tan, Zhaohan Fan, Jie Zhao

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

The widespread adoption of telehealth services necessitates accurate online department selection based on patient medical records, a task requiring significant medical knowledge. Incorrect triage results in considerable time wastage for both patients and medical professionals. To address this, we propose an intelligent triage model based on a Bidirectional Long Short-Term Memory (Bi-LSTM) neural network with character embedding to enhance the efficiency and capacity of telehealth services.

Methods

We gathered a 1.3 GB medical dataset comprising 200,000 records, each including medical history, physical examination data, and other pertinent information found on the electronic medical record homepage. Following data preprocessing, a clinical corpus was established to train character embeddings with a medical context.
These character embeddings were then utilized to extract features from patient chief  complaints, and a 2-layer Bi-LSTM neural network was trained to categorize these complaints, enabling intelligent triage for telehealth services.

Results

60,000 chief complaint-department data pairs were extracted from clinical corpus and divided into the training, validation, and test sets of 42,000, 9,000, and 9,000, respectively. The character embedding based Bi-LSTM neural network achieved a macro-precision of 85.50% and an F1 score of 85.45%.

Conclusion

The telehealth triage model developed in this study demonstrates strong implementation outcomes and significantly improves the efficiency and capacity of telehealth services. Character embedding outperforms word embedding, and future work will incorporate additional features such as patient age and gender into the chief complaint feature to future enhance model performance.
Literature
1.
go back to reference Zhao, Jie, et al. Discussing the status of development of telemedicine and its trend.[J]. Chin Health Service Manage. 2014;31(10):739–40. Zhao, Jie, et al. Discussing the status of development of telemedicine and its trend.[J]. Chin Health Service Manage. 2014;31(10):739–40.
2.
go back to reference Aydemir S, Ocak S, Saygılı S, et al. Telemedicine applications in a tertiary pediatric hospital in Turkey during COVID-19 pandemic[J]. Telemedicine and e-Health. 2021;27(10):1180–7.CrossRefPubMed Aydemir S, Ocak S, Saygılı S, et al. Telemedicine applications in a tertiary pediatric hospital in Turkey during COVID-19 pandemic[J]. Telemedicine and e-Health. 2021;27(10):1180–7.CrossRefPubMed
3.
go back to reference Park HY, Kwon YM, Jun HR, et al. Satisfaction survey of patients and medical staff for telephone-based telemedicine during hospital closing due to COVID-19 transmission[J]. Telemedicine and e-Health. 2021;27(7):724–32.CrossRefPubMedPubMedCentral Park HY, Kwon YM, Jun HR, et al. Satisfaction survey of patients and medical staff for telephone-based telemedicine during hospital closing due to COVID-19 transmission[J]. Telemedicine and e-Health. 2021;27(7):724–32.CrossRefPubMedPubMedCentral
5.
go back to reference Salman OH, Taha Z, Alsabah MQ, Hussein YS, Mohammed AS, Aal-Nouman M. A review on utilizing machine learning technology in the fields of electronic emergency triage and patient priority systems in telemedicine: coherent taxonomy, motivations, open research challenges and recommendations for intelligent future work. Comput Methods Programs Biomed. 2021;209:106357. https://doi.org/10.1016/j.cmpb.2021.106357.CrossRefPubMed Salman OH, Taha Z, Alsabah MQ, Hussein YS, Mohammed AS, Aal-Nouman M. A review on utilizing machine learning technology in the fields of electronic emergency triage and patient priority systems in telemedicine: coherent taxonomy, motivations, open research challenges and recommendations for intelligent future work. Comput Methods Programs Biomed. 2021;209:106357. https://​doi.​org/​10.​1016/​j.​cmpb.​2021.​106357.CrossRefPubMed
7.
go back to reference Ray S. A quick review of machine learning algorithms. In 2019 International conference on machine learning, big data, cloud and parallel computing (COMITCon). IEEE; 2019. p. 35-39. Ray S. A quick review of machine learning algorithms. In 2019 International conference on machine learning, big data, cloud and parallel computing (COMITCon). IEEE; 2019. p. 35-39.
8.
go back to reference Wang Z, Wang. Research on intelligent triage of online inquiry platform based on machine learning. Data Anal Knowl Discovery. 2019;09:88–97. Wang Z, Wang. Research on intelligent triage of online inquiry platform based on machine learning. Data Anal Knowl Discovery. 2019;09:88–97.
9.
go back to reference Chen Qinjie. Research on intelligent medical diagnosis auxiliary method based on machine learning [ D ]. Hunan: National University of Defense Technology; 2017. Chen Qinjie. Research on intelligent medical diagnosis auxiliary method based on machine learning [ D ]. Hunan: National University of Defense Technology; 2017.
10.
go back to reference Dong, Tianshu. Zhang Meikui, & Ai Xuewei. Research on Automated Triage Technology in Remote Consultation System. China Digit Med. 2017;12(10):3. Dong, Tianshu. Zhang Meikui, & Ai Xuewei. Research on Automated Triage Technology in Remote Consultation System. China Digit Med. 2017;12(10):3.
11.
go back to reference Lin Y, Liang L, Cui Y, et al. INTELLIGENT MEDICAL GUIDE SYSTEM BASED ON VSM WEIGHT IMPROVEMENT ALGORITHM[J]. Computer Applications & Software; 2015. Lin Y, Liang L, Cui Y, et al. INTELLIGENT MEDICAL GUIDE SYSTEM BASED ON VSM WEIGHT IMPROVEMENT ALGORITHM[J]. Computer Applications & Software; 2015.
12.
go back to reference Mikolov T, Sutskever I, Chen K. Distributed representations of words and phrases and their compositionality. In: Proceedings of the 27th Conference on Neural Information Processing Systems 2013 (NIPS 2013). 2013 Presented at: 27th Conference on Neural Information Processing Systems 2013 (NIPS 2013); December 5–10, 2013; Lake Tahoe, NV p. 3111–3119. Mikolov T, Sutskever I, Chen K. Distributed representations of words and phrases and their compositionality. In: Proceedings of the 27th Conference on Neural Information Processing Systems 2013 (NIPS 2013). 2013 Presented at: 27th Conference on Neural Information Processing Systems 2013 (NIPS 2013); December 5–10, 2013; Lake Tahoe, NV p. 3111–3119.
13.
go back to reference Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014. p. 1532-1543. Pennington J, Socher R, Manning CD. Glove: Global vectors for word representation. In: Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 2014. p. 1532-1543.
14.
go back to reference Zhang Z, et al. Enhanced character-level deep convolutional neural networks for Cardiovascular Disease prediction. BMC medical informatics and decision making. 2020;20(3):1–10. Zhang Z, et al. Enhanced character-level deep convolutional neural networks for Cardiovascular Disease prediction. BMC medical informatics and decision making. 2020;20(3):1–10.
15.
go back to reference Barathi Ganesh HB, et al. MedNLU: natural language understander for medical texts. Deep Learning Techniques for Biomedical and Health Informatics. Cham: Springer; 2020. pp. 3–21. Barathi Ganesh HB, et al. MedNLU: natural language understander for medical texts. Deep Learning Techniques for Biomedical and Health Informatics. Cham: Springer; 2020. pp. 3–21.
16.
go back to reference Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint. 2013. arXiv:1301.3781. Mikolov T, Chen K, Corrado G, Dean J. Efficient estimation of word representations in vector space. arXiv preprint. 2013. arXiv:1301.3781.
17.
go back to reference Levy O, Goldberg Y, Dagan I. Improving distributional similarity with lessons learned from word embeddings. Trans Association Comput Linguistics. 2015;3:211–25.CrossRef Levy O, Goldberg Y, Dagan I. Improving distributional similarity with lessons learned from word embeddings. Trans Association Comput Linguistics. 2015;3:211–25.CrossRef
18.
go back to reference Chowdhury S, et al. A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records. BMC Bioinformatics. 2018;19(17):75–84. Chowdhury S, et al. A multitask bi-directional RNN model for named entity recognition on Chinese electronic medical records. BMC Bioinformatics. 2018;19(17):75–84.
19.
go back to reference Chen X, et al. Improving the named entity recognition of Chinese electronic medical records by combining domain dictionary and rules. Int J Environ Res Public Health. 2020;17:2687.CrossRefPubMedPubMedCentral Chen X, et al. Improving the named entity recognition of Chinese electronic medical records by combining domain dictionary and rules. Int J Environ Res Public Health. 2020;17:2687.CrossRefPubMedPubMedCentral
20.
go back to reference Yu Y, et al. A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput. 2019;31(7):1235–70.CrossRefPubMed Yu Y, et al. A review of recurrent neural networks: LSTM cells and network architectures. Neural Comput. 2019;31(7):1235–70.CrossRefPubMed
21.
go back to reference Siami-Namini S, Tavakoli N, Namin AS. The performance of LSTM and BiLSTM in forecasting time series. In 2019 IEEE International conference on big data (Big Data). IEEE; 2019. p. 3285-3292. Siami-Namini S, Tavakoli N, Namin AS. The performance of LSTM and BiLSTM in forecasting time series. In 2019 IEEE International conference on big data (Big Data). IEEE; 2019. p. 3285-3292.
22.
go back to reference Jiang S, Zhao S, Hou K, Liu Y, Zhang L. A BERT-BiLSTM-CRF model for Chinese electronic medical records named entity recognition. In 2019 12th international conference on intelligent computation technology and automation (ICICTA). IEEE; 2019. p. 166-169. Jiang S, Zhao S, Hou K, Liu Y, Zhang L. A BERT-BiLSTM-CRF model for Chinese electronic medical records named entity recognition. In 2019 12th international conference on intelligent computation technology and automation (ICICTA). IEEE; 2019. p. 166-169.
23.
go back to reference Ji B, et al. A hybrid approach for named entity recognition in Chinese electronic medical record. BMC medical informatics and decision making. 2019;19(2):149–58. Ji B, et al. A hybrid approach for named entity recognition in Chinese electronic medical record. BMC medical informatics and decision making. 2019;19(2):149–58.
25.
go back to reference Jr MF, Miller RA, Myers JD, Computers. Biomedical Res Int J. 1985;18(5):458–79. Jr MF, Miller RA, Myers JD, Computers. Biomedical Res Int J. 1985;18(5):458–79.
26.
go back to reference Buchanan BG, Shortliffe EH. Rule based Expert systems: the mycin experiments of the Stanford Heuristic Programming Project (the Addison-Wesley series in artificial intelligence)[M]. Addison-Wesley; 1984. Buchanan BG, Shortliffe EH. Rule based Expert systems: the mycin experiments of the Stanford Heuristic Programming Project (the Addison-Wesley series in artificial intelligence)[M]. Addison-Wesley; 1984.
28.
go back to reference Ru H. In: FEI HE, editor. The design and implementation of the guidance system based on the reasoning algorithm. Anhui University; 2016. Ru H. In: FEI HE, editor. The design and implementation of the guidance system based on the reasoning algorithm. Anhui University; 2016.
29.
go back to reference Yifeng XU, Liu L, Huang Q, et al. Research on TF-IDF weight improvement algorithm in intelligent guidance system[J]. Computer Engineering & Applications; 2017. Yifeng XU, Liu L, Huang Q, et al. Research on TF-IDF weight improvement algorithm in intelligent guidance system[J]. Computer Engineering & Applications; 2017.
30.
go back to reference Huang Lei. Research on the Intelligent Medical Guide System based on multi-words TF-IDF algorithm [D]. Zhengzhou University; 2015. Huang Lei. Research on the Intelligent Medical Guide System based on multi-words TF-IDF algorithm [D]. Zhengzhou University; 2015.
31.
go back to reference Liefold M, Wagner D, Pokraka A, et al. Low-cost medical infrastructure: triage as intelligent decision support[J]. Electron Imaging. 2018;2018(6):1–4. Liefold M, Wagner D, Pokraka A, et al. Low-cost medical infrastructure: triage as intelligent decision support[J]. Electron Imaging. 2018;2018(6):1–4.
32.
go back to reference Wang Ruojia Z, Lu, Wang, Jimin. Research on Intelligent Triage of Online Consultation platform based on machine learning. Data Anal Knowl Discovery. 2019;3(9):88–97. Wang Ruojia Z, Lu, Wang, Jimin. Research on Intelligent Triage of Online Consultation platform based on machine learning. Data Anal Knowl Discovery. 2019;3(9):88–97.
33.
go back to reference Abdaoui A, et al. Assisting e-patients in an ask the Doctor Service. Digital Healthcare empowering europeans. IOS Press; 2015. pp. 572–6. Abdaoui A, et al. Assisting e-patients in an ask the Doctor Service. Digital Healthcare empowering europeans. IOS Press; 2015. pp. 572–6.
34.
go back to reference Diao BS. Research on online doctor recommendation system based on online patient consultation data (Master's thesis). Beijing Institute of Technology. 2018. DOI: CNKI:CDMD: 2.1018.812266. Diao BS. Research on online doctor recommendation system based on online patient consultation data (Master's thesis). Beijing Institute of Technology. 2018. DOI: CNKI:CDMD: 2.1018.812266.
Metadata
Title
Enhancing efficiency and capacity of telehealth services with intelligent triage: a bidirectional LSTM neural network model employing character embedding
Authors
Jinming Shi
Ming Ye
Haotian Chen
Yaoen Lu
Zhongke Tan
Zhaohan Fan
Jie Zhao
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02367-1

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue