Skip to main content
Top
Published in: Journal of Digital Imaging 5/2023

Open Access 12-06-2023

Patient Identification Based on Deep Metric Learning for Preventing Human Errors in Follow-up X-Ray Examinations

Authors: Yasuyuki Ueda, Junji Morishita

Published in: Journal of Imaging Informatics in Medicine | Issue 5/2023

Login to get access

Abstract

Biological fingerprints extracted from clinical images can be used for patient identity verification to determine misfiled clinical images in picture archiving and communication systems. However, such methods have not been incorporated into clinical use, and their performance can degrade with variability in the clinical images. Deep learning can be used to improve the performance of these methods. A novel method is proposed to automatically identify individuals among examined patients using posteroanterior (PA) and anteroposterior (AP) chest X-ray images. The proposed method uses deep metric learning based on a deep convolutional neural network (DCNN) to overcome the extreme classification requirements for patient validation and identification. It was trained on the NIH chest X-ray dataset (ChestX-ray8) in three steps: preprocessing, DCNN feature extraction with an EfficientNetV2-S backbone, and classification with deep metric learning. The proposed method was evaluated using two public datasets and two clinical chest X-ray image datasets containing data from patients undergoing screening and hospital care. A 1280-dimensional feature extractor pretrained for 300 epochs performed the best with an area under the receiver operating characteristic curve of 0.9894, an equal error rate of 0.0269, and a top-1 accuracy of 0.839 on the PadChest dataset containing both PA and AP view positions. The findings of this study provide considerable insights into the development of automated patient identification to reduce the possibility of medical malpractice due to human errors.
Literature
2.
go back to reference Morishita J, Katsuragawa S, Kondo K, Doi K: An automated patient recognition method based on an image-matching technique using previous chest radiographs in the picture archiving and communication system environment. Med Phys 28(6):1093–1097, 2001. https://doi.org/10.1118/1.1373403 Morishita J, Katsuragawa S, Kondo K, Doi K: An automated patient recognition method based on an image-matching technique using previous chest radiographs in the picture archiving and communication system environment. Med Phys 28(6):1093–1097, 2001. https://​doi.​org/​10.​1118/​1.​1373403
25.
go back to reference Koike-Akino T, Mahajan R, Marks TK, et al.: High-accuracy user identification using EEG biometrics. Conf Proc IEEE Eng Med Biol Soc 2016: 854-858, 2016. Koike-Akino T, Mahajan R, Marks TK, et al.: High-accuracy user identification using EEG biometrics. Conf Proc IEEE Eng Med Biol Soc 2016: 854-858, 2016.
26.
27.
go back to reference Sakai Y, Takahashi K, Shimizu Y, Ishibashi E, Kato T, Morishita J: Clinical application of biological fingerprints extracted from averaged chest radiographs and template-matching technique for preventing left-right flipping mistakes in chest radiography. Radiol Phys Technol 12:216-223, 2019. https://doi.org/10.1007/s12194-019-00504-y Sakai Y, Takahashi K, Shimizu Y, Ishibashi E, Kato T, Morishita J: Clinical application of biological fingerprints extracted from averaged chest radiographs and template-matching technique for preventing left-right flipping mistakes in chest radiography. Radiol Phys Technol 12:216-223, 2019. https://​doi.​org/​10.​1007/​s12194-019-00504-y
28.
go back to reference Nguyen K, Nguyen HH, Tiulpin A: AdaTriplet: Adaptive gradient triplet loss with automatic margin learning for forensic medical image matching. In: Wang L, Dou Q, Fletcher PT, Speidel S, Li S (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13438, 725–735, 2022. https://doi.org/10.1007/978-3-031-16452-1_69 Nguyen K, Nguyen HH, Tiulpin A: AdaTriplet: Adaptive gradient triplet loss with automatic margin learning for forensic medical image matching. In: Wang L, Dou Q, Fletcher PT, Speidel S, Li S (eds) Medical Image Computing and Computer Assisted Intervention – MICCAI 2022. MICCAI 2022. Lecture Notes in Computer Science, vol 13438, 725–735, 2022. https://​doi.​org/​10.​1007/​978-3-031-16452-1_​69
38.
go back to reference Suzuki T, Maki S, Yamazaki T, Wakita H, Toguchi Y, Horii M, Yamauchi T, Kawamura K, Aramomi M, Sugiyama H, Matsuura Y, Yamashita T, Orita S, Ohtori S: Detecting distal radial fractures from wrist radiographs using a deep convolutional neural network with an accuracy comparable to hand orthopedic surgeons. J Digit Imaging. 35:39-46, 2022. https://doi.org/10.1007/s10278-021-00519-1CrossRefPubMed Suzuki T, Maki S, Yamazaki T, Wakita H, Toguchi Y, Horii M, Yamauchi T, Kawamura K, Aramomi M, Sugiyama H, Matsuura Y, Yamashita T, Orita S, Ohtori S: Detecting distal radial fractures from wrist radiographs using a deep convolutional neural network with an accuracy comparable to hand orthopedic surgeons. J Digit Imaging. 35:39-46, 2022. https://​doi.​org/​10.​1007/​s10278-021-00519-1CrossRefPubMed
46.
go back to reference Kawakubo M, Waki H, Shirasaka T, Kojima T, Mikayama R, Hamasaki H, Akamine H, Kato T, Baba S, Ushiro S, Ishigami K: A deep learning model based on fusion images of chest radiography and X-ray sponge images supports human visual characteristics of retained surgical items detection. Int J Comput Assist Radiol Surg 2022. https://doi.org/10.1007/s11548-022-02816-8.CrossRefPubMed Kawakubo M, Waki H, Shirasaka T, Kojima T, Mikayama R, Hamasaki H, Akamine H, Kato T, Baba S, Ushiro S, Ishigami K: A deep learning model based on fusion images of chest radiography and X-ray sponge images supports human visual characteristics of retained surgical items detection. Int J Comput Assist Radiol Surg 2022. https://​doi.​org/​10.​1007/​s11548-022-02816-8.CrossRefPubMed
48.
50.
go back to reference Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM: ChestX-Ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 3462–3471, 2017. https://doi.org/10.1109/CVPR.2017.369 Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM: ChestX-Ray8: Hospital-scale chest X-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA, 3462–3471, 2017. https://​doi.​org/​10.​1109/​CVPR.​2017.​369
52.
56.
go back to reference Tan M, Le Q: EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning, ICML 2019. 6105–6114, 2019. Tan M, Le Q: EfficientNet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning, ICML 2019. 6105–6114, 2019.
57.
go back to reference Tan M, Le Q: EfficientNetV2: Smaller models and faster training. Proceedings of the 38th International Conference on Machine Learning, PMLR 139:10096–10106, 2021. Tan M, Le Q: EfficientNetV2: Smaller models and faster training. Proceedings of the 38th International Conference on Machine Learning, PMLR 139:10096–10106, 2021.
59.
Metadata
Title
Patient Identification Based on Deep Metric Learning for Preventing Human Errors in Follow-up X-Ray Examinations
Authors
Yasuyuki Ueda
Junji Morishita
Publication date
12-06-2023
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 5/2023
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-023-00850-9

Other articles of this Issue 5/2023

Journal of Digital Imaging 5/2023 Go to the issue