Skip to main content
Top
Published in:

Open Access 01-12-2024 | Ventricular Septal Defect | Research

Application of artificial intelligence in VSD prenatal diagnosis from fetal heart ultrasound images

Authors: Furong Li, Ping Li, Zhonghua Liu, Shunlan Liu, Pan Zeng, Haisheng Song, Peizhong Liu, Guorong Lyu

Published in: BMC Pregnancy and Childbirth | Issue 1/2024

Login to get access

Abstract

Background

Developing a combined artificial intelligence (AI) and ultrasound imaging to provide an accurate, objective, and efficient adjunctive diagnostic approach for fetal heart ventricular septal defects (VSD).

Methods

1,451 fetal heart ultrasound images from 500 pregnant women were comprehensively analyzed between January 2016 and June 2022. The fetal heart region was manually labeled and the presence of VSD was discriminated by experts. The principle of five-fold cross-validation was followed in the training set to develop the AI model to assist in the diagnosis of VSD. The model was evaluated in the test set using metrics such as mAP@0.5, precision, recall, and F1 score. The diagnostic accuracy and inference time were also compared with junior doctors, intermediate doctors, and senior doctors.

Results

The mAP@0.5, precision, recall, and F1 scores for the AI model diagnosis of VSD were 0.926, 0.879, 0.873, and 0.88, respectively. The accuracy of junior doctors and intermediate doctors improved by 6.7% and 2.8%, respectively, with the assistance of this system.

Conclusions

This study reports an AI-assisted diagnostic method for VSD that has a high agreement with manual recognition. It also has a low number of parameters and computational complexity, which can also improve the diagnostic accuracy and speed of some physicians for VSD.
Appendix
Available only for authorised users
Literature
1.
go back to reference El-Chouli M, Mohr GH, Bang CN, Malmborg M, Ahlehoff O, Torp-Pedersen C, Gerds TA, Idorn L, Raunsø J, Gislason G. Time trends in simple congenital heart Disease over 39 years: a Danish Nationwide Study. J Am Heart Assoc. 2021;10(14):e020375. Epub 2021 Jul 3. PMID. 34219468; PMCID: PMC8483486.CrossRefPubMedPubMedCentral El-Chouli M, Mohr GH, Bang CN, Malmborg M, Ahlehoff O, Torp-Pedersen C, Gerds TA, Idorn L, Raunsø J, Gislason G. Time trends in simple congenital heart Disease over 39 years: a Danish Nationwide Study. J Am Heart Assoc. 2021;10(14):e020375. Epub 2021 Jul 3. PMID. 34219468; PMCID: PMC8483486.CrossRefPubMedPubMedCentral
3.
go back to reference WHO CO. World health organization. Responding to Community Spread of COVID-19 Reference WHO/COVID-19/Community_Transmission/20201. 2020. WHO CO. World health organization. Responding to Community Spread of COVID-19 Reference WHO/COVID-19/Community_Transmission/20201. 2020.
4.
go back to reference Rieder W, Eperon I, Meagher S. Congenital heart anomalies in the first trimester: from screening to diagnosis. Prenat Diagn. 2023;43:889–900.CrossRefPubMed Rieder W, Eperon I, Meagher S. Congenital heart anomalies in the first trimester: from screening to diagnosis. Prenat Diagn. 2023;43:889–900.CrossRefPubMed
5.
go back to reference Tudorache S, Cara M, Iliescu DG, Novac L, Cernea N. First trimester two- and four-dimensional cardiac scan: intra- and interobserver agreement, comparison between methods and benefits of color Doppler technique. Ultrasound Obstet Gynecol. 2013;42:659–68.CrossRefPubMed Tudorache S, Cara M, Iliescu DG, Novac L, Cernea N. First trimester two- and four-dimensional cardiac scan: intra- and interobserver agreement, comparison between methods and benefits of color Doppler technique. Ultrasound Obstet Gynecol. 2013;42:659–68.CrossRefPubMed
6.
go back to reference Soto B, Becker A, Moulaert A, Lie J, Anderson R. Classification of ventricular septal defects. Heart. 1980;43:332–43.CrossRef Soto B, Becker A, Moulaert A, Lie J, Anderson R. Classification of ventricular septal defects. Heart. 1980;43:332–43.CrossRef
8.
go back to reference Sridevi S, Kanimozhi T, Bhattacharjee S, Reddy SS, Shahwar D. Hybrid Quantum Classical Neural Network-Based Classification of Prenatal Ventricular Septal Defect from Ultrasound Images. In: International Conference on Computational Intelligence and Data Engineering. Springer; 2022. pp. 461–8. Sridevi S, Kanimozhi T, Bhattacharjee S, Reddy SS, Shahwar D. Hybrid Quantum Classical Neural Network-Based Classification of Prenatal Ventricular Septal Defect from Ultrasound Images. In: International Conference on Computational Intelligence and Data Engineering. Springer; 2022. pp. 461–8.
10.
go back to reference Ximenes RS, Bravo-Valenzuela NJ, Pares DBS, Araujo Júnior E. The use of cardiac ultrasound imaging in first-trimester prenatal diagnosis of congenital heart diseases. J Clin Ultrasound. 2023;51:225–39.CrossRefPubMed Ximenes RS, Bravo-Valenzuela NJ, Pares DBS, Araujo Júnior E. The use of cardiac ultrasound imaging in first-trimester prenatal diagnosis of congenital heart diseases. J Clin Ultrasound. 2023;51:225–39.CrossRefPubMed
11.
go back to reference Amrane M, Oukid S, Gagaoua I, Ensari T. Breast cancer classification using machine learning. 2018 electric electronics, computer science, biomedical engineerings’ meeting (EBBT). IEEE; 2018. pp. 1–4. Amrane M, Oukid S, Gagaoua I, Ensari T. Breast cancer classification using machine learning. 2018 electric electronics, computer science, biomedical engineerings’ meeting (EBBT). IEEE; 2018. pp. 1–4.
12.
go back to reference Wang D, Khosla A, Gargeya R, Irshad H, Beck AH. Deep learning for identifying metastatic breast cancer. arXiv Preprint arXiv:160605718. 2016. Wang D, Khosla A, Gargeya R, Irshad H, Beck AH. Deep learning for identifying metastatic breast cancer. arXiv Preprint arXiv:160605718. 2016.
13.
go back to reference Horgan R, Nehme L, Abuhamad A. Artificial intelligence in obstetric ultrasound: a scoping review. Prenat Diagn. 2023. Horgan R, Nehme L, Abuhamad A. Artificial intelligence in obstetric ultrasound: a scoping review. Prenat Diagn. 2023.
14.
go back to reference Darsareh F, Ranjbar A, Farashah MV, Mehrnoush V, Shekari M, Jahromi MS. Application of machine learning to identify risk factors of birth asphyxia. BMC Pregnancy Childbirth. 2023;23:156.CrossRefPubMedPubMedCentral Darsareh F, Ranjbar A, Farashah MV, Mehrnoush V, Shekari M, Jahromi MS. Application of machine learning to identify risk factors of birth asphyxia. BMC Pregnancy Childbirth. 2023;23:156.CrossRefPubMedPubMedCentral
15.
go back to reference Huang B, Zheng S, Ma B, Yang Y, Zhang S, Jin L. Using deep learning to predict the outcome of live birth from more than 10,000 embryo data. BMC Pregnancy Childbirth. 2022;22:36.CrossRefPubMedPubMedCentral Huang B, Zheng S, Ma B, Yang Y, Zhang S, Jin L. Using deep learning to predict the outcome of live birth from more than 10,000 embryo data. BMC Pregnancy Childbirth. 2022;22:36.CrossRefPubMedPubMedCentral
16.
go back to reference Islam MN, Mustafina SN, Mahmud T, Khan NI. Machine learning to predict pregnancy outcomes: a systematic review, synthesizing framework and future research agenda. BMC Pregnancy Childbirth. 2022;22:348.CrossRefPubMedPubMedCentral Islam MN, Mustafina SN, Mahmud T, Khan NI. Machine learning to predict pregnancy outcomes: a systematic review, synthesizing framework and future research agenda. BMC Pregnancy Childbirth. 2022;22:348.CrossRefPubMedPubMedCentral
17.
go back to reference Gangadhar MS, Sai KVS, Kumar SHS, Kumar KA, Kavitha M, Aravinth S. Machine Learning and Deep Learning Techniques on Accurate Risk Prediction of Coronary Heart Disease. In:, Methodologies, Communication. (ICCMC). IEEE; 2023. pp. 227–32. Gangadhar MS, Sai KVS, Kumar SHS, Kumar KA, Kavitha M, Aravinth S. Machine Learning and Deep Learning Techniques on Accurate Risk Prediction of Coronary Heart Disease. In:, Methodologies, Communication. (ICCMC). IEEE; 2023. pp. 227–32.
18.
go back to reference Morris SA, Lopez KN. Deep learning for detecting congenital heart disease in the fetus. Nat Med. 2021;27:764–5.CrossRefPubMed Morris SA, Lopez KN. Deep learning for detecting congenital heart disease in the fetus. Nat Med. 2021;27:764–5.CrossRefPubMed
19.
go back to reference Wang Y, Shi Y, Zhang C, Su K, Hu Y, Chen L, et al. Fetal weight estimation based on deep neural network: a retrospective observational study. BMC Pregnancy Childbirth. 2023;23:560.CrossRefPubMedPubMedCentral Wang Y, Shi Y, Zhang C, Su K, Hu Y, Chen L, et al. Fetal weight estimation based on deep neural network: a retrospective observational study. BMC Pregnancy Childbirth. 2023;23:560.CrossRefPubMedPubMedCentral
20.
go back to reference Zhu J, Chen J, Zhang Y, Ji J. Brain tissue development of neonates with congenital septal defect: study on MRI image evaluation of Deep Learning Algorithm. Pakistan J Med Sci. 2021;37:1652. Zhu J, Chen J, Zhang Y, Ji J. Brain tissue development of neonates with congenital septal defect: study on MRI image evaluation of Deep Learning Algorithm. Pakistan J Med Sci. 2021;37:1652.
21.
go back to reference Arnaout R, Curran L, Zhao Y, Levine JC, Chinn E, Moon-Grady AJ. An ensemble of neural networks provides expert-level prenatal detection of complex congenital heart disease. Nat Med. 2021;27(5):882–91.CrossRefPubMedPubMedCentral Arnaout R, Curran L, Zhao Y, Levine JC, Chinn E, Moon-Grady AJ. An ensemble of neural networks provides expert-level prenatal detection of complex congenital heart disease. Nat Med. 2021;27(5):882–91.CrossRefPubMedPubMedCentral
22.
go back to reference Ejaz H, Thyyib T, Ibrahim A, Nishat A, Malay J. Role of artificial intelligence in early detection of congenital heart diseases in neonates. Front Digit Health. 2024;5:1345814.CrossRefPubMedPubMedCentral Ejaz H, Thyyib T, Ibrahim A, Nishat A, Malay J. Role of artificial intelligence in early detection of congenital heart diseases in neonates. Front Digit Health. 2024;5:1345814.CrossRefPubMedPubMedCentral
23.
go back to reference Horgan R, Nehme L, Abuhamad A. Artificial intelligence in obstetric ultrasound: a scoping review. Prenat Diagn. 2023;43(9):1176–219.CrossRefPubMed Horgan R, Nehme L, Abuhamad A. Artificial intelligence in obstetric ultrasound: a scoping review. Prenat Diagn. 2023;43(9):1176–219.CrossRefPubMed
24.
go back to reference Ramirez Zegarra R, Ghi T. Use of artificial intelligence and deep learning in fetal ultrasound imaging. Ultrasound Obstet Gynecol. 2023;62(2):185–94.CrossRefPubMed Ramirez Zegarra R, Ghi T. Use of artificial intelligence and deep learning in fetal ultrasound imaging. Ultrasound Obstet Gynecol. 2023;62(2):185–94.CrossRefPubMed
25.
go back to reference Jost E, Kosian P, Jimenez Cruz J, Albarqouni S, Gembruch U, Strizek B, Recker F. Evolving the era of 5D Ultrasound? A systematic literature review on the applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology. J Clin Med. 2023;12(21):6833.CrossRefPubMedPubMedCentral Jost E, Kosian P, Jimenez Cruz J, Albarqouni S, Gembruch U, Strizek B, Recker F. Evolving the era of 5D Ultrasound? A systematic literature review on the applications for Artificial Intelligence Ultrasound Imaging in Obstetrics and Gynecology. J Clin Med. 2023;12(21):6833.CrossRefPubMedPubMedCentral
26.
go back to reference Enache, I. A., Iovoaica-Rămescu, C., Ciobanu, Ș. G., Berbecaru, E. I. A., Vochin,A., Băluță, I. D., … Iliescu, D. G. (2024). Artificial Intelligence in Obstetric Anomaly Scan: Heart and Brain. Life, 14(2), 166. Enache, I. A., Iovoaica-Rămescu, C., Ciobanu, Ș. G., Berbecaru, E. I. A., Vochin,A., Băluță, I. D., … Iliescu, D. G. (2024). Artificial Intelligence in Obstetric Anomaly Scan: Heart and Brain. Life, 14(2), 166.
27.
go back to reference Fiorentino MC, Villani FP, Di Cosmo M, Frontoni E, Moccia S. A review on deep-learning algorithms for fetal ultrasound-image analysis. Med Image Anal. 2023;83:102629.CrossRefPubMed Fiorentino MC, Villani FP, Di Cosmo M, Frontoni E, Moccia S. A review on deep-learning algorithms for fetal ultrasound-image analysis. Med Image Anal. 2023;83:102629.CrossRefPubMed
28.
go back to reference Malani IV, Shrivastava SN, D., Raka MS. (2023). A comprehensive review of the role of artificial intelligence in obstetrics and gynecology. Cureus, 15(2). Malani IV, Shrivastava SN, D., Raka MS. (2023). A comprehensive review of the role of artificial intelligence in obstetrics and gynecology. Cureus, 15(2).
29.
go back to reference Sun S, Wang H, Jiang Z, Fang Y, Tao T. Segmentation-based heart sound feature extraction combined with classifier models for a VSD diagnosis system. Expert Syst Appl. 2014;41:1769–80.CrossRef Sun S, Wang H, Jiang Z, Fang Y, Tao T. Segmentation-based heart sound feature extraction combined with classifier models for a VSD diagnosis system. Expert Syst Appl. 2014;41:1769–80.CrossRef
30.
go back to reference Chen S-H, Tai I-H, Chen Y-H, Weng K-P, Hsieh K-S. Data Augmentation for a Deep Learning Framework for ventricular septal defect Ultrasound Image classification. SpringerLink. 2021;:310–22. Chen S-H, Tai I-H, Chen Y-H, Weng K-P, Hsieh K-S. Data Augmentation for a Deep Learning Framework for ventricular septal defect Ultrasound Image classification. SpringerLink. 2021;:310–22.
31.
go back to reference Liu J, Wang H, Yang Z, Quan J, Liu L, Tian J. Deep learning-based computer-aided heart sound analysis in children with left-to-right shunt congenital heart disease. Int J Cardiol. 2022;348:58–64.CrossRefPubMed Liu J, Wang H, Yang Z, Quan J, Liu L, Tian J. Deep learning-based computer-aided heart sound analysis in children with left-to-right shunt congenital heart disease. Int J Cardiol. 2022;348:58–64.CrossRefPubMed
32.
go back to reference Miura K, Yagi R, Miyama H, Kimura M, Kanazawa H, Hashimoto M et al. Deep learning-based model detects atrial septal defects from electrocardiography: a cross-sectional multicenter hospital-based study. eClinicalMedicine. 2023. Miura K, Yagi R, Miyama H, Kimura M, Kanazawa H, Hashimoto M et al. Deep learning-based model detects atrial septal defects from electrocardiography: a cross-sectional multicenter hospital-based study. eClinicalMedicine. 2023.
33.
go back to reference Nurmaini S, Rachmatullah MN, Sapitri AI, Darmawahyuni A, Jovandy A, Firdaus F, et al. Accurate detection of septal defects with fetal ultrasonography images using deep learning-based multiclass instance segmentation. IEEE Access. 2020;8:196160–74.CrossRef Nurmaini S, Rachmatullah MN, Sapitri AI, Darmawahyuni A, Jovandy A, Firdaus F, et al. Accurate detection of septal defects with fetal ultrasonography images using deep learning-based multiclass instance segmentation. IEEE Access. 2020;8:196160–74.CrossRef
34.
go back to reference Dr. Lokaiah Pullagura MRD. Recognition of fetal heart diseases through machine learning techniques. Annals RSCB. 2021;25:2601–15. Dr. Lokaiah Pullagura MRD. Recognition of fetal heart diseases through machine learning techniques. Annals RSCB. 2021;25:2601–15.
35.
go back to reference He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. pp. 770–8. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition. 2016. pp. 770–8.
36.
go back to reference Tan M, Le Q. Efficientnetv2: Smaller models and faster training. In: International conference on machine learning. PMLR; 2021. pp. 10096–106. Tan M, Le Q. Efficientnetv2: Smaller models and faster training. In: International conference on machine learning. PMLR; 2021. pp. 10096–106.
37.
go back to reference Iandola F, Moskewicz M, Karayev S, Girshick R, Darrell T, Keutzer K. Densenet: implementing efficient convnet descriptor pyramids. arXiv Preprint arXiv:14041869. 2014. Iandola F, Moskewicz M, Karayev S, Girshick R, Darrell T, Keutzer K. Densenet: implementing efficient convnet descriptor pyramids. arXiv Preprint arXiv:14041869. 2014.
38.
go back to reference Howard A, Sandler M, Chu G, Chen L-C, Chen B, Tan M et al. Searching for mobilenetv3. In: Proceedings of the IEEE/CVF international conference on computer vision. 2019. pp. 1314–24. Howard A, Sandler M, Chu G, Chen L-C, Chen B, Tan M et al. Searching for mobilenetv3. In: Proceedings of the IEEE/CVF international conference on computer vision. 2019. pp. 1314–24.
39.
go back to reference Ren S, He K, Girshick R, Sun J. Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst. 2015;28. Ren S, He K, Girshick R, Sun J. Faster r-cnn: towards real-time object detection with region proposal networks. Adv Neural Inf Process Syst. 2015;28.
40.
go back to reference Jocher G, Chaurasia A, Stoken A, Borovec J, Kwon Y, Michael K et al. ultralytics/yolov5: v6. 2-yolov5 classification models, apple m1, reproducibility, clearml and deci. Ai integrations. Zenodo. 2022. Jocher G, Chaurasia A, Stoken A, Borovec J, Kwon Y, Michael K et al. ultralytics/yolov5: v6. 2-yolov5 classification models, apple m1, reproducibility, clearml and deci. Ai integrations. Zenodo. 2022.
41.
go back to reference Wang C-Y, Bochkovskiy A, Liao H-YM. YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. 2023. Wang C-Y, Bochkovskiy A, Liao H-YM. YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. 2023.
42.
go back to reference Ge Z, Liu S, Wang F, Li Z, Sun J. Yolox: Exceeding yolo series in 2021. arXiv preprint arXiv:210708430. 2021. Ge Z, Liu S, Wang F, Li Z, Sun J. Yolox: Exceeding yolo series in 2021. arXiv preprint arXiv:210708430. 2021.
Metadata
Title
Application of artificial intelligence in VSD prenatal diagnosis from fetal heart ultrasound images
Authors
Furong Li
Ping Li
Zhonghua Liu
Shunlan Liu
Pan Zeng
Haisheng Song
Peizhong Liu
Guorong Lyu
Publication date
01-12-2024
Publisher
BioMed Central
Published in
BMC Pregnancy and Childbirth / Issue 1/2024
Electronic ISSN: 1471-2393
DOI
https://doi.org/10.1186/s12884-024-06916-y

Keynote series | Spotlight on menopause

Menopause can have a significant impact on the body, with effects ranging beyond the endocrine and reproductive systems. Learn about the broader systemic effects of menopause, so you can help patients in your clinics through the transition.

Launching: Thursday 12th December 2024
 

Prof. Martha Hickey
Dr. Claudia Barth
Dr. Samar El Khoudary
Developed by: Springer Medicine
Register your interest now