Skip to main content
Top

23-04-2024 | Artificial Intelligence | Original Paper

Artificial intelligence-enhanced automation for M-mode echocardiographic analysis: ensuring fully automated, reliable, and reproducible measurements

Authors: Dawun Jeong, Sunghee Jung, Yeonyee E. Yoon, Jaeik Jeon, Yeonggul Jang, Seongmin Ha, Youngtaek Hong, JunHeum Cho, Seung-Ah Lee, Hong-Mi Choi, Hyuk-Jae Chang

Published in: The International Journal of Cardiovascular Imaging

Login to get access

Abstract

To enhance M-mode echocardiography’s utility for measuring cardiac structures, we developed and evaluated an artificial intelligence (AI)-based automated analysis system for M-mode images through the aorta and left atrium [M-mode (Ao-LA)], and through the left ventricle [M-mode (LV)]. Our system, integrating two deep neural networks (DNN) for view classification and image segmentation, alongside an auto-measurement algorithm, was developed using 5,958 M-mode images [3,258 M-mode (LA-Ao), and 2,700 M-mode (LV)] drawn from a nationwide echocardiographic dataset collated from five tertiary hospitals. The performance of view classification and segmentation DNNs were evaluated on 594 M-mode images, while automatic measurement accuracy was tested on separate internal test set with 100 M-mode images as well as external test set with 280 images (140 sinus rhythm and 140 atrial fibrillation). Performance evaluation showed the view classification DNN’s overall accuracy of 99.8% and segmentation DNN’s Dice similarity coefficient of 94.3%. Within the internal test set, all automated measurements, including LA, Ao, and LV wall and cavity, resonated strongly with expert evaluations, exhibiting Pearson’s correlation coefficients (PCCs) of 0.81–0.99. This performance persisted in the external test set for both sinus rhythm (PCC, 0.84–0.98) and atrial fibrillation (PCC, 0.70–0.97). Notably, automatic measurements, consistently offering multi-cardiac cycle readings, showcased a stronger correlation with the averaged multi-cycle manual measurements than with those of a single representative cycle. Our AI-based system for automatic M-mode echocardiographic analysis demonstrated excellent accuracy, reproducibility, and speed. This automated approach has the potential to improve efficiency and reduce variability in clinical practice.

Graphical abstract

Artificial intelligence (AI)-based pipeline for automated M-mode echocardiography analysis. The M-mode echocardiography analysis algorithm consists of a pipeline of two interconnected deep neural networks and an automated measurement algorithm. The first network classifies two different M-mode echocardiographic views, and the second segments M-mode echocardiographic images. The corresponding auto-measurements were then performed.
Appendix
Available only for authorised users
Literature
1.
go back to reference Lang RM, Bierig M, Devereux RB, Flachskampf FA, Foster E, Pellikka PA et al (2006) Recommendations for chamber quantification. Eur J Echocardiogr 7:79–108CrossRefPubMed Lang RM, Bierig M, Devereux RB, Flachskampf FA, Foster E, Pellikka PA et al (2006) Recommendations for chamber quantification. Eur J Echocardiogr 7:79–108CrossRefPubMed
2.
go back to reference Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L et al (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr 28:1-39.e14CrossRefPubMed Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L et al (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. J Am Soc Echocardiogr 28:1-39.e14CrossRefPubMed
3.
go back to reference Feigenbaum H (2010) Role of M-mode technique in today’s echocardiography. J Am Soc Echocardiogr 23(240–57):335–337 Feigenbaum H (2010) Role of M-mode technique in today’s echocardiography. J Am Soc Echocardiogr 23(240–57):335–337
5.
go back to reference Mitchell C, Rahko PS, Blauwet LA, Canaday B, Finstuen JA, Foster MC et al (2019) Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: recommendations from the American Society of echocardiography. J Am Soc Echocardiogr 32:1–64CrossRefPubMed Mitchell C, Rahko PS, Blauwet LA, Canaday B, Finstuen JA, Foster MC et al (2019) Guidelines for performing a comprehensive transthoracic echocardiographic examination in adults: recommendations from the American Society of echocardiography. J Am Soc Echocardiogr 32:1–64CrossRefPubMed
6.
go back to reference Nolan MT, Thavendiranathan P (2019) Automated quantification in echocardiography. JACC: Cardiovasc Imaging 12:1073–1092 Nolan MT, Thavendiranathan P (2019) Automated quantification in echocardiography. JACC: Cardiovasc Imaging 12:1073–1092
7.
go back to reference Zhang J, Gajjala S, Agrawal P, Tison GH, Hallock LA, Beussink-Nelson L et al (2018) Fully automated echocardiogram interpretation in clinical practice. Circulation 138:1623–1635CrossRefPubMedPubMedCentral Zhang J, Gajjala S, Agrawal P, Tison GH, Hallock LA, Beussink-Nelson L et al (2018) Fully automated echocardiogram interpretation in clinical practice. Circulation 138:1623–1635CrossRefPubMedPubMedCentral
9.
go back to reference Duan C, Montgomery MK, Chen X, Ullas S, Stansfield J, McElhanon K et al (2022) Fully automated mouse echocardiography analysis using deep convolutional neural networks. Am J Physiol Heart Circ Physiol 323:H628–H639CrossRefPubMed Duan C, Montgomery MK, Chen X, Ullas S, Stansfield J, McElhanon K et al (2022) Fully automated mouse echocardiography analysis using deep convolutional neural networks. Am J Physiol Heart Circ Physiol 323:H628–H639CrossRefPubMed
11.
go back to reference Tan M, Le QV (2019) EfficientNet: Rethinking model scaling for convolutional neural networks. International conference on machine learning, Long Beach, 97 Tan M, Le QV (2019) EfficientNet: Rethinking model scaling for convolutional neural networks. International conference on machine learning, Long Beach, 97
12.
go back to reference Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv pre-print server. 1412.6980 Kingma DP, Ba J (2014) Adam: a method for stochastic optimization. arXiv pre-print server. 1412.6980
13.
go back to reference Jeon J, Ha S, Yeonyee, Kim J, Jeong H, Jeong D et al (2023) Echocardiographic view classification with integrated out-of-distribution detection for enhanced automatic echocardiographic analysis. arXiv pre-print server Jeon J, Ha S, Yeonyee, Kim J, Jeong H, Jeong D et al (2023) Echocardiographic view classification with integrated out-of-distribution detection for enhanced automatic echocardiographic analysis. arXiv pre-print server
14.
go back to reference Ronneberger O, Fischer P (2015) Brox T. Convolutional networks for biomedical image segmentation. springer international publishing, U-Net, pp 234–241 Ronneberger O, Fischer P (2015) Brox T. Convolutional networks for biomedical image segmentation. springer international publishing, U-Net, pp 234–241
15.
go back to reference Sudre CH, Li W, Vercauteren T, Ourselin S, Jorge Cardoso M (2017) Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Springer International Publishing, pp 240–248 Sudre CH, Li W, Vercauteren T, Ourselin S, Jorge Cardoso M (2017) Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Springer International Publishing, pp 240–248
16.
go back to reference Hamilton P (2002) Open source ECG analysis. Comput Cardiol, pp 101–104 Hamilton P (2002) Open source ECG analysis. Comput Cardiol, pp 101–104
17.
go back to reference Oh JK, Kane GC (2018) The echo manual, 4th edn. Wolters Kluwer, Philadelphia Oh JK, Kane GC (2018) The echo manual, 4th edn. Wolters Kluwer, Philadelphia
18.
go back to reference Kim S, Park H-B, Jeon J, Arsanjani R, Heo R, Lee S-E et al (2022) Fully automated quantification of cardiac chamber and function assessment in 2-D echocardiography: clinical feasibility of deep learning-based algorithms. Int J Cardiovasc Imaging 38:1047–1059CrossRef Kim S, Park H-B, Jeon J, Arsanjani R, Heo R, Lee S-E et al (2022) Fully automated quantification of cardiac chamber and function assessment in 2-D echocardiography: clinical feasibility of deep learning-based algorithms. Int J Cardiovasc Imaging 38:1047–1059CrossRef
19.
go back to reference Bunting KV, Steeds RP, Slater LT, Rogers JK, Gkoutos GV, Kotecha D (2019) A practical guide to assess the reproducibility of echocardiographic measurements. J Am Soc Echocardiogr 32:1505–1515CrossRefPubMed Bunting KV, Steeds RP, Slater LT, Rogers JK, Gkoutos GV, Kotecha D (2019) A practical guide to assess the reproducibility of echocardiographic measurements. J Am Soc Echocardiogr 32:1505–1515CrossRefPubMed
20.
go back to reference Knackstedt C, Bekkers SCAM, Schummers G, Schreckenberg M, Muraru D, Badano LP et al (2015) Fully automated versus standard tracking of left ventricular ejection fraction and longitudinal strain. J Am Coll Cardiol 66:1456–1466CrossRefPubMed Knackstedt C, Bekkers SCAM, Schummers G, Schreckenberg M, Muraru D, Badano LP et al (2015) Fully automated versus standard tracking of left ventricular ejection fraction and longitudinal strain. J Am Coll Cardiol 66:1456–1466CrossRefPubMed
21.
go back to reference Leclerc S, Smistad E, Pedrosa J, Ostvik A, Cervenansky F, Espinosa F et al (2019) Deep learning for segmentation using an open large-scale dataset in 2D echocardiography. IEEE Trans Med Imaging 38:2198–2210CrossRefPubMed Leclerc S, Smistad E, Pedrosa J, Ostvik A, Cervenansky F, Espinosa F et al (2019) Deep learning for segmentation using an open large-scale dataset in 2D echocardiography. IEEE Trans Med Imaging 38:2198–2210CrossRefPubMed
22.
go back to reference Ghorbani A, Ouyang D, Abid A, He B, Chen JH, Harrington RA et al (2020) Deep learning interpretation of echocardiograms. npj Dig Med 3 Ghorbani A, Ouyang D, Abid A, He B, Chen JH, Harrington RA et al (2020) Deep learning interpretation of echocardiograms. npj Dig Med 3
23.
go back to reference Ouyang D, He B, Ghorbani A, Yuan N, Ebinger J, Langlotz CP et al (2020) Video-based AI for beat-to-beat assessment of cardiac function. Nature 580:252–256CrossRefPubMedPubMedCentral Ouyang D, He B, Ghorbani A, Yuan N, Ebinger J, Langlotz CP et al (2020) Video-based AI for beat-to-beat assessment of cardiac function. Nature 580:252–256CrossRefPubMedPubMedCentral
24.
go back to reference Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L et al (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging 16:233–270CrossRefPubMed Lang RM, Badano LP, Mor-Avi V, Afilalo J, Armstrong A, Ernande L et al (2015) Recommendations for cardiac chamber quantification by echocardiography in adults: an update from the American Society of Echocardiography and the European Association of Cardiovascular Imaging. Eur Heart J Cardiovasc Imaging 16:233–270CrossRefPubMed
Metadata
Title
Artificial intelligence-enhanced automation for M-mode echocardiographic analysis: ensuring fully automated, reliable, and reproducible measurements
Authors
Dawun Jeong
Sunghee Jung
Yeonyee E. Yoon
Jaeik Jeon
Yeonggul Jang
Seongmin Ha
Youngtaek Hong
JunHeum Cho
Seung-Ah Lee
Hong-Mi Choi
Hyuk-Jae Chang
Publication date
23-04-2024
Publisher
Springer Netherlands
Published in
The International Journal of Cardiovascular Imaging
Print ISSN: 1569-5794
Electronic ISSN: 1875-8312
DOI
https://doi.org/10.1007/s10554-024-03095-x