Top

BMC Medical Imaging

Published in:

Open Access 01-12-2023 | Magnetic Resonance Imaging | Research

Evaluation of convolutional neural networks for the detection of inter-breath-hold motion from a stack of cardiac short axis slice images

Authors: Yoon-Chul Kim, Min Woo Kim

Published in: BMC Medical Imaging | Issue 1/2023

Abstract

Purpose

This study aimed to develop and validate a deep learning-based method that detects inter-breath-hold motion from an estimated cardiac long axis image reconstructed from a stack of short axis cardiac cine images.

Methods

Cardiac cine magnetic resonance image data from all short axis slices and 2-/3-/4-chamber long axis slices were considered for the study. Data from 740 subjects were used for model development, and data from 491 subjects were used for testing. The method utilized the slice orientation information to calculate the intersection line of a short axis plane and a long axis plane. An estimated long axis image is shown along with a long axis image as a motion-free reference image, which enables visual assessment of the inter-breath-hold motion from the estimated long axis image. The estimated long axis image was labeled as either a motion-corrupted or a motion-free image. Deep convolutional neural network (CNN) models were developed and validated using the labeled data.

Results

The method was fully automatic in obtaining long axis images reformatted from a 3D stack of short axis slices and predicting the presence/absence of inter-breath-hold motion. The deep CNN model with EfficientNet-B0 as a feature extractor was effective at motion detection with an area under the receiver operating characteristic (AUC) curve of 0.87 for the testing data.

Conclusion

The proposed method can automatically assess inter-breath-hold motion in a stack of cardiac cine short axis slices. The method can help prospectively reacquire problematic short axis slices or retrospectively correct motion.

Available only for authorised users

Glovaci D, Fan W, Wong ND. Epidemiology of diabetes Mellitus and Cardiovascular Disease. Curr Cardiol Rep. p. 21, Mar 4 2019;21(4). https://doi.org/10.1007/s11886-019-1107-y.

Groenewegen A, Rutten FH, Mosterd A, Hoes AW. “Epidemiology of heart failure,“ Eur J Heart Fail, vol. 22, no. 8, pp. 1342–1356, Aug 2020, doi: https://doi.org/10.1002/ejhf.1858.

Schulz-Menger J, et al. Standardized image interpretation and post-processing in cardiovascular magnetic resonance – 2020 update: Society for Cardiovascular magnetic resonance (SCMR): Board of Trustees Task Force on standardized post-processing. J Cardiovasc Magn Reson. Mar 12 2020;22(1):19. https://doi.org/10.1186/s12968-020-00610-6.

Slomka PJ et al. “Patient motion correction for multiplanar, multi-breath-hold cardiac cine MR imaging,“ J Magn Reson Imaging, vol. 25, no. 5, pp. 965 – 73, May 2007, doi: https://doi.org/10.1002/jmri.20909.

Swingen C, Seethamraju RT, Jerosch-Herold M. An approach to the three-dimensional display of left ventricular function and viability using MRI. Int J Cardiovasc Imaging. Aug 2003;19(4):325–36. https://doi.org/10.1023/a:1025450211508.

Carminati MC, Maffessanti F, Caiani EG. Nearly automated motion artifacts correction between multi breath-hold short-axis and long-axis cine CMR images. Comput Biol Med. Mar 2014;46:42–50. https://doi.org/10.1016/j.compbiomed.2013.12.013.

Elen A et al. “Automatic 3-D breath-hold related motion correction of dynamic multislice MRI,“ IEEE Trans Med Imaging, vol. 29, no. 3, pp. 868 – 78, Mar 2010, doi: https://doi.org/10.1109/TMI.2009.2039145.

Wan M, et al. Correcting motion in multiplanar cardiac magnetic resonance images. Biomed Eng Online. 2016;15(1):1–16.CrossRef

Litjens G et al. “State-of-the-Art Deep Learning in Cardiovascular Image Analysis,“ JACC Cardiovasc Imaging, vol. 12, no. 8 Pt 1, pp. 1549–1565, Aug 2019, doi: https://doi.org/10.1016/j.jcmg.2019.06.009.

10.

Johnson KW et al. “Artificial Intelligence in Cardiology,“ J Am Coll Cardiol, vol. 71, no. 23, pp. 2668–2679, Jun 12 2018, doi: https://doi.org/10.1016/j.jacc.2018.03.521.

11.

Seetharam K, Brito D, Farjo PD, Sengupta PP. The role of artificial intelligence in cardiovascular imaging: state of the art review. Front Cardiovasc Med. 2020;7:618849.CrossRefPubMedPubMedCentral

12.

Kusunose K, Haga A, Inoue M, Fukuda D, Yamada H, Sata M. “Clinically Feasible and Accurate View Classification of Echocardiographic Images Using Deep Learning,“ Biomolecules, vol. 10, no. 5, Apr 25 2020, doi: https://doi.org/10.3390/biom10050665.

13.

Lossau T, et al. Motion artifact recognition and quantification in coronary CT angiography using convolutional neural networks. Med Image Anal. Feb 2019;52:68–79. https://doi.org/10.1016/j.media.2018.11.003.

14.

Fonseca CG et al. “The Cardiac Atlas Project–an imaging database for computational modeling and statistical atlases of the heart,“ Bioinformatics, vol. 27, no. 16, pp. 2288-95, Aug 15 2011, doi: https://doi.org/10.1093/bioinformatics/btr360.

15.

Mildenberger P, Eichelberg M, Martin E. Introduction to the DICOM standard. Eur Radiol. 2002;12(4):920–7.CrossRefPubMed

16.

Dangi S, Linte CA, Yaniv Z. A distance map regularized CNN for cardiac cine MR image segmentation. Med Phys. Dec 2019;46(12):5637–51. https://doi.org/10.1002/mp.13853.

17.

Plotly Technologies Inc. Plotly, charting tool for online collaborative data science. Montréal, QC; 2015.

18.

MATLAB. Version 9.12.0 (R2022a). The MathWorks Inc.; 2022.

19.

Chollet F. “Keras: The python deep learning library,“ Astrophysics source code library, p. ascl: 1806.022, 2018.

20.

Ioffe S, Szegedy C. “Batch normalization: Accelerating deep network training by reducing internal covariate shift,“ in International Conference on Machine Learning, 2015: PMLR, pp. 448–456.

21.

Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R. Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res. 2014;15(1):1929–58.

22.

Tan MX, Le QV. “EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks,“ (in English), Pr Mach Learn Res, vol. 97, 2019. [Online]. Available: ://WOS:000684034306026.

23.

Howard AG et al. “Mobilenets: Efficient convolutional neural networks for mobile vision applications,“ arXiv preprint arXiv:1704.04861, 2017.

24.

Zoph B, Vasudevan V, Shlens J, Le QV. “Learning Transferable Architectures for Scalable Image Recognition,“ (in English), 2018 IEEE Conference on Computer Vision and Pattern Recognition, pp. 8697–8710, 2018, doi: https://doi.org/10.1109/Cvpr.2018.00907.

25.

He KM, Zhang XY, Ren SQ, Sun J. “Identity Mappings in Deep Residual Networks,“ (in English), Lect Notes Comput Sc, vol. 9908, pp. 630–645, 2016, doi: https://doi.org/10.1007/978-3-319-46493-0_38.

26.

Simonyan K, Zisserman A. “Very deep convolutional networks for large-scale image recognition,“ arXiv preprint arXiv:1409.1556, 2014.

27.

Tan M, Le Q. “Efficientnet: Rethinking model scaling for convolutional neural networks,“ in International Conference on Machine Learning, 2019: PMLR, pp. 6105–6114.

28.

Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L. “Imagenet: A large-scale hierarchical image database,“ in 2009 IEEE Conference on Computer Vision and Pattern Recognition, 2009: Ieee, pp. 248–255.

29.

Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning Deep Features for Discriminative Localization,“ (in English). Proc Cvpr Ieee. 2016;2921–9. https://doi.org/10.1109/CVPR.2016.319.

30.

Kingma DP, Ba J. “Adam: A method for stochastic optimization,“ arXiv preprint arXiv:1412.6980, 2014.

31.

Pedregosa F, et al. Scikit-learn: machine learning in Python. J Mach Learn Res. 2011;12:2825–30.

32.

Ho N, Kim YC. “Estimation of Cardiac Short Axis Slice Levels with a Cascaded Deep Convolutional and Recurrent Neural Network Model,“ Tomography, vol. 8, no. 6, pp. 2749–2760, Nov 14 2022, doi: https://doi.org/10.3390/tomography8060229.

33.

Ho N, Kim YC. Evaluation of transfer learning in deep convolutional neural network models for cardiac short axis slice classification. Sci Rep. Jan 19 2021;11(1):1839. https://doi.org/10.1038/s41598-021-81525-9.

34.

Liew YM et al. “Motion corrected LV quantification based on 3D modelling for improved functional assessment in cardiac MRI,“ Phys Med Biol, vol. 60, no. 7, pp. 2715-33, Apr 7 2015, doi: https://doi.org/10.1088/0031-9155/60/7/2715.

Title: Evaluation of convolutional neural networks for the detection of inter-breath-hold motion from a stack of cardiac short axis slice images
Authors: Yoon-Chul Kim
Min Woo Kim
Publication date: 01-12-2023
Publisher: BioMed Central
Keywords: Magnetic Resonance Imaging
Magnetic Resonance Imaging
Published in: BMC Medical Imaging / Issue 1/2023
Electronic ISSN: 1471-2342
DOI: https://doi.org/10.1186/s12880-023-01070-x

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Evaluation of convolutional neural networks for the detection of inter-breath-hold motion from a stack of cardiac short axis slice images

Abstract

Purpose

Methods

Results

Conclusion

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Purpose

Methods

Results

Conclusion

Please log in to get access to this content

Other articles of this Issue 1/2023

DeepHipp: accurate segmentation of hippocampus using 3D dense-block based on attention mechanism

Application of attenuation coefficient in the assessment of hepatic involvement in children and adolescents with Wilson’s disease

18F-FDG gallbladder uptake: observation from a total-body PET/CT scanner

Multiparametric MRI radiomics for the differentiation of brain glial cell hyperplasia from low-grade glioma

CT target scanning in the diagnosis of solid pseudopapillary tumor of the pancreas

A novel MRI feature, the cut green pepper sign, can help differentiate a suprasellar pilocytic astrocytoma from an adamantinomatous craniopharyngioma