Skip to main content
Top
Published in: Journal of Cardiovascular Magnetic Resonance 1/2020

Open Access 01-12-2020 | Technical notes

Rapid whole-heart CMR with single volume super-resolution

Authors: Jennifer A. Steeden, Michael Quail, Alexander Gotschy, Kristian H. Mortensen, Andreas Hauptmann, Simon Arridge, Rodney Jones, Vivek Muthurangu

Published in: Journal of Cardiovascular Magnetic Resonance | Issue 1/2020

Login to get access

Abstract

Background

Three-dimensional, whole heart, balanced steady state free precession (WH-bSSFP) sequences provide delineation of intra-cardiac and vascular anatomy. However, they have long acquisition times. Here, we propose significant speed-ups using a deep-learning single volume super-resolution reconstruction, to recover high-resolution features from rapidly acquired low-resolution WH-bSSFP images.

Methods

A 3D residual U-Net was trained using synthetic data, created from a library of 500 high-resolution WH-bSSFP images by simulating 50% slice resolution and 50% phase resolution. The trained network was validated with 25 synthetic test data sets. Additionally, prospective low-resolution data and high-resolution data were acquired in 40 patients. In the prospective data, vessel diameters, quantitative and qualitative image quality, and diagnostic scoring was compared between the low-resolution, super-resolution and reference high-resolution WH-bSSFP data.

Results

The synthetic test data showed a significant increase in image quality of the low-resolution images after super-resolution reconstruction. Prospectively acquired low-resolution data was acquired ~× 3 faster than the prospective high-resolution data (173 s vs 488 s). Super-resolution reconstruction of the low-resolution data took < 1 s per volume. Qualitative image scores showed super-resolved images had better edge sharpness, fewer residual artefacts and less image distortion than low-resolution images, with similar scores to high-resolution data. Quantitative image scores showed super-resolved images had significantly better edge sharpness than low-resolution or high-resolution images, with significantly better signal-to-noise ratio than high-resolution data. Vessel diameters measurements showed over-estimation in the low-resolution measurements, compared to the high-resolution data. No significant differences and no bias was found in the super-resolution measurements in any of the great vessels. However, a small but significant for the underestimation was found in the proximal left coronary artery diameter measurement from super-resolution data. Diagnostic scoring showed that although super-resolution did not improve accuracy of diagnosis, it did improve diagnostic confidence compared to low-resolution imaging.

Conclusion

This paper demonstrates the potential of using a residual U-Net for super-resolution reconstruction of rapidly acquired low-resolution whole heart bSSFP data within a clinical setting. We were able to train the network using synthetic training data from retrospective high-resolution whole heart data. The resulting network can be applied very quickly, making these techniques particularly appealing within busy clinical workflow. Thus, we believe that this technique may help speed up whole heart CMR in clinical practice.
Appendix
Available only for authorised users
Literature
2.
go back to reference Barkauskas KJ, Rajiah P, Ashwath R, Hamilton JI, Chen Y, Ma D, et al. Quantification of left ventricular functional parameter values using 3D spiral bSSFP and through-time Non-Cartesian GRAPPA. J Cardiovasc Magn Reson. 2014;16(1):65.PubMedPubMedCentralCrossRef Barkauskas KJ, Rajiah P, Ashwath R, Hamilton JI, Chen Y, Ma D, et al. Quantification of left ventricular functional parameter values using 3D spiral bSSFP and through-time Non-Cartesian GRAPPA. J Cardiovasc Magn Reson. 2014;16(1):65.PubMedPubMedCentralCrossRef
3.
go back to reference Stehning C, Börnert P, Nehrke K, Eggers H, Stuber M. Free-breathing whole-heart coronary MRA with 3D radial SSFP and self-navigated image reconstruction. MRM. 2005;54(2):476–80.PubMedCrossRef Stehning C, Börnert P, Nehrke K, Eggers H, Stuber M. Free-breathing whole-heart coronary MRA with 3D radial SSFP and self-navigated image reconstruction. MRM. 2005;54(2):476–80.PubMedCrossRef
4.
go back to reference Akçakaya M, Basha TA, Goddu B, Goepfert LA, Kissinger KV, Tarokh V, et al. Low-dimensional-structure self-learning and thresholding: regularization beyond compressed sensing for MRI reconstruction. MRM. 2011;66(3):756–67.PubMedCrossRef Akçakaya M, Basha TA, Goddu B, Goepfert LA, Kissinger KV, Tarokh V, et al. Low-dimensional-structure self-learning and thresholding: regularization beyond compressed sensing for MRI reconstruction. MRM. 2011;66(3):756–67.PubMedCrossRef
5.
go back to reference Nam S, Akçakaya M, Basha T, Stehning C, Manning WJ, Tarokh V, et al. Compressed sensing reconstruction for whole-heart imaging with 3D radial trajectories: a graphics processing unit implementation. Magn Reson Med. 2013;69(1):91–102.PubMedCrossRef Nam S, Akçakaya M, Basha T, Stehning C, Manning WJ, Tarokh V, et al. Compressed sensing reconstruction for whole-heart imaging with 3D radial trajectories: a graphics processing unit implementation. Magn Reson Med. 2013;69(1):91–102.PubMedCrossRef
6.
go back to reference Lu Y, Yang R, Zhang J, Zhang C, editors. Super resolution image reconstruction in parallel magnetic resonance imaging. IEEE ICCA 2010: 9–11 June 2010; 2010. Lu Y, Yang R, Zhang J, Zhang C, editors. Super resolution image reconstruction in parallel magnetic resonance imaging. IEEE ICCA 2010: 9–11 June 2010; 2010.
7.
go back to reference Tang Y, Yan P, Yuan Y, Li X. Single-image super-resolution via local learning. Int J Mach Learn Cybern. 2011;2(1):15–23.CrossRef Tang Y, Yan P, Yuan Y, Li X. Single-image super-resolution via local learning. Int J Mach Learn Cybern. 2011;2(1):15–23.CrossRef
8.
go back to reference Shi W, Caballero J, Ledig C, Zhuang X, Bai W, Bhatia K, et al., editors. Cardiac image super-resolution with global correspondence using multi-atlas patchmatch. Berlin: Springer Berlin Heidelberg; 2013. Shi W, Caballero J, Ledig C, Zhuang X, Bai W, Bhatia K, et al., editors. Cardiac image super-resolution with global correspondence using multi-atlas patchmatch. Berlin: Springer Berlin Heidelberg; 2013.
9.
go back to reference Van Reeth E, Tham IWK, Tan CH, Poh CL. Super-resolution in magnetic resonance imaging: a review. Concept Magn Reson A. 2012;40A(6):306–25.CrossRef Van Reeth E, Tham IWK, Tan CH, Poh CL. Super-resolution in magnetic resonance imaging: a review. Concept Magn Reson A. 2012;40A(6):306–25.CrossRef
10.
go back to reference Hauptmann A, Arridge S, Lucka F, Muthurangu V, Steeden JA. Real-time cardiovascular MR with spatio-temporal artifact suppression using deep learning–proof of concept in congenital heart disease. Magn Reson Med. 2019;81(2):1143–56.PubMedCrossRef Hauptmann A, Arridge S, Lucka F, Muthurangu V, Steeden JA. Real-time cardiovascular MR with spatio-temporal artifact suppression using deep learning–proof of concept in congenital heart disease. Magn Reson Med. 2019;81(2):1143–56.PubMedCrossRef
11.
go back to reference Yang D, Huang Q, Axel L, Metaxas D, editors. Multi-component deformable models coupled with 2D-3D U-Net for automated probabilistic segmentation of cardiac walls and blood. 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018); 2018. Yang D, Huang Q, Axel L, Metaxas D, editors. Multi-component deformable models coupled with 2D-3D U-Net for automated probabilistic segmentation of cardiac walls and blood. 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018); 2018.
12.
go back to reference Cong C, Zhang H. Invert-U-Net DNN segmentation model for MRI cardiac left ventricle segmentation. J Eng. 2018;2018(16):1463–7. Cong C, Zhang H. Invert-U-Net DNN segmentation model for MRI cardiac left ventricle segmentation. J Eng. 2018;2018(16):1463–7.
13.
go back to reference Zheng Q, Delingette H, Duchateau N, Ayache N. 3-D consistent and robust segmentation of cardiac images by deep learning with spatial propagation. IEEE Trans Med Imaging. 2018;37(9):2137–48.PubMedCrossRef Zheng Q, Delingette H, Duchateau N, Ayache N. 3-D consistent and robust segmentation of cardiac images by deep learning with spatial propagation. IEEE Trans Med Imaging. 2018;37(9):2137–48.PubMedCrossRef
14.
go back to reference Ronneberger O, Fischer P, Brox T, editors. U-Net: convolutional networks for biomedical image segmentation. Medical image computing and computer-assisted intervention; Munich: Springer International Publishing; 2015. Ronneberger O, Fischer P, Brox T, editors. U-Net: convolutional networks for biomedical image segmentation. Medical image computing and computer-assisted intervention; Munich: Springer International Publishing; 2015.
15.
go back to reference Jin KH, McCann MT, Froustey E, Unser M. Deep convolutional neural network for inverse problems in imaging. IEEE Trans Image Process. 2017;26(9):4509–22.CrossRef Jin KH, McCann MT, Froustey E, Unser M. Deep convolutional neural network for inverse problems in imaging. IEEE Trans Image Process. 2017;26(9):4509–22.CrossRef
16.
go back to reference Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M. Tensorflow: A system for large-scale machine learning 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI). Savannah; 2016:265-83. Abadi M, Barham P, Chen J, Chen Z, Davis A, Dean J, Devin M, Ghemawat S, Irving G, Isard M. Tensorflow: A system for large-scale machine learning 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI). Savannah; 2016:265-83.
17.
go back to reference Kingma DP, Ba J. Adam: a method for stochastic optimization. In: International conference on learning representations (ICLR). San Diego; Ithaca: arXiv.org; 2014. p. 13. Kingma DP, Ba J. Adam: a method for stochastic optimization. In: International conference on learning representations (ICLR). San Diego; Ithaca: arXiv.org; 2014. p. 13.
18.
19.
go back to reference Steeden JA, Atkinson D, Hansen MS, Taylor AM, Muthurangu V. Rapid flow assessment of congenital heart disease with high-spatiotemporal-resolution gated spiral phase-contrast MR imaging. Radiology. 2011;260(1):79–87.PubMedPubMedCentralCrossRef Steeden JA, Atkinson D, Hansen MS, Taylor AM, Muthurangu V. Rapid flow assessment of congenital heart disease with high-spatiotemporal-resolution gated spiral phase-contrast MR imaging. Radiology. 2011;260(1):79–87.PubMedPubMedCentralCrossRef
20.
go back to reference Kourtidou S, Jones MR, Moore RA, Tretter JT, Ollberding NJ, Crotty EJ, et al. mDixon ECG-gated 3-dimensional cardiovascular magnetic resonance angiography in patients with congenital cardiovascular disease. J Cardiovasc Magn Reson. 2019;21(1):52.PubMedPubMedCentralCrossRef Kourtidou S, Jones MR, Moore RA, Tretter JT, Ollberding NJ, Crotty EJ, et al. mDixon ECG-gated 3-dimensional cardiovascular magnetic resonance angiography in patients with congenital cardiovascular disease. J Cardiovasc Magn Reson. 2019;21(1):52.PubMedPubMedCentralCrossRef
21.
go back to reference Peled S, Yeshurun Y. Superresolution in MRI—perhaps sometimes. Magn Reson Med. 2002;48(2):409.CrossRef Peled S, Yeshurun Y. Superresolution in MRI—perhaps sometimes. Magn Reson Med. 2002;48(2):409.CrossRef
23.
go back to reference Pham C-H, Tor-Díez C, Meunier H, Bednarek N, Fablet R, Passat N, et al. Multiscale brain MRI super-resolution using deep 3D convolutional networks. Comput Med Imaging Graph. 2019;77:101647.PubMedCrossRef Pham C-H, Tor-Díez C, Meunier H, Bednarek N, Fablet R, Passat N, et al. Multiscale brain MRI super-resolution using deep 3D convolutional networks. Comput Med Imaging Graph. 2019;77:101647.PubMedCrossRef
24.
go back to reference Qiu D, Zhang S, Liu Y, Zhu J, Zheng L. Super-resolution reconstruction of knee magnetic resonance imaging based on deep learning. Comput Methods Prog Biomed. 2019;187:105059. Qiu D, Zhang S, Liu Y, Zhu J, Zheng L. Super-resolution reconstruction of knee magnetic resonance imaging based on deep learning. Comput Methods Prog Biomed. 2019;187:105059.
25.
go back to reference Jun L, Ming Y, Jue Z, Xiaoying W. Respiratory motion correction for free-breathing 3D abdominal MRI using CNN-based image registration: a feasibility study. Br J Radiol. 2018;91(1083):20170788. Jun L, Ming Y, Jue Z, Xiaoying W. Respiratory motion correction for free-breathing 3D abdominal MRI using CNN-based image registration: a feasibility study. Br J Radiol. 2018;91(1083):20170788.
26.
go back to reference Tamada D, Kromrey M-L, Ichikawa S, Onishi H, Motosugi U. Motion artifact reduction using a convolutional neural network for dynamic contrast enhanced MR imaging of the liver. Magn Reson Med Sci. 2020;19(1):64.PubMedCrossRef Tamada D, Kromrey M-L, Ichikawa S, Onishi H, Motosugi U. Motion artifact reduction using a convolutional neural network for dynamic contrast enhanced MR imaging of the liver. Magn Reson Med Sci. 2020;19(1):64.PubMedCrossRef
27.
go back to reference Küstner T, Armanious K, Yang J, Yang B, Schick F, Gatidis S. Retrospective correction of motion-affected MR images using deep learning frameworks. Magn Reson Med. 2019;82(4):1527–40.PubMedCrossRef Küstner T, Armanious K, Yang J, Yang B, Schick F, Gatidis S. Retrospective correction of motion-affected MR images using deep learning frameworks. Magn Reson Med. 2019;82(4):1527–40.PubMedCrossRef
Metadata
Title
Rapid whole-heart CMR with single volume super-resolution
Authors
Jennifer A. Steeden
Michael Quail
Alexander Gotschy
Kristian H. Mortensen
Andreas Hauptmann
Simon Arridge
Rodney Jones
Vivek Muthurangu
Publication date
01-12-2020
Publisher
BioMed Central
Published in
Journal of Cardiovascular Magnetic Resonance / Issue 1/2020
Electronic ISSN: 1532-429X
DOI
https://doi.org/10.1186/s12968-020-00651-x

Other articles of this Issue 1/2020

Journal of Cardiovascular Magnetic Resonance 1/2020 Go to the issue