Skip to main content
Top
Published in: Pediatric Radiology 3/2021

01-03-2021 | Magnetic Resonance Imaging | Original Article

DeepLiverNet: a deep transfer learning model for classifying liver stiffness using clinical and T2-weighted magnetic resonance imaging data in children and young adults

Authors: Hailong Li, Lili He, Jonathan A. Dudley, Thomas C. Maloney, Elanchezhian Somasundaram, Samuel L. Brady, Nehal A. Parikh, Jonathan R. Dillman

Published in: Pediatric Radiology | Issue 3/2021

Login to get access

Abstract

Background

Although MR elastography allows for quantitative evaluation of liver stiffness to assess chronic liver diseases, it has associated drawbacks related to additional scanning time, patient discomfort, and added costs.

Objective

To develop a machine learning model that can categorically classify the severity of liver stiffness using both anatomical T2-weighted MRI and clinical data for children and young adults with known or suspected pediatric chronic liver diseases.

Materials and methods

We included 273 subjects with known or suspected chronic liver disease. We extracted data including axial T2-weighted fast spin-echo fat-suppressed images, clinical data (e.g., demographic/anthropomorphic data, particular medical diagnoses, laboratory values) and MR elastography liver stiffness measurements. We propose DeepLiverNet (a deep transfer learning model) to classify patients into one of two groups: no/mild liver stiffening (<3 kPa) or moderate/severe liver stiffening (≥3 kPa). We conducted internal cross-validation using 178 subjects, and external validation using an independent cohort of 95 subjects. We assessed diagnostic performance using accuracy, sensitivity, specificity and area under the receiver operating characteristic curve (AuROC).

Results

In the internal cross-validation experiment, the combination of clinical and imaging data produced the best performance (AuROC=0.86) compared to clinical (AuROC=0.83) or imaging (AuROC=0.80) data alone. Using both clinical and imaging data, the DeepLiverNet correctly classified patients with accuracy of 88.0%, sensitivity of 74.3% and specificity of 94.6%. In our external validation experiment, this same deep learning model achieved an accuracy of 80.0%, sensitivity of 61.1%, specificity of 91.5% and AuROC of 0.79.

Conclusion

A deep learning model that incorporates clinical data and anatomical T2-weighted MR images might provide a means of risk-stratifying liver stiffness and directing the use of MR elastography.
Appendix
Available only for authorised users
Literature
1.
go back to reference Chalasani N, Younossi Z, Lavine JE et al (2018) The diagnosis and management of nonalcoholic fatty liver disease: practice guidance from the American Association for the Study of Liver Diseases. Hepatology 67:328–357CrossRef Chalasani N, Younossi Z, Lavine JE et al (2018) The diagnosis and management of nonalcoholic fatty liver disease: practice guidance from the American Association for the Study of Liver Diseases. Hepatology 67:328–357CrossRef
2.
3.
go back to reference Tapper EB, Lok AS-F (2017) Use of liver imaging and biopsy in clinical practice. N Engl J Med 377:756–768CrossRef Tapper EB, Lok AS-F (2017) Use of liver imaging and biopsy in clinical practice. N Engl J Med 377:756–768CrossRef
4.
go back to reference Serai SD, Trout AT, Miethke A et al (2018) Putting it all together: established and emerging MRI techniques for detecting and measuring liver fibrosis. Pediatr Radiol 48:1256–1272CrossRef Serai SD, Trout AT, Miethke A et al (2018) Putting it all together: established and emerging MRI techniques for detecting and measuring liver fibrosis. Pediatr Radiol 48:1256–1272CrossRef
5.
go back to reference Smith AD, Porter KK, Elkassem AA et al (2019) Current imaging techniques for noninvasive staging of hepatic fibrosis. AJR Am J Roentgenol 213:77–89 Smith AD, Porter KK, Elkassem AA et al (2019) Current imaging techniques for noninvasive staging of hepatic fibrosis. AJR Am J Roentgenol 213:77–89
6.
go back to reference Banerjee R, Pavlides M, Tunnicliffe EM et al (2014) Multiparametric magnetic resonance for the non-invasive diagnosis of liver disease. J Hepatol 60:69–77 Banerjee R, Pavlides M, Tunnicliffe EM et al (2014) Multiparametric magnetic resonance for the non-invasive diagnosis of liver disease. J Hepatol 60:69–77
7.
go back to reference Dillman JR, Heider A, Bilhartz JL et al (2015) Ultrasound shear wave speed measurements correlate with liver fibrosis in children. Pediatr Radiol 45:1480–1488CrossRef Dillman JR, Heider A, Bilhartz JL et al (2015) Ultrasound shear wave speed measurements correlate with liver fibrosis in children. Pediatr Radiol 45:1480–1488CrossRef
8.
go back to reference Yin M, Glaser KJ, Talwalkar JA et al (2015) Hepatic MR elastography: clinical performance in a series of 1,377 consecutive examinations. Radiology 278:114–124CrossRef Yin M, Glaser KJ, Talwalkar JA et al (2015) Hepatic MR elastography: clinical performance in a series of 1,377 consecutive examinations. Radiology 278:114–124CrossRef
9.
go back to reference Shi Y, Guo Q, Xia F et al (2014) MR elastography for the assessment of hepatic fibrosis in patients with chronic hepatitis B infection: does histologic necroinflammation influence the measurement of hepatic stiffness? Radiology 273:88–98CrossRef Shi Y, Guo Q, Xia F et al (2014) MR elastography for the assessment of hepatic fibrosis in patients with chronic hepatitis B infection: does histologic necroinflammation influence the measurement of hepatic stiffness? Radiology 273:88–98CrossRef
10.
go back to reference Joshi M, Dillman JR, Singh K et al (2018) Quantitative MRI of fatty liver disease in a large pediatric cohort: correlation between liver fat fraction, stiffness, volume, and patient-specific factors. Abdom Radiol 43:1168–1179CrossRef Joshi M, Dillman JR, Singh K et al (2018) Quantitative MRI of fatty liver disease in a large pediatric cohort: correlation between liver fat fraction, stiffness, volume, and patient-specific factors. Abdom Radiol 43:1168–1179CrossRef
11.
go back to reference DiPaola FW, Schumacher KR, Goldberg CS et al (2017) Effect of Fontan operation on liver stiffness in children with single ventricle physiology. Eur Radiol 27:2434–2442CrossRef DiPaola FW, Schumacher KR, Goldberg CS et al (2017) Effect of Fontan operation on liver stiffness in children with single ventricle physiology. Eur Radiol 27:2434–2442CrossRef
12.
go back to reference Rotemberg V, Palmeri M, Nightingale R et al (2011) The impact of hepatic pressurization on liver shear wave speed estimates in constrained versus unconstrained conditions. Phys Med Biol 57:329CrossRef Rotemberg V, Palmeri M, Nightingale R et al (2011) The impact of hepatic pressurization on liver shear wave speed estimates in constrained versus unconstrained conditions. Phys Med Biol 57:329CrossRef
13.
go back to reference Trout AT, Sheridan RM, Serai SD et al (2018) Diagnostic performance of MR elastography for liver fibrosis in children and young adults with a spectrum of liver diseases. Radiology 287:824–832CrossRef Trout AT, Sheridan RM, Serai SD et al (2018) Diagnostic performance of MR elastography for liver fibrosis in children and young adults with a spectrum of liver diseases. Radiology 287:824–832CrossRef
14.
go back to reference Serai SD, Towbin AJ, Podberesky DJ (2012) Pediatric liver MR elastography. Dig Dis Sci 57:2713–2719CrossRef Serai SD, Towbin AJ, Podberesky DJ (2012) Pediatric liver MR elastography. Dig Dis Sci 57:2713–2719CrossRef
15.
go back to reference Muthupillai R, Lomas D, Rossman P et al (1995) Magnetic resonance elastography by direct visualization of propagating acoustic strain waves. Science 269:1854–1857CrossRef Muthupillai R, Lomas D, Rossman P et al (1995) Magnetic resonance elastography by direct visualization of propagating acoustic strain waves. Science 269:1854–1857CrossRef
16.
go back to reference Bahl M, Barzilay R, Yedidia AB et al (2018) High-risk breast lesions: a machine learning model to predict pathologic upgrade and reduce unnecessary surgical excision. Radiology 286:810–818CrossRef Bahl M, Barzilay R, Yedidia AB et al (2018) High-risk breast lesions: a machine learning model to predict pathologic upgrade and reduce unnecessary surgical excision. Radiology 286:810–818CrossRef
17.
go back to reference Dawes TJW, de Marvao A, Shi W et al (2017) Machine learning of three-dimensional right ventricular motion enables outcome prediction in pulmonary hypertension: a cardiac MR imaging study. Radiology 283:381–390CrossRef Dawes TJW, de Marvao A, Shi W et al (2017) Machine learning of three-dimensional right ventricular motion enables outcome prediction in pulmonary hypertension: a cardiac MR imaging study. Radiology 283:381–390CrossRef
18.
go back to reference Kickingereder P, Bonekamp D, Nowosielski M et al (2016) Radiogenomics of glioblastoma: machine learning-based classification of molecular characteristics by using multiparametric and multiregional MR imaging features. Radiology 281:907–918CrossRef Kickingereder P, Bonekamp D, Nowosielski M et al (2016) Radiogenomics of glioblastoma: machine learning-based classification of molecular characteristics by using multiparametric and multiregional MR imaging features. Radiology 281:907–918CrossRef
19.
go back to reference Wu H, Deng Z, Zhang B et al (2016) Classifier model based on machine learning algorithms: application to differential diagnosis of suspicious thyroid nodules via sonography. AJR Am J Roentgenol 207:859–864CrossRef Wu H, Deng Z, Zhang B et al (2016) Classifier model based on machine learning algorithms: application to differential diagnosis of suspicious thyroid nodules via sonography. AJR Am J Roentgenol 207:859–864CrossRef
20.
go back to reference Abajian A, Murali N, Savic LJ et al (2018) Predicting treatment response to intra-arterial therapies for hepatocellular carcinoma with the use of supervised machine learning — an artificial intelligence concept. J Vasc Interv Radiol 29:850–857CrossRef Abajian A, Murali N, Savic LJ et al (2018) Predicting treatment response to intra-arterial therapies for hepatocellular carcinoma with the use of supervised machine learning — an artificial intelligence concept. J Vasc Interv Radiol 29:850–857CrossRef
21.
go back to reference Kline TL, Korfiatis P, Edwards ME et al (2017) Performance of an artificial multi-observer deep neural network for fully automated segmentation of polycystic kidneys. J Digit Imaging 30:442–448CrossRef Kline TL, Korfiatis P, Edwards ME et al (2017) Performance of an artificial multi-observer deep neural network for fully automated segmentation of polycystic kidneys. J Digit Imaging 30:442–448CrossRef
22.
go back to reference Mutasa S, Chang PD, Ruzal-Shapiro C, Ayyala R (2018) MABAL: a novel deep-learning architecture for machine-assisted bone age labeling. J Digit Imaging 31:513–519CrossRef Mutasa S, Chang PD, Ruzal-Shapiro C, Ayyala R (2018) MABAL: a novel deep-learning architecture for machine-assisted bone age labeling. J Digit Imaging 31:513–519CrossRef
23.
go back to reference He L, Li H, Dudley JA et al (2019) Machine learning prediction of liver stiffness using clinical and T2-weighted MRI radiomic data. AJR Am J Roentgenol 213:1–10CrossRef He L, Li H, Dudley JA et al (2019) Machine learning prediction of liver stiffness using clinical and T2-weighted MRI radiomic data. AJR Am J Roentgenol 213:1–10CrossRef
24.
go back to reference LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444 LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444
25.
go back to reference Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284:574–582CrossRef Lakhani P, Sundaram B (2017) Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks. Radiology 284:574–582CrossRef
26.
go back to reference Serai SD, Dillman JR, Trout AT (2016) Spin-echo echo-planar imaging MR elastography versus gradient-echo MR elastography for assessment of liver stiffness in children and young adults suspected of having liver disease. Radiology 282:761–770CrossRef Serai SD, Dillman JR, Trout AT (2016) Spin-echo echo-planar imaging MR elastography versus gradient-echo MR elastography for assessment of liver stiffness in children and young adults suspected of having liver disease. Radiology 282:761–770CrossRef
27.
go back to reference Sawh MC, Newton KP, Goyal NP et al (2020) Normal range for MR elastography measured liver stiffness in children without liver disease. J Magn Reson Imaging 51:919–927CrossRef Sawh MC, Newton KP, Goyal NP et al (2020) Normal range for MR elastography measured liver stiffness in children without liver disease. J Magn Reson Imaging 51:919–927CrossRef
28.
go back to reference Yin M, Talwalkar JA, Glaser KJ et al (2007) Assessment of hepatic fibrosis with magnetic resonance elastography. Clin Gastroenterol Hepatol 5:1207–1213CrossRef Yin M, Talwalkar JA, Glaser KJ et al (2007) Assessment of hepatic fibrosis with magnetic resonance elastography. Clin Gastroenterol Hepatol 5:1207–1213CrossRef
31.
go back to reference He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778 He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 770–778
32.
go back to reference Szegedy C, Vanhoucke V, Ioffe S et al (2016) Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2818–2826 Szegedy C, Vanhoucke V, Ioffe S et al (2016) Rethinking the inception architecture for computer vision. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 2818–2826
33.
go back to reference Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 8697–8710 Zoph B, Vasudevan V, Shlens J, Le QV (2018) Learning transferable architectures for scalable image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 8697–8710
37.
go back to reference Olden JD, Jackson DA (2002) Illuminating the “black box”: a randomization approach for understanding variable contributions in artificial neural networks. Ecol Model 154:135–150CrossRef Olden JD, Jackson DA (2002) Illuminating the “black box”: a randomization approach for understanding variable contributions in artificial neural networks. Ecol Model 154:135–150CrossRef
38.
go back to reference Ng A (2017) Machine learning yearning. eBook Ng A (2017) Machine learning yearning. eBook
39.
go back to reference Szegedy C, Liu W, Jia Y et al (2015) Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–9 Szegedy C, Liu W, Jia Y et al (2015) Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 1–9
40.
go back to reference Pickhardt PJ, Malecki K, Hunt OF et al (2017) Hepatosplenic volumetric assessment at MDCT for staging liver fibrosis. Eur Radiol 27:3060–3068 Pickhardt PJ, Malecki K, Hunt OF et al (2017) Hepatosplenic volumetric assessment at MDCT for staging liver fibrosis. Eur Radiol 27:3060–3068
Metadata
Title
DeepLiverNet: a deep transfer learning model for classifying liver stiffness using clinical and T2-weighted magnetic resonance imaging data in children and young adults
Authors
Hailong Li
Lili He
Jonathan A. Dudley
Thomas C. Maloney
Elanchezhian Somasundaram
Samuel L. Brady
Nehal A. Parikh
Jonathan R. Dillman
Publication date
01-03-2021
Publisher
Springer Berlin Heidelberg
Published in
Pediatric Radiology / Issue 3/2021
Print ISSN: 0301-0449
Electronic ISSN: 1432-1998
DOI
https://doi.org/10.1007/s00247-020-04854-3

Other articles of this Issue 3/2021

Pediatric Radiology 3/2021 Go to the issue