Skip to main content
Top
Published in: Journal of Digital Imaging 4/2017

Open Access 01-08-2017

Performance of an Artificial Multi-observer Deep Neural Network for Fully Automated Segmentation of Polycystic Kidneys

Authors: Timothy L. Kline, Panagiotis Korfiatis, Marie E. Edwards, Jaime D. Blais, Frank S. Czerwiec, Peter C. Harris, Bernard F. King, Vicente E. Torres, Bradley J. Erickson

Published in: Journal of Imaging Informatics in Medicine | Issue 4/2017

Login to get access

Abstract

Deep learning techniques are being rapidly applied to medical imaging tasks—from organ and lesion segmentation to tissue and tumor classification. These techniques are becoming the leading algorithmic approaches to solve inherently difficult image processing tasks. Currently, the most critical requirement for successful implementation lies in the need for relatively large datasets that can be used for training the deep learning networks. Based on our initial studies of MR imaging examinations of the kidneys of patients affected by polycystic kidney disease (PKD), we have generated a unique database of imaging data and corresponding reference standard segmentations of polycystic kidneys. In the study of PKD, segmentation of the kidneys is needed in order to measure total kidney volume (TKV). Automated methods to segment the kidneys and measure TKV are needed to increase measurement throughput and alleviate the inherent variability of human-derived measurements. We hypothesize that deep learning techniques can be leveraged to perform fast, accurate, reproducible, and fully automated segmentation of polycystic kidneys. Here, we describe a fully automated approach for segmenting PKD kidneys within MR images that simulates a multi-observer approach in order to create an accurate and robust method for the task of segmentation and computation of TKV for PKD patients. A total of 2000 cases were used for training and validation, and 400 cases were used for testing. The multi-observer ensemble method had mean ± SD percent volume difference of 0.68 ± 2.2% compared with the reference standard segmentations. The complete framework performs fully automated segmentation at a level comparable with interobserver variability and could be considered as a replacement for the task of segmentation of PKD kidneys by a human.
Literature
2.
go back to reference Greenspan, H., B. van Ginneken, and R.M. Summers, Deep learning in medical imaging: overview and future promise of an exciting new technique. Ieee Transactions on Medical Imaging, 2016. 35(5): p. 1153–1159.CrossRef Greenspan, H., B. van Ginneken, and R.M. Summers, Deep learning in medical imaging: overview and future promise of an exciting new technique. Ieee Transactions on Medical Imaging, 2016. 35(5): p. 1153–1159.CrossRef
3.
go back to reference Roth, H.R., et al. DeepOrgan: multi-level deep convolutional networks for automated pancreas segmentation. in Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015. 2015. Springer. Roth, H.R., et al. DeepOrgan: multi-level deep convolutional networks for automated pancreas segmentation. in Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015. 2015. Springer.
4.
go back to reference Korfiatis, P., T.L. Kline, and B.J. Erickson, Automated segmentation of hyperintense regions in FLAIR MRI using deep learning. Tomography, 2016. 2(4): p. 334–340.CrossRefPubMedPubMedCentral Korfiatis, P., T.L. Kline, and B.J. Erickson, Automated segmentation of hyperintense regions in FLAIR MRI using deep learning. Tomography, 2016. 2(4): p. 334–340.CrossRefPubMedPubMedCentral
5.
go back to reference Shin, H.C., et al., Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging, 2016. 35(5): p. 1285–98.CrossRefPubMed Shin, H.C., et al., Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging, 2016. 35(5): p. 1285–98.CrossRefPubMed
6.
go back to reference Esteva, A., et al., Dermatologist-level classification of skin cancer with deep neural networks. Nature, 2017. 542(7639): p. 115–118.CrossRefPubMed Esteva, A., et al., Dermatologist-level classification of skin cancer with deep neural networks. Nature, 2017. 542(7639): p. 115–118.CrossRefPubMed
7.
go back to reference Gabow, P.A., Autosomal dominant polycystic kidney disease. The New England journal of medicine, 1993. 329(5): p. 332–42.CrossRefPubMed Gabow, P.A., Autosomal dominant polycystic kidney disease. The New England journal of medicine, 1993. 329(5): p. 332–42.CrossRefPubMed
9.
go back to reference Torres, V.E., P.C. Harris, and Y. Pirson, Autosomal dominant polycystic kidney disease. Lancet, 2007. 369(9569): p. 1287–301.CrossRefPubMed Torres, V.E., P.C. Harris, and Y. Pirson, Autosomal dominant polycystic kidney disease. Lancet, 2007. 369(9569): p. 1287–301.CrossRefPubMed
10.
go back to reference Grantham, J.J., A.B. Chapman, and V.E. Torres, Volume progression in autosomal dominant polycystic kidney disease: the major factor determining clinical outcomes. Clinical journal of the American Society of Nephrology : CJASN, 2006. 1(1): p. 148–57.CrossRefPubMed Grantham, J.J., A.B. Chapman, and V.E. Torres, Volume progression in autosomal dominant polycystic kidney disease: the major factor determining clinical outcomes. Clinical journal of the American Society of Nephrology : CJASN, 2006. 1(1): p. 148–57.CrossRefPubMed
11.
go back to reference Schrier, R.W., et al., Blood pressure in early autosomal dominant polycystic kidney disease. The New England journal of medicine, 2014. 371(24): p. 2255–66.CrossRefPubMedPubMedCentral Schrier, R.W., et al., Blood pressure in early autosomal dominant polycystic kidney disease. The New England journal of medicine, 2014. 371(24): p. 2255–66.CrossRefPubMedPubMedCentral
12.
go back to reference Caroli, A., et al., Effect of longacting somatostatin analogue on kidney and cyst growth in autosomal dominant polycystic kidney disease (ALADIN): a randomised, placebo-controlled, multicentre trial. Lancet, 2013. 382(9903): p. 1485–95.CrossRefPubMed Caroli, A., et al., Effect of longacting somatostatin analogue on kidney and cyst growth in autosomal dominant polycystic kidney disease (ALADIN): a randomised, placebo-controlled, multicentre trial. Lancet, 2013. 382(9903): p. 1485–95.CrossRefPubMed
13.
go back to reference Torres, V.E., et al., Tolvaptan in patients with autosomal dominant polycystic kidney disease. The New England journal of medicine, 2012. 367(25): p. 2407–18.CrossRefPubMedPubMedCentral Torres, V.E., et al., Tolvaptan in patients with autosomal dominant polycystic kidney disease. The New England journal of medicine, 2012. 367(25): p. 2407–18.CrossRefPubMedPubMedCentral
14.
go back to reference Serra, A.L., et al., Sirolimus and kidney growth in autosomal dominant polycystic kidney disease. The New England journal of medicine, 2010. 363(9): p. 820–9.CrossRefPubMed Serra, A.L., et al., Sirolimus and kidney growth in autosomal dominant polycystic kidney disease. The New England journal of medicine, 2010. 363(9): p. 820–9.CrossRefPubMed
15.
go back to reference Walz, G., et al., Everolimus in patients with autosomal dominant polycystic kidney disease. The New England journal of medicine, 2010. 363(9): p. 830–40.CrossRefPubMed Walz, G., et al., Everolimus in patients with autosomal dominant polycystic kidney disease. The New England journal of medicine, 2010. 363(9): p. 830–40.CrossRefPubMed
17.
go back to reference Liebau, M.C. and A.L. Serra, Looking at the (w)hole: magnet resonance imaging in polycystic kidney disease. Pediatric nephrology, 2013. 28(9): p. 1771–83.CrossRefPubMed Liebau, M.C. and A.L. Serra, Looking at the (w)hole: magnet resonance imaging in polycystic kidney disease. Pediatric nephrology, 2013. 28(9): p. 1771–83.CrossRefPubMed
18.
go back to reference Fick-Brosnahan, G.M., et al., Relationship between renal volume growth and renal function in autosomal dominant polycystic kidney disease: a longitudinal study. American journal of kidney diseases : the official journal of the National Kidney Foundation, 2002. 39(6): p. 1127–34.CrossRef Fick-Brosnahan, G.M., et al., Relationship between renal volume growth and renal function in autosomal dominant polycystic kidney disease: a longitudinal study. American journal of kidney diseases : the official journal of the National Kidney Foundation, 2002. 39(6): p. 1127–34.CrossRef
19.
go back to reference Grantham, J.J., et al., Volume progression in polycystic kidney disease. The New England journal of medicine, 2006. 354(20): p. 2122–30.CrossRefPubMed Grantham, J.J., et al., Volume progression in polycystic kidney disease. The New England journal of medicine, 2006. 354(20): p. 2122–30.CrossRefPubMed
20.
go back to reference Irazabal, M.V., et al., Imaging classification of autosomal dominant polycystic kidney disease: a simple model for selecting patients for clinical trials. Journal of the American Society of Nephrology : JASN, 2014. Irazabal, M.V., et al., Imaging classification of autosomal dominant polycystic kidney disease: a simple model for selecting patients for clinical trials. Journal of the American Society of Nephrology : JASN, 2014.
21.
go back to reference Bae, K.T., P.K. Commean, and J. Lee, Volumetric measurement of renal cysts and parenchyma using MRI: phantoms and patients with polycystic kidney disease. Journal of computer assisted tomography, 2000. 24(4): p. 614–9.CrossRefPubMed Bae, K.T., P.K. Commean, and J. Lee, Volumetric measurement of renal cysts and parenchyma using MRI: phantoms and patients with polycystic kidney disease. Journal of computer assisted tomography, 2000. 24(4): p. 614–9.CrossRefPubMed
22.
go back to reference Kistler, A.D., et al., Increases in kidney volume in autosomal dominant polycystic kidney disease can be detected within 6 months. Kidney International, 2009. 75(2): p. 235–41.CrossRefPubMed Kistler, A.D., et al., Increases in kidney volume in autosomal dominant polycystic kidney disease can be detected within 6 months. Kidney International, 2009. 75(2): p. 235–41.CrossRefPubMed
23.
go back to reference King, B.F., et al., Quantification and longitudinal trends of kidney, renal cyst, and renal parenchyma volumes in autosomal dominant polycystic kidney disease. Journal of the American Society of Nephrology : JASN, 2000. 11(8): p. 1505–11.PubMed King, B.F., et al., Quantification and longitudinal trends of kidney, renal cyst, and renal parenchyma volumes in autosomal dominant polycystic kidney disease. Journal of the American Society of Nephrology : JASN, 2000. 11(8): p. 1505–11.PubMed
24.
go back to reference Kline, T.L., et al., Semiautomated segmentation of polycystic kidneys in T2-weighted MR images. American Journal of Roentgenology, 2016. 207(3): p. 605–613.CrossRefPubMedPubMedCentral Kline, T.L., et al., Semiautomated segmentation of polycystic kidneys in T2-weighted MR images. American Journal of Roentgenology, 2016. 207(3): p. 605–613.CrossRefPubMedPubMedCentral
25.
go back to reference Kline, T.L., et al., Automatic total kidney volume measurement on follow-up magnetic resonance images to facilitate monitoring of autosomal dominant polycystic kidney disease progression. Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association, 2016. 31(2): p. 241–8. Kline, T.L., et al., Automatic total kidney volume measurement on follow-up magnetic resonance images to facilitate monitoring of autosomal dominant polycystic kidney disease progression. Nephrology, dialysis, transplantation : official publication of the European Dialysis and Transplant Association - European Renal Association, 2016. 31(2): p. 241–8.
26.
go back to reference Shin, H.C., et al., Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data. IEEE Trans Pattern Anal Mach Intell, 2013. 35(8): p. 1930–43.CrossRefPubMed Shin, H.C., et al., Stacked autoencoders for unsupervised feature learning and multiple organ detection in a pilot study using 4D patient data. IEEE Trans Pattern Anal Mach Intell, 2013. 35(8): p. 1930–43.CrossRefPubMed
27.
go back to reference Ronneberger, O., P. Fischer, and T. Brox, U-Net: convolutional networks for biomedical image segmentation, in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III, N. Navab, et al., Editors. 2015, Springer International Publishing: Cham. p. 234–241. Ronneberger, O., P. Fischer, and T. Brox, U-Net: convolutional networks for biomedical image segmentation, in Medical Image Computing and Computer-Assisted Intervention – MICCAI 2015: 18th International Conference, Munich, Germany, October 5–9, 2015, Proceedings, Part III, N. Navab, et al., Editors. 2015, Springer International Publishing: Cham. p. 234–241.
28.
go back to reference Torres, V.E., et al., Rationale and design of the TEMPO (Tolvaptan Efficacy and Safety in Management of Autosomal Dominant Polycystic Kidney Disease and its Outcomes) 3-4 Study. American journal of kidney diseases : the official journal of the National Kidney Foundation, 2011. 57(5): p. 692–9.CrossRef Torres, V.E., et al., Rationale and design of the TEMPO (Tolvaptan Efficacy and Safety in Management of Autosomal Dominant Polycystic Kidney Disease and its Outcomes) 3-4 Study. American journal of kidney diseases : the official journal of the National Kidney Foundation, 2011. 57(5): p. 692–9.CrossRef
29.
go back to reference Irazabal, M.V., et al., Imaging classification of autosomal dominant polycystic kidney disease: a simple model for selecting patients for clinical trials. Journal of the American Society of Nephrology : JASN, 2015. 26(1): p. 160–72.CrossRefPubMed Irazabal, M.V., et al., Imaging classification of autosomal dominant polycystic kidney disease: a simple model for selecting patients for clinical trials. Journal of the American Society of Nephrology : JASN, 2015. 26(1): p. 160–72.CrossRefPubMed
30.
go back to reference Kline, T.L., et al., Image texture features predict renal function decline in autosomal polycystic kidney disease patients. Kidney international, 2017. in press. Kline, T.L., et al., Image texture features predict renal function decline in autosomal polycystic kidney disease patients. Kidney international, 2017. in press.
31.
go back to reference Kline, T.L., et al., Utilizing magnetization transfer imaging to investigate tissue remodeling in a murine model of autosomal dominant polycystic kidney disease. Magnetic resonance in medicine, 2016. 75(4): p. 1466–1473.CrossRefPubMed Kline, T.L., et al., Utilizing magnetization transfer imaging to investigate tissue remodeling in a murine model of autosomal dominant polycystic kidney disease. Magnetic resonance in medicine, 2016. 75(4): p. 1466–1473.CrossRefPubMed
Metadata
Title
Performance of an Artificial Multi-observer Deep Neural Network for Fully Automated Segmentation of Polycystic Kidneys
Authors
Timothy L. Kline
Panagiotis Korfiatis
Marie E. Edwards
Jaime D. Blais
Frank S. Czerwiec
Peter C. Harris
Bernard F. King
Vicente E. Torres
Bradley J. Erickson
Publication date
01-08-2017
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 4/2017
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-017-9978-1

Other articles of this Issue 4/2017

Journal of Digital Imaging 4/2017 Go to the issue