Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Research

2.5D MFFAU-Net: a convolutional neural network for kidney segmentation

Authors: Peng Sun, Zengnan Mo, Fangrong Hu, Xin Song, Taiping Mo, Bonan Yu, Yewei Zhang, Zhencheng Chen

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Kidney tumors have become increasingly prevalent among adults and are now considered one of the most common types of tumors. Accurate segmentation of kidney tumors can help physicians assess tumor complexity and aggressiveness before surgery. However, segmenting kidney tumors manually can be difficult because of their heterogeneity.

Methods

This paper proposes a 2.5D MFFAU-Net (multi-level Feature Fusion Attention U-Net) to segment kidneys, tumors and cysts. First, we propose a 2.5D model for learning to combine and represent a given slice in 2D slices, thereby introducing 3D information to balance memory consumption and model complexity. Then, we propose a ResConv architecture in MFFAU-Net and use the high-level and low-level feature in the model. Finally, we use multi-level information to analyze the spatial features between slices to segment kidneys and tumors.

Results

The 2.5D MFFAU-Net was evaluated on KiTS19 and KiTS21 kidney datasets and demonstrated an average dice score of 0.924 and 0.875, respectively, and an average Surface dice (SD) score of 0.794 in KiTS21.

Conclusion

The 2.5D MFFAU-Net model can effectively segment kidney tumors, and the results are comparable to those obtained with high-performance 3D CNN models, and have the potential to serve as a point of reference in clinical practice.
Literature
1.
go back to reference Moch H, Amin MB, Berney DM, et al. The 2022 World Health Organization classification of Tumours of the urinary system and male genital Organs—Part A: renal, Penile, and testicular Tumours[J]. European urology; 2022. Moch H, Amin MB, Berney DM, et al. The 2022 World Health Organization classification of Tumours of the urinary system and male genital Organs—Part A: renal, Penile, and testicular Tumours[J]. European urology; 2022.
3.
go back to reference Hendry J, Rai BP, McNeill AS et al. Kidney and Ureter Neoplasm[J]. Blandy’s Urol, 2019: 237–75. Hendry J, Rai BP, McNeill AS et al. Kidney and Ureter Neoplasm[J]. Blandy’s Urol, 2019: 237–75.
4.
go back to reference Saadaat R, Haidary AM, Ibrahimkhil AS, et al. Metastatic renal cell carcinoma involving colon with unusual histologic features and diagnostic challenges: a case report[J]. Int J Surg case Rep. 2021;80:105627.CrossRefPubMedPubMedCentral Saadaat R, Haidary AM, Ibrahimkhil AS, et al. Metastatic renal cell carcinoma involving colon with unusual histologic features and diagnostic challenges: a case report[J]. Int J Surg case Rep. 2021;80:105627.CrossRefPubMedPubMedCentral
5.
go back to reference Denize T, Massa S, Valent A, et al. Renal cell carcinoma in children and adolescents: a retrospective study of a french–italian series of 93 cases[J]. Histopathology. 2022;80(6):928–45.CrossRefPubMed Denize T, Massa S, Valent A, et al. Renal cell carcinoma in children and adolescents: a retrospective study of a french–italian series of 93 cases[J]. Histopathology. 2022;80(6):928–45.CrossRefPubMed
6.
go back to reference Dahle DO, Skauby M, Langberg CW, et al. Renal cell carcinoma and kidney transplantation: a narrative review[J]. Transplantation. 2022;106(1):e52–e63.CrossRefPubMed Dahle DO, Skauby M, Langberg CW, et al. Renal cell carcinoma and kidney transplantation: a narrative review[J]. Transplantation. 2022;106(1):e52–e63.CrossRefPubMed
7.
go back to reference Roussel E, Capitanio U, Kutikov A, et al. Novel imaging methods for renal mass characterization: a collaborative review[J]. European urology; 2022. Roussel E, Capitanio U, Kutikov A, et al. Novel imaging methods for renal mass characterization: a collaborative review[J]. European urology; 2022.
8.
go back to reference Irigaray P, Newby JA, Clapp R, et al. Lifestyle-related factors and environmental agents causing cancer: an overview[J]. Volume 61. Biomedicine & Pharmacotherapy; 2007. pp. 640–58. 10. Irigaray P, Newby JA, Clapp R, et al. Lifestyle-related factors and environmental agents causing cancer: an overview[J]. Volume 61. Biomedicine & Pharmacotherapy; 2007. pp. 640–58. 10.
9.
go back to reference Ansari KK, Jha A. Causes of cancer in the world: comparative risk assessment of nine behavioral and environmental risk factors[J]. Cureus, 2022, 14(9). Ansari KK, Jha A. Causes of cancer in the world: comparative risk assessment of nine behavioral and environmental risk factors[J]. Cureus, 2022, 14(9).
10.
go back to reference Bi WL, Hosny A, Schabath MB, et al. Artificial intelligence in cancer imaging: clinical challenges and applications[J]. Cancer J Clin. 2019;69(2):127–57. Bi WL, Hosny A, Schabath MB, et al. Artificial intelligence in cancer imaging: clinical challenges and applications[J]. Cancer J Clin. 2019;69(2):127–57.
11.
go back to reference Rowe SP, Pomper MG. Molecular imaging in oncology: current impact and future directions[J]. Cancer J Clin. 2022;72(4):333–52.CrossRef Rowe SP, Pomper MG. Molecular imaging in oncology: current impact and future directions[J]. Cancer J Clin. 2022;72(4):333–52.CrossRef
12.
go back to reference Kocak B, Durmaz ES, Kaya OK, et al. Reliability of single-slice–based 2D CT texture analysis of renal masses: influence of intra-and interobserver manual segmentation variability on radiomic feature reproducibility[J]. Am J Roentgenol. 2019;213(2):377–83.CrossRef Kocak B, Durmaz ES, Kaya OK, et al. Reliability of single-slice–based 2D CT texture analysis of renal masses: influence of intra-and interobserver manual segmentation variability on radiomic feature reproducibility[J]. Am J Roentgenol. 2019;213(2):377–83.CrossRef
13.
go back to reference Anwar SM, Majid M, Qayyum A, et al. Medical image analysis using convolutional neural networks: a review[J]. J Med Syst. 2018;42(11):1–13.CrossRef Anwar SM, Majid M, Qayyum A, et al. Medical image analysis using convolutional neural networks: a review[J]. J Med Syst. 2018;42(11):1–13.CrossRef
14.
go back to reference Elyan E, Vuttipittayamongkol P, Johnston P et al. Computer vision and machine learning for medical image analysis: recent advances, challenges, and way forward[J]. Artif Intell Surg, 2022, 2. Elyan E, Vuttipittayamongkol P, Johnston P et al. Computer vision and machine learning for medical image analysis: recent advances, challenges, and way forward[J]. Artif Intell Surg, 2022, 2.
15.
go back to reference Pandey M, Gupta A. A systematic review of the automatic kidney segmentation methods in abdominal images[J]. Biocybernetics and Biomedical Engineering. 2021;41(4):1601–28.CrossRef Pandey M, Gupta A. A systematic review of the automatic kidney segmentation methods in abdominal images[J]. Biocybernetics and Biomedical Engineering. 2021;41(4):1601–28.CrossRef
16.
go back to reference Pandey M, Gupta A. An approach to remove extraneous slices from CT for kidney segmentation[C]//2022 1st IEEE International Conference on Industrial Electronics: Developments & Applications (ICIDeA). IEEE, 2022: 116–121. Pandey M, Gupta A. An approach to remove extraneous slices from CT for kidney segmentation[C]//2022 1st IEEE International Conference on Industrial Electronics: Developments & Applications (ICIDeA). IEEE, 2022: 116–121.
17.
go back to reference Niyas S, Pawan SJ, Kumar MA, et al. Medical image segmentation with 3D convolutional neural networks: a survey[J]. Neurocomputing. 2022;493:397–413.CrossRef Niyas S, Pawan SJ, Kumar MA, et al. Medical image segmentation with 3D convolutional neural networks: a survey[J]. Neurocomputing. 2022;493:397–413.CrossRef
18.
go back to reference Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015: 234–241. Ronneberger O, Fischer P, Brox T. U-net: Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015: 234–241.
19.
go back to reference Heller N, Isensee F, Maier-Hein KH, et al. The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: results of the KiTS19 challenge[J]. Med Image Anal. 2021;67:101821.CrossRefPubMed Heller N, Isensee F, Maier-Hein KH, et al. The state of the art in kidney and kidney tumor segmentation in contrast-enhanced CT imaging: results of the KiTS19 challenge[J]. Med Image Anal. 2021;67:101821.CrossRefPubMed
20.
go back to reference Isensee F, Maier-Hein KH. An attempt at beating the 3D U-Net[J]. arXiv preprint arXiv:1908.02182, 2019. Isensee F, Maier-Hein KH. An attempt at beating the 3D U-Net[J]. arXiv preprint arXiv:1908.02182, 2019.
21.
go back to reference Kang L, Zhou Z, Huang J, et al. Renal tumors segmentation in abdomen CT images using 3D-CNN and ConvLSTM[J]. Biomed Signal Process Control. 2022;72:103334.CrossRef Kang L, Zhou Z, Huang J, et al. Renal tumors segmentation in abdomen CT images using 3D-CNN and ConvLSTM[J]. Biomed Signal Process Control. 2022;72:103334.CrossRef
22.
go back to reference da Cruz LB, Araújo JDL, Ferreira JL, et al. Kidney segmentation from computed tomography images using deep neural network[J]. Comput Biol Med. 2020;123:103906.CrossRefPubMed da Cruz LB, Araújo JDL, Ferreira JL, et al. Kidney segmentation from computed tomography images using deep neural network[J]. Comput Biol Med. 2020;123:103906.CrossRefPubMed
23.
go back to reference Pandey M, Gupta A. Tumorous kidney segmentation in abdominal CT images using active contour and 3D-UNet[J]. Irish Journal of Medical Science (1971-), 2022: 1–9. Pandey M, Gupta A. Tumorous kidney segmentation in abdominal CT images using active contour and 3D-UNet[J]. Irish Journal of Medical Science (1971-), 2022: 1–9.
24.
go back to reference Shen Z, Yang H, Zhang Z, et al. Automated kidney tumor segmentation with convolution and transformer network[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 1–12. Shen Z, Yang H, Zhang Z, et al. Automated kidney tumor segmentation with convolution and transformer network[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 1–12.
25.
go back to reference Adam J, Agethen N, Bohnsack R, et al. Extraction of kidney anatomy based on a 3D U-ResNet with overlap-tile Strategy[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 13–21. Adam J, Agethen N, Bohnsack R, et al. Extraction of kidney anatomy based on a 3D U-ResNet with overlap-tile Strategy[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 13–21.
26.
go back to reference Zhao Z, Chen H, Wang L. A coarse-to-fine Framework for the 2021 kidney and kidney tumor segmentation Challenge[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 53–8. Zhao Z, Chen H, Wang L. A coarse-to-fine Framework for the 2021 kidney and kidney tumor segmentation Challenge[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 53–8.
27.
go back to reference Müller D, Soto-Rey I, Kramer F. Towards a Guideline for Evaluation Metrics in Medical Image Segmentation[J]. arXiv preprint arXiv:2202.05273, 2022. Müller D, Soto-Rey I, Kramer F. Towards a Guideline for Evaluation Metrics in Medical Image Segmentation[J]. arXiv preprint arXiv:2202.05273, 2022.
28.
go back to reference da Cruz LB, Júnior DAD, Diniz JOB, et al. Kidney tumor segmentation from computed tomography images using DeepLabv3 + 2.5 D model[J]. Expert Syst Appl. 2022;192:116270.CrossRef da Cruz LB, Júnior DAD, Diniz JOB, et al. Kidney tumor segmentation from computed tomography images using DeepLabv3 + 2.5 D model[J]. Expert Syst Appl. 2022;192:116270.CrossRef
29.
go back to reference Causey J, Stubblefield J, Qualls J, et al. An ensemble of u-net models for kidney tumor segmentation with CT images[J]. IEEE/ACM Transactions on Computational Biology and Bioinformatics; 2021. Causey J, Stubblefield J, Qualls J, et al. An ensemble of u-net models for kidney tumor segmentation with CT images[J]. IEEE/ACM Transactions on Computational Biology and Bioinformatics; 2021.
30.
go back to reference Kittipongdaja P, Siriborvornratanakul T. Automatic kidney segmentation using 2.5 D ResUNet and 2.5 D DenseUNet for malignant potential analysis in complex renal cyst based on CT images[J]. EURASIP J Image Video Process. 2022;2022(1):1–15.CrossRef Kittipongdaja P, Siriborvornratanakul T. Automatic kidney segmentation using 2.5 D ResUNet and 2.5 D DenseUNet for malignant potential analysis in complex renal cyst based on CT images[J]. EURASIP J Image Video Process. 2022;2022(1):1–15.CrossRef
31.
go back to reference Türk F, Lüy M, Barışçı N. Kidney and renal tumor segmentation using a hybrid V-Net-based model[J]. Mathematics. 2020;8(10):1772.CrossRef Türk F, Lüy M, Barışçı N. Kidney and renal tumor segmentation using a hybrid V-Net-based model[J]. Mathematics. 2020;8(10):1772.CrossRef
32.
go back to reference Turk F, Luy M, Barışçı N, et al. Kidney tumor segmentation using two-stage Bottleneck Block Architecture[J]. Volume 33. Intelligent Automation & Soft Computing; 2022. 1. Turk F, Luy M, Barışçı N, et al. Kidney tumor segmentation using two-stage Bottleneck Block Architecture[J]. Volume 33. Intelligent Automation & Soft Computing; 2022. 1.
33.
go back to reference Zang M, Wysoczanski A, Angelini E, et al. 3D U-Net based semantic segmentation of kidneys and renal masses on contrast-enhanced CT[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 143–50. Zang M, Wysoczanski A, Angelini E, et al. 3D U-Net based semantic segmentation of kidneys and renal masses on contrast-enhanced CT[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 143–50.
34.
go back to reference Chen Z, Liu H. 2.5 D cascaded semantic segmentation for kidney tumor Cyst[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 28–34.CrossRef Chen Z, Liu H. 2.5 D cascaded semantic segmentation for kidney tumor Cyst[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 28–34.CrossRef
35.
go back to reference Li D, Chen Z, Hassan H, et al. A cascaded 3D segmentation model for renal enhanced CT Images[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 123–8.CrossRef Li D, Chen Z, Hassan H, et al. A cascaded 3D segmentation model for renal enhanced CT Images[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 123–8.CrossRef
36.
go back to reference George YA, Coarse-to-Fine. 3D U-Net Network for semantic segmentation of kidney CT Scans[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 137–42.CrossRef George YA, Coarse-to-Fine. 3D U-Net Network for semantic segmentation of kidney CT Scans[C]//International challenge on kidney and kidney tumor segmentation. Cham: Springer; 2022. pp. 137–42.CrossRef
Metadata
Title
2.5D MFFAU-Net: a convolutional neural network for kidney segmentation
Authors
Peng Sun
Zengnan Mo
Fangrong Hu
Xin Song
Taiping Mo
Bonan Yu
Yewei Zhang
Zhencheng Chen
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02189-1

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue