Skip to main content
Top
Published in: Journal of Digital Imaging 4/2020

01-08-2020 | Magnetic Resonance Imaging | Original Paper

Automatic Segmentation of Meniscus in Multispectral MRI Using Regions with Convolutional Neural Network (R-CNN)

Authors: Emre ÖLMEZ, Volkan AKDOĞAN, Murat KORKMAZ, Orhan ER

Published in: Journal of Imaging Informatics in Medicine | Issue 4/2020

Login to get access

Abstract

The meniscus has a significant function in human anatomy, and Magnetic Resonance Imaging (MRI) has an essential role in meniscus examination. Due to a variety of MRI data, it is excessively difficult to segment the meniscus with image processing methods. An MRI data sequence contains multiple images, and the region features we are looking for may vary from each image in the sequence. Therefore, feature extraction becomes more difficult, and hence, explicitly programming for segmentation becomes more difficult. Convolutional Neural Network (CNN) extracts features directly from images and thus eliminates the need for manual feature extraction. Regions with Convolutional Neural Network (R-CNN) allow us to use CNN features in object detection problems by combining CNN features with Region Proposals. In this study, we designed and trained an R-CNN for detecting meniscus region in MRI data sequence. We used transfer learning for training R-CNN with a small amount of meniscus data. After detection of the meniscus region by R-CNN, we segmented meniscus by morphological image analysis using two different MRI sequences. Automatic detection of the meniscus region with R-CNN made the meniscus segmentation process easier, and the use of different contrast features of two different image sequences allowed us to differentiate the meniscus from its surroundings.
Literature
1.
go back to reference Makris EA, Hadidi P, Athanasiou KA: The knee meniscus: Structure-function, pathophysiology, current repair techniques, and prospects for regeneration. Biomaterials 32(30):7411–7431, 2011CrossRef Makris EA, Hadidi P, Athanasiou KA: The knee meniscus: Structure-function, pathophysiology, current repair techniques, and prospects for regeneration. Biomaterials 32(30):7411–7431, 2011CrossRef
2.
go back to reference Bryceland JK, Powell AJ, Nunn T: Knee Menisci. Cartilage 8(2):99–104, 2017CrossRef Bryceland JK, Powell AJ, Nunn T: Knee Menisci. Cartilage 8(2):99–104, 2017CrossRef
3.
go back to reference Liew SC, Liew SW, Zain JM: Tamper localization and lossless recovery watermarking scheme with ROI segmentation and multilevel authentication. Journal of Digital Imaging 26:316–325, 2013CrossRef Liew SC, Liew SW, Zain JM: Tamper localization and lossless recovery watermarking scheme with ROI segmentation and multilevel authentication. Journal of Digital Imaging 26:316–325, 2013CrossRef
4.
go back to reference Deepa S: SubbiahBharathi: Efficient ROI segmentation of digital mammogram images using Otsu’s N thresholding method. International Journal of Engineering Research & Technology 2(1):1–6, 2013CrossRef Deepa S: SubbiahBharathi: Efficient ROI segmentation of digital mammogram images using Otsu’s N thresholding method. International Journal of Engineering Research & Technology 2(1):1–6, 2013CrossRef
5.
go back to reference Nagi J, Abdul Kareem S, Nagi F, Ahmed SK: Automated Breast Profile Segmentation for ROI Detection Using Digital Mammograms: IEEE EMBS conference on Biomedical Engineering & Sciences. Kuala Lumpur, Malaysia, November–December 2010:87–92, 2010 Nagi J, Abdul Kareem S, Nagi F, Ahmed SK: Automated Breast Profile Segmentation for ROI Detection Using Digital Mammograms: IEEE EMBS conference on Biomedical Engineering & Sciences. Kuala Lumpur, Malaysia, November–December 2010:87–92, 2010
6.
go back to reference John NW: Segmentation of radiological images. In: Neri E, Caramella D, Bartolozzi C Eds. Image processing in radiology. Medical radiology (diagnostic imaging). Berlin, Heidelberg: Springer, 2008 John NW: Segmentation of radiological images. In: Neri E, Caramella D, Bartolozzi C Eds. Image processing in radiology. Medical radiology (diagnostic imaging). Berlin, Heidelberg: Springer, 2008
7.
go back to reference Samuel AL: Some studies in machine learning using the game of checkers. IBM Journal of Research and Development 3(3):210–229, 1959CrossRef Samuel AL: Some studies in machine learning using the game of checkers. IBM Journal of Research and Development 3(3):210–229, 1959CrossRef
8.
go back to reference Ng, A.: Machine learning yearning: Technical strategy for AI engineers, in the era of deep learning, Andrew Ng., Draft Version, 2018 Ng, A.: Machine learning yearning: Technical strategy for AI engineers, in the era of deep learning, Andrew Ng., Draft Version, 2018
9.
go back to reference Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Jianming Liang: Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Transactions on Medical Imaging 35(5):1299–1312, 2016CrossRef Tajbakhsh N, Shin JY, Gurudu SR, Hurst RT, Kendall CB, Gotway MB, Jianming Liang: Convolutional neural networks for medical image analysis: Full training or fine tuning? IEEE Transactions on Medical Imaging 35(5):1299–1312, 2016CrossRef
10.
go back to reference Akilan T, Wu QJ, Zhang W: Video foreground extraction using multi-view receptive field and encoder-decoder DCNN for traffic and surveillance applications. IEEE Transactions on Vehicular Technology 68(10):9478–9493, 2019CrossRef Akilan T, Wu QJ, Zhang W: Video foreground extraction using multi-view receptive field and encoder-decoder DCNN for traffic and surveillance applications. IEEE Transactions on Vehicular Technology 68(10):9478–9493, 2019CrossRef
11.
go back to reference Lu, Le, Zheng, Yefeng, Carneiro, Gustavo, Yang, Lin (2017) ‘Deep learning and convolutional neural networks for medical image computing’: ‘Advances in Computer Vision and Pattern Recognition’ Springer Lu, Le, Zheng, Yefeng, Carneiro, Gustavo, Yang, Lin (2017) ‘Deep learning and convolutional neural networks for medical image computing’: ‘Advances in Computer Vision and Pattern Recognition’ Springer
12.
go back to reference Aghdam, H.A., Heravi, E.J. 2017 ‘Guide to convolutional neural networks: A practical application to traffic-sign detection and classification’ (springer, 1st edn. ) Aghdam, H.A., Heravi, E.J. 2017 ‘Guide to convolutional neural networks: A practical application to traffic-sign detection and classification’ (springer, 1st edn. )
13.
go back to reference Farabet C, Couprie C, Najman L, LeCun Y: Learning hierarchical features for scene labelling. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(8):1915–1929, 2013CrossRef Farabet C, Couprie C, Najman L, LeCun Y: Learning hierarchical features for scene labelling. IEEE Transactions on Pattern Analysis and Machine Intelligence 35(8):1915–1929, 2013CrossRef
14.
go back to reference Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. 25th international conference on neural information processing systems. Nevada: Lake Tahoe, 2012, pp. 1097–1105 Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks. 25th international conference on neural information processing systems. Nevada: Lake Tahoe, 2012, pp. 1097–1105
15.
go back to reference Girshick R, Donahue J, Darrell T, Malik J: Rich feature hierarchies for accurate object detection and semantic segmentation. Columbus: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 580–587 Girshick R, Donahue J, Darrell T, Malik J: Rich feature hierarchies for accurate object detection and semantic segmentation. Columbus: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 580–587
16.
go back to reference Köse C, Gençalioğlu O, Şevik U: An automatic diagnosis method for the knee meniscus tears in MR images. Expert Systems with Applications 36(2):1208–1216, 2009CrossRef Köse C, Gençalioğlu O, Şevik U: An automatic diagnosis method for the knee meniscus tears in MR images. Expert Systems with Applications 36(2):1208–1216, 2009CrossRef
17.
go back to reference Fripp J, Bourgeat P, Engstrom C, Ourselin S, Crozier S, Salvado O: Automated segmentation of the menisci from MR images. Boston: IEEE international symposium on biomedical imaging: From nano to macro, 2009, pp. 510–513 Fripp J, Bourgeat P, Engstrom C, Ourselin S, Crozier S, Salvado O: Automated segmentation of the menisci from MR images. Boston: IEEE international symposium on biomedical imaging: From nano to macro, 2009, pp. 510–513
18.
go back to reference Paproki A, Engstrom C, Chandra SS, Neubert A, Fripp J, Crozier S: Automated segmentation and analysis of normal and osteoarthritic knee menisci from magnetic resonance images data from the osteoarthritis initiative. Osteoarthritis and Cartilage 2(9):1259–1270, 2014CrossRef Paproki A, Engstrom C, Chandra SS, Neubert A, Fripp J, Crozier S: Automated segmentation and analysis of normal and osteoarthritic knee menisci from magnetic resonance images data from the osteoarthritis initiative. Osteoarthritis and Cartilage 2(9):1259–1270, 2014CrossRef
19.
go back to reference Zhang K, Lu W, Marziliano P: The unified extreme learning machines and discriminative random fields for automatic knee cartilage and meniscus segmentation from multi-contrast MR images. Machine Vision and Applications 24(7):1459–1472, 2013CrossRef Zhang K, Lu W, Marziliano P: The unified extreme learning machines and discriminative random fields for automatic knee cartilage and meniscus segmentation from multi-contrast MR images. Machine Vision and Applications 24(7):1459–1472, 2013CrossRef
20.
go back to reference Saygılı A, Albayrak S: A new computer-based approach for fully automated segmentation of knee meniscus from magnetic resonance images. Biocybernetics and Biomedical Engineering 37(3):432–442, 2017CrossRef Saygılı A, Albayrak S: A new computer-based approach for fully automated segmentation of knee meniscus from magnetic resonance images. Biocybernetics and Biomedical Engineering 37(3):432–442, 2017CrossRef
21.
go back to reference Aldrin F: Automated segmentation of the meniscus. KTH Royal Institute of Technology: Master Thesis, 2017 Aldrin F: Automated segmentation of the meniscus. KTH Royal Institute of Technology: Master Thesis, 2017
22.
go back to reference Tack A, Mukhopadhyay A, Zachow S: Knee menisci segmentation using convolutional neural networks: Data from the osteoarthritis initiative. Osteoarthritis and Cartilage 26(5):680–688, 2018CrossRef Tack A, Mukhopadhyay A, Zachow S: Knee menisci segmentation using convolutional neural networks: Data from the osteoarthritis initiative. Osteoarthritis and Cartilage 26(5):680–688, 2018CrossRef
23.
go back to reference Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW: Selective search for object recognition. International Journal of Computer Vision 104(2):154–171, 2013CrossRef Uijlings JR, Van De Sande KE, Gevers T, Smeulders AW: Selective search for object recognition. International Journal of Computer Vision 104(2):154–171, 2013CrossRef
24.
go back to reference Marcus DS et al.: Human connectome project informatics: Quality control, database services, and data visualization. Neuroimage 80:202–219, 2013CrossRef Marcus DS et al.: Human connectome project informatics: Quality control, database services, and data visualization. Neuroimage 80:202–219, 2013CrossRef
25.
go back to reference Huo J, Wang G, Wu QJ, Akilan T: Label fusion for multi-atlas segmentation based on majority voting. Niagara Falls: International Conference on Image Analysis and Recognition, July 2015, pp. 100–106 Huo J, Wang G, Wu QJ, Akilan T: Label fusion for multi-atlas segmentation based on majority voting. Niagara Falls: International Conference on Image Analysis and Recognition, July 2015, pp. 100–106
26.
go back to reference Soille P: Morphological image analysis: Principles and Applications, 2nd edition. Germany: Springer, 2002 Soille P: Morphological image analysis: Principles and Applications, 2nd edition. Germany: Springer, 2002
27.
go back to reference Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing Using MATLAB, 2nd edn., USA:Gatesmark Publishing, 2009 Gonzalez RC, Woods RE, Eddins SL: Digital Image Processing Using MATLAB, 2nd edn., USA:Gatesmark Publishing, 2009
28.
go back to reference Gonzalez RC, Woods RE: Digital Image Processing, 3rd edn., Pearson Prentice Hall, 2008 Gonzalez RC, Woods RE: Digital Image Processing, 3rd edn., Pearson Prentice Hall, 2008
29.
go back to reference Sedgewick R: Algorithms in C, 3rd edn., Addison-Wesley, 1998 Sedgewick R: Algorithms in C, 3rd edn., Addison-Wesley, 1998
30.
go back to reference Solomon C, Breckon T: Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab, 1st edn., Wiley-Blackwell, 2011 Solomon C, Breckon T: Fundamentals of Digital Image Processing: A Practical Approach with Examples in Matlab, 1st edn., Wiley-Blackwell, 2011
Metadata
Title
Automatic Segmentation of Meniscus in Multispectral MRI Using Regions with Convolutional Neural Network (R-CNN)
Authors
Emre ÖLMEZ
Volkan AKDOĞAN
Murat KORKMAZ
Orhan ER
Publication date
01-08-2020
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 4/2020
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-020-00329-x

Other articles of this Issue 4/2020

Journal of Digital Imaging 4/2020 Go to the issue