Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 14/2020

Open Access 01-12-2020 | Research

Texture features in the Shearlet domain for histopathological image classification

Authors: Sadiq Alinsaif, Jochen Lang

Published in: BMC Medical Informatics and Decision Making | Special Issue 14/2020

Login to get access

Abstract

Background

A various number of imaging modalities are available (e.g., magnetic resonance, x-ray, ultrasound, and biopsy) where each modality can reveal different structural aspects of tissues. However, the analysis of histological slide images that are captured using a biopsy is considered the gold standard to determine whether cancer exists. Furthermore, it can reveal the stage of cancer. Therefore, supervised machine learning can be used to classify histopathological tissues. Several computational techniques have been proposed to study histopathological images with varying levels of success. Often handcrafted techniques based on texture analysis are proposed to classify histopathological tissues which can be used with supervised machine learning.

Methods

In this paper, we construct a novel feature space to automate the classification of tissues in histology images. Our feature representation is to integrate various features sets into a new texture feature representation. All of our descriptors are computed in the complex Shearlet domain. With complex coefficients, we investigate not only the use of magnitude coefficients, but also study the effectiveness of incorporating the relative phase (RP) coefficients to create the input feature vector. In our study, four texture-based descriptors are extracted from the Shearlet coefficients: co-occurrence texture features, Local Binary Patterns, Local Oriented Statistic Information Booster, and segmentation-based Fractal Texture Analysis. Each set of these attributes captures significant local and global statistics. Therefore, we study them individually, but additionally integrate them to boost the accuracy of classifying the histopathology tissues while being fed to classical classifiers. To tackle the problem of high-dimensionality, our proposed feature space is reduced using principal component analysis. In our study, we use two classifiers to indicate the success of our proposed feature representation: Support Vector Machine (SVM) and Decision Tree Bagger (DTB).

Results

Our feature representation delivered high performance when used on four public datasets. As such, the best achieved accuracy: multi-class Kather (i.e., 92.56%), BreakHis (i.e., 91.73%), Epistroma (i.e., 98.04%), Warwick-QU (i.e., 96.29%).

Conclusions

Our proposed method in the Shearlet domain for the classification of histopathological images proved to be effective when it was investigated on four different datasets that exhibit different levels of complexity.
Appendix
Available only for authorised users
Literature
1.
go back to reference Irshad H, Veillard A, Roux L, Racoceanu D. Methods for nuclei detection, segmentation, and classification in digital histopathology: a review–current status and future potential. IEEE Rev Biomed Eng. 2014;7:97–114.CrossRef Irshad H, Veillard A, Roux L, Racoceanu D. Methods for nuclei detection, segmentation, and classification in digital histopathology: a review–current status and future potential. IEEE Rev Biomed Eng. 2014;7:97–114.CrossRef
2.
go back to reference Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A. Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imaging. 2016;35(1):119–30.CrossRef Xu J, Xiang L, Liu Q, Gilmore H, Wu J, Tang J, Madabhushi A. Stacked sparse autoencoder (SSAE) for nuclei detection on breast cancer histopathology images. IEEE Trans Med Imaging. 2016;35(1):119–30.CrossRef
3.
go back to reference Spanhol FA, Oliveira LS, Petitjean C, Heutte L. A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng. 2016;63(7):1455–62.CrossRef Spanhol FA, Oliveira LS, Petitjean C, Heutte L. A dataset for breast cancer histopathological image classification. IEEE Trans Biomed Eng. 2016;63(7):1455–62.CrossRef
4.
go back to reference Kather JN, Weis C-A, Bianconi F, Melchers SM, Schad LR, Gaiser T, Marx A, Zöllner FG. Multi-class texture analysis in colorectal cancer histology. Sci Reports. 2016;6:27988. Kather JN, Weis C-A, Bianconi F, Melchers SM, Schad LR, Gaiser T, Marx A, Zöllner FG. Multi-class texture analysis in colorectal cancer histology. Sci Reports. 2016;6:27988.
5.
go back to reference Linder N, Konsti J, Turkki R, Rahtu E, Lundin M, Nordling S, Haglund C, Ahonen T, Pietikäinen M, Lundin J. Identification of tumor epithelium and stroma in tissue microarrays using texture analysis. Diagn Pathol. 2012;7(1):22.CrossRef Linder N, Konsti J, Turkki R, Rahtu E, Lundin M, Nordling S, Haglund C, Ahonen T, Pietikäinen M, Lundin J. Identification of tumor epithelium and stroma in tissue microarrays using texture analysis. Diagn Pathol. 2012;7(1):22.CrossRef
6.
go back to reference Bruno DOT, do Nascimento MZ, Ramos RP, Batista VR, Neves LA, Martins AS, Lbp operators on curvelet coefficients as an algorithm to describe texture in breast cancer tissues. Expert Syst Appl. 2016;55:329–40. Bruno DOT, do Nascimento MZ, Ramos RP, Batista VR, Neves LA, Martins AS, Lbp operators on curvelet coefficients as an algorithm to describe texture in breast cancer tissues. Expert Syst Appl. 2016;55:329–40.
7.
go back to reference Ribeiro MG, Neves LA, do Nascimento MZ, Roberto GF, Martins AS, Tosta TAA. Classification of colorectal cancer based on the association of multidimensional and multiresolution features. Expert Syst Appl. 2019;120:262–78.CrossRef Ribeiro MG, Neves LA, do Nascimento MZ, Roberto GF, Martins AS, Tosta TAA. Classification of colorectal cancer based on the association of multidimensional and multiresolution features. Expert Syst Appl. 2019;120:262–78.CrossRef
8.
go back to reference Vo AP, Oraintara S, Nguyen TT. Using phase and magnitude information of the complex directional filter bank for texture image retrieval. In: 2007 IEEE International Conference on Image Processing, 2007;4, p. 61. IEEE. Vo AP, Oraintara S, Nguyen TT. Using phase and magnitude information of the complex directional filter bank for texture image retrieval. In: 2007 IEEE International Conference on Image Processing, 2007;4, p. 61. IEEE.
9.
go back to reference He J, Ji H, Yang X. Rotation invariant texture descriptor using local shearlet-based energy histograms. IEEE Signal Process Lett. 2013;20(9):905–8.CrossRef He J, Ji H, Yang X. Rotation invariant texture descriptor using local shearlet-based energy histograms. IEEE Signal Process Lett. 2013;20(9):905–8.CrossRef
10.
go back to reference Zhou S, Shi J, Zhu J, Cai Y, Wang R. Shearlet-based texture feature extraction for classification of breast tumor in ultrasound image. Biomed Signal Process Control. 2013;8(6):688–96.CrossRef Zhou S, Shi J, Zhu J, Cai Y, Wang R. Shearlet-based texture feature extraction for classification of breast tumor in ultrasound image. Biomed Signal Process Control. 2013;8(6):688–96.CrossRef
11.
go back to reference Dong Y, Tao D, Li X, Ma J, Pu J. Texture classification and retrieval using shearlets and linear regression. IEEE Trans Cybernet. 2015;45(3):358–69.CrossRef Dong Y, Tao D, Li X, Ma J, Pu J. Texture classification and retrieval using shearlets and linear regression. IEEE Trans Cybernet. 2015;45(3):358–69.CrossRef
12.
go back to reference Meshkini K, Ghassemian H. Texture classification using Shearlet transform and GLCM. In: 2017 Iranian Conference on Electrical Engineering (ICEE), 2017;1845–1850. IEEE. Meshkini K, Ghassemian H. Texture classification using Shearlet transform and GLCM. In: 2017 Iranian Conference on Electrical Engineering (ICEE), 2017;1845–1850. IEEE.
13.
go back to reference Song Y, Chang, H, Gao Y, Liu S, Zhang D, Yao J, Chrzanowski W, Cai W. Feature learning with component selective encoding for histopathology image classification. In: IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 2018;257–260. IEEE. Song Y, Chang, H, Gao Y, Liu S, Zhang D, Yao J, Chrzanowski W, Cai W. Feature learning with component selective encoding for histopathology image classification. In: IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018), 2018;257–260. IEEE.
14.
go back to reference Gupta V, Bhavsar A. Sequential modeling of deep features for breast cancer histopathological image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018;2254–2261. Gupta V, Bhavsar A. Sequential modeling of deep features for breast cancer histopathological image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2018;2254–2261.
15.
go back to reference Wang C, Shi J, Zhang Q, Ying S. Histopathological image classification with bilinear convolutional neural networks. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017;4050–4053. IEEE. Wang C, Shi J, Zhang Q, Ying S. Histopathological image classification with bilinear convolutional neural networks. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017;4050–4053. IEEE.
16.
go back to reference Alinsaif S, Lang J. Histological image classification using deep features and transfer learning. In: 2020 17th Conference on Computer and Robot Vision (CRV), 2020;101–108. IEEE. Alinsaif S, Lang J. Histological image classification using deep features and transfer learning. In: 2020 17th Conference on Computer and Robot Vision (CRV), 2020;101–108. IEEE.
17.
go back to reference Qu J, Hiruta N, Terai K, Nosato H, Murakawa M, Sakanashi H. Gastric pathology image classification using stepwise fine-tuning for deep neural networks. J Healthc Eng. 2018;2018: Qu J, Hiruta N, Terai K, Nosato H, Murakawa M, Sakanashi H. Gastric pathology image classification using stepwise fine-tuning for deep neural networks. J Healthc Eng. 2018;2018:
18.
go back to reference Therrien R, Doyle S. Role of training data variability on classifier performance and generalizability. In: Medical Imaging 2018: Digital Pathology, vol. 10581, p. 1058109 (2018). International Society for Optics and Photonics. Therrien R, Doyle S. Role of training data variability on classifier performance and generalizability. In: Medical Imaging 2018: Digital Pathology, vol. 10581, p. 1058109 (2018). International Society for Optics and Photonics.
19.
go back to reference Soh L-K, Tsatsoulis C. Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices. IEEE Trans Geosci Remote Sens. 1999;37(2):780–95.CrossRef Soh L-K, Tsatsoulis C. Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices. IEEE Trans Geosci Remote Sens. 1999;37(2):780–95.CrossRef
20.
go back to reference Haralick RM, Shanmugam K. Others: textural features for image classification. IEEE Trans Syst Man Cybern. 1973;6:610–21.CrossRef Haralick RM, Shanmugam K. Others: textural features for image classification. IEEE Trans Syst Man Cybern. 1973;6:610–21.CrossRef
21.
go back to reference Ojala T, Pietikäinen M, Mäenpää T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell. 2002;7:971–87.CrossRef Ojala T, Pietikäinen M, Mäenpää T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans Pattern Anal Mach Intell. 2002;7:971–87.CrossRef
22.
go back to reference García-Olalla O, Alegre E, Fernández-Robles L, González-Castro V. Local oriented statistics information booster (losib) for texture classification. In: 2014 22nd International Conference on Pattern Recognition, 2014;1114–1119. IEEE. García-Olalla O, Alegre E, Fernández-Robles L, González-Castro V. Local oriented statistics information booster (losib) for texture classification. In: 2014 22nd International Conference on Pattern Recognition, 2014;1114–1119. IEEE.
23.
go back to reference Costa AF, Humpire-Mamani G, Traina AJM. An efficient algorithm for fractal analysis of textures. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 39–46 (2012). IEEE. Costa AF, Humpire-Mamani G, Traina AJM. An efficient algorithm for fractal analysis of textures. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 39–46 (2012). IEEE.
24.
go back to reference Kutyniok G, Labate D. Introduction to shearlets. Shearlets. 2012;1–38: Kutyniok G, Labate D. Introduction to shearlets. Shearlets. 2012;1–38:
25.
go back to reference Cristianini N, Shawe-Taylor J, et al. An introduction to support vector machines and other kernel-based learning methods. Cambridge: Cambridge University Press; 2000.CrossRef Cristianini N, Shawe-Taylor J, et al. An introduction to support vector machines and other kernel-based learning methods. Cambridge: Cambridge University Press; 2000.CrossRef
26.
go back to reference Breiman L. Bagging predictors. Mach Learn. 1996;24(2):123–40. Breiman L. Bagging predictors. Mach Learn. 1996;24(2):123–40.
27.
go back to reference Breiman L, Friedman J, Stone CJ, Olshen RA. Classification and regression trees. Baco Raton: CRC Press; 1984. Breiman L, Friedman J, Stone CJ, Olshen RA. Classification and regression trees. Baco Raton: CRC Press; 1984.
28.
go back to reference Došilović FK, Brčić M, Hlupić N. Explainable artificial intelligence: a survey. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2018;0210–0215. IEEE. Došilović FK, Brčić M, Hlupić N. Explainable artificial intelligence: a survey. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), 2018;0210–0215. IEEE.
29.
go back to reference Alinsaif S, Lang J. Shearlet-based techniques for histological image classification. In: 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM); 2019. Alinsaif S, Lang J. Shearlet-based techniques for histological image classification. In: 2019 IEEE International Conference on Bioinformatics and Biomedicine (BIBM); 2019.
30.
go back to reference Jonnalagedda P, Schmolze D, Bhanu B. [regular paper] mvpnets: Multi-viewing path deep learning neural networks for magnification invariant diagnosis in breast cancer. In: 2018 IEEE 18th International Conference on Bioinformatics and Bioengineering (BIBE), 2018;189–194. IEEE. Jonnalagedda P, Schmolze D, Bhanu B. [regular paper] mvpnets: Multi-viewing path deep learning neural networks for magnification invariant diagnosis in breast cancer. In: 2018 IEEE 18th International Conference on Bioinformatics and Bioengineering (BIBE), 2018;189–194. IEEE.
31.
go back to reference Sellaro TL, Filkins R, Hoffman C, Fine JL, Ho J, Parwani AV, Pantanowitz L, Montalto M. Relationship between magnification and resolution in digital pathology systems. J Pathol Inf. 2013;4:21.CrossRef Sellaro TL, Filkins R, Hoffman C, Fine JL, Ho J, Parwani AV, Pantanowitz L, Montalto M. Relationship between magnification and resolution in digital pathology systems. J Pathol Inf. 2013;4:21.CrossRef
32.
go back to reference Sirinukunwattana K, Pluim JP, Chen H, Qi X, Heng P-A, Guo YB, Wang LY, Matuszewski BJ, Bruni E, Sanchez U, et al. Gland segmentation in colon histology images: the glas challenge contest. Med Image Anal. 2017;35:489–502.CrossRef Sirinukunwattana K, Pluim JP, Chen H, Qi X, Heng P-A, Guo YB, Wang LY, Matuszewski BJ, Bruni E, Sanchez U, et al. Gland segmentation in colon histology images: the glas challenge contest. Med Image Anal. 2017;35:489–502.CrossRef
33.
go back to reference Reisenhofer R. The complex shearlet transform and applications to image quality assessment. Master’s thesis, Technische Universität Berlin 2014. Reisenhofer R. The complex shearlet transform and applications to image quality assessment. Master’s thesis, Technische Universität Berlin 2014.
34.
go back to reference Candès EJ, Donoho DL. New tight frames of curvelets and optimal representations of objects with piecewise c2 singularities. Commun Pure Appl Math J Issued Courant Inst Math Sci. 2004;57(2):219–66.CrossRef Candès EJ, Donoho DL. New tight frames of curvelets and optimal representations of objects with piecewise c2 singularities. Commun Pure Appl Math J Issued Courant Inst Math Sci. 2004;57(2):219–66.CrossRef
35.
go back to reference Do MN, Vetterli M. The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process. 2005;14(12):2091–106.CrossRef Do MN, Vetterli M. The contourlet transform: an efficient directional multiresolution image representation. IEEE Trans Image Process. 2005;14(12):2091–106.CrossRef
36.
go back to reference Kutyniok G, Shahram M, Zhuang X. Shearlab: a rational design of a digital parabolic scaling algorithm. SIAM J Imaging Sci. 2012;5(4):1291–332.CrossRef Kutyniok G, Shahram M, Zhuang X. Shearlab: a rational design of a digital parabolic scaling algorithm. SIAM J Imaging Sci. 2012;5(4):1291–332.CrossRef
37.
go back to reference Clausi DA. An analysis of co-occurrence texture statistics as a function of grey level quantization. Can J Remote Sens. 2002;28(1):45–62.CrossRef Clausi DA. An analysis of co-occurrence texture statistics as a function of grey level quantization. Can J Remote Sens. 2002;28(1):45–62.CrossRef
38.
go back to reference Pan Y, Liu L, Yang L, Wang Y. Texture feature extracting method based on local relative phase binary pattern. In: 2016 5th International Conference on Computer Science and Network Technology (ICCSNT), 2016;749–753. IEEE. Pan Y, Liu L, Yang L, Wang Y. Texture feature extracting method based on local relative phase binary pattern. In: 2016 5th International Conference on Computer Science and Network Technology (ICCSNT), 2016;749–753. IEEE.
39.
go back to reference Cai L, Wang X, Wang Y, Guo Y, Yu J, Wang Y. Robust phase-based texture descriptor for classification of breast ultrasound images. Biomed Eng Online. 2015;14(1):26.CrossRef Cai L, Wang X, Wang Y, Guo Y, Yu J, Wang Y. Robust phase-based texture descriptor for classification of breast ultrasound images. Biomed Eng Online. 2015;14(1):26.CrossRef
40.
go back to reference Oppenheim AV, Lim JS. The importance of phase in signals. Proc IEEE. 1981;69(5):529–41.CrossRef Oppenheim AV, Lim JS. The importance of phase in signals. Proc IEEE. 1981;69(5):529–41.CrossRef
41.
go back to reference Harman HH. Modern factor analysis. Chicago: University of Chicago press; 1976. Harman HH. Modern factor analysis. Chicago: University of Chicago press; 1976.
42.
go back to reference Stegmann MB, Sjöstrand K, Larsen R. Sparse modeling of landmark and texture variability using the orthomax criterion. In: Medical Imaging 2006: Image Processing, 2006;6144: 61441. International Society for Optics and Photonics. Stegmann MB, Sjöstrand K, Larsen R. Sparse modeling of landmark and texture variability using the orthomax criterion. In: Medical Imaging 2006: Image Processing, 2006;6144: 61441. International Society for Optics and Photonics.
43.
go back to reference Zanaty E. Support vector machines (svms) versus multilayer perception (mlp) in data classification. Egyptian Inf J. 2012;13(3):177–83.CrossRef Zanaty E. Support vector machines (svms) versus multilayer perception (mlp) in data classification. Egyptian Inf J. 2012;13(3):177–83.CrossRef
44.
go back to reference Hastie T, Tibshirani R. Classification by pairwise coupling. In: Advances in Neural Information Processing Systems, 1998;507–513. Hastie T, Tibshirani R. Classification by pairwise coupling. In: Advances in Neural Information Processing Systems, 1998;507–513.
45.
go back to reference Platt J. Sequential minimal optimization: a fast algorithm for training support vector machines; 1998. Platt J. Sequential minimal optimization: a fast algorithm for training support vector machines; 1998.
46.
go back to reference Friedman J, Hastie T, Tibshirani R. The elements of statistical learning. Berlin: Springer; 2001. Friedman J, Hastie T, Tibshirani R. The elements of statistical learning. Berlin: Springer; 2001.
48.
go back to reference Ramalho GLB, Ferreira DS, Rebouças Filho PP, de Medeiros FNS. Rotation-invariant feature extraction using a structural co-occurrence matrix. Measurement. 2016;94:406–15.CrossRef Ramalho GLB, Ferreira DS, Rebouças Filho PP, de Medeiros FNS. Rotation-invariant feature extraction using a structural co-occurrence matrix. Measurement. 2016;94:406–15.CrossRef
49.
go back to reference Gunning D. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2017;2. Gunning D. Explainable artificial intelligence (xai). Defense Advanced Research Projects Agency (DARPA), nd Web 2017;2.
Metadata
Title
Texture features in the Shearlet domain for histopathological image classification
Authors
Sadiq Alinsaif
Jochen Lang
Publication date
01-12-2020
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s12911-020-01327-3

Other articles of this Special Issue 14/2020

BMC Medical Informatics and Decision Making 14/2020 Go to the issue