Skip to main content
Top
Published in: Journal of Digital Imaging 4/2018

01-08-2018

Rethinking Skin Lesion Segmentation in a Convolutional Classifier

Authors: Jack Burdick, Oge Marques, Janet Weinthal, Borko Furht

Published in: Journal of Imaging Informatics in Medicine | Issue 4/2018

Login to get access

Abstract

Melanoma is a fatal form of skin cancer when left undiagnosed. Computer-aided diagnosis systems powered by convolutional neural networks (CNNs) can improve diagnostic accuracy and save lives. CNNs have been successfully used in both skin lesion segmentation and classification. For reasons heretofore unclear, previous works have found image segmentation to be, conflictingly, both detrimental and beneficial to skin lesion classification. We investigate the effect of expanding the segmentation border to include pixels surrounding the target lesion. Ostensibly, segmenting a target skin lesion will remove inessential information, non-lesion skin, and artifacts to aid in classification. Our results indicate that segmentation border enlargement produces, to a certain degree, better results across all metrics of interest when using a convolutional based classifier built using the transfer learning paradigm. Consequently, preprocessing methods which produce borders larger than the actual lesion can potentially improve classifier performance, more than both perfect segmentation, using dermatologist created ground truth masks, and no segmentation altogether.
Literature
1.
go back to reference Siegel RL, Miller KD, Jemal A: Cancer statistics, 2016. CA: Cancer J Clin 66(1):7–30, 2016 Siegel RL, Miller KD, Jemal A: Cancer statistics, 2016. CA: Cancer J Clin 66(1):7–30, 2016
2.
go back to reference Guy GP, Machlin SR, Ekwueme DU, Yabroff KR: Prevalence and costs of skin cancer treatment in the US, 2002- 2006 and 2007- 2011. Am J Prev Med 48(2):183–187, 2015 Guy GP, Machlin SR, Ekwueme DU, Yabroff KR: Prevalence and costs of skin cancer treatment in the US, 2002- 2006 and 2007- 2011. Am J Prev Med 48(2):183–187, 2015
3.
go back to reference Guy GP Jr, Ekwueme DU: Years of potential life lost and indirect costs of melanoma and non-melanoma skin cancer. Pharmacoeconomics 29(10):863–874, 2011 Guy GP Jr, Ekwueme DU: Years of potential life lost and indirect costs of melanoma and non-melanoma skin cancer. Pharmacoeconomics 29(10):863–874, 2011
4.
go back to reference Nachbar F, Stolz W, Merkle T, Cognetta AB, Vogt T, Landthaler M, Bilek P, Braun Falco O, Plewig G: The ABCD rule of dermatoscopy: high prospective value in the diagnosis of doubtful melanocytic skin lesions. J Am Acad Dermatol 30(4):551–559, 1994CrossRefPubMed Nachbar F, Stolz W, Merkle T, Cognetta AB, Vogt T, Landthaler M, Bilek P, Braun Falco O, Plewig G: The ABCD rule of dermatoscopy: high prospective value in the diagnosis of doubtful melanocytic skin lesions. J Am Acad Dermatol 30(4):551–559, 1994CrossRefPubMed
5.
go back to reference Argenziano G, Fabbrocini G, Carli P, De Giorgi V, Sammarco E, Delfino M: Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions: comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. Arch Dermatol 134(12):1563–1570, 1998CrossRefPubMed Argenziano G, Fabbrocini G, Carli P, De Giorgi V, Sammarco E, Delfino M: Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions: comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. Arch Dermatol 134(12):1563–1570, 1998CrossRefPubMed
6.
go back to reference Henning JS, Dusza SW, Wang SQ, Marghoob AA, Rabinovitz HS, Polsky D, Kopf AW: The CASH (color, architecture, symmetry, and homogeneity) algorithm for dermoscopy. J Am Acad Dermatol 56(1):45–52, 2007CrossRefPubMed Henning JS, Dusza SW, Wang SQ, Marghoob AA, Rabinovitz HS, Polsky D, Kopf AW: The CASH (color, architecture, symmetry, and homogeneity) algorithm for dermoscopy. J Am Acad Dermatol 56(1):45–52, 2007CrossRefPubMed
7.
go back to reference Argenziano G, Soyer HP: Dermoscopy of pigmented skin lesions–a valuable tool for early diagnosis of melanoma. Lancet Oncol 2(7):443–449, 2001CrossRefPubMed Argenziano G, Soyer HP: Dermoscopy of pigmented skin lesions–a valuable tool for early diagnosis of melanoma. Lancet Oncol 2(7):443–449, 2001CrossRefPubMed
8.
go back to reference Kittler H, Pehamberger H, Wolff K, Binder M: Diagnostic accuracy of dermoscopy. Lancet Oncol 3(3):159–165, 2002CrossRefPubMed Kittler H, Pehamberger H, Wolff K, Binder M: Diagnostic accuracy of dermoscopy. Lancet Oncol 3(3):159–165, 2002CrossRefPubMed
9.
go back to reference Vestergaard M, Macaskill P, Holt P, Menzies S: Dermoscopy compared with naked eye examination for the diagnosis of primary melanoma: a meta-analysis of studies performed in a clinical setting. Brit J Dermatol 159(3):669–676, 2008 Vestergaard M, Macaskill P, Holt P, Menzies S: Dermoscopy compared with naked eye examination for the diagnosis of primary melanoma: a meta-analysis of studies performed in a clinical setting. Brit J Dermatol 159(3):669–676, 2008
10.
go back to reference Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118, 2017CrossRefPubMed Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S: Dermatologist-level classification of skin cancer with deep neural networks. Nature 542(7639):115–118, 2017CrossRefPubMed
11.
go back to reference Marques O: Morphological image processing. In: Practical image and video processing using MATLAB. Wiley - IEEE, chap. 13, 2011, pp 299–334 Marques O: Morphological image processing. In: Practical image and video processing using MATLAB. Wiley - IEEE, chap. 13, 2011, pp 299–334
12.
go back to reference Oliveira RB, Mercedes Filho E, Ma Z, Papa JP, Pereira AS, Tavares JMR: Computational methods for the image segmentation of pigmented skin lesions: a review. Comput Methods Programs Biomed 131: 127–141, 2016CrossRefPubMed Oliveira RB, Mercedes Filho E, Ma Z, Papa JP, Pereira AS, Tavares JMR: Computational methods for the image segmentation of pigmented skin lesions: a review. Comput Methods Programs Biomed 131: 127–141, 2016CrossRefPubMed
13.
go back to reference Burdick J, Marques O, Romero Lopez A, Giró Nieto X, Weinthal J: The impact of segmentation on the accuracy and sensitivity of a melanoma classifier based on skin lesion images. In: SIIM (Society for Imaging Informatics in Medicine) 2017 annual meeting. Pittsburgh, 2017, pp 1–6 Burdick J, Marques O, Romero Lopez A, Giró Nieto X, Weinthal J: The impact of segmentation on the accuracy and sensitivity of a melanoma classifier based on skin lesion images. In: SIIM (Society for Imaging Informatics in Medicine) 2017 annual meeting. Pittsburgh, 2017, pp 1–6
14.
go back to reference Codella N, Nguyen QB, Pankanti S, Gutman D, Helba B, Halpern A, Smith JR: Deep learning ensembles for melanoma recognition in dermoscopy images, arXiv:1610.04662, 2016 Codella N, Nguyen QB, Pankanti S, Gutman D, Helba B, Halpern A, Smith JR: Deep learning ensembles for melanoma recognition in dermoscopy images, arXiv:1610.​04662, 2016
15.
go back to reference Kawahara J, BenTaieb A, Hamarneh G: Deep features to classify skin lesions. In: IEEE International symposium on biomedical imaging (IEEE ISBI). Prague, 2016, pp 1397–1400 Kawahara J, BenTaieb A, Hamarneh G: Deep features to classify skin lesions. In: IEEE International symposium on biomedical imaging (IEEE ISBI). Prague, 2016, pp 1397–1400
16.
go back to reference Lopez AR, Giro-i Nieto X, Burdick J, Marques O: Skin lesion classification from dermoscopic images using deep learning techniques.. In: 13th IASTED International conference on biomedical engineering (BioMed). IEEE, Innsbruck, 2017, pp 49– 54 Lopez AR, Giro-i Nieto X, Burdick J, Marques O: Skin lesion classification from dermoscopic images using deep learning techniques.. In: 13th IASTED International conference on biomedical engineering (BioMed). IEEE, Innsbruck, 2017, pp 49– 54
17.
go back to reference Yu L, Chen H, Dou Q, Qin J, Heng PA: Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Trans Med Imaging 36(4):994–1004, 2017CrossRefPubMed Yu L, Chen H, Dou Q, Qin J, Heng PA: Automated melanoma recognition in dermoscopy images via very deep residual networks. IEEE Trans Med Imaging 36(4):994–1004, 2017CrossRefPubMed
18.
go back to reference Jaworek Korjakowska J, Kłeczek P: Automatic classification of specific melanocytic lesions using artificial intelligence. BioMed Res Int, 2016, p 17 Jaworek Korjakowska J, Kłeczek P: Automatic classification of specific melanocytic lesions using artificial intelligence. BioMed Res Int, 2016, p 17
19.
20.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z: Rethinking theInception architecture for computer vision. arXiv:1512.00567, 2016, pp 2818–2826 Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z: Rethinking theInception architecture for computer vision. arXiv:1512.​00567, 2016, pp 2818–2826
21.
go back to reference Deng J, Dong W, Socher R, Li LJ, Li K, Fei Fei L: ImageNet: a large-scale hierarchical image database.. In: 2009 IEEE Conference on computer vision and pattern recognition. IEEE, MIami, 2009, pp 248–255 Deng J, Dong W, Socher R, Li LJ, Li K, Fei Fei L: ImageNet: a large-scale hierarchical image database.. In: 2009 IEEE Conference on computer vision and pattern recognition. IEEE, MIami, 2009, pp 248–255
23.
go back to reference Yosinski J, Clune J, Bengio Y, Lipson H: How transferable are features in deep neural networks?. In: Advances in neural information processing systems. Curran Associates, Inc., New York, 2014, pp 3320–3328 Yosinski J, Clune J, Bengio Y, Lipson H: How transferable are features in deep neural networks?. In: Advances in neural information processing systems. Curran Associates, Inc., New York, 2014, pp 3320–3328
24.
go back to reference Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks.. In: Advances in neural information processing systems, vol 25. Curran Associates, Inc., New York, 2012, pp 1097–1105 Krizhevsky A, Sutskever I, Hinton GE: ImageNet classification with deep convolutional neural networks.. In: Advances in neural information processing systems, vol 25. Curran Associates, Inc., New York, 2012, pp 1097–1105
Metadata
Title
Rethinking Skin Lesion Segmentation in a Convolutional Classifier
Authors
Jack Burdick
Oge Marques
Janet Weinthal
Borko Furht
Publication date
01-08-2018
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 4/2018
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-017-0026-y

Other articles of this Issue 4/2018

Journal of Digital Imaging 4/2018 Go to the issue