Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 2/2018

Open Access 01-07-2018 | Research

Towards improving diagnosis of skin diseases by combining deep neural network and human knowledge

Authors: Xinyuan Zhang, Shiqi Wang, Jie Liu, Cui Tao

Published in: BMC Medical Informatics and Decision Making | Special Issue 2/2018

Login to get access

Abstract

Background

The emergence of the deep convolutional neural network (CNN) greatly improves the quality of computer-aided supporting systems. However, due to the challenges of generating reliable and timely results, clinical adoption of computer-aided diagnosis systems is still limited. Recent informatics research indicates that machine learning algorithms need to be combined with sufficient clinical expertise in order to achieve an optimal result.

Methods

In this research, we used deep learning algorithms to help diagnose four common cutaneous diseases based on dermoscopic images. In order to facilitate decision-making and improve the accuracy of our algorithm, we summarized classification/diagnosis scenarios based on domain expert knowledge and semantically represented them in a hierarchical structure.

Results

Our algorithm achieved an accuracy of 87.25 ± 2.24% in our test dataset with 1067 images. The semantic summarization of diagnosis scenarios can help further improve the algorithm to facilitate future computer-aided decision support.

Conclusions

In this paper, we applied deep neural network algorithm to classify dermoscopic images of four common skin diseases and archived promising results. Based on the results, we further summarized the diagnosis/classification scenarios, which reflect the importance of combining the efforts of both human expertise and computer algorithms in dermatologic diagnoses.
Literature
1.
go back to reference Masood A, Ali Al-Jumaily A. Computer aided diagnostic support system for skin cancer: a review of techniques and algorithms. Int J Biomed Imaging. 2013;2013 Masood A, Ali Al-Jumaily A. Computer aided diagnostic support system for skin cancer: a review of techniques and algorithms. Int J Biomed Imaging. 2013;2013
2.
go back to reference Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–8.CrossRefPubMed Esteva A, Kuprel B, Novoa RA, Ko J, Swetter SM, Blau HM, Thrun S. Dermatologist-level classification of skin cancer with deep neural networks. Nature. 2017;542(7639):115–8.CrossRefPubMed
3.
go back to reference Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst. 2012;25:1097–105. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst. 2012;25:1097–105.
4.
go back to reference Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. Proc. 32nd. Int Conference on Machine Learning. 2015:448–56. Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift. Proc. 32nd. Int Conference on Machine Learning. 2015:448–56.
5.
go back to reference Szegedy C, et al. Going deeper with convolutions. Proc IEEE Conference on Computer Vision and Pattern Recognition. 2015:1–9. Szegedy C, et al. Going deeper with convolutions. Proc IEEE Conference on Computer Vision and Pattern Recognition. 2015:1–9.
6.
go back to reference Ramlakhan K, Shang Y. A mobile automated skin lesion classification system. 23rd IEEE International Conference on Tools with Artificial Intelligence (ICTAI). 2011:138–41. Ramlakhan K, Shang Y. A mobile automated skin lesion classification system. 23rd IEEE International Conference on Tools with Artificial Intelligence (ICTAI). 2011:138–41.
7.
go back to reference He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778); 2016. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778); 2016.
8.
go back to reference Rosado, B. et al. Accuracy of computer diagnosis of melanoma: a quantitative meta-analysis. Arch Dermatol 139, 361–367, discussion 366 (2003). Rosado, B. et al. Accuracy of computer diagnosis of melanoma: a quantitative meta-analysis. Arch Dermatol 139, 361–367, discussion 366 (2003).
9.
go back to reference Burroni M, et al. Melanoma computer-aided diagnosis: reliability and feasibility study. Clin Cancer Res. 2004;10:1881–6.CrossRefPubMed Burroni M, et al. Melanoma computer-aided diagnosis: reliability and feasibility study. Clin Cancer Res. 2004;10:1881–6.CrossRefPubMed
10.
go back to reference Li B, Meng MQH. Computer-aided detection of bleeding regions for capsule endoscopy images. IEEE Trans Biomed Eng. 2009;56(4):1032–9.CrossRefPubMed Li B, Meng MQH. Computer-aided detection of bleeding regions for capsule endoscopy images. IEEE Trans Biomed Eng. 2009;56(4):1032–9.CrossRefPubMed
11.
go back to reference Woods DD. Cognitive technologies: the design of joint human-machine cognitive systems. AI Mag. 1985;6(4):86. Woods DD. Cognitive technologies: the design of joint human-machine cognitive systems. AI Mag. 1985;6(4):86.
12.
go back to reference Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, et al. Human-level control through deep reinforcement learning. Nature. 2015;518(7540):529–33.CrossRefPubMed Mnih V, Kavukcuoglu K, Silver D, Rusu AA, Veness J, Bellemare MG, et al. Human-level control through deep reinforcement learning. Nature. 2015;518(7540):529–33.CrossRefPubMed
13.
go back to reference Zhang, X., Wang, S., Liu, L. & Tao, C. Computer-aided diagnosis of four common cutaneous diseases using deep learning algorithm. 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Kansas City, MO, USA, pp. 1304–1306 (2017). Zhang, X., Wang, S., Liu, L. & Tao, C. Computer-aided diagnosis of four common cutaneous diseases using deep learning algorithm. 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), Kansas City, MO, USA, pp. 1304–1306 (2017).
14.
go back to reference Hauschild A, Egberts F, Garbe C, Bauer J, Grabbe S, Hamm H, Schlaeger M. Melanocytic nevi. JDDG: Journal der Deutschen Dermatologischen Gesellschaft. 2011;9(9):723–34.PubMed Hauschild A, Egberts F, Garbe C, Bauer J, Grabbe S, Hamm H, Schlaeger M. Melanocytic nevi. JDDG: Journal der Deutschen Dermatologischen Gesellschaft. 2011;9(9):723–34.PubMed
15.
go back to reference Braun RP, Ludwig S, Marghoob AA. Differential diagnosis of seborrheic keratosis: clinical and Dermoscopic features[J]. J Drugs Dermatol. 2017;16(9):835–42.PubMed Braun RP, Ludwig S, Marghoob AA. Differential diagnosis of seborrheic keratosis: clinical and Dermoscopic features[J]. J Drugs Dermatol. 2017;16(9):835–42.PubMed
16.
go back to reference Scalvenzi M, Lembo S, Francia MG, Balato A. Dermoscopic patterns of superficial basal cell carcinoma. Int J Dermatol. 2008;47(10):1015–8.CrossRefPubMed Scalvenzi M, Lembo S, Francia MG, Balato A. Dermoscopic patterns of superficial basal cell carcinoma. Int J Dermatol. 2008;47(10):1015–8.CrossRefPubMed
17.
go back to reference Armstrong AW. Psoriasis. Jama Dermatology Patient Page. JAMA Dermatology September. 2017;153(9):2017. Armstrong AW. Psoriasis. Jama Dermatology Patient Page. JAMA Dermatology September. 2017;153(9):2017.
18.
go back to reference Weenig RH, Davis MD, Dahl PR, Su WD. Skin ulcers misdiagnosed as pyoderma gangrenosum. N Engl J Med. 2002;347(18):1412–8.CrossRefPubMed Weenig RH, Davis MD, Dahl PR, Su WD. Skin ulcers misdiagnosed as pyoderma gangrenosum. N Engl J Med. 2002;347(18):1412–8.CrossRefPubMed
19.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818–2826); 2016. Szegedy C, Vanhoucke V, Ioffe S, Shlens J, Wojna Z. Rethinking the inception architecture for computer vision. In: Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 2818–2826); 2016.
20.
go back to reference Waxman SG. Chapter 2. Development and cellular constituents of the nervous system. Clinical neuroanatomy. 26th. New York: McGraw-Hill; 2010. Waxman SG. Chapter 2. Development and cellular constituents of the nervous system. Clinical neuroanatomy. 26th. New York: McGraw-Hill; 2010.
21.
go back to reference Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems (pp. 1097–1105); 2012. Krizhevsky A, Sutskever I, Hinton GE. Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems (pp. 1097–1105); 2012.
22.
go back to reference LeCun Y, Bengio Y. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks. 1995;3361(10):1995. LeCun Y, Bengio Y. Convolutional networks for images, speech, and time series. The handbook of brain theory and neural networks. 1995;3361(10):1995.
23.
go back to reference Egmont-Petersen M, de Ridder D, Handels H. Image processing with neural networks—a review. Pattern Recogn. 2002;35(10):2279–301.CrossRef Egmont-Petersen M, de Ridder D, Handels H. Image processing with neural networks—a review. Pattern Recogn. 2002;35(10):2279–301.CrossRef
25.
go back to reference Panchal G, Ganatra A, Kosta YP, Panchal D. Behaviour analysis of multilayer perceptronswith multiple hidden neurons and hidden layers. Int J Computer Theory and Engineering. 2011;3(2):332.CrossRef Panchal G, Ganatra A, Kosta YP, Panchal D. Behaviour analysis of multilayer perceptronswith multiple hidden neurons and hidden layers. Int J Computer Theory and Engineering. 2011;3(2):332.CrossRef
26.
go back to reference Minagawa A. Dermoscopy–pathology relationship in seborrheic keratosis. J Dermatol. 2017;44(5):518–24.CrossRefPubMed Minagawa A. Dermoscopy–pathology relationship in seborrheic keratosis. J Dermatol. 2017;44(5):518–24.CrossRefPubMed
27.
go back to reference Abbas Q, Celebi ME, García IF. Hair removal methods: a comparative study for dermoscopy images. Biomedical Signal Processing and Control. 2011;6(4):395–404.CrossRef Abbas Q, Celebi ME, García IF. Hair removal methods: a comparative study for dermoscopy images. Biomedical Signal Processing and Control. 2011;6(4):395–404.CrossRef
28.
go back to reference Jamil U, Khalid S, Akram MU. Digital image preprocessing and hair artifact removal by using Gabor wavelet. In: SoC design conference (ISOCC), 2016 international (pp. 215–216). IEEE; 2016. Jamil U, Khalid S, Akram MU. Digital image preprocessing and hair artifact removal by using Gabor wavelet. In: SoC design conference (ISOCC), 2016 international (pp. 215–216). IEEE; 2016.
29.
go back to reference George Y, Aldeen M, Garnavi R. Skin hair removal for 2D psoriasis images. In: Digital image computing: techniques and applications (DICTA), 2015 international conference on (pp. 1–8). IEEE; 2015. George Y, Aldeen M, Garnavi R. Skin hair removal for 2D psoriasis images. In: Digital image computing: techniques and applications (DICTA), 2015 international conference on (pp. 1–8). IEEE; 2015.
30.
go back to reference Kricker A, Armstrong BK, English DR, Heenan PJ. Does intermittent sun exposure cause basal cell carcinoma? A case-control study in Western Australia. Int J Cancer. 1995;60(4):489–94.CrossRefPubMed Kricker A, Armstrong BK, English DR, Heenan PJ. Does intermittent sun exposure cause basal cell carcinoma? A case-control study in Western Australia. Int J Cancer. 1995;60(4):489–94.CrossRefPubMed
Metadata
Title
Towards improving diagnosis of skin diseases by combining deep neural network and human knowledge
Authors
Xinyuan Zhang
Shiqi Wang
Jie Liu
Cui Tao
Publication date
01-07-2018
Publisher
BioMed Central
DOI
https://doi.org/10.1186/s12911-018-0631-9

Other articles of this Special Issue 2/2018

BMC Medical Informatics and Decision Making 2/2018 Go to the issue