Skip to main content
Key Specialties
Cardiology Diabetology Endocrinology Gastroenterology Geriatrics and Gerontology Gynecology and Obstetrics Hematology Infectious Disease Internal Medicine Nephrology Neurology Oncology Pediatrics Respiratory Medicine Rheumatology Surgery
Congress Coverage
2024 ACC Congress 2023 ESMO Congress 2023 EASD Congress 2023 ERS Congress 2023 ESC Congress 2023 EHA Congress 2023 ASCO Annual Meeting
Clinical Collections
Advances in Alzheimer’s

Keynote webinar | Spotlight on sleep in brain health

LIVE: Thursday 2nd May 2024, 18:00-19:30 (CEST)

Quality sleep is essential for health. But what happens to our brains when sleep patterns are disturbed? Join our experts to explore the interplay between sleep disruption and neurological diseases, and the questions that you need to be asking your patients to help you prevent the harmful effects of sleep deprivation.
ADVANCED SEARCH
Log in
Top
BMC Medical Imaging
Published in: BMC Medical Imaging 1/2019

Open Access 01-12-2019 | Ultrasound | Research article

An experimental study on breast lesion detection and classification from ultrasound images using deep learning architectures

Authors: Zhantao Cao, Lixin Duan, Guowu Yang, Ting Yue, Qin Chen

Published in: BMC Medical Imaging | Issue 1/2019

Login to get access

Abstract

Background

Computer-aided diagnosis (CAD) in the medical field has received more and more attention in recent years. One important CAD application is to detect and classify breast lesions in ultrasound images. Traditionally, the process of CAD for breast lesions classification is mainly composed of two separated steps: i) locate the lesion region of interests (ROI); ii) classify the located region of interests (ROI) to see if they are benign or not. However, due to the complex structure of breast and the existence of noise in the ultrasound images, traditional handcrafted feature based methods usually can not achieve satisfactory result.

Methods

With the recent advance of deep learning, the performance of object detection and classification has been boosted to a great extent. In this paper, we aim to systematically evaluate the performance of several existing state-of-the-art object detection and classification methods for breast lesions CAD. To achieve that, we have collected a new dataset consisting of 579 benign and 464 malignant lesion cases with the corresponding ultrasound images manually annotated by experienced clinicians. We evaluate different deep learning architectures and conduct comprehensive experiments on our newly collected dataset.

Results

For the lesion regions detecting task, Single Shot MultiBox Detector with the input size as 300×300 (SSD300) achieves the best performance in terms of average precision rate (APR), average recall rate (ARR) and F1 score. For the classification task, DenseNet is more suitable for our problems.

Conclusions

Our experiments reveal that better and more efficient detection and convolutional neural network (CNN) frameworks is one important factor for better performance of detecting and classification task of the breast lesion. Another significant factor for improving the performance of detecting and classification task, which is transfer learning from the large-scale annotated ImageNet to classify breast lesion.
Literature
1.
Cheng HD, Shan J, Ju W, Guo YH, Zhang L. Automated breast cancer detection and classification using ultrasound images: A survey. Pattern Recog. 2010; 43:299–317.CrossRef
2.
Zhang H, Wang KF, Wang FY. Advances and Perspectives on Applications of Deep Learning in Visual Object Detection. Acta Automatica Sinica. 2017; 43:1289–305.
3.
Huang KQ, Ren WQ, Tan TN. A review on image object classification and detection. Chinese J Comput. 2014; 37:1225–40.
4.
5.
Lowe DG. Distinctive image features from scale-invariant keypoints. Int J Comput Vision. 2004; 60:91–110.CrossRef
6.
Dalal N, Triggs B. Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. San Diego: IEEE: 2005. p. 886–93.
7.
Ojala T, Pietikäinen M, Harwood D. Performance evaluation of texture measures with classification based on Kullback discrimination of distributions. In: Proceedings of 12th International Conference on Pattern Recognition (ICPR). Jerusalem: IEEE: 1994. p. 582–5.
8.
Ojala T, Pietikäinen M, Harwood D. A Comparative Study of Texture Measures with Classification Based on Feature Distributions. Pattern Recog. 1996; 29:51–9.CrossRef
9.
Felzenszwalb P, McAllester D, Ramaman D. A Discriminatively Trained and Multiscale: Deformable Part Model. In: CVPR: 2008. p. 1–8.
10.
Felzenszwalb PF, Girshick RB, McAllester D, Ramanan D. Object detection with discriminatively trained part-based models. IEEE Trans Pattern Anal Mach Intell. 2010; 32:1627–45.CrossRef
11.
Munozmeza C, Gomez C. A feature selection methodology for breast ultrasound classification. In: International conference on electrical engineering, computing science and automatic control. Mexico City: IEEE: 2013. p. 245–9.
12.
Gomez W, Rodriguez A, Pereira WCA, Infantosi AFC. Feature selection and classifier performance in computer-aided diagnosis for breast ultrasound. In: 2013 10th International Conference and Expo on Emerging Technologies for a Smarter World (CEWIT): 2013. p. 713755. https://​doi.​org/​10.​1109/​CEWIT.​2013.​6X00000.
13.
14.
15.
Bhusri S, Jain S, Virmani J. Classification of Breast Lesions based on Laws’ Feature Extraction Techniques. In: 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom). New Delhi: IEEE: 2016. p. 1700–4.
16.
Ren XF, Ramanan D. Histograms of Sparse Codes for Object Detection. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Portland: IEEE: 2013. p. 1–8.
17.
Ren HY, Li ZN. Object Detection Using Generalization and Efficiency Balanced Co-Occurrence Features. In: 2015 IEEE International Conference on Computer Vision (ICCV). Santiago: IEEE: 2015. p. 46–54.
18.
Su YN, Wang YY. Automatic detection of the region of interest from breast tumor ultrasound image. Chinese J Biomed Eng. 2010; 29:178–184.
19.
Shan J, Cheng HD, Wang XY. Completely automated segmentation approach for breast ultrasound images using multiple-domain features. Ultrasound Med Biol. 2012; 38:262–75.CrossRef
20.
Liu B, Cheng HD, Huang JH, Tian JW, Tang XL, Liu JF. Fully automatic and segmentation-robust classification of breast tumors based on local texture analysis of ultrasound images. Pattern Recog. 2010; 43:280–98.CrossRef
21.
Xian M, Zhang YT, Cheng HD. Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains. Pattern Recog. 2015; 48:485–97.CrossRef
22.
Girshick R. Fast R-CNN. In: IEEE International Conference on Computer Vision. Santiago: IEEE: 2015. p. 1440–8.
23.
Ren SQ, He K, Girshick R, Sun J. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. In: The 28th International Conference on Neural Information Processing Systems (NIPS). Montreal: NIPS: 2015. p. 91–9.
24.
Redmon J, Divvala S, Girshick R, Farhadi A. You Only Look Once: Unified, Real-Time Object Detection. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE: 2016. p. 779–88.
25.
26.
Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu CY, et al.SSD: Single Shot MultiBox Detector. In: The 14th European Conference on Computer Vision (ECCV2016). Amsterdam: Springer: 2016. p. 21–37.
27.
Krizhevsky A, Sutskever L, Hinton GE. Imagenet classification with deep convolutional neural networks. Neural Inf Process Syst. 2012; 60:1097–105.
28.
Zeiler MD, Fergus R. 2014 Visualizing and Understanding Convolutional Networks. In: European Conference on Computer Vision (ECCV). Zurich: Springer: 2014. p. 818–33.
29.
30.
He K, Zhang XY, Ren SQ, Sun J. Deep Residual Learning for Image Recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas: IEEE: 2016. p. 770–8.
31.
Szegedy C, Liu W, Jia Y, Sermanet P, Anguelov D, Erhan D, et al.Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston: IEEE: 2015. p. 1–9.
32.
Huang G, Liu Z, Weinberger KQ, Maaten LVD. Densely connected convolutional network. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE: 2017. p. 2261–9.
33.
Akselrodballin A, Karlinsky L, Alpert S, Hasoul S, Benari R, Barkan E. A Region Based Convolutional Network for Tumor Detection and Classification in Breast Mammography. In: Deep Learning and Data Labeling for Medical Applications. Athens: Springer: 2016. p. 197–205.
34.
Cao ZT, Duan LX, Yang GW, Yue T, Chen Q, Fu HZ, et al.Breast Tumor Detection in Ultrasound Images Using Deep Learning. In: International Workshop on Patch-based Techniques in Medical Imaging (Patch-MI 2017). Quebec City: Springer: 2017. p. 121–128.
35.
36.
Girshick R, Donahue J, Darrell T, Malik J. Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. In: 2014 IEEE Conference on Computer. Honolulu: IEEE; 2014. pp. 580–7.
37.
He K, Zhang XY, Ren SQ, Sun J. Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition. IEEE Trans Pattern Anal Mach Intell. 2015; 37:1904–16.CrossRef
38.
Redmon J, Farhadi A. YOLO9000: Better, Faster, Stronger. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Honolulu: IEEE: 2017. p. 6517–25.
Metadata
Title
An experimental study on breast lesion detection and classification from ultrasound images using deep learning architectures
Authors
Zhantao Cao
Lixin Duan
Guowu Yang
Ting Yue
Qin Chen
Publication date
01-12-2019
Publisher
BioMed Central
Published in
BMC Medical Imaging / Issue 1/2019
Electronic ISSN: 1471-2342
DOI
https://doi.org/10.1186/s12880-019-0349-x

Other articles of this Issue 1/2019

BMC Medical Imaging 1/2019 Go to the issue

Technical advance

HF-SENSE: an improved partially parallel imaging using a high-pass filter

Research article

Potential use of a diluted high-relaxivity gadolinium-based intra-articular contrast agent for magnetic resonance arthrography: an in-vitro study

Research article

Assessment the reliability of ultrasonography in the imaging of the plantar fascia: a comparative study

Correction

Correction to: Performance of a feature-based algorithm for 3D-3D registration of CT angiography to cone-beam CT for endovascular repair of complex abdominal aortic aneurysms

Research article

Repeatability and reproducibility of cerebral 23Na imaging in healthy subjects

Research article

Automated detection of nonmelanoma skin cancer using digital images: a systematic review