Skip to main content
Top
Published in: Abdominal Radiology 2/2024

Open Access 12-01-2024 | Technical

Analysis of neural networks for routine classification of sixteen ultrasound upper abdominal cross sections

Authors: Alistair Lawley, Rory Hampson, Kevin Worrall, Gordon Dobie

Published in: Abdominal Radiology | Issue 2/2024

Login to get access

Abstract

Purpose

Abdominal ultrasound screening requires the capture of multiple standardized plane views as per clinical guidelines. Currently, the extent of adherence to such guidelines is dependent entirely on the skills of the sonographer. The use of neural network classification has the potential to better standardize captured plane views and streamline plane capture reducing the time burden on operators by combatting operator variability.

Methods

A dataset consisting of 16 routine upper abdominal ultrasound scans from 64 patients was used to test the classification accuracy of 9 neural networks. These networks were tested on both a small, idealised subset of 800 samples as well as full video sweeps of the region of interest using stratified sampling and transfer learning.

Results

The highest validation accuracy attained by both GoogLeNet and InceptionV3 is 83.9% using transfer learning and the large sample set of 26,294 images. A top-2 accuracy of 95.1% was achieved using InceptionV3. Alexnet attained the highest accuracy of 79.5% (top-2 of 91.5%) for the smaller sample set of 800 images. The neural networks evaluated during this study were also successfully able to identify problematic individual cross sections such as between kidneys, with right and left kidney being accurately identified 78.6% and 89.7%, respectively.

Conclusion

Dataset size proved a more important factor in determining accuracy than network selection with more complex neural networks providing higher accuracy as dataset size increases and simpler linear neural networks providing better results where the dataset is small.
Literature
1.
go back to reference Levin DC, Rao VM (2016) Factors that will determine future utilization trends in diagnostic imaging. Journal of the American College of Radiology 13:904-908CrossRefPubMed Levin DC, Rao VM (2016) Factors that will determine future utilization trends in diagnostic imaging. Journal of the American College of Radiology 13:904-908CrossRefPubMed
3.
go back to reference Shung KK (2011) Diagnostic ultrasound: Past, present, and future. J Med Biol Eng 31:371-374CrossRef Shung KK (2011) Diagnostic ultrasound: Past, present, and future. J Med Biol Eng 31:371-374CrossRef
4.
go back to reference Stewart KA, Navarro SM, Kambala S, et al (2020) Trends in ultrasound use in low and middle income countries: a systematic review. International Journal of Maternal and Child Health and AIDS 9:103PubMedPubMedCentral Stewart KA, Navarro SM, Kambala S, et al (2020) Trends in ultrasound use in low and middle income countries: a systematic review. International Journal of Maternal and Child Health and AIDS 9:103PubMedPubMedCentral
5.
go back to reference Naomi C (2004) Strategies for eliminating the sonographer shortage: Recruitment, retention, and educational perspectives. Journal of Diagnostic Medical Sonography 20:408-413CrossRef Naomi C (2004) Strategies for eliminating the sonographer shortage: Recruitment, retention, and educational perspectives. Journal of Diagnostic Medical Sonography 20:408-413CrossRef
6.
go back to reference Parker P, Harrison G (2015) Educating the future sonographic workforce: Membership survey report from the British Medical Ultrasound Society. Ultrasound 23:231-241CrossRefPubMedPubMedCentral Parker P, Harrison G (2015) Educating the future sonographic workforce: Membership survey report from the British Medical Ultrasound Society. Ultrasound 23:231-241CrossRefPubMedPubMedCentral
7.
go back to reference Chan L, Fung T, Leung T, et al (2009) Volumetric (3D) imaging reduces inter‐and intraobserver variation of fetal biometry measurements. Ultrasound in Obstetrics and Gynecology: The Official Journal of the International Society of Ultrasound in Obstetrics and Gynecology 33:447-452CrossRefPubMed Chan L, Fung T, Leung T, et al (2009) Volumetric (3D) imaging reduces inter‐and intraobserver variation of fetal biometry measurements. Ultrasound in Obstetrics and Gynecology: The Official Journal of the International Society of Ultrasound in Obstetrics and Gynecology 33:447-452CrossRefPubMed
9.
go back to reference Coffin CT (2014) Work-related musculoskeletal disorders in sonographers: a review of causes and types of injury and best practices for reducing injury risk. Reports in Medical Imaging:15–26 Coffin CT (2014) Work-related musculoskeletal disorders in sonographers: a review of causes and types of injury and best practices for reducing injury risk. Reports in Medical Imaging:15–26
10.
go back to reference Koski JM (2000) Ultrasound guided injections in rheumatology. The Journal of rheumatology 27:2131-2138PubMed Koski JM (2000) Ultrasound guided injections in rheumatology. The Journal of rheumatology 27:2131-2138PubMed
11.
go back to reference Marhofer P, Harrop-Griffiths W, Kettner S, et al (2010) Fifteen years of ultrasound guidance in regional anaesthesia: part 1. British journal of anaesthesia 104:538-546CrossRefPubMed Marhofer P, Harrop-Griffiths W, Kettner S, et al (2010) Fifteen years of ultrasound guidance in regional anaesthesia: part 1. British journal of anaesthesia 104:538-546CrossRefPubMed
12.
go back to reference Litjens G, Kooi T, Bejnordi BE, et al (2017) A survey on deep learning in medical image analysis. Medical image analysis 42:60-88CrossRefPubMed Litjens G, Kooi T, Bejnordi BE, et al (2017) A survey on deep learning in medical image analysis. Medical image analysis 42:60-88CrossRefPubMed
13.
go back to reference Kinsler LE, Frey AR, Coppens AB, et al (1999) Fundamentals of acoustics. Kinsler LE, Frey AR, Coppens AB, et al (1999) Fundamentals of acoustics.
14.
go back to reference Hindi A, Peterson C, Barr RG (2013) Artifacts in diagnostic ultrasound. Reports in Medical Imaging 6:29-48 Hindi A, Peterson C, Barr RG (2013) Artifacts in diagnostic ultrasound. Reports in Medical Imaging 6:29-48
16.
go back to reference Wu K, Chen X, Ding M (2014) Deep learning based classification of focal liver lesions with contrast-enhanced ultrasound. Optik 125:4057-4063CrossRef Wu K, Chen X, Ding M (2014) Deep learning based classification of focal liver lesions with contrast-enhanced ultrasound. Optik 125:4057-4063CrossRef
17.
go back to reference Han S, Kang H-K, Jeong J-Y, et al (2017) A deep learning framework for supporting the classification of breast lesions in ultrasound images. Physics in Medicine & Biology 62:7714CrossRef Han S, Kang H-K, Jeong J-Y, et al (2017) A deep learning framework for supporting the classification of breast lesions in ultrasound images. Physics in Medicine & Biology 62:7714CrossRef
18.
go back to reference Chi J, Walia E, Babyn P, et al (2017) Thyroid nodule classification in ultrasound images by fine-tuning deep convolutional neural network. Journal of digital imaging 30:477-486CrossRefPubMedPubMedCentral Chi J, Walia E, Babyn P, et al (2017) Thyroid nodule classification in ultrasound images by fine-tuning deep convolutional neural network. Journal of digital imaging 30:477-486CrossRefPubMedPubMedCentral
19.
go back to reference Guo M, Du Y (2019) Classification of Thyroid Ultrasound Standard Plane Images using ResNet-18 Networks. IEEE,324–328 Guo M, Du Y (2019) Classification of Thyroid Ultrasound Standard Plane Images using ResNet-18 Networks. IEEE,324–328
20.
go back to reference Reddy DS, Bharath R, Rajalakshmi P (2018) A novel computer-aided diagnosis framework using deep learning for classification of fatty liver disease in ultrasound imaging. IEEE,1–5 Reddy DS, Bharath R, Rajalakshmi P (2018) A novel computer-aided diagnosis framework using deep learning for classification of fatty liver disease in ultrasound imaging. IEEE,1–5
21.
go back to reference Sabih D, Hussain M (2012) Automated classification of liver disorders using ultrasound images. Journal of medical systems 36:3163-3172CrossRefPubMed Sabih D, Hussain M (2012) Automated classification of liver disorders using ultrasound images. Journal of medical systems 36:3163-3172CrossRefPubMed
22.
go back to reference Pesteie M, Abolmaesumi P, Ashab HA-D, et al (2015) Real-time ultrasound image classification for spine anesthesia using local directional Hadamard features. International journal of computer assisted radiology and surgery 10:901-912CrossRefPubMed Pesteie M, Abolmaesumi P, Ashab HA-D, et al (2015) Real-time ultrasound image classification for spine anesthesia using local directional Hadamard features. International journal of computer assisted radiology and surgery 10:901-912CrossRefPubMed
23.
go back to reference Zhu P, Li Z (2016) Guideline-based machine learning for standard plane extraction in 3D cardiac ultrasound Zhu P, Li Z (2016) Guideline-based machine learning for standard plane extraction in 3D cardiac ultrasound
24.
go back to reference Gao Y, Zhu Y, Liu B, et al (2020) Automated recognition of ultrasound cardiac views based on deep learning with graph constraint. medRxiv Gao Y, Zhu Y, Liu B, et al (2020) Automated recognition of ultrasound cardiac views based on deep learning with graph constraint. medRxiv
25.
go back to reference Morioka C, Meng F, Taira R, et al (2016) Automatic classification of ultrasound screening examinations of the abdominal aorta. Journal of digital imaging 29:742-748CrossRefPubMedPubMedCentral Morioka C, Meng F, Taira R, et al (2016) Automatic classification of ultrasound screening examinations of the abdominal aorta. Journal of digital imaging 29:742-748CrossRefPubMedPubMedCentral
26.
go back to reference Cheng PM, Malhi HS (2017) Transfer learning with convolutional neural networks for classification of abdominal ultrasound images. Journal of digital imaging 30:234-243CrossRefPubMed Cheng PM, Malhi HS (2017) Transfer learning with convolutional neural networks for classification of abdominal ultrasound images. Journal of digital imaging 30:234-243CrossRefPubMed
27.
go back to reference Russakovsky O, Deng J, Su H, et al (2015) Imagenet large scale visual recognition challenge. International journal of computer vision 115:211-252CrossRef Russakovsky O, Deng J, Su H, et al (2015) Imagenet large scale visual recognition challenge. International journal of computer vision 115:211-252CrossRef
28.
go back to reference Xu Z, Huo Y, Park J, et al (2018) Less is more: Simultaneous view classification and landmark detection for abdominal ultrasound images. Springer,711–719 Xu Z, Huo Y, Park J, et al (2018) Less is more: Simultaneous view classification and landmark detection for abdominal ultrasound images. Springer,711–719
29.
go back to reference Reddy DS, Rajalakshmi P, Mateen M (2021) A deep learning based approach for classification of abdominal organs using ultrasound images. Biocybernetics and Biomedical Engineering 41:779-791CrossRef Reddy DS, Rajalakshmi P, Mateen M (2021) A deep learning based approach for classification of abdominal organs using ultrasound images. Biocybernetics and Biomedical Engineering 41:779-791CrossRef
32.
go back to reference Mildenberger P, Eichelberg M, Martin E (2002) Introduction to the DICOM standard. European radiology 12:920-927CrossRefPubMed Mildenberger P, Eichelberg M, Martin E (2002) Introduction to the DICOM standard. European radiology 12:920-927CrossRefPubMed
33.
go back to reference Paszke A, Gross S, Chintala S, et al (2017) Automatic differentiation in pytorch. Paszke A, Gross S, Chintala S, et al (2017) Automatic differentiation in pytorch.
34.
go back to reference Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25:1097-1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Advances in neural information processing systems 25:1097-1105
35.
go back to reference Krizhevsky A (2014) One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:14045997 Krizhevsky A (2014) One weird trick for parallelizing convolutional neural networks. arXiv preprint arXiv:14045997
36.
go back to reference Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556 Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556
37.
go back to reference He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition.770–778 He K, Zhang X, Ren S, et al (2016) Deep residual learning for image recognition.770–778
38.
go back to reference Szegedy C, Liu W, Jia Y, et al (2015) Going deeper with convolutions.1–9 Szegedy C, Liu W, Jia Y, et al (2015) Going deeper with convolutions.1–9
39.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, et al (2016) Rethinking the inception architecture for computer vision.2818–2826 Szegedy C, Vanhoucke V, Ioffe S, et al (2016) Rethinking the inception architecture for computer vision.2818–2826
40.
go back to reference Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv preprint arXiv:14126980 Kingma DP, Ba J (2014) Adam: A method for stochastic optimization. arXiv preprint arXiv:14126980
41.
go back to reference Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 6:107-116CrossRef Hochreiter S (1998) The vanishing gradient problem during learning recurrent neural nets and problem solutions. International Journal of Uncertainty, Fuzziness and Knowledge-Based Systems 6:107-116CrossRef
42.
go back to reference Ide H, Kurita T (2017) Improvement of learning for CNN with ReLU activation by sparse regularization. IEEE,2684–2691 Ide H, Kurita T (2017) Improvement of learning for CNN with ReLU activation by sparse regularization. IEEE,2684–2691
43.
go back to reference Lawley A, Hampson R, Worrall K, et al (2023) Prescriptive method for optimizing cost of data collection and annotation in machine learning of clinical ultrasound. Lawley A, Hampson R, Worrall K, et al (2023) Prescriptive method for optimizing cost of data collection and annotation in machine learning of clinical ultrasound.
Metadata
Title
Analysis of neural networks for routine classification of sixteen ultrasound upper abdominal cross sections
Authors
Alistair Lawley
Rory Hampson
Kevin Worrall
Gordon Dobie
Publication date
12-01-2024
Publisher
Springer US
Published in
Abdominal Radiology / Issue 2/2024
Print ISSN: 2366-004X
Electronic ISSN: 2366-0058
DOI
https://doi.org/10.1007/s00261-023-04147-x

Other articles of this Issue 2/2024

Abdominal Radiology 2/2024 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine