Skip to main content
Top
Published in: European Radiology 4/2024

09-10-2023 | Mammography | Breast

Multitask deep learning on mammography to predict extensive intraductal component in invasive breast cancer

Authors: Huei-Yi Tsai, Yu-Wei Kao, Jo-Ching Wang, Tsung-Yu Tsai, Wei-Shiuan Chung, Jui-Sheng Hsu, Ming-Feng Hou, Shih-Feng Weng

Published in: European Radiology | Issue 4/2024

Login to get access

Abstract

Objectives

To develop a multitask deep learning (DL) algorithm to automatically classify mammography imaging findings and predict the existence of extensive intraductal component (EIC) in invasive breast cancer.

Methods

Mammograms with invasive breast cancers from 2010 to 2019 were downloaded for two radiologists performing image segmentation and imaging findings annotation. Images were randomly split into training, validation, and test datasets. A multitask approach was performed on the EfficientNet-B0 neural network mainly to predict EIC and classify imaging findings. Three more models were trained for comparison, including a single-task model (predicting EIC), a two-task model (predicting EIC and cell receptor status), and a three-task model (combining the abovementioned tasks). Additionally, these models were trained in a subgroup of invasive ductal carcinoma. The DeLong test was used to examine the difference in model performance.

Results

This study enrolled 1459 breast cancers on 3076 images. The EIC-positive rate was 29.0%. The three-task model was the best DL model with an area under the curve (AUC) of EIC prediction of 0.758 and 0.775 at the image and breast (patient) levels, respectively. Mass was the most accurately classified imaging finding (AUC = 0.915), followed by calcifications and mass with calcifications (AUC = 0.878 and 0.824, respectively). Cell receptor status prediction was less accurate (AUC = 0.625–0.653). The multitask approach improves the model training compared to the single-task model, but without significant effects.

Conclusions

A mammography-based multitask DL model can perform simultaneous imaging finding classification and EIC prediction.

Clinical relevance statement

The study results demonstrated the potential of deep learning to extract more information from mammography for clinical decision-making.

Key Points

• Extensive intraductal component (EIC) is an independent risk factor of local tumor recurrence after breast-conserving surgery.
• A mammography-based deep learning model was trained to predict extensive intraductal component close to radiologists’ reading.
• The developed multitask deep learning model could perform simultaneous imaging finding classification and extensive intraductal component prediction.
Appendix
Available only for authorised users
Literature
1.
go back to reference Schnitt SJ, Connolly JL, Harris JR, Hellman S, Cohen RB (1984) Pathologic predictors of early local recurrence in stage I and II breast cancer treated by primary radiation therapy. Cancer 53(5):1049–1057CrossRefPubMed Schnitt SJ, Connolly JL, Harris JR, Hellman S, Cohen RB (1984) Pathologic predictors of early local recurrence in stage I and II breast cancer treated by primary radiation therapy. Cancer 53(5):1049–1057CrossRefPubMed
5.
go back to reference Ha SM, Cha JH, Shin HJ, Chae EY, Choi WJ, Kim HH (2019) Mammography, US, and MRI to assess outcomes of invasive breast cancer with extensive intraductal component: a matched cohort study. Radiology 292(2):299–308CrossRefPubMed Ha SM, Cha JH, Shin HJ, Chae EY, Choi WJ, Kim HH (2019) Mammography, US, and MRI to assess outcomes of invasive breast cancer with extensive intraductal component: a matched cohort study. Radiology 292(2):299–308CrossRefPubMed
10.
go back to reference Kuhl CK, Strobel K, Bieling H, Wardelmann E, Kuhn W, Maass N et al (2017) Impact of preoperative breast MR imaging and MR-guided surgery on diagnosis and surgical outcome of women with invasive breast cancer with and without DCIS component. Radiology 284(3):645–655CrossRefPubMed Kuhl CK, Strobel K, Bieling H, Wardelmann E, Kuhn W, Maass N et al (2017) Impact of preoperative breast MR imaging and MR-guided surgery on diagnosis and surgical outcome of women with invasive breast cancer with and without DCIS component. Radiology 284(3):645–655CrossRefPubMed
12.
go back to reference Soffer S, Ben-Cohen A, Shimon O, Amitai MM, Greenspan H, Klang E (2019) Convolutional neural networks for radiologic images: a radiologist’s guide. Radiology 290(3):590–606CrossRefPubMed Soffer S, Ben-Cohen A, Shimon O, Amitai MM, Greenspan H, Klang E (2019) Convolutional neural networks for radiologic images: a radiologist’s guide. Radiology 290(3):590–606CrossRefPubMed
15.
go back to reference Rodríguez-Ruiz A, Krupinski E, Mordang JJ, Schilling K, Heywang-Köbrunner SH, Sechopoulos I et al (2019) Detection of breast cancer with mammography: effect of an artificial intelligence support system. Radiology 290(2):305–314CrossRefPubMed Rodríguez-Ruiz A, Krupinski E, Mordang JJ, Schilling K, Heywang-Köbrunner SH, Sechopoulos I et al (2019) Detection of breast cancer with mammography: effect of an artificial intelligence support system. Radiology 290(2):305–314CrossRefPubMed
21.
go back to reference Leung K, Zhang B, Tan J, Shen Y, Geras KJ, Babb JS et al (2020) Prediction of total knee replacement and diagnosis of osteoarthritis by using deep learning on knee radiographs: data from the Osteoarthritis Initiative. Radiology 296(3):584–593CrossRefPubMed Leung K, Zhang B, Tan J, Shen Y, Geras KJ, Babb JS et al (2020) Prediction of total knee replacement and diagnosis of osteoarthritis by using deep learning on knee radiographs: data from the Osteoarthritis Initiative. Radiology 296(3):584–593CrossRefPubMed
22.
go back to reference von Schacky CEv, Sohn JH, Liu F, Ozhinsky E, Jungmann PM, Nardo L et al (2020) Development and validation of a multitask deep learning model for severity grading of hip osteoarthritis features on radiographs. Radiology 295(1):136-45 von Schacky CEv, Sohn JH, Liu F, Ozhinsky E, Jungmann PM, Nardo L et al (2020) Development and validation of a multitask deep learning model for severity grading of hip osteoarthritis features on radiographs. Radiology 295(1):136-45
24.
go back to reference Hammond MEH, Hayes DF, Dowsett M, Allred DC, Hagerty KL, Badve S et al (2010) American Society of Clinical Oncology/College of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer (unabridged version). Arch Pathol Lab Med DOI 10(5858/134):7.e48 Hammond MEH, Hayes DF, Dowsett M, Allred DC, Hagerty KL, Badve S et al (2010) American Society of Clinical Oncology/College of American Pathologists guideline recommendations for immunohistochemical testing of estrogen and progesterone receptors in breast cancer (unabridged version). Arch Pathol Lab Med DOI 10(5858/134):7.e48
25.
29.
go back to reference DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3):837–845CrossRefPubMed DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44(3):837–845CrossRefPubMed
30.
go back to reference Cedolini C, Bertozzi S, Londero AP, Seriau L, Andretta M, Agakiza D et al (2015) Impact of the presence and quantity of ductal carcinoma in situ component on the outcome of invasive breast cancer. Int J Clin Exp Pathol 8(10):13304–13313PubMedPubMedCentral Cedolini C, Bertozzi S, Londero AP, Seriau L, Andretta M, Agakiza D et al (2015) Impact of the presence and quantity of ductal carcinoma in situ component on the outcome of invasive breast cancer. Int J Clin Exp Pathol 8(10):13304–13313PubMedPubMedCentral
31.
go back to reference Somerville JE, Clarke LA, Biggart JD (1992) c-erbB-2 overexpression and histological type of in situ and invasive breast carcinoma. Clin Pathol 45(1):16–20CrossRef Somerville JE, Clarke LA, Biggart JD (1992) c-erbB-2 overexpression and histological type of in situ and invasive breast carcinoma. Clin Pathol 45(1):16–20CrossRef
Metadata
Title
Multitask deep learning on mammography to predict extensive intraductal component in invasive breast cancer
Authors
Huei-Yi Tsai
Yu-Wei Kao
Jo-Ching Wang
Tsung-Yu Tsai
Wei-Shiuan Chung
Jui-Sheng Hsu
Ming-Feng Hou
Shih-Feng Weng
Publication date
09-10-2023
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 4/2024
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-023-10254-6

Other articles of this Issue 4/2024

European Radiology 4/2024 Go to the issue