Skip to main content
Top
Published in: Cancer Imaging 1/2024

Open Access 01-12-2024 | Research article

Dual-modal radiomics nomogram based on contrast-enhanced ultrasound to improve differential diagnostic accuracy and reduce unnecessary biopsy rate in ACR TI-RADS 4–5 thyroid nodules

Authors: Jia-Yu Ren, Wen-Zhi Lv, Liang Wang, Wei Zhang, Ying-Ying Ma, Yong-Zhen Huang, Yue-Xiang Peng, Jian-Jun Lin, Xin-Wu Cui

Published in: Cancer Imaging | Issue 1/2024

Login to get access

Abstract

Background

American College of Radiology (ACR) Thyroid Imaging Reporting and Data System (TI-RADS, TR) 4 and 5 thyroid nodules (TNs) demonstrate much more complicated and overlapping risk characteristics than TR1-3 and have a rather wide range of malignancy possibilities (> 5%), which may cause overdiagnosis or misdiagnosis. This study was designed to establish and validate a dual-modal ultrasound (US) radiomics nomogram integrating B-mode ultrasound (BMUS) and contrast-enhanced ultrasound (CEUS) imaging to improve differential diagnostic accuracy and reduce unnecessary fine needle aspiration biopsy (FNAB) rates in TR 4–5 TNs.

Methods

A retrospective dataset of 312 pathologically confirmed TR4-5 TNs from 269 patients was collected for our study. Data were randomly divided into a training dataset of 219 TNs and a validation dataset of 93 TNs. Radiomics characteristics were derived from the BMUS and CEUS images. After feature reduction, the BMUS and CEUS radiomics scores (Rad-score) were built. A multivariate logistic regression analysis was conducted incorporating both Rad-scores and clinical/US data, and a radiomics nomogram was subsequently developed. The performance of the radiomics nomogram was evaluated using calibration, discrimination, and clinical usefulness, and the unnecessary FNAB rate was also calculated.

Results

BMUS Rad-score, CEUS Rad-score, age, shape, margin, and enhancement direction were significant independent predictors associated with malignant TR4-5 TNs. The radiomics nomogram involving the six variables exhibited excellent calibration and discrimination in the training and validation cohorts, with an AUC of 0.873 (95% CI, 0.821–0.925) and 0.851 (95% CI, 0.764–0.938), respectively. The marked improvements in the net reclassification index and integrated discriminatory improvement suggested that the BMUS and CEUS Rad-scores could be valuable indicators for distinguishing benign from malignant TR4-5 TNs. Decision curve analysis demonstrated that our developed radiomics nomogram was an instrumental tool for clinical decision-making. Using the radiomics nomogram, the unnecessary FNAB rate decreased from 35.3 to 14.5% in the training cohort and from 41.5 to 17.7% in the validation cohorts compared with ACR TI-RADS.

Conclusion

The dual-modal US radiomics nomogram revealed superior discrimination accuracy and considerably decreased unnecessary FNAB rates in benign and malignant TR4-5 TNs. It could guide further examination or treatment options.
Appendix
Available only for authorised users
Literature
1.
go back to reference Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association Management Guidelines for adult patients with thyroid nodules and differentiated thyroid Cancer: the American Thyroid Association Guidelines Task Force on thyroid nodules and differentiated thyroid Cancer. Thyroid. 2016;26:1–133.CrossRefPubMedPubMedCentral Haugen BR, Alexander EK, Bible KC, Doherty GM, Mandel SJ, Nikiforov YE, et al. 2015 American Thyroid Association Management Guidelines for adult patients with thyroid nodules and differentiated thyroid Cancer: the American Thyroid Association Guidelines Task Force on thyroid nodules and differentiated thyroid Cancer. Thyroid. 2016;26:1–133.CrossRefPubMedPubMedCentral
2.
go back to reference Haymart MR, Banerjee M, Reyes-Gastelum D, Caoili E, Norton EC. Thyroid ultrasound and the increase in diagnosis of low-risk thyroid Cancer. J Clin Endocrinol Metab. 2019;104:785–92.CrossRefPubMed Haymart MR, Banerjee M, Reyes-Gastelum D, Caoili E, Norton EC. Thyroid ultrasound and the increase in diagnosis of low-risk thyroid Cancer. J Clin Endocrinol Metab. 2019;104:785–92.CrossRefPubMed
3.
go back to reference Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA, et al. ACR thyroid imaging, reporting and Data System (TI-RADS): White Paper of the ACR TI-RADS Committee. J Am Coll Radiol. 2017;14:587–95.CrossRefPubMed Tessler FN, Middleton WD, Grant EG, Hoang JK, Berland LL, Teefey SA, et al. ACR thyroid imaging, reporting and Data System (TI-RADS): White Paper of the ACR TI-RADS Committee. J Am Coll Radiol. 2017;14:587–95.CrossRefPubMed
4.
go back to reference Wang J, Jiang J, Zhang D, Zhang YZ, Guo L, Jiang Y, et al. An integrated AI model to improve diagnostic accuracy of ultrasound and output known risk features in suspicious thyroid nodules. Eur Radiol. 2022;32:2120–9.CrossRefPubMed Wang J, Jiang J, Zhang D, Zhang YZ, Guo L, Jiang Y, et al. An integrated AI model to improve diagnostic accuracy of ultrasound and output known risk features in suspicious thyroid nodules. Eur Radiol. 2022;32:2120–9.CrossRefPubMed
5.
go back to reference Radzina M, Ratniece M, Putrins DS, Saule L, Cantisani V. Performance of contrast-enhanced ultrasound in thyroid nodules: review of current state and future perspectives. Cancers (Basel). 2021;13. Radzina M, Ratniece M, Putrins DS, Saule L, Cantisani V. Performance of contrast-enhanced ultrasound in thyroid nodules: review of current state and future perspectives. Cancers (Basel). 2021;13.
6.
go back to reference Zhang Y, Zhou P, Tian SM, Zhao YF, Li JL, Li L. Usefulness of combined use of contrast-enhanced ultrasound and TI-RADS classification for the differentiation of benign from malignant lesions of thyroid nodules. Eur Radiol. 2017;27:1527–36.CrossRefPubMed Zhang Y, Zhou P, Tian SM, Zhao YF, Li JL, Li L. Usefulness of combined use of contrast-enhanced ultrasound and TI-RADS classification for the differentiation of benign from malignant lesions of thyroid nodules. Eur Radiol. 2017;27:1527–36.CrossRefPubMed
7.
go back to reference Trimboli P, Castellana M, Virili C, Havre RF, Bini F, Marinozzi F, et al. Performance of contrast-enhanced ultrasound (CEUS) in assessing thyroid nodules: a systematic review and meta-analysis using histological standard of reference. Radiol Med. 2020;125:406–15.CrossRefPubMed Trimboli P, Castellana M, Virili C, Havre RF, Bini F, Marinozzi F, et al. Performance of contrast-enhanced ultrasound (CEUS) in assessing thyroid nodules: a systematic review and meta-analysis using histological standard of reference. Radiol Med. 2020;125:406–15.CrossRefPubMed
8.
go back to reference Zhang B, Jiang YX, Liu JB, Yang M, Dai Q, Zhu QL, et al. Utility of contrast-enhanced ultrasound for evaluation of thyroid nodules. Thyroid. 2010;20:51–7.CrossRefPubMed Zhang B, Jiang YX, Liu JB, Yang M, Dai Q, Zhu QL, et al. Utility of contrast-enhanced ultrasound for evaluation of thyroid nodules. Thyroid. 2010;20:51–7.CrossRefPubMed
9.
go back to reference Sidhu PS, Cantisani V, Dietrich CF, Gilja OH, Saftoiu A, Bartels E, et al. The EFSUMB guidelines and recommendations for the clinical practice of contrast-enhanced Ultrasound (CEUS) in non-hepatic applications: Update 2017 (Long Version). Ultraschall Med. 2018;39:e2–e44.CrossRefPubMed Sidhu PS, Cantisani V, Dietrich CF, Gilja OH, Saftoiu A, Bartels E, et al. The EFSUMB guidelines and recommendations for the clinical practice of contrast-enhanced Ultrasound (CEUS) in non-hepatic applications: Update 2017 (Long Version). Ultraschall Med. 2018;39:e2–e44.CrossRefPubMed
10.
go back to reference Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14:749–62.CrossRefPubMed Lambin P, Leijenaar RTH, Deist TM, Peerlings J, de Jong EEC, van Timmeren J, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14:749–62.CrossRefPubMed
11.
go back to reference Liang J, Huang X, Hu H, Liu Y, Zhou Q, Cao Q, et al. Predicting Malignancy in thyroid nodules: Radiomics score Versus 2017 American College of Radiology Thyroid Imaging, reporting and Data System. Thyroid. 2018;28:1024–33.CrossRefPubMed Liang J, Huang X, Hu H, Liu Y, Zhou Q, Cao Q, et al. Predicting Malignancy in thyroid nodules: Radiomics score Versus 2017 American College of Radiology Thyroid Imaging, reporting and Data System. Thyroid. 2018;28:1024–33.CrossRefPubMed
12.
go back to reference Yoon J, Lee E, Kang SW, Han K, Park VY, Kwak JY. Implications of US radiomics signature for predicting malignancy in thyroid nodules with indeterminate cytology. Eur Radiol. 2021;31:5059–67.CrossRefPubMed Yoon J, Lee E, Kang SW, Han K, Park VY, Kwak JY. Implications of US radiomics signature for predicting malignancy in thyroid nodules with indeterminate cytology. Eur Radiol. 2021;31:5059–67.CrossRefPubMed
13.
go back to reference Park VY, Lee E, Lee HS, Kim HJ, Yoon J, Son J, et al. Combining radiomics with ultrasound-based risk stratification systems for thyroid nodules: an approach for improving performance. Eur Radiol. 2021;31:2405–13.CrossRefPubMed Park VY, Lee E, Lee HS, Kim HJ, Yoon J, Son J, et al. Combining radiomics with ultrasound-based risk stratification systems for thyroid nodules: an approach for improving performance. Eur Radiol. 2021;31:2405–13.CrossRefPubMed
14.
go back to reference Wu GG, Lv WZ, Yin R, Xu JW, Yan YJ, Chen RX, et al. Deep learning based on ACR TI-RADS can improve the Differential diagnosis of thyroid nodules. Front Oncol. 2021;11:575166.CrossRefPubMedPubMedCentral Wu GG, Lv WZ, Yin R, Xu JW, Yan YJ, Chen RX, et al. Deep learning based on ACR TI-RADS can improve the Differential diagnosis of thyroid nodules. Front Oncol. 2021;11:575166.CrossRefPubMedPubMedCentral
15.
go back to reference Guo BL, Ouyang FS, Ouyang LZ, Liu ZW, Lin SJ, Meng W, et al. Development and validation of an ultrasound-based nomogram to improve the diagnostic accuracy for malignant thyroid nodules. Eur Radiol. 2019;29:1518–26.CrossRefPubMed Guo BL, Ouyang FS, Ouyang LZ, Liu ZW, Lin SJ, Meng W, et al. Development and validation of an ultrasound-based nomogram to improve the diagnostic accuracy for malignant thyroid nodules. Eur Radiol. 2019;29:1518–26.CrossRefPubMed
16.
go back to reference Yoon JH, Lee HS, Kim EK, Moon HJ, Kwak JY. A nomogram for predicting malignancy in thyroid nodules diagnosed as atypia of undetermined significance/follicular lesions of undetermined significance on fine needle aspiration. Surgery. 2014;155:1006–13.CrossRefPubMed Yoon JH, Lee HS, Kim EK, Moon HJ, Kwak JY. A nomogram for predicting malignancy in thyroid nodules diagnosed as atypia of undetermined significance/follicular lesions of undetermined significance on fine needle aspiration. Surgery. 2014;155:1006–13.CrossRefPubMed
17.
go back to reference Zhou X, Zhou P, Hu Z, Tian SM, Zhao Y, Liu W, et al. Diagnostic efficiency of quantitative contrast-enhanced Ultrasound indicators for discriminating Benign from Malignant solid thyroid nodules. J Ultrasound Med. 2018;37:425–37.CrossRefPubMed Zhou X, Zhou P, Hu Z, Tian SM, Zhao Y, Liu W, et al. Diagnostic efficiency of quantitative contrast-enhanced Ultrasound indicators for discriminating Benign from Malignant solid thyroid nodules. J Ultrasound Med. 2018;37:425–37.CrossRefPubMed
18.
go back to reference Hoang JK, Middleton WD, Tessler FN. Update on ACR TI-RADS: successes, challenges, and future directions, from the AJR Special Series on Radiology Reporting and Data systems. AJR Am J Roentgenol. 2021;216:570–8.CrossRefPubMed Hoang JK, Middleton WD, Tessler FN. Update on ACR TI-RADS: successes, challenges, and future directions, from the AJR Special Series on Radiology Reporting and Data systems. AJR Am J Roentgenol. 2021;216:570–8.CrossRefPubMed
19.
go back to reference Yu D, Han Y, Chen T. Contrast-enhanced ultrasound for differentiation of benign and malignant thyroid lesions: meta-analysis. Otolaryngol Head Neck Surg. 2014;151:909–15.CrossRefPubMed Yu D, Han Y, Chen T. Contrast-enhanced ultrasound for differentiation of benign and malignant thyroid lesions: meta-analysis. Otolaryngol Head Neck Surg. 2014;151:909–15.CrossRefPubMed
20.
go back to reference Yu P, Niu S, Gao S, Tian H, Zhu J. Benefits of contrast-enhanced Ultrasonography to the Differential diagnosis of TI-RADS 4–5 thyroid nodules. Appl Bionics Biomech. 2022;2022:7386516.CrossRefPubMedPubMedCentral Yu P, Niu S, Gao S, Tian H, Zhu J. Benefits of contrast-enhanced Ultrasonography to the Differential diagnosis of TI-RADS 4–5 thyroid nodules. Appl Bionics Biomech. 2022;2022:7386516.CrossRefPubMedPubMedCentral
21.
go back to reference Wang Y, Dong T, Nie F, Wang G, Liu T, Niu Q. Contrast-enhanced Ultrasound in the Differential diagnosis and risk stratification of ACR TI-RADS category 4 and 5 thyroid nodules with non-hypovascular. Front Oncol. 2021;11:662273.CrossRefPubMedPubMedCentral Wang Y, Dong T, Nie F, Wang G, Liu T, Niu Q. Contrast-enhanced Ultrasound in the Differential diagnosis and risk stratification of ACR TI-RADS category 4 and 5 thyroid nodules with non-hypovascular. Front Oncol. 2021;11:662273.CrossRefPubMedPubMedCentral
22.
go back to reference Tong T, Gu J, Xu D, Song L, Zhao Q, Cheng F, et al. Deep learning radiomics based on contrast-enhanced ultrasound images for assisted diagnosis of pancreatic ductal adenocarcinoma and chronic pancreatitis. BMC Med. 2022;20:74.CrossRefPubMedPubMedCentral Tong T, Gu J, Xu D, Song L, Zhao Q, Cheng F, et al. Deep learning radiomics based on contrast-enhanced ultrasound images for assisted diagnosis of pancreatic ductal adenocarcinoma and chronic pancreatitis. BMC Med. 2022;20:74.CrossRefPubMedPubMedCentral
23.
go back to reference Xu Z, Wang Y, Chen M, Zhang Q. Multi-region radiomics for artificially intelligent diagnosis of breast cancer using multimodal ultrasound. Comput Biol Med. 2022;149:105920.CrossRefPubMed Xu Z, Wang Y, Chen M, Zhang Q. Multi-region radiomics for artificially intelligent diagnosis of breast cancer using multimodal ultrasound. Comput Biol Med. 2022;149:105920.CrossRefPubMed
24.
go back to reference Jiang L, Zhang Z, Guo S, Zhao Y, Zhou P. Clinical-Radiomics Nomogram based on Contrast-Enhanced Ultrasound for Preoperative Prediction of Cervical Lymph Node Metastasis in Papillary thyroid carcinoma. Cancers (Basel). 2023;15. Jiang L, Zhang Z, Guo S, Zhao Y, Zhou P. Clinical-Radiomics Nomogram based on Contrast-Enhanced Ultrasound for Preoperative Prediction of Cervical Lymph Node Metastasis in Papillary thyroid carcinoma. Cancers (Basel). 2023;15.
25.
go back to reference Zhang D, Wei Q, Wu GG, Zhang XY, Lu WW, Lv WZ, et al. Preoperative prediction of Microvascular Invasion in patients with Hepatocellular Carcinoma based on Radiomics Nomogram using contrast-enhanced Ultrasound. Front Oncol. 2021;11:709339.CrossRefPubMedPubMedCentral Zhang D, Wei Q, Wu GG, Zhang XY, Lu WW, Lv WZ, et al. Preoperative prediction of Microvascular Invasion in patients with Hepatocellular Carcinoma based on Radiomics Nomogram using contrast-enhanced Ultrasound. Front Oncol. 2021;11:709339.CrossRefPubMedPubMedCentral
26.
go back to reference Liu D, Liu F, Xie X, Su L, Liu M, Xie X, et al. Accurate prediction of responses to transarterial chemoembolization for patients with hepatocellular carcinoma by using artificial intelligence in contrast-enhanced ultrasound. Eur Radiol. 2020;30:2365–76.CrossRefPubMed Liu D, Liu F, Xie X, Su L, Liu M, Xie X, et al. Accurate prediction of responses to transarterial chemoembolization for patients with hepatocellular carcinoma by using artificial intelligence in contrast-enhanced ultrasound. Eur Radiol. 2020;30:2365–76.CrossRefPubMed
27.
go back to reference Zhang H, Huo F. Prediction of early recurrence of HCC after hepatectomy by contrast-enhanced ultrasound-based deep learning radiomics. Front Oncol. 2022;12:930458.CrossRefPubMedPubMedCentral Zhang H, Huo F. Prediction of early recurrence of HCC after hepatectomy by contrast-enhanced ultrasound-based deep learning radiomics. Front Oncol. 2022;12:930458.CrossRefPubMedPubMedCentral
28.
go back to reference Liu F, Liu D, Wang K, Xie X, Su L, Kuang M, et al. Deep Learning Radiomics based on contrast-enhanced Ultrasound might optimize curative treatments for very-early or early-stage Hepatocellular Carcinoma patients. Liver Cancer. 2020;9:397–413.CrossRefPubMedPubMedCentral Liu F, Liu D, Wang K, Xie X, Su L, Kuang M, et al. Deep Learning Radiomics based on contrast-enhanced Ultrasound might optimize curative treatments for very-early or early-stage Hepatocellular Carcinoma patients. Liver Cancer. 2020;9:397–413.CrossRefPubMedPubMedCentral
29.
go back to reference Turco S, Frinking P, Wildeboer R, Arditi M, Wijkstra H, Lindner JR, et al. Contrast-enhanced Ultrasound quantification: from Kinetic modeling to machine learning. Ultrasound Med Biol. 2020;46:518–43.CrossRefPubMed Turco S, Frinking P, Wildeboer R, Arditi M, Wijkstra H, Lindner JR, et al. Contrast-enhanced Ultrasound quantification: from Kinetic modeling to machine learning. Ultrasound Med Biol. 2020;46:518–43.CrossRefPubMed
30.
go back to reference Guo SY, Zhou P, Zhang Y, Jiang LQ, Zhao YF. Exploring the value of Radiomics features based on B-Mode and contrast-enhanced Ultrasound in discriminating the nature of thyroid nodules. Front Oncol. 2021;11:738909.CrossRefPubMedPubMedCentral Guo SY, Zhou P, Zhang Y, Jiang LQ, Zhao YF. Exploring the value of Radiomics features based on B-Mode and contrast-enhanced Ultrasound in discriminating the nature of thyroid nodules. Front Oncol. 2021;11:738909.CrossRefPubMedPubMedCentral
Metadata
Title
Dual-modal radiomics nomogram based on contrast-enhanced ultrasound to improve differential diagnostic accuracy and reduce unnecessary biopsy rate in ACR TI-RADS 4–5 thyroid nodules
Authors
Jia-Yu Ren
Wen-Zhi Lv
Liang Wang
Wei Zhang
Ying-Ying Ma
Yong-Zhen Huang
Yue-Xiang Peng
Jian-Jun Lin
Xin-Wu Cui
Publication date
01-12-2024
Publisher
BioMed Central
Published in
Cancer Imaging / Issue 1/2024
Electronic ISSN: 1470-7330
DOI
https://doi.org/10.1186/s40644-024-00661-3

Other articles of this Issue 1/2024

Cancer Imaging 1/2024 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine