Skip to main content
Top
Published in: European Radiology 3/2019

01-03-2019 | Ultrasound

Development and validation of an ultrasound-based nomogram to improve the diagnostic accuracy for malignant thyroid nodules

Authors: Bao-liang Guo, Fu-sheng Ouyang, Li-zhu Ouyang, Zi-wei Liu, Shao-jia Lin, Wei Meng, Xi-yi Huang, Hai-xiong Chen, Shao-ming Yang, Qiu-gen Hu

Published in: European Radiology | Issue 3/2019

Login to get access

Abstract

Objectives

The aim of this study was to develop an ultrasound-based nomogram to improve the diagnostic accuracy of the identification of malignant thyroid nodules.

Methods

A total of 1675 histologically proven thyroid nodules (1169 benign, 506 malignant) were included in this study. The nodules were grouped into the training dataset (n = 700), internal validation dataset (n = 479), or external validation dataset (n = 496). The grayscale ultrasound features included the nodule size, shape, aspect ratio, echogenicity, margins, and calcification pattern. We applied least absolute shrinkage and selection operator (lasso) regression to select the strongest features for the nomogram. Nomogram discrimination (area under the receiver operating characteristic curve, AUC) and calibration were assessed. The nomogram was subjected to bootstrapping validation (1000 bootstrap resamples) to calculate a mean AUC and 95% confidence interval (CI).

Results

The nomogram showed good discrimination in the training dataset, with an AUC of 0.936 (95% CI: 0.918–0.953) and good calibration. Application of the nomogram to the internal validation dataset also resulted in good discrimination (AUC: 0.935; 95% CI, 0.915–0.954) and good calibration. The model tested in an external validation dataset demonstrated a lower AUC of 0.782 (95% CI: 0.776–0.789).

Conclusions

This ultrasound-based nomogram can be used to quantify the probability of malignant thyroid nodules.

Key Points

• Ultrasound examination is helpful in the differential diagnosis of malignant and benign thyroid nodules.
• However, ultrasound accuracy relies heavily on examiner experience.
• A less subjective diagnostic model is desired, and the developed nomogram for thyroid nodules showed good discrimination and good calibration.
Literature
1.
go back to reference Yoon JH, Lee HS, Kim EK, Moon HJ, Kwak JY (2016) Malignancy Risk Stratification of Thyroid Nodules: Comparison between the Thyroid Imaging Reporting and Data System and the 2014 American Thyroid Association Management Guidelines. Radiology 278(3):917–924CrossRefPubMed Yoon JH, Lee HS, Kim EK, Moon HJ, Kwak JY (2016) Malignancy Risk Stratification of Thyroid Nodules: Comparison between the Thyroid Imaging Reporting and Data System and the 2014 American Thyroid Association Management Guidelines. Radiology 278(3):917–924CrossRefPubMed
2.
go back to reference Gharib H, Papini E, Paschke R et al (2010) American Association of Clinical Endocrinologists, Associazione Medici Endocrinologi, and European Thyroid Association Medical Guidelines for Clinical Practice for the Diagnosis and Management of Thyroid Nodules. Endocr Pract 16(3):468–475CrossRefPubMed Gharib H, Papini E, Paschke R et al (2010) American Association of Clinical Endocrinologists, Associazione Medici Endocrinologi, and European Thyroid Association Medical Guidelines for Clinical Practice for the Diagnosis and Management of Thyroid Nodules. Endocr Pract 16(3):468–475CrossRefPubMed
4.
5.
go back to reference Haugen BR, Alexander EK, Bible KC et al (2016) 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid 26(1):1–133CrossRefPubMedPubMedCentral Haugen BR, Alexander EK, Bible KC et al (2016) 2015 American Thyroid Association Management Guidelines for Adult Patients with Thyroid Nodules and Differentiated Thyroid Cancer: The American Thyroid Association Guidelines Task Force on Thyroid Nodules and Differentiated Thyroid Cancer. Thyroid 26(1):1–133CrossRefPubMedPubMedCentral
6.
go back to reference Kim D, Kim DW, Heo YJ et al (2017) Computed Tomography Features of Benign and Malignant Calcified Thyroid Nodules: A Single-Center Study. J Comput Assist Tomogr 41(6):937–940CrossRefPubMed Kim D, Kim DW, Heo YJ et al (2017) Computed Tomography Features of Benign and Malignant Calcified Thyroid Nodules: A Single-Center Study. J Comput Assist Tomogr 41(6):937–940CrossRefPubMed
7.
go back to reference Shi RY, Yao QY, Zhou QY et al (2017) Preliminary study of diffusion kurtosis imaging in thyroid nodules and its histopathologic correlation. Eur Radiol 27(11):4710–4720CrossRefPubMed Shi RY, Yao QY, Zhou QY et al (2017) Preliminary study of diffusion kurtosis imaging in thyroid nodules and its histopathologic correlation. Eur Radiol 27(11):4710–4720CrossRefPubMed
8.
go back to reference Pathak KA, Goertzen AL, Nason RW, Klonisch T, Leslie WD (2016) A prospective cohort study to assess the role of FDG-PET in differentiating benign and malignant follicular neoplasms. Ann Med Surg (Lond) 12:27–31CrossRef Pathak KA, Goertzen AL, Nason RW, Klonisch T, Leslie WD (2016) A prospective cohort study to assess the role of FDG-PET in differentiating benign and malignant follicular neoplasms. Ann Med Surg (Lond) 12:27–31CrossRef
9.
go back to reference Raue F, Frank-Raue K (2016) Thyroid Cancer: Risk-Stratified Management and Individualized Therapy. Clin Cancer Res 22(10):5012–5021CrossRefPubMed Raue F, Frank-Raue K (2016) Thyroid Cancer: Risk-Stratified Management and Individualized Therapy. Clin Cancer Res 22(10):5012–5021CrossRefPubMed
10.
go back to reference Kaur K, Sonkhya N, Bapna AS, Mital P (2002) A comparative study of fine needle aspiration cytology, ultrasonography and radionuclide scan in the management of solitary thyroid nodule: A prospective analysis of fifty cases. Indian J Otolaryngol Head Neck Surg 54(2):96–101PubMedPubMedCentral Kaur K, Sonkhya N, Bapna AS, Mital P (2002) A comparative study of fine needle aspiration cytology, ultrasonography and radionuclide scan in the management of solitary thyroid nodule: A prospective analysis of fifty cases. Indian J Otolaryngol Head Neck Surg 54(2):96–101PubMedPubMedCentral
11.
go back to reference Tae HJ, Lim DJ, Baek KH et al (2007) Diagnostic value of ultrasonography to distinguish between benign and malignant lesions in the management of thyroid nodules. Thyroid 17(5):461–466CrossRefPubMed Tae HJ, Lim DJ, Baek KH et al (2007) Diagnostic value of ultrasonography to distinguish between benign and malignant lesions in the management of thyroid nodules. Thyroid 17(5):461–466CrossRefPubMed
12.
go back to reference Oberije C, Nalbantov G, Dekker A et al (2014) A prospective study comparing the predictions of doctors versus models for treatment outcome of lung cancer patients: a step toward individualized care and shared decision making. Radiother Oncol 112(1):37–43CrossRefPubMedPubMedCentral Oberije C, Nalbantov G, Dekker A et al (2014) A prospective study comparing the predictions of doctors versus models for treatment outcome of lung cancer patients: a step toward individualized care and shared decision making. Radiother Oncol 112(1):37–43CrossRefPubMedPubMedCentral
13.
go back to reference Iasonos A, Schrag D, Raj GV, Panageas KS (2008) How to build and interpret a nomogram for cancer prognosis. J Clin Oncol 26:1364–1370CrossRefPubMed Iasonos A, Schrag D, Raj GV, Panageas KS (2008) How to build and interpret a nomogram for cancer prognosis. J Clin Oncol 26:1364–1370CrossRefPubMed
14.
go back to reference Abu-Rustum NR, Zhou Q, Gomez JD et al (2010) A nomogram for predicting overall survival of women with endometrial cancer following primary therapy: toward improving individualized cancer care. Gynecol Oncol 116:399–403CrossRefPubMed Abu-Rustum NR, Zhou Q, Gomez JD et al (2010) A nomogram for predicting overall survival of women with endometrial cancer following primary therapy: toward improving individualized cancer care. Gynecol Oncol 116:399–403CrossRefPubMed
15.
go back to reference Sternberg CN (2006) Are nomograms better than currently available stage groupings for bladder cancer? J Clin Oncol 24:3819–3820CrossRefPubMed Sternberg CN (2006) Are nomograms better than currently available stage groupings for bladder cancer? J Clin Oncol 24:3819–3820CrossRefPubMed
16.
go back to reference Kumamaru KK, Saboo SS, Aghayev A et al (2016) CT pulmonary angiography-based scoring system to predict the prognosis of acute pulmonary embolism. J Cardiovasc Comput Tomogr 10(6):473–479CrossRefPubMed Kumamaru KK, Saboo SS, Aghayev A et al (2016) CT pulmonary angiography-based scoring system to predict the prognosis of acute pulmonary embolism. J Cardiovasc Comput Tomogr 10(6):473–479CrossRefPubMed
17.
go back to reference Vasquez MM, Hu C, Roe DJ, Chen Z, Halonen M, Guerra S (2016) Least absolute shrinkage and selection operator type methods for the identification of serum biomarkers of overweight and obesity: simulation and application. BMC Med Res Methodol 16(1):154CrossRefPubMedPubMedCentral Vasquez MM, Hu C, Roe DJ, Chen Z, Halonen M, Guerra S (2016) Least absolute shrinkage and selection operator type methods for the identification of serum biomarkers of overweight and obesity: simulation and application. BMC Med Res Methodol 16(1):154CrossRefPubMedPubMedCentral
18.
go back to reference Werga P, Wallin G, Skoog L, Hamberger B (2000) Expanding role of fine-needle aspiration cytology in thyroid diagnosis and management. World J Surg 24:907–912CrossRefPubMed Werga P, Wallin G, Skoog L, Hamberger B (2000) Expanding role of fine-needle aspiration cytology in thyroid diagnosis and management. World J Surg 24:907–912CrossRefPubMed
19.
go back to reference Theoharis CG, Schofield KM, Hammers L, Udelsman R, Chhieng DC (2009) The Bethesda thyroid fine-needle aspiration classification system: year 1 at an academic institution. Thyroid 19(11):1215–1223CrossRefPubMed Theoharis CG, Schofield KM, Hammers L, Udelsman R, Chhieng DC (2009) The Bethesda thyroid fine-needle aspiration classification system: year 1 at an academic institution. Thyroid 19(11):1215–1223CrossRefPubMed
20.
go back to reference Mathur A, Weng J, Moses W et al (2010) A prospective study evaluating the accuracy of using combined clinical factors and candidate diagnostic markers to refine the accuracy of thyroid fine needle aspiration biopsy. Surgery 148(6):1170–1176CrossRefPubMed Mathur A, Weng J, Moses W et al (2010) A prospective study evaluating the accuracy of using combined clinical factors and candidate diagnostic markers to refine the accuracy of thyroid fine needle aspiration biopsy. Surgery 148(6):1170–1176CrossRefPubMed
21.
go back to reference Zhang F, Zhao X, Han R, Du M, Li P, Ji X (2017) Comparison of Acoustic Radiation Force Impulse Imaging and Strain Elastography in Differentiating Malignant From Benign Thyroid Nodules. J Ultrasound Med 36(12):2533–2543CrossRefPubMed Zhang F, Zhao X, Han R, Du M, Li P, Ji X (2017) Comparison of Acoustic Radiation Force Impulse Imaging and Strain Elastography in Differentiating Malignant From Benign Thyroid Nodules. J Ultrasound Med 36(12):2533–2543CrossRefPubMed
22.
go back to reference Chandramohan A, Therese M, Abhraham D, Paul TV, Mazhuvanchary PJ (2017) Can ARFI elastography be used to differentiate parathyroid from thyroid lesions? J Endocrinol Invest 41(1):111–119CrossRefPubMed Chandramohan A, Therese M, Abhraham D, Paul TV, Mazhuvanchary PJ (2017) Can ARFI elastography be used to differentiate parathyroid from thyroid lesions? J Endocrinol Invest 41(1):111–119CrossRefPubMed
23.
go back to reference Zhan J, Diao XH, Chen L, Jin JM, Chen Y (2017) Role of Contrast-Enhanced Ultrasound in Diagnosis of Thyroid Nodules in Acoustic Radiation Force Impulse “Gray Zone”. Ultrasound Med Biol 43(6):1179–1186CrossRefPubMed Zhan J, Diao XH, Chen L, Jin JM, Chen Y (2017) Role of Contrast-Enhanced Ultrasound in Diagnosis of Thyroid Nodules in Acoustic Radiation Force Impulse “Gray Zone”. Ultrasound Med Biol 43(6):1179–1186CrossRefPubMed
25.
go back to reference Zahir ST, Vakili M, Ghaneei A, Sharahjin NS, Heidari F (2016) Ultrasound Assistance In Differentiating Malignant Thyroid Nodules From Benign Ones. J Ayub Med Coll Abbottabad 28(4):644–649PubMed Zahir ST, Vakili M, Ghaneei A, Sharahjin NS, Heidari F (2016) Ultrasound Assistance In Differentiating Malignant Thyroid Nodules From Benign Ones. J Ayub Med Coll Abbottabad 28(4):644–649PubMed
26.
go back to reference Iqbal M, Mehmood Z, Rasul S, Inamullah H, Shah SS, Bokhari I (2010) Carcinoma thyroid in multi and uninodular goiter. J Coll Physicians Surg Pak 20(5):310–312 Iqbal M, Mehmood Z, Rasul S, Inamullah H, Shah SS, Bokhari I (2010) Carcinoma thyroid in multi and uninodular goiter. J Coll Physicians Surg Pak 20(5):310–312
27.
go back to reference Chammas MC, de Araujo Filho VJ, Moysés RA et al (2008) Predictive value for malignancy in the finding of microcalcifications on ultrasonography of thyroid nodules. Head Neck 30(9):1206–1210 Chammas MC, de Araujo Filho VJ, Moysés RA et al (2008) Predictive value for malignancy in the finding of microcalcifications on ultrasonography of thyroid nodules. Head Neck 30(9):1206–1210
28.
go back to reference Rahimi M, Farshchian N, Rezaee E, Shahebrahimi K, Madani H (2013) To differentiate benign from malignant thyroid nodule comparison of sonography with FNAC findings. Pak J Med Sci 29(1):77–80PubMedPubMedCentral Rahimi M, Farshchian N, Rezaee E, Shahebrahimi K, Madani H (2013) To differentiate benign from malignant thyroid nodule comparison of sonography with FNAC findings. Pak J Med Sci 29(1):77–80PubMedPubMedCentral
29.
go back to reference Kim EK, Park CS, Chung WY et al (2002) New sonographic criteria for recommending fine-needle aspiration biopsy of nonpalpable solid nodules of the thyroid. AJR Am J Roentgenol 178:687–691CrossRefPubMed Kim EK, Park CS, Chung WY et al (2002) New sonographic criteria for recommending fine-needle aspiration biopsy of nonpalpable solid nodules of the thyroid. AJR Am J Roentgenol 178:687–691CrossRefPubMed
30.
go back to reference Nikiforov YE, Seethala RR, Tallini G et al (2016) Nomenclature Revision for Encapsulated Follicular Variant of Papillary Thyroid Carcinoma: A Paradigm Shift to Reduce Overtreatment of Indolent Tumors. JAMA Oncol 2(8):1023–1029CrossRefPubMedPubMedCentral Nikiforov YE, Seethala RR, Tallini G et al (2016) Nomenclature Revision for Encapsulated Follicular Variant of Papillary Thyroid Carcinoma: A Paradigm Shift to Reduce Overtreatment of Indolent Tumors. JAMA Oncol 2(8):1023–1029CrossRefPubMedPubMedCentral
Metadata
Title
Development and validation of an ultrasound-based nomogram to improve the diagnostic accuracy for malignant thyroid nodules
Authors
Bao-liang Guo
Fu-sheng Ouyang
Li-zhu Ouyang
Zi-wei Liu
Shao-jia Lin
Wei Meng
Xi-yi Huang
Hai-xiong Chen
Shao-ming Yang
Qiu-gen Hu
Publication date
01-03-2019
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 3/2019
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-018-5715-5

Other articles of this Issue 3/2019

European Radiology 3/2019 Go to the issue