Skip to main content
Top
Published in: BMC Endocrine Disorders 1/2023

Open Access 01-12-2023 | Research

Comparison of the cox regression to machine learning in predicting the survival of anaplastic thyroid carcinoma

Authors: Lizhen Xu, Liangchun Cai, Zheng Zhu, Gang Chen

Published in: BMC Endocrine Disorders | Issue 1/2023

Login to get access

Summary

Background

To compare the ability of the Cox regression and machine learning algorithms to predict the survival of patients with Anaplastic thyroid carcinoma (ATC).

Methods

Patients diagnosed with ATC were extracted from the Surveillance, Epidemiology, and End Results database. The outcomes were overall survival (OS) and cancer-specific survival (CSS), divided into: (1) binary data: survival or not at 6 months and 1 year; (2): time-to-event data. The Cox regression method and machine learnings were used to construct models. Model performance was evaluated using the concordance index (C-index), brier score and calibration curves. The SHapley Additive exPlanations (SHAP) method was deployed to interpret the results of machine learning models.

Results

For binary outcomes, the Logistic algorithm performed best in the prediction of 6-month OS, 12-month OS, 6-month CSS, and 12-month CSS (C-index = 0.790, 0.811, 0.775, 0.768). For time-event outcomes, traditional Cox regression exhibited good performances (OS: C-index = 0.713; CSS: C-index = 0.712). The DeepSurv algorithm performed the best in the training set (OS: C-index = 0.945; CSS: C-index = 0.834) but performs poorly in the verification set (OS: C-index = 0.658; CSS: C-index = 0.676). The brier score and calibration curve showed favorable consistency between the predicted and actual survival. The SHAP values was deployed to explain the best machine learning prediction model.

Conclusions

Cox regression and machine learning models combined with the SHAP method can predict the prognosis of ATC patients in clinical practice. However, due to the small sample size and lack of external validation, our findings should be interpreted with caution.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cabanillas ME, McFadden DG, Durante C. Thyroid cancer. Lancet (London England). 2016;388(10061):2783–95.CrossRefPubMed Cabanillas ME, McFadden DG, Durante C. Thyroid cancer. Lancet (London England). 2016;388(10061):2783–95.CrossRefPubMed
2.
go back to reference Kitahara CM, Sosa JA. The changing incidence of thyroid cancer. Nat reviews Endocrinol. 2016;12(11):646–53.CrossRef Kitahara CM, Sosa JA. The changing incidence of thyroid cancer. Nat reviews Endocrinol. 2016;12(11):646–53.CrossRef
3.
go back to reference Miller KD, Fidler-Benaoudia M, Keegan TH, Hipp HS, Jemal A, Siegel RL. Cancer statistics for adolescents and young adults, 2020. Cancer J Clin. 2020;70(6):443–59.CrossRef Miller KD, Fidler-Benaoudia M, Keegan TH, Hipp HS, Jemal A, Siegel RL. Cancer statistics for adolescents and young adults, 2020. Cancer J Clin. 2020;70(6):443–59.CrossRef
4.
go back to reference Megwalu UC, Moon PK. Thyroid Cancer Incidence and Mortality Trends in the United States: 2000–2018. Thyroid: official journal of the American Thyroid Association. 2022;32(5):560–70.CrossRefPubMed Megwalu UC, Moon PK. Thyroid Cancer Incidence and Mortality Trends in the United States: 2000–2018. Thyroid: official journal of the American Thyroid Association. 2022;32(5):560–70.CrossRefPubMed
5.
go back to reference Molinaro E, Romei C, Biagini A, Sabini E, Agate L, Mazzeo S, Materazzi G, Sellari-Franceschini S, Ribechini A, Torregrossa L, et al. Anaplastic thyroid carcinoma: from clinicopathology to genetics and advanced therapies. Nat reviews Endocrinol. 2017;13(11):644–60.CrossRef Molinaro E, Romei C, Biagini A, Sabini E, Agate L, Mazzeo S, Materazzi G, Sellari-Franceschini S, Ribechini A, Torregrossa L, et al. Anaplastic thyroid carcinoma: from clinicopathology to genetics and advanced therapies. Nat reviews Endocrinol. 2017;13(11):644–60.CrossRef
6.
go back to reference Zivaljevic V, Slijepcevic N, Paunovic I, Diklic A, Kalezic N, Marinkovic J, Zivic R, Vekic B, Sipetic S. Risk factors for anaplastic thyroid cancer. Int J Endocrinol. 2014;2014:815070.PubMedPubMedCentral Zivaljevic V, Slijepcevic N, Paunovic I, Diklic A, Kalezic N, Marinkovic J, Zivic R, Vekic B, Sipetic S. Risk factors for anaplastic thyroid cancer. Int J Endocrinol. 2014;2014:815070.PubMedPubMedCentral
7.
go back to reference Roche AM, Fedewa SA, Shi LL, Chen AY. Treatment and survival vary by race/ethnicity in patients with anaplastic thyroid cancer. Cancer. 2018;124(8):1780–90.CrossRefPubMed Roche AM, Fedewa SA, Shi LL, Chen AY. Treatment and survival vary by race/ethnicity in patients with anaplastic thyroid cancer. Cancer. 2018;124(8):1780–90.CrossRefPubMed
8.
go back to reference Pierie JP, Muzikansky A, Gaz RD, Faquin WC, Ott MJ. The effect of surgery and radiotherapy on outcome of anaplastic thyroid carcinoma. Ann Surg Oncol. 2002;9(1):57–64.CrossRefPubMed Pierie JP, Muzikansky A, Gaz RD, Faquin WC, Ott MJ. The effect of surgery and radiotherapy on outcome of anaplastic thyroid carcinoma. Ann Surg Oncol. 2002;9(1):57–64.CrossRefPubMed
9.
go back to reference Lin B, Ma H, Ma M, Zhang Z, Sun Z, Hsieh IY, Okenwa O, Guan H, Li J, Lv W. The incidence and survival analysis for anaplastic thyroid cancer: a SEER database analysis. Am J translational Res. 2019;11(9):5888–96. Lin B, Ma H, Ma M, Zhang Z, Sun Z, Hsieh IY, Okenwa O, Guan H, Li J, Lv W. The incidence and survival analysis for anaplastic thyroid cancer: a SEER database analysis. Am J translational Res. 2019;11(9):5888–96.
10.
go back to reference Joseph KR, Edirimanne S, Eslick GD. Multifocality as a prognostic factor in thyroid cancer: a meta-analysis. Int J Surg (London England). 2018;50:121–5.CrossRef Joseph KR, Edirimanne S, Eslick GD. Multifocality as a prognostic factor in thyroid cancer: a meta-analysis. Int J Surg (London England). 2018;50:121–5.CrossRef
11.
go back to reference Araque KA, Gubbi S, Klubo-Gwiezdzinska J. Updates on the management of thyroid Cancer. Hormone and metabolic research = Hormon- und Stoffwechselforschung = Hormones et metabolisme 2020, 52(8):562–77. Araque KA, Gubbi S, Klubo-Gwiezdzinska J. Updates on the management of thyroid Cancer. Hormone and metabolic research = Hormon- und Stoffwechselforschung = Hormones et metabolisme 2020, 52(8):562–77.
12.
go back to reference Zhang H, Zhao YC, Wu Q, Wang L, Sun S. The prognostic value of lymph node metastasis and the eighth edition of AJCC for patients with anaplastic thyroid cancer. Clin Endocrinol. 2021;95(3):498–507.CrossRef Zhang H, Zhao YC, Wu Q, Wang L, Sun S. The prognostic value of lymph node metastasis and the eighth edition of AJCC for patients with anaplastic thyroid cancer. Clin Endocrinol. 2021;95(3):498–507.CrossRef
13.
go back to reference Gui W, Zhu W, Lu W, Shang C, Zheng F, Lin X, Li H. Development and validation of a prognostic nomogram to predict overall survival and cancer-specific survival for patients with anaplastic thyroid carcinoma. PeerJ. 2020;8:e9173.CrossRefPubMedPubMedCentral Gui W, Zhu W, Lu W, Shang C, Zheng F, Lin X, Li H. Development and validation of a prognostic nomogram to predict overall survival and cancer-specific survival for patients with anaplastic thyroid carcinoma. PeerJ. 2020;8:e9173.CrossRefPubMedPubMedCentral
14.
go back to reference Zhou W, Yue Y, Zhang X. Radiotherapy Plus Chemotherapy leads to prolonged survival in patients with anaplastic thyroid Cancer compared with radiotherapy alone regardless of Surgical Resection and distant metastasis: a Retrospective Population Study. Front Endocrinol. 2021;12:748023.CrossRef Zhou W, Yue Y, Zhang X. Radiotherapy Plus Chemotherapy leads to prolonged survival in patients with anaplastic thyroid Cancer compared with radiotherapy alone regardless of Surgical Resection and distant metastasis: a Retrospective Population Study. Front Endocrinol. 2021;12:748023.CrossRef
15.
go back to reference Huang NS, Shi X, Lei BW, Wei WJ, Lu ZW, Yu PC, Wang Y, Ji QH, Wang YL. An update of the appropriate treatment strategies in anaplastic thyroid Cancer: a Population-Based study of 735 patients. Int J Endocrinol. 2019;2019:8428547.CrossRefPubMedPubMedCentral Huang NS, Shi X, Lei BW, Wei WJ, Lu ZW, Yu PC, Wang Y, Ji QH, Wang YL. An update of the appropriate treatment strategies in anaplastic thyroid Cancer: a Population-Based study of 735 patients. Int J Endocrinol. 2019;2019:8428547.CrossRefPubMedPubMedCentral
16.
go back to reference Qiu B, Li HQ, Chang QG, Yin DT. Nomograms Predict Survival in patients with anaplastic thyroid carcinoma. Med Sci monitor: Int Med J experimental Clin Res. 2019;25:8447–56.CrossRef Qiu B, Li HQ, Chang QG, Yin DT. Nomograms Predict Survival in patients with anaplastic thyroid carcinoma. Med Sci monitor: Int Med J experimental Clin Res. 2019;25:8447–56.CrossRef
17.
go back to reference Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, Wang Y, Dong Q, Shen H, Wang Y. Artificial intelligence in healthcare: past, present and future. Stroke and vascular neurology. 2017;2(4):230–43.CrossRefPubMedPubMedCentral Jiang F, Jiang Y, Zhi H, Dong Y, Li H, Ma S, Wang Y, Dong Q, Shen H, Wang Y. Artificial intelligence in healthcare: past, present and future. Stroke and vascular neurology. 2017;2(4):230–43.CrossRefPubMedPubMedCentral
18.
go back to reference Jajroudi M, Baniasadi T, Kamkar L, Arbabi F, Sanei M, Ahmadzade M. Prediction of survival in thyroid cancer using data mining technique. Technol Cancer Res Treat. 2014;13(4):353–9.CrossRefPubMed Jajroudi M, Baniasadi T, Kamkar L, Arbabi F, Sanei M, Ahmadzade M. Prediction of survival in thyroid cancer using data mining technique. Technol Cancer Res Treat. 2014;13(4):353–9.CrossRefPubMed
19.
go back to reference Lee JH, Ha EJ, Kim D, Jung YJ, Heo S, Jang YH, An SH, Lee K. Application of deep learning to the diagnosis of cervical lymph node metastasis from thyroid cancer with CT: external validation and clinical utility for resident training. Eur Radiol. 2020;30(6):3066–72.CrossRefPubMed Lee JH, Ha EJ, Kim D, Jung YJ, Heo S, Jang YH, An SH, Lee K. Application of deep learning to the diagnosis of cervical lymph node metastasis from thyroid cancer with CT: external validation and clinical utility for resident training. Eur Radiol. 2020;30(6):3066–72.CrossRefPubMed
20.
go back to reference Liu C, Chen S, Yang Y, Shao D, Peng W, Wang Y, Chen Y, Wang Y. The value of the computer-aided diagnosis system for thyroid lesions based on computed tomography images. Quant imaging Med Surg. 2019;9(4):642–53.CrossRefPubMedPubMedCentral Liu C, Chen S, Yang Y, Shao D, Peng W, Wang Y, Chen Y, Wang Y. The value of the computer-aided diagnosis system for thyroid lesions based on computed tomography images. Quant imaging Med Surg. 2019;9(4):642–53.CrossRefPubMedPubMedCentral
21.
go back to reference Zhao Z, Ye C, Hu Y, Li C, Li X. Cascade and Fusion of Multitask Convolutional Neural Networks for Detection of Thyroid Nodules in Contrast-Enhanced CT. Computational intelligence and neuroscience 2019, 2019:7401235. Zhao Z, Ye C, Hu Y, Li C, Li X. Cascade and Fusion of Multitask Convolutional Neural Networks for Detection of Thyroid Nodules in Contrast-Enhanced CT. Computational intelligence and neuroscience 2019, 2019:7401235.
22.
go back to reference Khan K, Ahmad W, Amin MN, Ahmad A, Nazar S, Alabdullah AA. Compressive strength estimation of Steel-Fiber-Reinforced concrete and raw material interactions using Advanced Algorithms. Polymers 2022, 14(15). Khan K, Ahmad W, Amin MN, Ahmad A, Nazar S, Alabdullah AA. Compressive strength estimation of Steel-Fiber-Reinforced concrete and raw material interactions using Advanced Algorithms. Polymers 2022, 14(15).
23.
go back to reference Bible KC, Kebebew E, Brierley J, Brito JP, Cabanillas ME, Clark TJ Jr, Di Cristofano A, Foote R, Giordano T, Kasperbauer J, et al. 2021 american thyroid Association Guidelines for Management of patients with anaplastic thyroid Cancer. Thyroid: official journal of the American Thyroid Association. 2021;31(3):337–86.CrossRefPubMed Bible KC, Kebebew E, Brierley J, Brito JP, Cabanillas ME, Clark TJ Jr, Di Cristofano A, Foote R, Giordano T, Kasperbauer J, et al. 2021 american thyroid Association Guidelines for Management of patients with anaplastic thyroid Cancer. Thyroid: official journal of the American Thyroid Association. 2021;31(3):337–86.CrossRefPubMed
24.
go back to reference Jung Y. Multiple predicting K-fold cross-validation for model selection. J Nonparametric Stat. 2018;30(1):197–215.CrossRef Jung Y. Multiple predicting K-fold cross-validation for model selection. J Nonparametric Stat. 2018;30(1):197–215.CrossRef
25.
go back to reference Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017, 30. Lundberg SM, Lee S-I. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst 2017, 30.
26.
go back to reference Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. J Br Surg. 2015;102(3):148–58.CrossRef Collins GS, Reitsma JB, Altman DG, Moons KG. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. J Br Surg. 2015;102(3):148–58.CrossRef
27.
go back to reference Marchand-Crety C, Pascard M, Debreuve-Theresette A, Ettalhaoui L, Schvartz C, Zalzali M, Brugel M, Bellefqih S, Servagi-Vernat S. Prognostic factors and survival score for patients with anaplastic thyroid carcinoma: a retrospective study from a Regional Registry. Anticancer Res. 2021;41(3):1555–61.CrossRefPubMed Marchand-Crety C, Pascard M, Debreuve-Theresette A, Ettalhaoui L, Schvartz C, Zalzali M, Brugel M, Bellefqih S, Servagi-Vernat S. Prognostic factors and survival score for patients with anaplastic thyroid carcinoma: a retrospective study from a Regional Registry. Anticancer Res. 2021;41(3):1555–61.CrossRefPubMed
28.
go back to reference Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol. 2007;165(6):710–8.CrossRefPubMed Vittinghoff E, McCulloch CE. Relaxing the rule of ten events per variable in logistic and Cox regression. Am J Epidemiol. 2007;165(6):710–8.CrossRefPubMed
29.
go back to reference Zhu W, Xie L, Han J, Guo X. The application of Deep Learning in Cancer Prognosis Prediction. Cancers 2020, 12(3). Zhu W, Xie L, Han J, Guo X. The application of Deep Learning in Cancer Prognosis Prediction. Cancers 2020, 12(3).
30.
go back to reference Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T, Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Med Res Methodol. 2018;18(1):24.CrossRefPubMedPubMedCentral Katzman JL, Shaham U, Cloninger A, Bates J, Jiang T, Kluger Y. DeepSurv: personalized treatment recommender system using a Cox proportional hazards deep neural network. BMC Med Res Methodol. 2018;18(1):24.CrossRefPubMedPubMedCentral
31.
go back to reference Jing B, Zhang T, Wang Z, Jin Y, Liu K, Qiu W, Ke L, Sun Y, He C, Hou D, et al. A deep survival analysis method based on ranking. Artif Intell Med. 2019;98:1–9.CrossRefPubMed Jing B, Zhang T, Wang Z, Jin Y, Liu K, Qiu W, Ke L, Sun Y, He C, Hou D, et al. A deep survival analysis method based on ranking. Artif Intell Med. 2019;98:1–9.CrossRefPubMed
32.
go back to reference Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, Cui C, Corrado G, Thrun S, Dean J. A guide to deep learning in healthcare. Nat Med. 2019;25(1):24–9.CrossRefPubMed Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, Cui C, Corrado G, Thrun S, Dean J. A guide to deep learning in healthcare. Nat Med. 2019;25(1):24–9.CrossRefPubMed
33.
go back to reference Kwon J, Kim BH, Jung HW, Besic N, Sugitani I, Wu HG. The prognostic impacts of postoperative radiotherapy in the patients with resected anaplastic thyroid carcinoma: a systematic review and meta-analysis. Eur J cancer (Oxford England: 1990). 2016;59:34–45.CrossRef Kwon J, Kim BH, Jung HW, Besic N, Sugitani I, Wu HG. The prognostic impacts of postoperative radiotherapy in the patients with resected anaplastic thyroid carcinoma: a systematic review and meta-analysis. Eur J cancer (Oxford England: 1990). 2016;59:34–45.CrossRef
34.
go back to reference Landa I, Ibrahimpasic T, Boucai L, Sinha R, Knauf JA, Shah RH, Dogan S, Ricarte-Filho JC, Krishnamoorthy GP, Xu B, et al. Genomic and transcriptomic hallmarks of poorly differentiated and anaplastic thyroid cancers. J Clin Investig. 2016;126(3):1052–66.CrossRefPubMedPubMedCentral Landa I, Ibrahimpasic T, Boucai L, Sinha R, Knauf JA, Shah RH, Dogan S, Ricarte-Filho JC, Krishnamoorthy GP, Xu B, et al. Genomic and transcriptomic hallmarks of poorly differentiated and anaplastic thyroid cancers. J Clin Investig. 2016;126(3):1052–66.CrossRefPubMedPubMedCentral
35.
go back to reference Tang J, Tian Y, Xi X, Ma J, Li H, Wang L, Zhang B. A novel prognostic model based on log odds of positive lymph nodes to predict outcomes of patients with anaplastic thyroid carcinoma after surgery. Clin Endocrinol 2022. Tang J, Tian Y, Xi X, Ma J, Li H, Wang L, Zhang B. A novel prognostic model based on log odds of positive lymph nodes to predict outcomes of patients with anaplastic thyroid carcinoma after surgery. Clin Endocrinol 2022.
Metadata
Title
Comparison of the cox regression to machine learning in predicting the survival of anaplastic thyroid carcinoma
Authors
Lizhen Xu
Liangchun Cai
Zheng Zhu
Gang Chen
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Endocrine Disorders / Issue 1/2023
Electronic ISSN: 1472-6823
DOI
https://doi.org/10.1186/s12902-023-01368-5

Other articles of this Issue 1/2023

BMC Endocrine Disorders 1/2023 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine