Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2020

Open Access 01-12-2020 | Artificial Intelligence | Research article

Novel prognostication of patients with spinal and pelvic chondrosarcoma using deep survival neural networks

Authors: Sung Mo Ryu, Sung Wook Seo, Sun-Ho Lee

Published in: BMC Medical Informatics and Decision Making | Issue 1/2020

Login to get access

Abstract

Background

We used the Surveillance, Epidemiology, and End Results (SEER) database to develop and validate deep survival neural network machine learning (ML) algorithms to predict survival following a spino-pelvic chondrosarcoma diagnosis.

Methods

The SEER 18 registries were used to apply the Risk Estimate Distance Survival Neural Network (RED_SNN) in the model. Our model was evaluated at each time window with receiver operating characteristic curves and areas under the curves (AUCs), as was the concordance index (c-index).

Results

The subjects (n = 1088) were separated into training (80%, n = 870) and test sets (20%, n = 218). The training data were randomly sorted into training and validation sets using 5-fold cross validation. The median c-index of the five validation sets was 0.84 (95% confidence interval 0.79–0.87). The median AUC of the five validation subsets was 0.84. This model was evaluated with the previously separated test set. The c-index was 0.82 and the mean AUC of the 30 different time windows was 0.85 (standard deviation 0.02). According to the estimated survival probability (by 62 months), we divided the test group into five subgroups. The survival curves of the subgroups showed statistically significant separation (p < 0.001).

Conclusions

This study is the first to analyze population-level data using artificial neural network ML algorithms for the role and outcomes of surgical resection and radiation therapy in spino-pelvic chondrosarcoma.
Appendix
Available only for authorised users
Literature
1.
go back to reference McGirt MJ, Gokaslan ZL, Chaichana KL. Preoperative grading scale to predict survival in patients undergoing resection of malignant primary osseous spinal neoplasms. Spine J. 2011;11:190–6.CrossRef McGirt MJ, Gokaslan ZL, Chaichana KL. Preoperative grading scale to predict survival in patients undergoing resection of malignant primary osseous spinal neoplasms. Spine J. 2011;11:190–6.CrossRef
2.
go back to reference Mukherjee D, Chaichana KL, Adogwa O, Gokaslan Z, Aaronson O, Cheng JS, et al. Association of extent of local tumor invasion and survival in patients with malignant primary osseous spinal neoplasms from the surveillance, epidemiology, and end results (SEER) database. World Neurosurg. 2011;76:580–5.CrossRef Mukherjee D, Chaichana KL, Adogwa O, Gokaslan Z, Aaronson O, Cheng JS, et al. Association of extent of local tumor invasion and survival in patients with malignant primary osseous spinal neoplasms from the surveillance, epidemiology, and end results (SEER) database. World Neurosurg. 2011;76:580–5.CrossRef
3.
go back to reference Mukherjee D, Chaichana KL, Gokaslan ZL, Aaronson O, Cheng JS, McGirt MJ. Survival of patients with malignant primary osseous spinal neoplasms: results from the surveillance, epidemiology, and end results (SEER) database from 1973 to 2003. J Neurosurg Spine. 2011;14:143–50.CrossRef Mukherjee D, Chaichana KL, Gokaslan ZL, Aaronson O, Cheng JS, McGirt MJ. Survival of patients with malignant primary osseous spinal neoplasms: results from the surveillance, epidemiology, and end results (SEER) database from 1973 to 2003. J Neurosurg Spine. 2011;14:143–50.CrossRef
4.
go back to reference Mukherjee D, Chaichana KL, Parker SL, Gokaslan ZL, McGirt MJ. Association of surgical resection and survival in patients with malignant primary osseous spinal neoplasms from the surveillance, epidemiology, and end results (SEER) database. Eur Spine J. 2013;22:1375–82.CrossRef Mukherjee D, Chaichana KL, Parker SL, Gokaslan ZL, McGirt MJ. Association of surgical resection and survival in patients with malignant primary osseous spinal neoplasms from the surveillance, epidemiology, and end results (SEER) database. Eur Spine J. 2013;22:1375–82.CrossRef
5.
go back to reference Reni M, Gatta G, Mazza E, Vecht C. Ependymoma. Crit Rev Oncol Hematol. 2007;63:81–9.CrossRef Reni M, Gatta G, Mazza E, Vecht C. Ependymoma. Crit Rev Oncol Hematol. 2007;63:81–9.CrossRef
6.
go back to reference Giuffrida AY, Burgueno JE, Koniaris LG, Gutierrez JC, Duncan R, Scully SP. Chondrosarcoma in the United States (1973 to 2003): an analysis of 2890 cases from the SEER database. J Bone Joint Surg Am. 2009;91:1063–72.CrossRef Giuffrida AY, Burgueno JE, Koniaris LG, Gutierrez JC, Duncan R, Scully SP. Chondrosarcoma in the United States (1973 to 2003): an analysis of 2890 cases from the SEER database. J Bone Joint Surg Am. 2009;91:1063–72.CrossRef
7.
go back to reference Nathoo N, Mendel E. The National Cancer Institute's SEER registry and primary malignant osseous spine tumors. World Neurosurg. 2011;76:531–2.CrossRef Nathoo N, Mendel E. The National Cancer Institute's SEER registry and primary malignant osseous spine tumors. World Neurosurg. 2011;76:531–2.CrossRef
8.
go back to reference Arshi A, Sharim J, Park DY, Park HY, Bernthal NM, Yazdanshenas H, et al. Chondrosarcoma of the Osseous Spine: An Analysis of Epidemiology, Patient Outcomes, and Prognostic Factors Using the SEER Registry From 1973 to 2012. Spine (Phila Pa 1976). 2017;42:644–52.CrossRef Arshi A, Sharim J, Park DY, Park HY, Bernthal NM, Yazdanshenas H, et al. Chondrosarcoma of the Osseous Spine: An Analysis of Epidemiology, Patient Outcomes, and Prognostic Factors Using the SEER Registry From 1973 to 2012. Spine (Phila Pa 1976). 2017;42:644–52.CrossRef
9.
go back to reference Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med. 2016;375:1216–9.CrossRef Obermeyer Z, Emanuel EJ. Predicting the future - big data, machine learning, and clinical medicine. N Engl J Med. 2016;375:1216–9.CrossRef
10.
go back to reference Cruz JA, Wishart DS. Applications of machine learning in cancer prediction and prognosis. Cancer Inform. 2007;2:59–77.PubMedPubMedCentral Cruz JA, Wishart DS. Applications of machine learning in cancer prediction and prognosis. Cancer Inform. 2007;2:59–77.PubMedPubMedCentral
11.
go back to reference Karhade AV, Thio Q, Ogink P, Kim J, Lozano-Calderon S, Raskin K, et al. Development of machine learning algorithms for prediction of 5-year spinal Chordoma survival. World Neurosurg. 2018;119:e842–7.CrossRef Karhade AV, Thio Q, Ogink P, Kim J, Lozano-Calderon S, Raskin K, et al. Development of machine learning algorithms for prediction of 5-year spinal Chordoma survival. World Neurosurg. 2018;119:e842–7.CrossRef
12.
go back to reference Bergh P, Gunterberg B, Meis-Kindblom JM, Kindblom LG. Prognostic factors and outcome of pelvic, sacral, and spinal chondrosarcomas: a center-based study of 69 cases. Cancer. 2001;91:1201–12.CrossRef Bergh P, Gunterberg B, Meis-Kindblom JM, Kindblom LG. Prognostic factors and outcome of pelvic, sacral, and spinal chondrosarcomas: a center-based study of 69 cases. Cancer. 2001;91:1201–12.CrossRef
13.
go back to reference Boriani S, De Iure F, Bandiera S, Campanacci L, Biagini R, Di Fiore M, et al. Chondrosarcoma of the mobile spine: report on 22 cases. Spine (Phila Pa 1976). 2000;25:804–12.CrossRef Boriani S, De Iure F, Bandiera S, Campanacci L, Biagini R, Di Fiore M, et al. Chondrosarcoma of the mobile spine: report on 22 cases. Spine (Phila Pa 1976). 2000;25:804–12.CrossRef
14.
go back to reference Gitelis S, Bertoni F, Picci P, Campanacci M. Chondrosarcoma of bone. The experience at the Istituto Ortopedico Rizzoli. J Bone Joint Surg Am. 1981;63:1248–57.CrossRef Gitelis S, Bertoni F, Picci P, Campanacci M. Chondrosarcoma of bone. The experience at the Istituto Ortopedico Rizzoli. J Bone Joint Surg Am. 1981;63:1248–57.CrossRef
15.
go back to reference Henderson ED, Dahlin DC. Chondrosarcoma of bone--a study of two hundred and eighty-eight cases. J Bone Joint Surg Am. 1963;45:1450–8.CrossRef Henderson ED, Dahlin DC. Chondrosarcoma of bone--a study of two hundred and eighty-eight cases. J Bone Joint Surg Am. 1963;45:1450–8.CrossRef
16.
go back to reference Schoenfeld AJ, Hornicek FJ, Pedlow FX, Kobayashi W, Raskin KA, Springfield D, et al. Chondrosarcoma of the mobile spine: a review of 21 cases treated at a single center. Spine (Phila Pa 1976). 2012;37:119–26.CrossRef Schoenfeld AJ, Hornicek FJ, Pedlow FX, Kobayashi W, Raskin KA, Springfield D, et al. Chondrosarcoma of the mobile spine: a review of 21 cases treated at a single center. Spine (Phila Pa 1976). 2012;37:119–26.CrossRef
17.
go back to reference Shives TC, McLeod RA, Unni KK, Schray MF. Chondrosarcoma of the spine. J Bone Joint Surg Am. 1989;71:1158–65.CrossRef Shives TC, McLeod RA, Unni KK, Schray MF. Chondrosarcoma of the spine. J Bone Joint Surg Am. 1989;71:1158–65.CrossRef
18.
go back to reference Stuckey RM, Marco RA. Chondrosarcoma of the mobile spine and sacrum. Sarcoma. 2011;2011:274281.CrossRef Stuckey RM, Marco RA. Chondrosarcoma of the mobile spine and sacrum. Sarcoma. 2011;2011:274281.CrossRef
19.
go back to reference Zhou ZH, Jiang Y. Medical diagnosis with C4.5 Rule preceded by artificial neural network ensemble. IEEE Trans Inf Technol Biomed. 2003;7:37–42.CrossRef Zhou ZH, Jiang Y. Medical diagnosis with C4.5 Rule preceded by artificial neural network ensemble. IEEE Trans Inf Technol Biomed. 2003;7:37–42.CrossRef
20.
go back to reference Delen D, Walker G, Kadam A. Predicting breast cancer survivability: a comparison of three data mining methods. Artif Intell Med. 2005;34:113–27.CrossRef Delen D, Walker G, Kadam A. Predicting breast cancer survivability: a comparison of three data mining methods. Artif Intell Med. 2005;34:113–27.CrossRef
21.
go back to reference Endo A, Shibata T, Tanaka H. Comparison of seven algorithms to predict breast Cancer survival(<special issue>contribution to 21 century intelligent technologies and bioinformatics). Int J Biomedical Soft Computing Hum Sci. 2008;13:11–6. Endo A, Shibata T, Tanaka H. Comparison of seven algorithms to predict breast Cancer survival(<special issue>contribution to 21 century intelligent technologies and bioinformatics). Int J Biomedical Soft Computing Hum Sci. 2008;13:11–6.
22.
go back to reference Groves ML, Zadnik PL, Kaloostian P, Sui J, Goodwin CR, Wolinsky JP, et al. Epidemiologic, functional, and oncologic outcome analysis of spinal sarcomas treated surgically at a single institution over 10 years. Spine J. 2015;15:110–4.CrossRef Groves ML, Zadnik PL, Kaloostian P, Sui J, Goodwin CR, Wolinsky JP, et al. Epidemiologic, functional, and oncologic outcome analysis of spinal sarcomas treated surgically at a single institution over 10 years. Spine J. 2015;15:110–4.CrossRef
23.
go back to reference Hsieh PC, Xu R, Sciubba DM, McGirt MJ, Nelson C, Witham TF, et al. Long-term clinical outcomes following en bloc resections for sacral chordomas and chondrosarcomas: a series of twenty consecutive patients. Spine (Phila Pa 1976). 2009;34:2233–9.CrossRef Hsieh PC, Xu R, Sciubba DM, McGirt MJ, Nelson C, Witham TF, et al. Long-term clinical outcomes following en bloc resections for sacral chordomas and chondrosarcomas: a series of twenty consecutive patients. Spine (Phila Pa 1976). 2009;34:2233–9.CrossRef
24.
go back to reference Strike SA, McCarthy EF. Chondrosarcoma of the spine: a series of 16 cases and a review of the literature. Iowa Orthop J. 2011;31:154–9.PubMedPubMedCentral Strike SA, McCarthy EF. Chondrosarcoma of the spine: a series of 16 cases and a review of the literature. Iowa Orthop J. 2011;31:154–9.PubMedPubMedCentral
25.
go back to reference Sgouros S, Malluci CL, Jackowski A. Spinal ependymomas--the value of postoperative radiotherapy for residual disease control. Br J Neurosurg. 1996;10:559–66.CrossRef Sgouros S, Malluci CL, Jackowski A. Spinal ependymomas--the value of postoperative radiotherapy for residual disease control. Br J Neurosurg. 1996;10:559–66.CrossRef
26.
go back to reference Chen D, Xing K, Henson D, Sheng L, Schwartz AM, Cheng X. Developing prognostic systems of cancer patients by ensemble clustering. J Biomed Biotechnol. 2009;2009:632786.PubMedPubMedCentral Chen D, Xing K, Henson D, Sheng L, Schwartz AM, Cheng X. Developing prognostic systems of cancer patients by ensemble clustering. J Biomed Biotechnol. 2009;2009:632786.PubMedPubMedCentral
27.
go back to reference Pica A, Miller R, Villa S, Kadish SP, Anacak Y, Abusaris H, et al. The results of surgery, with or without radiotherapy, for primary spinal myxopapillary ependymoma: a retrospective study from the rare cancer network. Int J Radiat Oncol Biol Phys. 2009;74:1114–20.CrossRef Pica A, Miller R, Villa S, Kadish SP, Anacak Y, Abusaris H, et al. The results of surgery, with or without radiotherapy, for primary spinal myxopapillary ependymoma: a retrospective study from the rare cancer network. Int J Radiat Oncol Biol Phys. 2009;74:1114–20.CrossRef
28.
go back to reference Ravdin PM, Clark GM. A practical application of neural network analysis for predicting outcome of individual breast cancer patients. Breast Cancer Res Treat. 1992;22:285–93.CrossRef Ravdin PM, Clark GM. A practical application of neural network analysis for predicting outcome of individual breast cancer patients. Breast Cancer Res Treat. 1992;22:285–93.CrossRef
29.
go back to reference Faraggi D, Simon R. A neural network model for survival data. Stat Med. 1995;14:73–82.CrossRef Faraggi D, Simon R. A neural network model for survival data. Stat Med. 1995;14:73–82.CrossRef
30.
go back to reference Park K, Ali A, Kim D, An Y, Kim M, Shin H. Robust predictive model for evaluating breast cancer survivability. Eng Appl Artif Intell. 2013;26:2194–205.CrossRef Park K, Ali A, Kim D, An Y, Kim M, Shin H. Robust predictive model for evaluating breast cancer survivability. Eng Appl Artif Intell. 2013;26:2194–205.CrossRef
31.
go back to reference Oh SE, Seo SW, Choi MG, Sohn TS, Bae JM, Kim S. Prediction of overall survival and novel classification of patients with gastric Cancer using the survival recurrent network. Ann Surg Oncol. 2018;25:1153–9.CrossRef Oh SE, Seo SW, Choi MG, Sohn TS, Bae JM, Kim S. Prediction of overall survival and novel classification of patients with gastric Cancer using the survival recurrent network. Ann Surg Oncol. 2018;25:1153–9.CrossRef
32.
go back to reference Navid F, Willert JR, McCarville MB, Furman W, Watkins A, Roberts W, et al. Combination of gemcitabine and docetaxel in the treatment of children and young adults with refractory bone sarcoma. Cancer. 2008;113:419–25.CrossRef Navid F, Willert JR, McCarville MB, Furman W, Watkins A, Roberts W, et al. Combination of gemcitabine and docetaxel in the treatment of children and young adults with refractory bone sarcoma. Cancer. 2008;113:419–25.CrossRef
33.
go back to reference Rao G, Suki D, Chakrabarti I, Feiz-Erfan I, Mody MG, McCutcheon IE, et al. Surgical management of primary and metastatic sarcoma of the mobile spine. J Neurosurg Spine. 2008;9:120–8.CrossRef Rao G, Suki D, Chakrabarti I, Feiz-Erfan I, Mody MG, McCutcheon IE, et al. Surgical management of primary and metastatic sarcoma of the mobile spine. J Neurosurg Spine. 2008;9:120–8.CrossRef
34.
go back to reference Wagner LM, McAllister N, Goldsby RE, Rausen AR, McNall-Knapp RY, McCarville MB, et al. Temozolomide and intravenous irinotecan for treatment of advanced Ewing sarcoma. Pediatr Blood Cancer. 2007;48:132–9.CrossRef Wagner LM, McAllister N, Goldsby RE, Rausen AR, McNall-Knapp RY, McCarville MB, et al. Temozolomide and intravenous irinotecan for treatment of advanced Ewing sarcoma. Pediatr Blood Cancer. 2007;48:132–9.CrossRef
Metadata
Title
Novel prognostication of patients with spinal and pelvic chondrosarcoma using deep survival neural networks
Authors
Sung Mo Ryu
Sung Wook Seo
Sun-Ho Lee
Publication date
01-12-2020
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2020
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-019-1008-4

Other articles of this Issue 1/2020

BMC Medical Informatics and Decision Making 1/2020 Go to the issue