Skip to main content
Top
Published in: BMC Cancer 1/2023

Open Access 01-12-2023 | Metastasis | Research

Two machine learning-based nomogram to predict risk and prognostic factors for liver metastasis from pancreatic neuroendocrine tumors: a multicenter study

Authors: Jianbo Li, Long Huang, Chengyu Liao, Guozhong Liu, Yifeng Tian, Shi Chen

Published in: BMC Cancer | Issue 1/2023

Login to get access

Abstract

Background

Pancreatic neuroendocrine tumors (PNETs) are one of the most common endocrine tumors, and liver metastasis (LMs) are the most common location of metastasis from PNETS; However, there is no valid nomogram to predict the diagnosis and prognosis of liver metastasis (LMs) from PNETs. Therefore, we aimed to develop a valid predictive model to aid physicians in making better clinical decisions.

Methods

We screened patients in the Surveillance, Epidemiology, and End Results (SEER) database from 2010–2016. Feature selection was performed by machine learning algorithms and then models were constructed. Two nomograms were constructed based on the feature selection algorithm to predict the prognosis and risk of LMs from PNETs. We then used the area under the curve (AUC), receiver operating characteristic (ROC) curve, calibration plot and consistency index (C-index) to evaluate the discrimination and accuracy of the nomograms. Kaplan-Meier (K-M) survival curves and decision curve analysis (DCA) were also used further to validate the clinical efficacy of the nomograms. In the external validation set, the same validation is performed.

Results

Of the 1998 patients screened from the SEER database with a pathological diagnosis of PNET, 343 (17.2%) had LMs at the time of diagnosis. The independent risk factors for the occurrence of LMs in PNET patients included histological grade, N stage, surgery, chemotherapy, tumor size and bone metastasis. According to Cox regression analysis, we found that histological subtype, histological grade, surgery, age, and brain metastasis were independent prognostic factors for PNET patients with LMs. Based on these factors, the two nomograms demonstrated good performance in model evaluation.

Conclusion

We developed two clinically significant predictive models to aid physicians in personalized clinical decision-makings.
Appendix
Available only for authorised users
Literature
1.
go back to reference Gray KD, Moore MD, Panjwani S, Elmously A, Afaneh C, Fahey TJ 3rd, et al. Predicting survival and response to treatment in gastroesophageal neuroendocrine tumors: an analysis of the National Cancer Database. Ann Surg Oncol. 2018;25(5):1418–24.CrossRefPubMed Gray KD, Moore MD, Panjwani S, Elmously A, Afaneh C, Fahey TJ 3rd, et al. Predicting survival and response to treatment in gastroesophageal neuroendocrine tumors: an analysis of the National Cancer Database. Ann Surg Oncol. 2018;25(5):1418–24.CrossRefPubMed
2.
go back to reference Dasari A, Shen C, Halperin D, Zhao B, Zhou S, Xu Y, et al. Trends in the incidence, prevalence, and survival outcomes in patients with neuroendocrine tumors in the United States. JAMA Oncol. 2017;3(10):1335–42.CrossRefPubMedPubMedCentral Dasari A, Shen C, Halperin D, Zhao B, Zhou S, Xu Y, et al. Trends in the incidence, prevalence, and survival outcomes in patients with neuroendocrine tumors in the United States. JAMA Oncol. 2017;3(10):1335–42.CrossRefPubMedPubMedCentral
3.
go back to reference Yao JC, Hassan M, Phan A, Dagohoy C, Leary C, Mares JE, et al. One hundred years after “carcinoid”: epidemiology of and prognostic factors for neuroendocrine tumors in 35,825 cases in the United States. J Clin Oncol. 2008;26(18):3063–72.CrossRefPubMed Yao JC, Hassan M, Phan A, Dagohoy C, Leary C, Mares JE, et al. One hundred years after “carcinoid”: epidemiology of and prognostic factors for neuroendocrine tumors in 35,825 cases in the United States. J Clin Oncol. 2008;26(18):3063–72.CrossRefPubMed
4.
go back to reference Mpilla GB, Philip PA, El-Rayes B, Azmi AS. Pancreatic neuroendocrine tumors: therapeutic challenges and research limitations. World J Gastroenterol. 2020;26(28):4036–54.CrossRefPubMedPubMedCentral Mpilla GB, Philip PA, El-Rayes B, Azmi AS. Pancreatic neuroendocrine tumors: therapeutic challenges and research limitations. World J Gastroenterol. 2020;26(28):4036–54.CrossRefPubMedPubMedCentral
5.
go back to reference Spolverato G, Bagante F, Aldrighetti L, Poultsides G, Bauer TW, Field RC, et al. Neuroendocrine liver metastasis: prognostic implications of primary tumor site on patients undergoing curative intent liver surgery. J Gastrointest Surg. 2017;21(12):2039–47.CrossRefPubMed Spolverato G, Bagante F, Aldrighetti L, Poultsides G, Bauer TW, Field RC, et al. Neuroendocrine liver metastasis: prognostic implications of primary tumor site on patients undergoing curative intent liver surgery. J Gastrointest Surg. 2017;21(12):2039–47.CrossRefPubMed
6.
go back to reference Dong DH, Zhang XF, Poultsides G, Rocha F, Weber S, Fields R, et al. Impact of tumor size and nodal status on recurrence of nonfunctional pancreatic neuroendocrine tumors ≤2 cm after curative resection: a multi-institutional study of 392 cases. J Surg Oncol. 2019;120(7):1071–9.CrossRefPubMedPubMedCentral Dong DH, Zhang XF, Poultsides G, Rocha F, Weber S, Fields R, et al. Impact of tumor size and nodal status on recurrence of nonfunctional pancreatic neuroendocrine tumors ≤2 cm after curative resection: a multi-institutional study of 392 cases. J Surg Oncol. 2019;120(7):1071–9.CrossRefPubMedPubMedCentral
7.
go back to reference Chen J, Yang Y, Liu Y, Kan H. Prognosis analysis of patients with pancreatic neuroendocrine tumors after surgical resection and the application of enucleation. World J Surg Oncol. 2021;19(1):11.CrossRefPubMedPubMedCentral Chen J, Yang Y, Liu Y, Kan H. Prognosis analysis of patients with pancreatic neuroendocrine tumors after surgical resection and the application of enucleation. World J Surg Oncol. 2021;19(1):11.CrossRefPubMedPubMedCentral
8.
go back to reference Mou Y, Wang ZY, Tan CL, Chen YH, Liu XB, Ke NW. The role of primary tumor resection in patients with pancreatic neuroendocrine tumors with liver metastases. Front Oncol. 2022;12:838103.CrossRefPubMedPubMedCentral Mou Y, Wang ZY, Tan CL, Chen YH, Liu XB, Ke NW. The role of primary tumor resection in patients with pancreatic neuroendocrine tumors with liver metastases. Front Oncol. 2022;12:838103.CrossRefPubMedPubMedCentral
9.
go back to reference Wei C, Li C, Chen X, Chen G, Nie R, Zhao C, et al. Development and verification of a nomogram for predicting the prognosis of resectable gastric cancer with outlet obstruction. BMC Cancer. 2022;22(1):1154.CrossRefPubMedPubMedCentral Wei C, Li C, Chen X, Chen G, Nie R, Zhao C, et al. Development and verification of a nomogram for predicting the prognosis of resectable gastric cancer with outlet obstruction. BMC Cancer. 2022;22(1):1154.CrossRefPubMedPubMedCentral
10.
go back to reference Zhou L, Zhang Y, Chen W, Niu N, Zhao J, Qi W, et al. Development and validation of a prognostic nomogram for early stage non-small cell lung cancer: a study based on the SEER database and a Chinese cohort. BMC Cancer. 2022;22(1):980.CrossRefPubMedPubMedCentral Zhou L, Zhang Y, Chen W, Niu N, Zhao J, Qi W, et al. Development and validation of a prognostic nomogram for early stage non-small cell lung cancer: a study based on the SEER database and a Chinese cohort. BMC Cancer. 2022;22(1):980.CrossRefPubMedPubMedCentral
11.
go back to reference Strosberg JR, Cheema A, Weber J, Han G, Coppola D, Kvols LK. Prognostic validity of a novel American Joint Committee on Cancer Staging Classification for pancreatic neuroendocrine tumors. J Clin Oncol. 2011;29(22):3044–9.CrossRefPubMed Strosberg JR, Cheema A, Weber J, Han G, Coppola D, Kvols LK. Prognostic validity of a novel American Joint Committee on Cancer Staging Classification for pancreatic neuroendocrine tumors. J Clin Oncol. 2011;29(22):3044–9.CrossRefPubMed
12.
go back to reference Zhang W, Ji L, Wang X, Zhu S, Luo J, Zhang Y, et al. Nomogram predicts risk and prognostic factors for bone metastasis of pancreatic cancer: a population-based analysis. Front Endocrinol (Lausanne). 2021;12:752176.CrossRefPubMed Zhang W, Ji L, Wang X, Zhu S, Luo J, Zhang Y, et al. Nomogram predicts risk and prognostic factors for bone metastasis of pancreatic cancer: a population-based analysis. Front Endocrinol (Lausanne). 2021;12:752176.CrossRefPubMed
13.
go back to reference Zhang W, Ji L, Zhong X, Zhu S, Zhang Y, Ge M, et al. Two novel nomograms predicting the risk and prognosis of pancreatic cancer patients with lung metastases: a population-based study. Front Public Health. 2022;10:884349.CrossRefPubMedPubMedCentral Zhang W, Ji L, Zhong X, Zhu S, Zhang Y, Ge M, et al. Two novel nomograms predicting the risk and prognosis of pancreatic cancer patients with lung metastases: a population-based study. Front Public Health. 2022;10:884349.CrossRefPubMedPubMedCentral
14.
go back to reference Martin MS, Wells GA, Crocker AG, Potter BK, Colman I. Decision curve analysis as a framework to estimate the potential value of screening or other decision-making aids. Int J Methods Psychiatr Res. 2018;27(1):e1601.CrossRefPubMed Martin MS, Wells GA, Crocker AG, Potter BK, Colman I. Decision curve analysis as a framework to estimate the potential value of screening or other decision-making aids. Int J Methods Psychiatr Res. 2018;27(1):e1601.CrossRefPubMed
15.
go back to reference Goto T, Camargo CA Jr, Faridi MK, Yun BJ, Hasegawa K. Machine learning approaches for predicting disposition of asthma and COPD exacerbations in the ED. Am J Emerg Med. 2018;36(9):1650–4.CrossRefPubMed Goto T, Camargo CA Jr, Faridi MK, Yun BJ, Hasegawa K. Machine learning approaches for predicting disposition of asthma and COPD exacerbations in the ED. Am J Emerg Med. 2018;36(9):1650–4.CrossRefPubMed
16.
go back to reference He CB, Zhang Y, Cai ZY, Lin XJ. The impact of surgery in metastatic pancreatic neuroendocrine tumors: a competing risk analysis. Endocr Connect. 2019;8(3):239–51.CrossRefPubMedPubMedCentral He CB, Zhang Y, Cai ZY, Lin XJ. The impact of surgery in metastatic pancreatic neuroendocrine tumors: a competing risk analysis. Endocr Connect. 2019;8(3):239–51.CrossRefPubMedPubMedCentral
17.
go back to reference Masui T, Nagai K, Anazawa T, Kasai Y, Sato A, Nakano K, et al. Risk factors for short recurrence-free survival after resection of pancreatic neuroendocrine tumor (PanNET) liver metastases: which patients should undergo resection? Scand J Gastroenterol. 2020;55(4):479–84.CrossRefPubMed Masui T, Nagai K, Anazawa T, Kasai Y, Sato A, Nakano K, et al. Risk factors for short recurrence-free survival after resection of pancreatic neuroendocrine tumor (PanNET) liver metastases: which patients should undergo resection? Scand J Gastroenterol. 2020;55(4):479–84.CrossRefPubMed
18.
go back to reference Shiozaki H, Shirai Y, Horiuchi T, Yasuda J, Furukawa K, Onda S, et al. Feasible laparoscopic distal pancreatectomy for pancreatic neuroendocrine tumors. Mol Clin Oncol. 2021;14(6):111.CrossRefPubMedPubMedCentral Shiozaki H, Shirai Y, Horiuchi T, Yasuda J, Furukawa K, Onda S, et al. Feasible laparoscopic distal pancreatectomy for pancreatic neuroendocrine tumors. Mol Clin Oncol. 2021;14(6):111.CrossRefPubMedPubMedCentral
19.
go back to reference Zheng M, Chen L, Nie X, Wang D, Zhu J, Wang W, et al. Pancreatic neuroendocrine tumor with ectopic adrenocorticotropic hormone syndrome: a case report and 5-year follow-up. Endocr J. 2022;69(3):243–51.CrossRefPubMed Zheng M, Chen L, Nie X, Wang D, Zhu J, Wang W, et al. Pancreatic neuroendocrine tumor with ectopic adrenocorticotropic hormone syndrome: a case report and 5-year follow-up. Endocr J. 2022;69(3):243–51.CrossRefPubMed
20.
go back to reference Feng L, Yang YJ, Du J, Yu YJ, Diao JD. Marital status and survival of patients with colorectal signet ring cell carcinoma: a population-based study. Sci Rep. 2020;10(1):17881.CrossRefPubMedPubMedCentral Feng L, Yang YJ, Du J, Yu YJ, Diao JD. Marital status and survival of patients with colorectal signet ring cell carcinoma: a population-based study. Sci Rep. 2020;10(1):17881.CrossRefPubMedPubMedCentral
21.
go back to reference Tang CT, Liu BX, Chen Y, Zeng C. Analyzing and predicting the LNM rate and prognosis of patients with intraductal papillary mucinous neoplasm of the pancreas. Cancer Med. 2021;10(6):1925–35.CrossRefPubMedPubMedCentral Tang CT, Liu BX, Chen Y, Zeng C. Analyzing and predicting the LNM rate and prognosis of patients with intraductal papillary mucinous neoplasm of the pancreas. Cancer Med. 2021;10(6):1925–35.CrossRefPubMedPubMedCentral
22.
go back to reference Zou Y, Han H, Ruan S, Jian Z, Jin L, Zhang Y, et al. Development of a nomogram to predict disease-specific survival for patients after resection of a non-metastatic adenocarcinoma of the pancreatic body and tail. Front Oncol. 2020;10:526602.CrossRefPubMedPubMedCentral Zou Y, Han H, Ruan S, Jian Z, Jin L, Zhang Y, et al. Development of a nomogram to predict disease-specific survival for patients after resection of a non-metastatic adenocarcinoma of the pancreatic body and tail. Front Oncol. 2020;10:526602.CrossRefPubMedPubMedCentral
23.
go back to reference Cox TR, Erler JT. Remodeling and homeostasis of the extracellular matrix: implications for fibrotic diseases and cancer. Dis Model Mech. 2011;4(2):165–78.CrossRefPubMedPubMedCentral Cox TR, Erler JT. Remodeling and homeostasis of the extracellular matrix: implications for fibrotic diseases and cancer. Dis Model Mech. 2011;4(2):165–78.CrossRefPubMedPubMedCentral
24.
go back to reference Hendrick RE, Helvie MA, Monticciolo DL. Breast cancer mortality rates have stopped declining in U.S. women younger than 40 years. Radiology. 2021;299(1):143–9.CrossRefPubMed Hendrick RE, Helvie MA, Monticciolo DL. Breast cancer mortality rates have stopped declining in U.S. women younger than 40 years. Radiology. 2021;299(1):143–9.CrossRefPubMed
26.
go back to reference Shukla N, Osazuwa-Peters N, Megwalu UC. Association between age and nodal metastasis in papillary thyroid carcinoma. Otolaryngol Head Neck Surg. 2021;165(1):43–9.CrossRefPubMed Shukla N, Osazuwa-Peters N, Megwalu UC. Association between age and nodal metastasis in papillary thyroid carcinoma. Otolaryngol Head Neck Surg. 2021;165(1):43–9.CrossRefPubMed
27.
go back to reference Long KB, Srivastava A, Hirsch MS, Hornick JL. PAX8 expression in well-differentiated pancreatic endocrine tumors: correlation with clinicopathologic features and comparison with gastrointestinal and pulmonary carcinoid tumors. Am J Surg Pathol. 2010;34(5):723–9.CrossRefPubMed Long KB, Srivastava A, Hirsch MS, Hornick JL. PAX8 expression in well-differentiated pancreatic endocrine tumors: correlation with clinicopathologic features and comparison with gastrointestinal and pulmonary carcinoid tumors. Am J Surg Pathol. 2010;34(5):723–9.CrossRefPubMed
28.
go back to reference Rindi G, Kloppel G, Alhman H, Caplin M, Couvelard A, de Herder WW, et al. TNM staging of foregut (neuro)endocrine tumors: a consensus proposal including a grading system. Virchows Arch. 2006;449(4):395–401.CrossRefPubMedPubMedCentral Rindi G, Kloppel G, Alhman H, Caplin M, Couvelard A, de Herder WW, et al. TNM staging of foregut (neuro)endocrine tumors: a consensus proposal including a grading system. Virchows Arch. 2006;449(4):395–401.CrossRefPubMedPubMedCentral
29.
go back to reference Weiser MR, Landmann RG, Kattan MW, Gonen M, Shia J, Chou J, et al. Individualized prediction of colon cancer recurrence using a nomogram. J Clin Oncol. 2008;26(3):380–5.CrossRefPubMed Weiser MR, Landmann RG, Kattan MW, Gonen M, Shia J, Chou J, et al. Individualized prediction of colon cancer recurrence using a nomogram. J Clin Oncol. 2008;26(3):380–5.CrossRefPubMed
30.
go back to reference Nagtegaal ID, Odze RD, Klimstra D, Paradis V, Rugge M, Schirmacher P, et al. The 2019 WHO classification of tumours of the digestive system. Histopathology. 2020;76(2):182–8.CrossRefPubMed Nagtegaal ID, Odze RD, Klimstra D, Paradis V, Rugge M, Schirmacher P, et al. The 2019 WHO classification of tumours of the digestive system. Histopathology. 2020;76(2):182–8.CrossRefPubMed
31.
go back to reference Rinke A, Muller HH, Schade-Brittinger C, Klose KJ, Barth P, Wied M, et al. Placebo-controlled, double-blind, prospective, randomized study on the effect of octreotide LAR in the control of tumor growth in patients with metastatic neuroendocrine midgut tumors: a report from the PROMID Study Group. J Clin Oncol. 2009;27(28):4656–63.CrossRefPubMed Rinke A, Muller HH, Schade-Brittinger C, Klose KJ, Barth P, Wied M, et al. Placebo-controlled, double-blind, prospective, randomized study on the effect of octreotide LAR in the control of tumor growth in patients with metastatic neuroendocrine midgut tumors: a report from the PROMID Study Group. J Clin Oncol. 2009;27(28):4656–63.CrossRefPubMed
32.
go back to reference Yao JC, Phan AT, Jehl V, Shah G, Meric-Bernstam F. Everolimus in advanced pancreatic neuroendocrine tumors: the clinical experience. Cancer Res. 2013;73(5):1449–53.CrossRefPubMed Yao JC, Phan AT, Jehl V, Shah G, Meric-Bernstam F. Everolimus in advanced pancreatic neuroendocrine tumors: the clinical experience. Cancer Res. 2013;73(5):1449–53.CrossRefPubMed
34.
go back to reference Zhang J, Wang G, Ren J, Yang Z, Li D, Cui Y, et al. Multiparametric MRI-based radiomics nomogram for preoperative prediction of lymphovascular invasion and clinical outcomes in patients with breast invasive ductal carcinoma. Eur Radiol. 2022;32(6):4079–89.CrossRefPubMed Zhang J, Wang G, Ren J, Yang Z, Li D, Cui Y, et al. Multiparametric MRI-based radiomics nomogram for preoperative prediction of lymphovascular invasion and clinical outcomes in patients with breast invasive ductal carcinoma. Eur Radiol. 2022;32(6):4079–89.CrossRefPubMed
Metadata
Title
Two machine learning-based nomogram to predict risk and prognostic factors for liver metastasis from pancreatic neuroendocrine tumors: a multicenter study
Authors
Jianbo Li
Long Huang
Chengyu Liao
Guozhong Liu
Yifeng Tian
Shi Chen
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Cancer / Issue 1/2023
Electronic ISSN: 1471-2407
DOI
https://doi.org/10.1186/s12885-023-10893-4

Other articles of this Issue 1/2023

BMC Cancer 1/2023 Go to the issue
Webinar | 19-02-2024 | 17:30 (CET)

Keynote webinar | Spotlight on antibody–drug conjugates in cancer

Antibody–drug conjugates (ADCs) are novel agents that have shown promise across multiple tumor types. Explore the current landscape of ADCs in breast and lung cancer with our experts, and gain insights into the mechanism of action, key clinical trials data, existing challenges, and future directions.

Dr. Véronique Diéras
Prof. Fabrice Barlesi
Developed by: Springer Medicine