Skip to main content
Top
Published in: Journal of Gastroenterology 6/2021

01-06-2021 | Colorectal Cancer | Original Article—Alimentary Tract

Histopathological characteristics and artificial intelligence for predicting tumor mutational burden-high colorectal cancer

Authors: Yoshifumi Shimada, Shujiro Okuda, Yu Watanabe, Yosuke Tajima, Masayuki Nagahashi, Hiroshi Ichikawa, Masato Nakano, Jun Sakata, Yasumasa Takii, Takashi Kawasaki, Kei-ichi Homma, Tomohiro Kamori, Eiji Oki, Yiwei Ling, Shiho Takeuchi, Toshifumi Wakai

Published in: Journal of Gastroenterology | Issue 6/2021

Login to get access

Abstract

Background

Tumor mutational burden-high (TMB-H), which is detected with gene panel testing, is a promising biomarker for immune checkpoint inhibitors (ICIs) in colorectal cancer (CRC). However, in clinical practice, not every patient is tested for TMB-H using gene panel testing. We aimed to identify the histopathological characteristics of TMB-H CRC for efficient selection of patients who should undergo gene panel testing. Moreover, we attempted to develop a convolutional neural network (CNN)-based algorithm to predict TMB-H CRC directly from hematoxylin and eosin (H&E) slides.

Methods

We used two CRC cohorts tested for TMB-H, and whole-slide H&E digital images were obtained from the cohorts. The Japanese CRC (JP-CRC) cohort (N = 201) was evaluated to detect the histopathological characteristics of TMB-H using H&E slides. The JP-CRC cohort and The Cancer Genome Atlas (TCGA) CRC cohort (N = 77) were used to develop a CNN-based TMB-H prediction model from the H&E digital images.

Results

Tumor-infiltrating lymphocytes (TILs) were significantly associated with TMB-H CRC (P < 0.001). The area under the curve (AUC) for predicting TMB-H CRC was 0.910. We developed a CNN-based TMB-H prediction model. Validation tests were conducted 10 times using randomly selected slides, and the average AUC for predicting TMB-H slides was 0.934.

Conclusions

TILs, a histopathological characteristic detected with H&E slides, are associated with TMB-H CRC. Our CNN-based model has the potential to predict TMB-H CRC directly from H&E slides, thereby reducing the burden on pathologists. These approaches will provide clinicians with important information about the applications of ICIs at low cost.
Appendix
Available only for authorised users
Literature
1.
4.
go back to reference Goodman AM, Kato S, Bazhenova L, et al. Tumor mutational burden as an independent predictor of response to immunotherapy in diverse cancers. Mol Cancer Ther. 2017;16:2598–608.PubMedPubMedCentralCrossRef Goodman AM, Kato S, Bazhenova L, et al. Tumor mutational burden as an independent predictor of response to immunotherapy in diverse cancers. Mol Cancer Ther. 2017;16:2598–608.PubMedPubMedCentralCrossRef
5.
6.
go back to reference Goodman AM, Sokol ES, Frampton GM, et al. Microsatellite-stable tumors with high mutational burden benefit from immunotherapy. Cancer Immunol Res. 2019;7:1570–3.PubMedPubMedCentralCrossRef Goodman AM, Sokol ES, Frampton GM, et al. Microsatellite-stable tumors with high mutational burden benefit from immunotherapy. Cancer Immunol Res. 2019;7:1570–3.PubMedPubMedCentralCrossRef
7.
go back to reference Samstein RM, Lee CH, Shoushtari AN, et al. Tumor mutational load predicts survival after immunotherapy across multiple cancer types. Nat Genet. 2019;51:202–6.PubMedPubMedCentralCrossRef Samstein RM, Lee CH, Shoushtari AN, et al. Tumor mutational load predicts survival after immunotherapy across multiple cancer types. Nat Genet. 2019;51:202–6.PubMedPubMedCentralCrossRef
8.
go back to reference Campbell BB, Light N, Fabrizio D, et al. Comprehensive analysis of hypermutation in human cancer. Cell. 2017;171(1042–1056):e10. Campbell BB, Light N, Fabrizio D, et al. Comprehensive analysis of hypermutation in human cancer. Cell. 2017;171(1042–1056):e10.
9.
go back to reference Mehnert JM, Monjazeb AM, Beerthuijzen JMT, et al. The challenge for development of valuable immuno-oncology biomarkers. Clin Cancer Res. 2017;23:4970–9.PubMedPubMedCentralCrossRef Mehnert JM, Monjazeb AM, Beerthuijzen JMT, et al. The challenge for development of valuable immuno-oncology biomarkers. Clin Cancer Res. 2017;23:4970–9.PubMedPubMedCentralCrossRef
10.
go back to reference Network CGA. Genomic classification of cutaneous melanoma. Cell. 2015;161:1681–96.CrossRef Network CGA. Genomic classification of cutaneous melanoma. Cell. 2015;161:1681–96.CrossRef
11.
12.
go back to reference Cancer Genome Atlas Research Network. Comprehensive molecular characterization of urothelial bladder carcinoma. Nature. 2014;507:315–22.CrossRef Cancer Genome Atlas Research Network. Comprehensive molecular characterization of urothelial bladder carcinoma. Nature. 2014;507:315–22.CrossRef
13.
go back to reference Network CGA. Comprehensive molecular characterization of human colon and rectal cancer. Nature. 2012;487:330–7.CrossRef Network CGA. Comprehensive molecular characterization of human colon and rectal cancer. Nature. 2012;487:330–7.CrossRef
14.
go back to reference Cancer Genome Atlas Research Network. Integrated genomic characterization of endometrial carcinoma. Nature. 2013;497:67–73.CrossRef Cancer Genome Atlas Research Network. Integrated genomic characterization of endometrial carcinoma. Nature. 2013;497:67–73.CrossRef
16.
go back to reference Dudley JC, Lin MT, Le DT, et al. Microsatellite instability as a biomarker for PD-1 blockade. Clin Cancer Res. 2016;22:813–20.PubMedCrossRef Dudley JC, Lin MT, Le DT, et al. Microsatellite instability as a biomarker for PD-1 blockade. Clin Cancer Res. 2016;22:813–20.PubMedCrossRef
17.
go back to reference Fabrizio DA, George TJ Jr, Dunne RF, et al. Beyond microsatellite testing: assessment of tumor mutational burden identifies subsets of colorectal cancer who may respond to immune checkpoint inhibition. J Gastrointest Oncol. 2018;9:610–7.PubMedPubMedCentralCrossRef Fabrizio DA, George TJ Jr, Dunne RF, et al. Beyond microsatellite testing: assessment of tumor mutational burden identifies subsets of colorectal cancer who may respond to immune checkpoint inhibition. J Gastrointest Oncol. 2018;9:610–7.PubMedPubMedCentralCrossRef
19.
go back to reference Nagpal K, Foote D, Liu Y, et al. Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer. NPJ Digit Med. 2019;2:48.PubMedPubMedCentralCrossRef Nagpal K, Foote D, Liu Y, et al. Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer. NPJ Digit Med. 2019;2:48.PubMedPubMedCentralCrossRef
20.
go back to reference Saltz J, Gupta R, Hou L, et al. Spatial organization and molecular correlation of tumor-infiltrating lymphocytes using deep learning on pathology images. Cell Rep. 2018;23(181–193):e7. Saltz J, Gupta R, Hou L, et al. Spatial organization and molecular correlation of tumor-infiltrating lymphocytes using deep learning on pathology images. Cell Rep. 2018;23(181–193):e7.
21.
go back to reference Coudray N, Ocampo PS, Sakellaropoulos T, et al. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018;24:1559–67.PubMedCrossRef Coudray N, Ocampo PS, Sakellaropoulos T, et al. Classification and mutation prediction from non-small cell lung cancer histopathology images using deep learning. Nat Med. 2018;24:1559–67.PubMedCrossRef
22.
go back to reference Kather JN, Pearson AT, Halama N, et al. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer. Nat Med. 2019;25:1054–6.PubMedPubMedCentralCrossRef Kather JN, Pearson AT, Halama N, et al. Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer. Nat Med. 2019;25:1054–6.PubMedPubMedCentralCrossRef
23.
go back to reference Amin MB, Edge S, Greene F, et al editors. AJCC cancer staging manual. 8th ed. New York: Springer International; 2017. Amin MB, Edge S, Greene F, et al editors. AJCC cancer staging manual. 8th ed. New York: Springer International; 2017.
24.
go back to reference Nagahashi M, Wakai T, Shimada Y, et al. Genomic landscape of colorectal cancer in Japan: clinical implications of comprehensive genomic sequencing for precision medicine. Genome Med. 2016;8:136.PubMedPubMedCentralCrossRef Nagahashi M, Wakai T, Shimada Y, et al. Genomic landscape of colorectal cancer in Japan: clinical implications of comprehensive genomic sequencing for precision medicine. Genome Med. 2016;8:136.PubMedPubMedCentralCrossRef
25.
go back to reference Shimada Y, Yagi R, Kameyama H, et al. Utility of comprehensive genomic sequencing for detecting HER2-positive colorectal cancer. Hum Pathol. 2017;66:1–9.PubMedCrossRef Shimada Y, Yagi R, Kameyama H, et al. Utility of comprehensive genomic sequencing for detecting HER2-positive colorectal cancer. Hum Pathol. 2017;66:1–9.PubMedCrossRef
26.
go back to reference Shimada Y, Kameyama H, Nagahashi M, et al. Comprehensive genomic sequencing detects important genetic differences between right-sided and left-sided colorectal cancer. Oncotarget. 2017;8:93567–79.PubMedPubMedCentralCrossRef Shimada Y, Kameyama H, Nagahashi M, et al. Comprehensive genomic sequencing detects important genetic differences between right-sided and left-sided colorectal cancer. Oncotarget. 2017;8:93567–79.PubMedPubMedCentralCrossRef
27.
go back to reference Oyanagi H, Shimada Y, Nagahashi M, et al. SMAD4 alteration associates with invasive-front pathological markers and poor prognosis in colorectal cancer. Histopathology. 2019;74:873–82.PubMedPubMedCentralCrossRef Oyanagi H, Shimada Y, Nagahashi M, et al. SMAD4 alteration associates with invasive-front pathological markers and poor prognosis in colorectal cancer. Histopathology. 2019;74:873–82.PubMedPubMedCentralCrossRef
28.
go back to reference Shimada Y, Muneoka Y, Nagahashi M, et al. BRAF V600E and SRC mutations as molecular markers for predicting prognosis and conversion surgery in Stage IV colorectal cancer. Sci Rep. 2019;9:2466.PubMedPubMedCentralCrossRef Shimada Y, Muneoka Y, Nagahashi M, et al. BRAF V600E and SRC mutations as molecular markers for predicting prognosis and conversion surgery in Stage IV colorectal cancer. Sci Rep. 2019;9:2466.PubMedPubMedCentralCrossRef
29.
30.
go back to reference Okamura T, Shimada Y, Nogami H, et al. Tumor budding detection by immunohistochemical staining is not superior to hematoxylin and eosin staining for predicting lymph node metastasis in pT1 colorectal cancer. Dis Colon Rectum. 2016;59:396–402.PubMedCrossRef Okamura T, Shimada Y, Nogami H, et al. Tumor budding detection by immunohistochemical staining is not superior to hematoxylin and eosin staining for predicting lymph node metastasis in pT1 colorectal cancer. Dis Colon Rectum. 2016;59:396–402.PubMedCrossRef
31.
go back to reference Yagi R, Shimada Y, Kameyama H, et al. Clinical significance of extramural tumor deposits in the lateral pelvic lymph node area in low rectal cancer: A retrospective study at two institutions. Ann Surg Oncol. 2016;23(Suppl 4):552–8.PubMedPubMedCentralCrossRef Yagi R, Shimada Y, Kameyama H, et al. Clinical significance of extramural tumor deposits in the lateral pelvic lymph node area in low rectal cancer: A retrospective study at two institutions. Ann Surg Oncol. 2016;23(Suppl 4):552–8.PubMedPubMedCentralCrossRef
32.
go back to reference Tajima Y, Shimada Y, Kameyama H, et al. Association between poorly differentiated clusters and efficacy of 5-fluorouracil-based adjuvant chemotherapy in stage III colorectal cancer. Jpn J Clin Oncol. 2017;47:313–20.PubMedPubMedCentralCrossRef Tajima Y, Shimada Y, Kameyama H, et al. Association between poorly differentiated clusters and efficacy of 5-fluorouracil-based adjuvant chemotherapy in stage III colorectal cancer. Jpn J Clin Oncol. 2017;47:313–20.PubMedPubMedCentralCrossRef
33.
go back to reference Konishi T, Shimada Y, Lee LH, et al. Poorly differentiated clusters predict colon cancer recurrence: An in-Depth comparative analysis of invasive-front prognostic markers. Am J Surg Pathol. 2018;42:705–14.PubMedPubMedCentralCrossRef Konishi T, Shimada Y, Lee LH, et al. Poorly differentiated clusters predict colon cancer recurrence: An in-Depth comparative analysis of invasive-front prognostic markers. Am J Surg Pathol. 2018;42:705–14.PubMedPubMedCentralCrossRef
34.
go back to reference Shia J, Ellis NA, Paty PB, et al. Value of histopathology in predicting microsatellite instability in hereditary nonpolyposis colorectal cancer and sporadic colorectal cancer. Am J Surg Pathol. 2003;27:1407–17.PubMedCrossRef Shia J, Ellis NA, Paty PB, et al. Value of histopathology in predicting microsatellite instability in hereditary nonpolyposis colorectal cancer and sporadic colorectal cancer. Am J Surg Pathol. 2003;27:1407–17.PubMedCrossRef
35.
go back to reference Smyrk TC, Watson P, Kaul K, et al. Tumor-infiltrating lymphocytes are a marker for microsatellite instability in colorectal carcinoma. Cancer. 2001;91:2417–22.PubMedCrossRef Smyrk TC, Watson P, Kaul K, et al. Tumor-infiltrating lymphocytes are a marker for microsatellite instability in colorectal carcinoma. Cancer. 2001;91:2417–22.PubMedCrossRef
36.
go back to reference Ueno H, Hashiguchi Y, Shimazaki H, et al. Objective criteria for crohn-like lymphoid reaction in colorectal cancer. Am J Clin Pathol. 2013;139:434–41.PubMedCrossRef Ueno H, Hashiguchi Y, Shimazaki H, et al. Objective criteria for crohn-like lymphoid reaction in colorectal cancer. Am J Clin Pathol. 2013;139:434–41.PubMedCrossRef
37.
go back to reference Shia J, Black D, Hummer AJ, et al. Routinely assessed morphological features correlate with microsatellite instability status in endometrial cancer. Hum Pathol. 2008;39:116–25.PubMedCrossRef Shia J, Black D, Hummer AJ, et al. Routinely assessed morphological features correlate with microsatellite instability status in endometrial cancer. Hum Pathol. 2008;39:116–25.PubMedCrossRef
38.
go back to reference El Jabbour T, Ross JS, Sheehan CE, et al. PD-L1 protein expression in tumour cells and immune cells in mismatch repair protein-deficient and -proficient colorectal cancer: the foundation study using the SP142 antibody and whole section immunohistochemistry. J Clin Pathol. 2018;71:46–51.PubMedCrossRef El Jabbour T, Ross JS, Sheehan CE, et al. PD-L1 protein expression in tumour cells and immune cells in mismatch repair protein-deficient and -proficient colorectal cancer: the foundation study using the SP142 antibody and whole section immunohistochemistry. J Clin Pathol. 2018;71:46–51.PubMedCrossRef
39.
go back to reference Luchini C, Bibeau F, Ligtenberg MJL, et al. ESMO recommendations on microsatellite instability testing for immunotherapy in cancer, and its relationship with PD-1/PD-L1 expression and tumour mutational burden: a systematic review-based approach. Ann Oncol. 2019;30(8):1232–43.PubMedCrossRef Luchini C, Bibeau F, Ligtenberg MJL, et al. ESMO recommendations on microsatellite instability testing for immunotherapy in cancer, and its relationship with PD-1/PD-L1 expression and tumour mutational burden: a systematic review-based approach. Ann Oncol. 2019;30(8):1232–43.PubMedCrossRef
40.
go back to reference Gehring JS, Fischer B, Lawrence M, et al. SomaticSignatures: inferring mutational signatures from single-nucleotide variants. Bioinformatics. 2015;31:3673–5.PubMedPubMedCentral Gehring JS, Fischer B, Lawrence M, et al. SomaticSignatures: inferring mutational signatures from single-nucleotide variants. Bioinformatics. 2015;31:3673–5.PubMedPubMedCentral
41.
go back to reference Szegedy C, Vanhoucke V, Ioffe S, et al. IEEE conference on computer vision and pattern recognition. 2016. pp. 2818–26. Szegedy C, Vanhoucke V, Ioffe S, et al. IEEE conference on computer vision and pattern recognition. 2016. pp. 2818–26.
42.
go back to reference Shia J, Schultz N, Kuk D, et al. Morphological characterization of colorectal cancers in The Cancer Genome Atlas reveals distinct morphology-molecular associations: clinical and biological implications. Mod Pathol. 2017;30:599–609.PubMedCrossRef Shia J, Schultz N, Kuk D, et al. Morphological characterization of colorectal cancers in The Cancer Genome Atlas reveals distinct morphology-molecular associations: clinical and biological implications. Mod Pathol. 2017;30:599–609.PubMedCrossRef
43.
go back to reference Yaeger R, Cercek A, Chou JF, et al. BRAF mutation predicts for poor outcomes after metastasectomy in patients with metastatic colorectal cancer. Cancer. 2014;120:2316–24.PubMedCrossRef Yaeger R, Cercek A, Chou JF, et al. BRAF mutation predicts for poor outcomes after metastasectomy in patients with metastatic colorectal cancer. Cancer. 2014;120:2316–24.PubMedCrossRef
44.
go back to reference Chang SC, Lin PC, Lin JK, et al. Mutation spectra of common cancer-associated genes in different phenotypes of colorectal carcinoma without distant metastasis. Ann Surg Oncol. 2016;23:849–55.PubMedCrossRef Chang SC, Lin PC, Lin JK, et al. Mutation spectra of common cancer-associated genes in different phenotypes of colorectal carcinoma without distant metastasis. Ann Surg Oncol. 2016;23:849–55.PubMedCrossRef
45.
go back to reference Angelova M, Charoentong P, Hackl H, et al. The colorectal cancer immune paradox revisited. Oncoimmunology. 2016;5:e1078058.PubMedCrossRef Angelova M, Charoentong P, Hackl H, et al. The colorectal cancer immune paradox revisited. Oncoimmunology. 2016;5:e1078058.PubMedCrossRef
46.
go back to reference Pages F, Mlecnik B, Marliot F, et al. International validation of the consensus Immunoscore for the classification of colon cancer: a prognostic and accuracy study. Lancet. 2018;391:2128–39.PubMedCrossRef Pages F, Mlecnik B, Marliot F, et al. International validation of the consensus Immunoscore for the classification of colon cancer: a prognostic and accuracy study. Lancet. 2018;391:2128–39.PubMedCrossRef
48.
go back to reference Innocenti F, Ou FS, Qu X, et al. Mutational analysis of patients with colorectal cancer in CALGB/SWOG 80405 identifies new Roles of microsatellite instability and tumor mutational burden for patient outcome. J Clin Oncol. 2019;37:1217–27.PubMedPubMedCentralCrossRef Innocenti F, Ou FS, Qu X, et al. Mutational analysis of patients with colorectal cancer in CALGB/SWOG 80405 identifies new Roles of microsatellite instability and tumor mutational burden for patient outcome. J Clin Oncol. 2019;37:1217–27.PubMedPubMedCentralCrossRef
49.
go back to reference Jass JR. HNPCC and sporadic MSI-H colorectal cancer: a review of the morphological similarities and differences. Fam Cancer. 2004;3:93–100.PubMedCrossRef Jass JR. HNPCC and sporadic MSI-H colorectal cancer: a review of the morphological similarities and differences. Fam Cancer. 2004;3:93–100.PubMedCrossRef
50.
go back to reference Shia J. Evolving approach and clinical significance of detecting DNA mismatch repair deficiency in colorectal carcinoma. Semin Diagn Pathol. 2015;32:352–61.PubMedPubMedCentralCrossRef Shia J. Evolving approach and clinical significance of detecting DNA mismatch repair deficiency in colorectal carcinoma. Semin Diagn Pathol. 2015;32:352–61.PubMedPubMedCentralCrossRef
51.
52.
go back to reference Marabelle A, Fakih M, Lopez J, et al. Association of tumour mutational burden with outcomes in patients with advanced solid tumours treated with pembrolizumab: prospective biomarker analysis of the multicohort, open-label, phase 2 KEYNOTE-158 study. Lancet Oncol. 2020;21:1353–65.PubMedCrossRef Marabelle A, Fakih M, Lopez J, et al. Association of tumour mutational burden with outcomes in patients with advanced solid tumours treated with pembrolizumab: prospective biomarker analysis of the multicohort, open-label, phase 2 KEYNOTE-158 study. Lancet Oncol. 2020;21:1353–65.PubMedCrossRef
53.
go back to reference Loupakis F, Depetris I, Biason P, et al. Prediction of benefit from checkpoint inhibitors in mismatch repair deficient metastatic colorectal cancer: role of tumor infiltrating lymphocytes. Oncologist. 2020;25:481–7.PubMedPubMedCentralCrossRef Loupakis F, Depetris I, Biason P, et al. Prediction of benefit from checkpoint inhibitors in mismatch repair deficient metastatic colorectal cancer: role of tumor infiltrating lymphocytes. Oncologist. 2020;25:481–7.PubMedPubMedCentralCrossRef
Metadata
Title
Histopathological characteristics and artificial intelligence for predicting tumor mutational burden-high colorectal cancer
Authors
Yoshifumi Shimada
Shujiro Okuda
Yu Watanabe
Yosuke Tajima
Masayuki Nagahashi
Hiroshi Ichikawa
Masato Nakano
Jun Sakata
Yasumasa Takii
Takashi Kawasaki
Kei-ichi Homma
Tomohiro Kamori
Eiji Oki
Yiwei Ling
Shiho Takeuchi
Toshifumi Wakai
Publication date
01-06-2021
Publisher
Springer Singapore
Published in
Journal of Gastroenterology / Issue 6/2021
Print ISSN: 0944-1174
Electronic ISSN: 1435-5922
DOI
https://doi.org/10.1007/s00535-021-01789-w

Other articles of this Issue 6/2021

Journal of Gastroenterology 6/2021 Go to the issue
Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin
Prof. Florian Limbourg
Prof. Anoop Chauhan
Developed by: Springer Medicine
Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.