Skip to main content
Top
Published in: Journal of Digital Imaging 4/2020

01-08-2020 | NSCLC | Original Paper

Prediction of Non-small Cell Lung Cancer Histology by a Deep Ensemble of Convolutional and Bidirectional Recurrent Neural Network

Authors: Dipanjan Moitra, Rakesh Kumar Mandal

Published in: Journal of Imaging Informatics in Medicine | Issue 4/2020

Login to get access

Abstract

Histology subtype prediction is a major task for grading non-small cell lung cancer (NSCLC) tumors. Invasive methods such as biopsy often lack in tumor sample, and as a result radiologists or oncologists find it difficult to detect proper histology of NSCLC tumors. The non-invasive methods such as machine learning may play a useful role to predict NSCLC histology by using medical image biomarkers. Few attempts have so far been made to predict NSCLC histology by considering all the major subtypes. The present study aimed to develop a more accurate deep learning model by clubbing convolutional and bidirectional recurrent neural networks. The NSCLC Radiogenomics dataset having 211 subjects was used in the study. Ten best models found during experimentation were averaged to form an ensemble. The model ensemble was executed with 10-fold repeated stratified cross-validation, and the results got were tested with metrics like accuracy, recall, precision, F1-score, Cohen’s kappa, and ROC-AUC score. The accuracy of the ensemble model showed considerable improvement over the best model found with the single model. The proposed model may help significantly in the automated prognosis of NSCLC and other types of cancers.
Literature
1.
go back to reference K. M. Kerr, L. Bubendorf, M. J. Edelman, A. Marchetti, T. Mok, S. Novello, K. O'Byrne, R. Stahel, S. Peters, E. Felip, Panel Members, Rolf Stahel, Enriqueta Felip, Solange Peters, Keith Kerr, Benjamin Besse, Johan Vansteenkiste, Wilfried Eberhardt, Martin Edelman, Tony Mok, Ken O'Byrne, Silvia Novello, Lukas Bubendorf, Antonio Marchetti, Paul Baas, Martin Reck, Konstantinos Syrigos, Luis Paz-Ares, Egbert F. Smit, Peter Meldgaard, Alex Adjei, Marianne Nicolson, Lucio Crinò, Paul Van Schil, Suresh Senan, Corinne Faivre-Finn, Gaetano Rocco, Giulia Veronesi, Jean-Yves Douillard, Eric Lim, Christophe Dooms, Walter Weder, Dirk De Ruysscher, Cecile De Pechoux, Paul De Leyn, Virginie Westeel, Second ESMO consensus conference on lung cancer: pathology and molecular biomarkers for non-small-cell lung cancer, Annals of Oncology, Volume 25, Issue 9, 2014, 1681–1690, https://doi.org/10.1093/annonc/mdu145CrossRefPubMed K. M. Kerr, L. Bubendorf, M. J. Edelman, A. Marchetti, T. Mok, S. Novello, K. O'Byrne, R. Stahel, S. Peters, E. Felip, Panel Members, Rolf Stahel, Enriqueta Felip, Solange Peters, Keith Kerr, Benjamin Besse, Johan Vansteenkiste, Wilfried Eberhardt, Martin Edelman, Tony Mok, Ken O'Byrne, Silvia Novello, Lukas Bubendorf, Antonio Marchetti, Paul Baas, Martin Reck, Konstantinos Syrigos, Luis Paz-Ares, Egbert F. Smit, Peter Meldgaard, Alex Adjei, Marianne Nicolson, Lucio Crinò, Paul Van Schil, Suresh Senan, Corinne Faivre-Finn, Gaetano Rocco, Giulia Veronesi, Jean-Yves Douillard, Eric Lim, Christophe Dooms, Walter Weder, Dirk De Ruysscher, Cecile De Pechoux, Paul De Leyn, Virginie Westeel, Second ESMO consensus conference on lung cancer: pathology and molecular biomarkers for non-small-cell lung cancer, Annals of Oncology, Volume 25, Issue 9, 2014, 1681–1690, https://​doi.​org/​10.​1093/​annonc/​mdu145CrossRefPubMed
2.
go back to reference Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Volume 6, 2016, https://doi.org/10.3389/fonc.2016.00071 Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Volume 6, 2016, https://​doi.​org/​10.​3389/​fonc.​2016.​00071
3.
go back to reference Matthew D. Wilkerson, Jason M. Schallheim, D. Neil Hayes, Patrick J. Roberts, Roy R.L. Bastien, Michael Mullins, Xiaoying Yin, C. Ryan Miller, Leigh B. Thorne, Katherine B. Geiersbach, Kenneth L. Muldrew, William K. Funkhouser, Cheng Fan, Michele C. Hayward, Steven Bayer, Charles M. Perou, Philip S. Bernard, Prediction of lung cancer histological types by RT-qPCR gene expression in FFPE specimens, The Journal of Molecular Diagnostics, Volume 15, Issue 4, 2013, Pages 485–497, ISSN 1525–1578, https://doi.org/10.1016/j.jmoldx.2013.03.007CrossRefPubMed Matthew D. Wilkerson, Jason M. Schallheim, D. Neil Hayes, Patrick J. Roberts, Roy R.L. Bastien, Michael Mullins, Xiaoying Yin, C. Ryan Miller, Leigh B. Thorne, Katherine B. Geiersbach, Kenneth L. Muldrew, William K. Funkhouser, Cheng Fan, Michele C. Hayward, Steven Bayer, Charles M. Perou, Philip S. Bernard, Prediction of lung cancer histological types by RT-qPCR gene expression in FFPE specimens, The Journal of Molecular Diagnostics, Volume 15, Issue 4, 2013, Pages 485–497, ISSN 1525–1578, https://​doi.​org/​10.​1016/​j.​jmoldx.​2013.​03.​007CrossRefPubMed
4.
go back to reference A. Karlsson, H. Cirenajwis, K. Ericson-Lindqvist, C. Reuterswärd, M. Jönsson, A. Patthey, A.F. Behndig, M. Johansson, M. Planck, J. Staaf, 19P Single sample predictor of non-small cell lung cancer histology based on gene expression analysis of archival tissue, Journal of Thoracic Oncology, Volume 13, Issue 4 A. Karlsson, H. Cirenajwis, K. Ericson-Lindqvist, C. Reuterswärd, M. Jönsson, A. Patthey, A.F. Behndig, M. Johansson, M. Planck, J. Staaf, 19P Single sample predictor of non-small cell lung cancer histology based on gene expression analysis of archival tissue, Journal of Thoracic Oncology, Volume 13, Issue 4
5.
go back to reference Travis W.D., Brambilla E., Geisinger K.R., Histological grading in lung cancer: One system for all or separate systems for each histological type?, European Respiratory Journal, 2016, 47 (3), pp. 720–723CrossRef Travis W.D., Brambilla E., Geisinger K.R., Histological grading in lung cancer: One system for all or separate systems for each histological type?, European Respiratory Journal, 2016, 47 (3), pp. 720–723CrossRef
8.
go back to reference Pooya Mobadersany, Safoora Yousefi, Mohamed Amgad, David A. Gutman, Jill S. Barnholtz-Sloan, José E. Velázquez Vega, Daniel J. Brat, Lee A. D. Cooper, Predicting cancer outcomes from histology and genomics using convolutional networks, Proceedings of the National Academy of Sciences Mar 2018, 115 (13) E2970-E2979; DOI: https://doi.org/10.1073/pnas.1717139115CrossRef Pooya Mobadersany, Safoora Yousefi, Mohamed Amgad, David A. Gutman, Jill S. Barnholtz-Sloan, José E. Velázquez Vega, Daniel J. Brat, Lee A. D. Cooper, Predicting cancer outcomes from histology and genomics using convolutional networks, Proceedings of the National Academy of Sciences Mar 2018, 115 (13) E2970-E2979; DOI: https://​doi.​org/​10.​1073/​pnas.​1717139115CrossRef
9.
go back to reference N. Zhang, J. Wu, M. Yang, J. Yu, R. Li, A composite model integrating imaging, histological, and genetic features to predict tumor mutation burden in non-small cell lung cancer patients, International Journal of Radiation Oncology Biology Physics, Volume 105, Issue 1, 2019 N. Zhang, J. Wu, M. Yang, J. Yu, R. Li, A composite model integrating imaging, histological, and genetic features to predict tumor mutation burden in non-small cell lung cancer patients, International Journal of Radiation Oncology Biology Physics, Volume 105, Issue 1, 2019
11.
go back to reference Anna Karlsson, Helena Cirenajwis, Kajsa Ericson-Lindquist, Hans Brunnström, Christel Reuterswärd, Mats Jönsson, Cristian Ortiz-Villalón, Aziz Hussein, Bengt Bergman, Anders Vikström, Nastaran Monsef, Eva Branden, Hirsh Koyi, Luigi de Petris, Patrick Micke, Annika Patthey, Annelie F. Behndig, Mikael Johansson, Maria Planck & Johan Staaf. A combined gene expression tool for parallel histological prediction and gene fusion detection in non-small cell lung cancer. Scientific Reports 9, 5207 (2019) doi:https://doi.org/10.1038/s41598-019-41585-4CrossRefPubMedPubMedCentral Anna Karlsson, Helena Cirenajwis, Kajsa Ericson-Lindquist, Hans Brunnström, Christel Reuterswärd, Mats Jönsson, Cristian Ortiz-Villalón, Aziz Hussein, Bengt Bergman, Anders Vikström, Nastaran Monsef, Eva Branden, Hirsh Koyi, Luigi de Petris, Patrick Micke, Annika Patthey, Annelie F. Behndig, Mikael Johansson, Maria Planck & Johan Staaf. A combined gene expression tool for parallel histological prediction and gene fusion detection in non-small cell lung cancer. Scientific Reports 9, 5207 (2019) doi:https://​doi.​org/​10.​1038/​s41598-019-41585-4CrossRefPubMedPubMedCentral
13.
go back to reference Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Vol. 6, 2016, DOI=https://doi.org/10.3389/fonc.2016.00071 Wu Weimiao, Parmar Chintan, Grossmann Patrick, Quackenbush John, Lambin Philippe, Bussink Johan, Mak Raymond, Aerts Hugo J. W. L., Exploratory study to identify radiomics classifiers for lung cancer histology, Frontiers in Oncology, Vol. 6, 2016, DOI=https://​doi.​org/​10.​3389/​fonc.​2016.​00071
15.
go back to reference Nicolas Coudray, Paolo Santiago Ocampo, Theodore Sakellaropoulos, Navneet Narula, Matija Snuderl, David Fenyö, Andre L. Moreira, Narges Razavian & Aristotelis Tsirigos, Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med 24, 1559–1567 (2018) doi:https://doi.org/10.1038/s41591-018-0177-5CrossRefPubMed Nicolas Coudray, Paolo Santiago Ocampo, Theodore Sakellaropoulos, Navneet Narula, Matija Snuderl, David Fenyö, Andre L. Moreira, Narges Razavian & Aristotelis Tsirigos, Classification and mutation prediction from non–small cell lung cancer histopathology images using deep learning. Nat Med 24, 1559–1567 (2018) doi:https://​doi.​org/​10.​1038/​s41591-018-0177-5CrossRefPubMed
17.
go back to reference Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository, Journal of Digital Imaging, Volume 26, Number 6, 2013, pp 1045–1057CrossRef Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer Imaging Archive (TCIA): maintaining and operating a public information repository, Journal of Digital Imaging, Volume 26, Number 6, 2013, pp 1045–1057CrossRef
18.
go back to reference Olivier Gevaert, Jiajing Xu, Chuong D. Hoang, Ann N. Leung, Yue Xu, Andrew Quon, Daniel L. Rubin, Sandy Napel, Sylvia K. Plevritis (2012). Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. Radiological Society of North America (RSNA). https://doi.org/10.1148/radiol.12111607, 264, 387, 396CrossRef Olivier Gevaert, Jiajing Xu, Chuong D. Hoang, Ann N. Leung, Yue Xu, Andrew Quon, Daniel L. Rubin, Sandy Napel, Sylvia K. Plevritis (2012). Non–small cell lung cancer: identifying prognostic imaging biomarkers by leveraging public gene expression microarray data—methods and preliminary results. Radiology. Radiological Society of North America (RSNA). https://​doi.​org/​10.​1148/​radiol.​12111607, 264, 387, 396CrossRef
20.
go back to reference Zhiyong Cui, Ruimin Ke, Yinhai Wang. Deep bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. arXiv:1801.02143 Zhiyong Cui, Ruimin Ke, Yinhai Wang. Deep bidirectional and unidirectional LSTM recurrent neural network for network-wide traffic speed prediction. arXiv:1801.02143
21.
go back to reference Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, Wang-chun Woo. Convolutional LSTM network: a machine learning approach for precipitation nowcasting. arXiv:1506.04214 Xingjian Shi, Zhourong Chen, Hao Wang, Dit-Yan Yeung, Wai-kin Wong, Wang-chun Woo. Convolutional LSTM network: a machine learning approach for precipitation nowcasting. arXiv:1506.04214
22.
go back to reference Jeff Donahue, Lisa Anne Hendricks, Marcus Rohrbach, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, Trevor Darrell. Long-term recurrent convolutional networks for visual recognition and description. arXiv:1411.4389 Jeff Donahue, Lisa Anne Hendricks, Marcus Rohrbach, Subhashini Venugopalan, Sergio Guadarrama, Kate Saenko, Trevor Darrell. Long-term recurrent convolutional networks for visual recognition and description. arXiv:1411.4389
24.
go back to reference Bakr, Shaimaa; Gevaert, Olivier; Echegaray, Sebastian; Ayers, Kelsey; Zhou, Mu; Shafiq, Majid; Zheng, Hong; Zhang, Weiruo; Leung, Ann; Kadoch, Michael; Shrager, Joseph; Quon, Andrew; Rubin, Daniel; Plevritis, Sylvia; Napel, Sandy. (2017). Data for NSCLC Radiogenomics collection. The Cancer Imaging Archive. https://doi.org/10.7937/K9/TCIA.2017.7hs46erv Bakr, Shaimaa; Gevaert, Olivier; Echegaray, Sebastian; Ayers, Kelsey; Zhou, Mu; Shafiq, Majid; Zheng, Hong; Zhang, Weiruo; Leung, Ann; Kadoch, Michael; Shrager, Joseph; Quon, Andrew; Rubin, Daniel; Plevritis, Sylvia; Napel, Sandy. (2017). Data for NSCLC Radiogenomics collection. The Cancer Imaging Archive. https://​doi.​org/​10.​7937/​K9/​TCIA.​2017.​7hs46erv
25.
go back to reference D. Moitra, R. Mandal, Review of brain tumor detection using pattern recognition techniques, International Journal of Computer Sciences and Engineering, Vol. 5, Issue 2, pp. 121–123, 2017 D. Moitra, R. Mandal, Review of brain tumor detection using pattern recognition techniques, International Journal of Computer Sciences and Engineering, Vol. 5, Issue 2, pp. 121–123, 2017
27.
go back to reference D. Moitra, R. Mandal, Segmentation strategy of PET brain tumor image, Indian Journal of Computer Science and Engineering, Vol. 8 No. 5 2017, e-ISSN:0976–5166 D. Moitra, R. Mandal, Segmentation strategy of PET brain tumor image, Indian Journal of Computer Science and Engineering, Vol. 8 No. 5 2017, e-ISSN:0976–5166
28.
go back to reference H. M. Nguyen, E. W. Cooper, K. Kamei, Borderline over-sampling for imbalanced data classification, International Journal of Knowledge Engineering and Soft Data Paradigms, 3(1), pp.4–21, 2009 H. M. Nguyen, E. W. Cooper, K. Kamei, Borderline over-sampling for imbalanced data classification, International Journal of Knowledge Engineering and Soft Data Paradigms, 3(1), pp.4–21, 2009
29.
go back to reference François Chollet, Deep learning with Python, Manning Publications Co., 2018, ISBN 9781617294433 François Chollet, Deep learning with Python, Manning Publications Co., 2018, ISBN 9781617294433
30.
go back to reference Powers, David M W (2011) [2007], Evaluation: from precision, recall and F-measure to ROC, informedness, markedness & correlation, Journal of Machine Learning Technologies. 2 (1): 37–63 Powers, David M W (2011) [2007], Evaluation: from precision, recall and F-measure to ROC, informedness, markedness & correlation, Journal of Machine Learning Technologies. 2 (1): 37–63
32.
go back to reference Dipanjan Moitra, Classification of malignant tumors: a practical approach, LAP LAMBERT Academic Publishing, 2019, ISBN: 978-613-9-47500-1 Dipanjan Moitra, Classification of malignant tumors: a practical approach, LAP LAMBERT Academic Publishing, 2019, ISBN: 978-613-9-47500-1
33.
go back to reference Dipanjan Moitra, R. K. Samanta, Performance evaluation of BioPerl, Biojava, BioPython, BioRuby and BioSmalltalk for executing bioinformatics tasks, International Journal of Computer Sciences and Engineering, Vol.03, Issue.01, pp.157–164, 2015 Dipanjan Moitra, R. K. Samanta, Performance evaluation of BioPerl, Biojava, BioPython, BioRuby and BioSmalltalk for executing bioinformatics tasks, International Journal of Computer Sciences and Engineering, Vol.03, Issue.01, pp.157–164, 2015
34.
go back to reference AJCC Cancer Stating Manual 7th Edition, American Joint Committee on Cancer, ISBN 978-0-387-88440-0, Springer New York AJCC Cancer Stating Manual 7th Edition, American Joint Committee on Cancer, ISBN 978-0-387-88440-0, Springer New York
Metadata
Title
Prediction of Non-small Cell Lung Cancer Histology by a Deep Ensemble of Convolutional and Bidirectional Recurrent Neural Network
Authors
Dipanjan Moitra
Rakesh Kumar Mandal
Publication date
01-08-2020
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine / Issue 4/2020
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-020-00337-x

Other articles of this Issue 4/2020

Journal of Digital Imaging 4/2020 Go to the issue