Skip to main content
Top
Published in: BMC Medicine 1/2021

01-12-2021 | Computed Tomography | Research article

Automated detection of lung nodules and coronary artery calcium using artificial intelligence on low-dose CT scans for lung cancer screening: accuracy and prognostic value

Authors: Jordan Chamberlin, Madison R. Kocher, Jeffrey Waltz, Madalyn Snoddy, Natalie F. C. Stringer, Joseph Stephenson, Pooyan Sahbaee, Puneet Sharma, Saikiran Rapaka, U. Joseph Schoepf, Andres F. Abadia, Jonathan Sperl, Phillip Hoelzer, Megan Mercer, Nayana Somayaji, Gilberto Aquino, Jeremy R. Burt

Published in: BMC Medicine | Issue 1/2021

Login to get access

Abstract

Background

Artificial intelligence (AI) in diagnostic radiology is undergoing rapid development. Its potential utility to improve diagnostic performance for cardiopulmonary events is widely recognized, but the accuracy and precision have yet to be demonstrated in the context of current screening modalities. Here, we present findings on the performance of an AI convolutional neural network (CNN) prototype (AI-RAD Companion, Siemens Healthineers) that automatically detects pulmonary nodules and quantifies coronary artery calcium volume (CACV) on low-dose chest CT (LDCT), and compare results to expert radiologists. We also correlate AI findings with adverse cardiopulmonary outcomes in a retrospective cohort of 117 patients who underwent LDCT.

Methods

A total of 117 patients were enrolled in this study. Two CNNs were used to identify lung nodules and CACV on LDCT scans. All subjects were used for lung nodule analysis, and 96 subjects met the criteria for coronary artery calcium volume analysis. Interobserver concordance was measured using ICC and Cohen’s kappa. Multivariate logistic regression and partial least squares regression were used for outcomes analysis.

Results

Agreement of the AI findings with experts was excellent (CACV ICC = 0.904, lung nodules Cohen’s kappa = 0.846) with high sensitivity and specificity (CACV: sensitivity = .929, specificity = .960; lung nodules: sensitivity = 1, specificity = 0.708). The AI findings improved the prediction of major cardiopulmonary outcomes at 1-year follow-up including major adverse cardiac events and lung cancer (AUCMACE = 0.911, AUCLung Cancer = 0.942).

Conclusion

We conclude the AI prototype rapidly and accurately identifies significant risk factors for cardiopulmonary disease on standard screening low-dose chest CT. This information can be used to improve diagnostic ability, facilitate intervention, improve morbidity and mortality, and decrease healthcare costs. There is also potential application in countries with limited numbers of cardiothoracic radiologists.
Appendix
Available only for authorised users
Literature
1.
go back to reference Siegel RL, Miller KD, Jemal A. Cancer statistics, 2020. CA Cancer J Clin. 2020;70(1):7–30.CrossRef Siegel RL, Miller KD, Jemal A. Cancer statistics, 2020. CA Cancer J Clin. 2020;70(1):7–30.CrossRef
2.
go back to reference D’Agostino RB, Russell MW, Huse DM, Ellison RC, Silbershatz H, Wilson PW, et al. Primary and subsequent coronary risk appraisal: new results from the Framingham Study. Am Heart J. 2000;139(2 Pt 1):272–81.CrossRef D’Agostino RB, Russell MW, Huse DM, Ellison RC, Silbershatz H, Wilson PW, et al. Primary and subsequent coronary risk appraisal: new results from the Framingham Study. Am Heart J. 2000;139(2 Pt 1):272–81.CrossRef
3.
go back to reference National Lung Screening Trial Research T, Church TR, Black WC, Aberle DR, Berg CD, Clingan KL, et al. Results of initial low-dose computed tomographic screening for lung cancer. N Engl J Med. 2013;368(21):1980–91.CrossRef National Lung Screening Trial Research T, Church TR, Black WC, Aberle DR, Berg CD, Clingan KL, et al. Results of initial low-dose computed tomographic screening for lung cancer. N Engl J Med. 2013;368(21):1980–91.CrossRef
4.
go back to reference National Lung Screening Trial Research T, Aberle DR, Adams AM, Berg CD, Black WC, Clapp JD, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365(5):395–409.CrossRef National Lung Screening Trial Research T, Aberle DR, Adams AM, Berg CD, Black WC, Clapp JD, et al. Reduced lung-cancer mortality with low-dose computed tomographic screening. N Engl J Med. 2011;365(5):395–409.CrossRef
5.
go back to reference International Early Lung Cancer Action Program I, Henschke CI, Yankelevitz DF, Libby DM, Pasmantier MW, Smith JP, et al. Survival of patients with stage I lung cancer detected on CT screening. N Engl J Med. 2006;355(17):1763–71.CrossRef International Early Lung Cancer Action Program I, Henschke CI, Yankelevitz DF, Libby DM, Pasmantier MW, Smith JP, et al. Survival of patients with stage I lung cancer detected on CT screening. N Engl J Med. 2006;355(17):1763–71.CrossRef
6.
go back to reference Moyer VA, USPST Force. Screening for lung cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 2014;160(5):330–338. Moyer VA, USPST Force. Screening for lung cancer: U.S. Preventive Services Task Force recommendation statement. Ann Intern Med 2014;160(5):330–338.
7.
go back to reference Horeweg N, Scholten ET, de Jong PA, van der Aalst CM, Weenink C, Lammers JW, et al. Detection of lung cancer through low-dose CT screening (NELSON): a prespecified analysis of screening test performance and interval cancers. Lancet Oncol. 2014;15(12):1342–50.CrossRef Horeweg N, Scholten ET, de Jong PA, van der Aalst CM, Weenink C, Lammers JW, et al. Detection of lung cancer through low-dose CT screening (NELSON): a prespecified analysis of screening test performance and interval cancers. Lancet Oncol. 2014;15(12):1342–50.CrossRef
8.
go back to reference Pasternak RC, Grundy SM, Levy D, Thompson PD. 27th Bethesda Conference: matching the intensity of risk factor management with the hazard for coronary disease events. Task Force 3. Spectrum of risk factors for coronary heart disease. J Am Coll Cardiol. 1996;27(5):978–90.CrossRef Pasternak RC, Grundy SM, Levy D, Thompson PD. 27th Bethesda Conference: matching the intensity of risk factor management with the hazard for coronary disease events. Task Force 3. Spectrum of risk factors for coronary heart disease. J Am Coll Cardiol. 1996;27(5):978–90.CrossRef
9.
go back to reference Greenland P, Knoll MD, Stamler J, Neaton JD, Dyer AR, Garside DB, et al. Major risk factors as antecedents of fatal and nonfatal coronary heart disease events. JAMA. 2003;290(7):891–7.CrossRef Greenland P, Knoll MD, Stamler J, Neaton JD, Dyer AR, Garside DB, et al. Major risk factors as antecedents of fatal and nonfatal coronary heart disease events. JAMA. 2003;290(7):891–7.CrossRef
10.
go back to reference Shemesh J, Henschke CI, Shaham D, Yip R, Farooqi AO, Cham MD, et al. Ordinal scoring of coronary artery calcifications on low-dose CT scans of the chest is predictive of death from cardiovascular disease. Radiology. 2010;257(2):541–8.CrossRef Shemesh J, Henschke CI, Shaham D, Yip R, Farooqi AO, Cham MD, et al. Ordinal scoring of coronary artery calcifications on low-dose CT scans of the chest is predictive of death from cardiovascular disease. Radiology. 2010;257(2):541–8.CrossRef
11.
go back to reference Ravenel JG, Nance JW. Coronary artery calcification in lung cancer screening. Transl Lung Cancer Res. 2018;7(3):361–7.CrossRef Ravenel JG, Nance JW. Coronary artery calcification in lung cancer screening. Transl Lung Cancer Res. 2018;7(3):361–7.CrossRef
12.
go back to reference Jacobs PC, Isgum I, Gondrie MJ, Mali WP, van Ginneken B, Prokop M, et al. Coronary artery calcification scoring in low-dose ungated CT screening for lung cancer: interscan agreement. AJR Am J Roentgenol. 2010;194(5):1244–9.CrossRef Jacobs PC, Isgum I, Gondrie MJ, Mali WP, van Ginneken B, Prokop M, et al. Coronary artery calcification scoring in low-dose ungated CT screening for lung cancer: interscan agreement. AJR Am J Roentgenol. 2010;194(5):1244–9.CrossRef
13.
go back to reference Baron KB, Choi AD, Chen MY. Low radiation dose calcium scoring: evidence and techniques. Curr Cardiovasc Imaging Rep. 2016;9:12.CrossRef Baron KB, Choi AD, Chen MY. Low radiation dose calcium scoring: evidence and techniques. Curr Cardiovasc Imaging Rep. 2016;9:12.CrossRef
14.
go back to reference Arcadi T, Maffei E, Sverzellati N, Mantini C, Guaricci AI, Tedeschi C, et al. Coronary artery calcium score on low-dose computed tomography for lung cancer screening. World J Radiol. 2014;6(6):381–7.CrossRef Arcadi T, Maffei E, Sverzellati N, Mantini C, Guaricci AI, Tedeschi C, et al. Coronary artery calcium score on low-dose computed tomography for lung cancer screening. World J Radiol. 2014;6(6):381–7.CrossRef
15.
go back to reference Liu K, Li Q, Ma J, Zhou Z, Sun M, Deng Y, et al. Evaluating a fully automated pulmonary nodule detection approach and its impact on radiologist performance. Radiol Artifical Intell. 2019;1:e180084.CrossRef Liu K, Li Q, Ma J, Zhou Z, Sun M, Deng Y, et al. Evaluating a fully automated pulmonary nodule detection approach and its impact on radiologist performance. Radiol Artifical Intell. 2019;1:e180084.CrossRef
16.
go back to reference Causey JL, Zhang J, Ma S, Jiang B, Qualls JA, Politte DG, et al. Highly accurate model for prediction of lung nodule malignancy with CT scans. Sci Rep. 2018;8(1):9286.CrossRef Causey JL, Zhang J, Ma S, Jiang B, Qualls JA, Politte DG, et al. Highly accurate model for prediction of lung nodule malignancy with CT scans. Sci Rep. 2018;8(1):9286.CrossRef
17.
go back to reference Ciompi F, Chung K, van Riel SJ, Setio AAA, Gerke PK, Jacobs C, et al. Towards automatic pulmonary nodule management in lung cancer screening with deep learning. Sci Rep. 2017;7:46479.CrossRef Ciompi F, Chung K, van Riel SJ, Setio AAA, Gerke PK, Jacobs C, et al. Towards automatic pulmonary nodule management in lung cancer screening with deep learning. Sci Rep. 2017;7:46479.CrossRef
18.
go back to reference Kazerooni EA, Austin JH, Black WC, Dyer DS, Hazelton TR, Leung AN, et al. ACR-STR practice parameter for the performance and reporting of lung cancer screening thoracic computed tomography (CT): 2014 (resolution 4). J Thorac Imaging. 2014;29(5):310–6.CrossRef Kazerooni EA, Austin JH, Black WC, Dyer DS, Hazelton TR, Leung AN, et al. ACR-STR practice parameter for the performance and reporting of lung cancer screening thoracic computed tomography (CT): 2014 (resolution 4). J Thorac Imaging. 2014;29(5):310–6.CrossRef
21.
go back to reference Yang D, Xu D, Zhou SK, Georgescu B, Chen M, Grbic S, et al. Automatic liver segmentation using an adversarial image-to-image network. Internation Conference on Medical Image Computing and Computer-Assisted Intervention. Quebec Canada. p. 507–515. London: Springer; 2017. Yang D, Xu D, Zhou SK, Georgescu B, Chen M, Grbic S, et al. Automatic liver segmentation using an adversarial image-to-image network. Internation Conference on Medical Image Computing and Computer-Assisted Intervention. Quebec Canada. p. 507–515. London: Springer; 2017.
22.
go back to reference Fischer AM, Yacoub B, Savage RH, Martinez JD, Wichmann JL, Sahbaee P, et al. Machine learning/deep neuronal network: routine application in chest computed tomography and workflow considerations. J Thorac Imaging. 2020;35(Suppl 1):S21–S7.CrossRef Fischer AM, Yacoub B, Savage RH, Martinez JD, Wichmann JL, Sahbaee P, et al. Machine learning/deep neuronal network: routine application in chest computed tomography and workflow considerations. J Thorac Imaging. 2020;35(Suppl 1):S21–S7.CrossRef
23.
go back to reference Fischer AM, Varga-Szemes A, Martin SS, Sperl JI, Sahbaee P, Neumann D, et al. Artificial intelligence-based fully automated per lobe segmentation and emphysema-quantification based on chest computed tomography compared with Global Initiative for Chronic Obstructive Lung Disease Severity of Smokers. J Thorac Imaging. 2020;35(Suppl 1):S28–34.CrossRef Fischer AM, Varga-Szemes A, Martin SS, Sperl JI, Sahbaee P, Neumann D, et al. Artificial intelligence-based fully automated per lobe segmentation and emphysema-quantification based on chest computed tomography compared with Global Initiative for Chronic Obstructive Lung Disease Severity of Smokers. J Thorac Imaging. 2020;35(Suppl 1):S28–34.CrossRef
24.
go back to reference Puliti D, Mascalchi M, Carozzi FM, Carrozzi L, Falaschi F, Paci E, et al. Decreased cardiovascular mortality in the ITALUNG lung cancer screening trial: analysis of underlying factors. Lung Cancer. 2019;138:72–8.CrossRef Puliti D, Mascalchi M, Carozzi FM, Carrozzi L, Falaschi F, Paci E, et al. Decreased cardiovascular mortality in the ITALUNG lung cancer screening trial: analysis of underlying factors. Lung Cancer. 2019;138:72–8.CrossRef
25.
go back to reference Mendoza DP, Kako B, Digumarthy SR, Shepard JO, Little BP. Impact of significant coronary artery calcification reported on low-dose computed tomography lung cancer screening. J Thorac Imaging. 2020;35(2):129–35.CrossRef Mendoza DP, Kako B, Digumarthy SR, Shepard JO, Little BP. Impact of significant coronary artery calcification reported on low-dose computed tomography lung cancer screening. J Thorac Imaging. 2020;35(2):129–35.CrossRef
26.
go back to reference Isgum I, Prokop M, Niemeijer M, Viergever MA, van Ginneken B. Automatic coronary calcium scoring in low-dose chest computed tomography. IEEE Trans Med Imaging. 2012;31(12):2322–34.CrossRef Isgum I, Prokop M, Niemeijer M, Viergever MA, van Ginneken B. Automatic coronary calcium scoring in low-dose chest computed tomography. IEEE Trans Med Imaging. 2012;31(12):2322–34.CrossRef
27.
go back to reference Dzaye O, Dudum R, Mirbolouk M, Orimoloye OA, Osei AD, Dardari ZA, et al. Validation of the Coronary Artery Calcium Data and Reporting System (CAC-DRS): dual importance of CAC score and CAC distribution from the Coronary Artery Calcium (CAC) consortium. J Cardiovasc Comput Tomogr. 2020;14(1):12–7.CrossRef Dzaye O, Dudum R, Mirbolouk M, Orimoloye OA, Osei AD, Dardari ZA, et al. Validation of the Coronary Artery Calcium Data and Reporting System (CAC-DRS): dual importance of CAC score and CAC distribution from the Coronary Artery Calcium (CAC) consortium. J Cardiovasc Comput Tomogr. 2020;14(1):12–7.CrossRef
28.
go back to reference Wilson PW, D’Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation. 1998;97(18):1837–47.CrossRef Wilson PW, D’Agostino RB, Levy D, Belanger AM, Silbershatz H, Kannel WB. Prediction of coronary heart disease using risk factor categories. Circulation. 1998;97(18):1837–47.CrossRef
29.
go back to reference Chong I-G, Jun C-H. Performance of some variable selection methods when multicollinearity is present. Chemometr Intell Lab Syst. 2005;78(1–2):103–12.CrossRef Chong I-G, Jun C-H. Performance of some variable selection methods when multicollinearity is present. Chemometr Intell Lab Syst. 2005;78(1–2):103–12.CrossRef
30.
go back to reference Miao B, Hernandez AV, Alberts MJ, Mangiafico N, Roman YM, Coleman CI. Incidence and predictors of major adverse cardiovascular events in patients with established atherosclerotic disease or multiple risk factors. J Am Heart Assoc. 2020;9(2):e014402.CrossRef Miao B, Hernandez AV, Alberts MJ, Mangiafico N, Roman YM, Coleman CI. Incidence and predictors of major adverse cardiovascular events in patients with established atherosclerotic disease or multiple risk factors. J Am Heart Assoc. 2020;9(2):e014402.CrossRef
31.
go back to reference Blaha MJ, Budoff MJ, Tota-Maharaj R, Dardari ZA, Wong ND, Kronmal RA, et al. Improving the CAC score by addition of regional measures of calcium distribution: multi-ethnic study of atherosclerosis. JACC Cardiovasc Imaging. 2016;9(12):1407–16.CrossRef Blaha MJ, Budoff MJ, Tota-Maharaj R, Dardari ZA, Wong ND, Kronmal RA, et al. Improving the CAC score by addition of regional measures of calcium distribution: multi-ethnic study of atherosclerosis. JACC Cardiovasc Imaging. 2016;9(12):1407–16.CrossRef
32.
go back to reference Raghu VK, Zhao W, Pu J, Leader JK, Wang R, Herman J, et al. Feasibility of lung cancer prediction from low-dose CT scan and smoking factors using causal models. Thorax. 2019;74(7):643–9.CrossRef Raghu VK, Zhao W, Pu J, Leader JK, Wang R, Herman J, et al. Feasibility of lung cancer prediction from low-dose CT scan and smoking factors using causal models. Thorax. 2019;74(7):643–9.CrossRef
33.
go back to reference Lehman CD, Arao RF, Sprague BL, Lee JM, Buist DS, Kerlikowske K, et al. National performance Benchmarks for modern screening digital mammography: update from the Breast Cancer Surveillance Consortium. Radiology. 2017;283(1):49–58.CrossRef Lehman CD, Arao RF, Sprague BL, Lee JM, Buist DS, Kerlikowske K, et al. National performance Benchmarks for modern screening digital mammography: update from the Breast Cancer Surveillance Consortium. Radiology. 2017;283(1):49–58.CrossRef
34.
go back to reference Armato SG 3rd, Roberts RY, Kocherginsky M, Aberle DR, Kazerooni EA, Macmahon H, et al. Assessment of radiologist performance in the detection of lung nodules: dependence on the definition of “truth”. Acad Radiol. 2009;16(1):28–38.CrossRef Armato SG 3rd, Roberts RY, Kocherginsky M, Aberle DR, Kazerooni EA, Macmahon H, et al. Assessment of radiologist performance in the detection of lung nodules: dependence on the definition of “truth”. Acad Radiol. 2009;16(1):28–38.CrossRef
35.
go back to reference Veronesi G, Maisonneuve P, Bellomi M, Rampinelli C, Durli I, Bertolotti R, et al. Estimating overdiagnosis in low-dose computed tomography screening for lung cancer: a cohort study. Ann Intern Med. 2012;157(11):776–84.CrossRef Veronesi G, Maisonneuve P, Bellomi M, Rampinelli C, Durli I, Bertolotti R, et al. Estimating overdiagnosis in low-dose computed tomography screening for lung cancer: a cohort study. Ann Intern Med. 2012;157(11):776–84.CrossRef
Metadata
Title
Automated detection of lung nodules and coronary artery calcium using artificial intelligence on low-dose CT scans for lung cancer screening: accuracy and prognostic value
Authors
Jordan Chamberlin
Madison R. Kocher
Jeffrey Waltz
Madalyn Snoddy
Natalie F. C. Stringer
Joseph Stephenson
Pooyan Sahbaee
Puneet Sharma
Saikiran Rapaka
U. Joseph Schoepf
Andres F. Abadia
Jonathan Sperl
Phillip Hoelzer
Megan Mercer
Nayana Somayaji
Gilberto Aquino
Jeremy R. Burt
Publication date
01-12-2021
Publisher
BioMed Central
Published in
BMC Medicine / Issue 1/2021
Electronic ISSN: 1741-7015
DOI
https://doi.org/10.1186/s12916-021-01928-3

Other articles of this Issue 1/2021

BMC Medicine 1/2021 Go to the issue