Skip to main content
Top
Published in: European Radiology 10/2022

07-05-2022 | CT Angiography | Imaging Informatics and Artificial Intelligence

Deep learning–based atherosclerotic coronary plaque segmentation on coronary CT angiography

Authors: Natasa Jávorszky, Bálint Homonnay, Gary Gerstenblith, David Bluemke, Péter Kiss, Mihály Török, David Celentano, Hong Lai, Shenghan Lai, Márton Kolossváry

Published in: European Radiology | Issue 10/2022

Login to get access

Abstract

Objectives

Volumetric evaluation of coronary artery disease (CAD) allows better prediction of cardiac events. However, CAD segmentation is labor intensive. Our objective was to create an open-source deep learning (DL) model to segment coronary plaques on coronary CT angiography (CCTA).

Methods

Three hundred eight individuals’ 894 CCTA scans with 3035 manually segmented plaques by an expert reader (considered as ground truth) were used to train (186/308, 60%), validate (tune, 61/308, 20%), and test (61/308, 20%) a 3D U-net model. We also evaluated the model on an external test set of 50 individuals with vulnerable plaques acquired at a different site. Furthermore, we applied transfer learning on 77 individuals’ data and re-evaluated the model’s performance using intra-class correlation coefficient (ICC).

Results

On the test set, DL outperformed the currently used minimum cost approach method to quantify total: ICC: 0.88 [CI: 0.85–0.91] vs. 0.63 [CI: 0.42–0.76], noncalcified: 0.84 [CI: 0.80–0.88] vs. 0.45 [CI: 0.26–0.59], calcified: 0.99 [CI: 0.98–0.99] vs. 0.96 [CI: 0.94–0.97], and low attenuation noncalcified: 0.25 [CI: 0.13–0.37] vs. −0.01 [CI: −0.13 to 0.11] plaque volumes. On the external dataset, substantial improvement was observed in DL model performance after transfer learning, total: 0.62 [CI: 0.01–0.84] vs. 0.94 [CI: 0.87–0.97], noncalcified: 0.54 [CI: −0.04 to 0.80] vs. 0.93 [CI: 0.86–0.96], calcified: 0.91 [CI:0.85–0.95] vs. 0.95 [CI: 0.91–0.97], and low attenuation noncalcified 0.48 [CI: 0.18–0.69] vs. 0.86 [CI: 0.76–0.92].

Conclusions

Our open-source DL algorithm achieved excellent agreement with expert CAD segmentations. However, transfer learning may be required to achieve accurate segmentations in the case of different plaque characteristics or machinery.

Key Points

Deep learning 3D U-net model for coronary segmentation achieves comparable results with expert readers’ volumetric plaque quantification.
Transfer learning may be needed to achieve similar results for other scanner and plaque characteristics.
The developed deep learning algorithm is open-source and may be implemented in any CT analysis software.
Appendix
Available only for authorised users
Literature
1.
go back to reference Mathers CD, Stevens GA, Boerma T, White RA, Tobias MI (2015) Causes of international increases in older age life expectancy. Lancet 385:540–548CrossRef Mathers CD, Stevens GA, Boerma T, White RA, Tobias MI (2015) Causes of international increases in older age life expectancy. Lancet 385:540–548CrossRef
2.
go back to reference GBD 2017 Causes of Death Collaborators (2018) Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980-2017: a systematic analysis for the Global Burden of Disease Study 2017 GBD 2017 Causes of Death Collaborators (2018) Global, regional, and national age-sex-specific mortality for 282 causes of death in 195 countries and territories, 1980-2017: a systematic analysis for the Global Burden of Disease Study 2017
3.
go back to reference Knuuti J, Wijns W, Saraste A et al (2020) 2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes. Eur Heart J 41:407–477CrossRef Knuuti J, Wijns W, Saraste A et al (2020) 2019 ESC Guidelines for the diagnosis and management of chronic coronary syndromes. Eur Heart J 41:407–477CrossRef
4.
go back to reference Moss AJ, Williams MC, Newby DE, Nicol ED (2017) The updated NICE guidelines: cardiac CT as the first-line test for coronary artery disease. Curr Cardiovasc Imaging Rep 10:15CrossRef Moss AJ, Williams MC, Newby DE, Nicol ED (2017) The updated NICE guidelines: cardiac CT as the first-line test for coronary artery disease. Curr Cardiovasc Imaging Rep 10:15CrossRef
5.
go back to reference Leipsic J, Abbara S, Achenbach S et al (2014) SCCT guidelines for the interpretation and reporting of coronary CT angiography: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J Cardiovasc Comput Tomogr 8:342–358CrossRef Leipsic J, Abbara S, Achenbach S et al (2014) SCCT guidelines for the interpretation and reporting of coronary CT angiography: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J Cardiovasc Comput Tomogr 8:342–358CrossRef
6.
go back to reference Kolossvary M, Szilveszter B, Merkely B, Maurovich-Horvat P (2017) Plaque imaging with CT-a comprehensive review on coronary CT angiography based risk assessment. Cardiovasc Diagn Ther 7:489–506CrossRef Kolossvary M, Szilveszter B, Merkely B, Maurovich-Horvat P (2017) Plaque imaging with CT-a comprehensive review on coronary CT angiography based risk assessment. Cardiovasc Diagn Ther 7:489–506CrossRef
8.
go back to reference Lee SE, Sung JM, Rizvi A et al (2018) Quantification of coronary atherosclerosis in the assessment of coronary artery disease. Circ Cardiovasc Imaging 11:e007562CrossRef Lee SE, Sung JM, Rizvi A et al (2018) Quantification of coronary atherosclerosis in the assessment of coronary artery disease. Circ Cardiovasc Imaging 11:e007562CrossRef
9.
go back to reference Ferencik M, Mayrhofer T, Puchner SB et al (2015) Computed tomography-based high-risk coronary plaque score to predict acute coronary syndrome among patients with acute chest pain--results from the ROMICAT II trial. J Cardiovasc Comput Tomogr 9:538–545CrossRef Ferencik M, Mayrhofer T, Puchner SB et al (2015) Computed tomography-based high-risk coronary plaque score to predict acute coronary syndrome among patients with acute chest pain--results from the ROMICAT II trial. J Cardiovasc Comput Tomogr 9:538–545CrossRef
10.
go back to reference Williams MC, Kwiecinski J, Doris M et al (2020) Low-attenuation noncalcified plaque on coronary computed tomography angiography predicts myocardial infarction: results from the multicenter SCOT-HEART trial (Scottish Computed Tomography of the HEART). Circulation 141:1452–1462CrossRef Williams MC, Kwiecinski J, Doris M et al (2020) Low-attenuation noncalcified plaque on coronary computed tomography angiography predicts myocardial infarction: results from the multicenter SCOT-HEART trial (Scottish Computed Tomography of the HEART). Circulation 141:1452–1462CrossRef
11.
go back to reference Kolossváry M, Karády J, Szilveszter B et al (2017) Radiomic features are superior to conventional quantitative computed tomographic metrics to identify coronary plaques with napkin-ring sign. Circ Cardiovasc Imaging 10:e006843CrossRef Kolossváry M, Karády J, Szilveszter B et al (2017) Radiomic features are superior to conventional quantitative computed tomographic metrics to identify coronary plaques with napkin-ring sign. Circ Cardiovasc Imaging 10:e006843CrossRef
12.
go back to reference Kolossvary M, Gerstenblith G, Bluemke DA et al (2021) Contribution of risk factors to the development of coronary atherosclerosis as confirmed via coronary CT angiography: a longitudinal radiomics-based study. Radiology 299:97–106CrossRef Kolossvary M, Gerstenblith G, Bluemke DA et al (2021) Contribution of risk factors to the development of coronary atherosclerosis as confirmed via coronary CT angiography: a longitudinal radiomics-based study. Radiology 299:97–106CrossRef
13.
go back to reference Boogers MJ, Broersen A, van Velzen JE et al (2012) Automated quantification of coronary plaque with computed tomography: comparison with intravascular ultrasound using a dedicated registration algorithm for fusion-based quantification. Eur Heart J 33:1007–1016CrossRef Boogers MJ, Broersen A, van Velzen JE et al (2012) Automated quantification of coronary plaque with computed tomography: comparison with intravascular ultrasound using a dedicated registration algorithm for fusion-based quantification. Eur Heart J 33:1007–1016CrossRef
14.
go back to reference Kolossvary M, Javorszky N, Karady J et al (2021) Effect of vessel wall segmentation on volumetric and radiomic parameters of coronary plaques with adverse characteristics. J Cardiovasc Comput Tomogr 15:137–145CrossRef Kolossvary M, Javorszky N, Karady J et al (2021) Effect of vessel wall segmentation on volumetric and radiomic parameters of coronary plaques with adverse characteristics. J Cardiovasc Comput Tomogr 15:137–145CrossRef
15.
go back to reference Chen C, Qin C, Qiu H et al (2020) Deep learning for cardiac image segmentation: a review. Front Cardiovasc Med 7:25CrossRef Chen C, Qin C, Qiu H et al (2020) Deep learning for cardiac image segmentation: a review. Front Cardiovasc Med 7:25CrossRef
16.
go back to reference Zeleznik R, Foldyna B, Eslami P et al (2021) Deep convolutional neural networks to predict cardiovascular risk from computed tomography. Nat Commun 12:715CrossRef Zeleznik R, Foldyna B, Eslami P et al (2021) Deep convolutional neural networks to predict cardiovascular risk from computed tomography. Nat Commun 12:715CrossRef
17.
go back to reference van Velzen SGM, Lessmann N, Velthuis BK et al (2020) Deep learning for automatic calcium scoring in CT: validation using multiple cardiac CT and chest CT protocols. Radiology 295:66–79CrossRef van Velzen SGM, Lessmann N, Velthuis BK et al (2020) Deep learning for automatic calcium scoring in CT: validation using multiple cardiac CT and chest CT protocols. Radiology 295:66–79CrossRef
18.
go back to reference Lai S, Fishman EK, Lai H et al (2008) Long-term cocaine use and antiretroviral therapy are associated with silent coronary artery disease in African Americans with HIV infection who have no cardiovascular symptoms. Clin Infect Dis 46:600–610CrossRef Lai S, Fishman EK, Lai H et al (2008) Long-term cocaine use and antiretroviral therapy are associated with silent coronary artery disease in African Americans with HIV infection who have no cardiovascular symptoms. Clin Infect Dis 46:600–610CrossRef
19.
go back to reference Lai H, Moore R, Celentano DD et al (2016) HIV infection itself may not be associated with subclinical coronary artery disease among African Americans without cardiovascular symptoms. J Am Heart Assoc 5:e002529CrossRef Lai H, Moore R, Celentano DD et al (2016) HIV infection itself may not be associated with subclinical coronary artery disease among African Americans without cardiovascular symptoms. J Am Heart Assoc 5:e002529CrossRef
20.
go back to reference Kolossvary M, Fishman EK, Gerstenblith G et al (2021) Cardiovascular risk factors and illicit drug use may have a more profound effect on coronary atherosclerosis progression in people living with HIV. Eur Radiol 31:2756–2767CrossRef Kolossvary M, Fishman EK, Gerstenblith G et al (2021) Cardiovascular risk factors and illicit drug use may have a more profound effect on coronary atherosclerosis progression in people living with HIV. Eur Radiol 31:2756–2767CrossRef
21.
go back to reference Kolossvary M, Celentano D, Gerstenblith G et al (2021) HIV indirectly accelerates coronary artery disease by promoting the effects of risk factors: longitudinal observational study. Sci Rep 11:23110CrossRef Kolossvary M, Celentano D, Gerstenblith G et al (2021) HIV indirectly accelerates coronary artery disease by promoting the effects of risk factors: longitudinal observational study. Sci Rep 11:23110CrossRef
22.
go back to reference Kolossvary M, Szilveszter B, Karady J, Drobni ZD, Merkely B, Maurovich-Horvat P (2019) Effect of image reconstruction algorithms on volumetric and radiomic parameters of coronary plaques. J Cardiovasc Comput Tomogr 13:325–330CrossRef Kolossvary M, Szilveszter B, Karady J, Drobni ZD, Merkely B, Maurovich-Horvat P (2019) Effect of image reconstruction algorithms on volumetric and radiomic parameters of coronary plaques. J Cardiovasc Comput Tomogr 13:325–330CrossRef
23.
go back to reference Karady J, Panajotu A, Kolossvary M et al (2017) The effect of four-phasic versus three-phasic contrast media injection protocols on extravasation rate in coronary CT angiography: a randomized controlled trial. Eur Radiol 27:4538–4543CrossRef Karady J, Panajotu A, Kolossvary M et al (2017) The effect of four-phasic versus three-phasic contrast media injection protocols on extravasation rate in coronary CT angiography: a randomized controlled trial. Eur Radiol 27:4538–4543CrossRef
24.
go back to reference Newby DE, Adamson PD, Berry C et al (2018) Coronary CT angiography and 5-year risk of myocardial infarction. N Engl J Med 379:924–933CrossRef Newby DE, Adamson PD, Berry C et al (2018) Coronary CT angiography and 5-year risk of myocardial infarction. N Engl J Med 379:924–933CrossRef
25.
go back to reference Inoue K, Motoyama S, Sarai M et al (2010) Serial coronary CT angiography-verified changes in plaque characteristics as an end point: evaluation of effect of statin intervention. JACC Cardiovasc Imaging 3:691–698CrossRef Inoue K, Motoyama S, Sarai M et al (2010) Serial coronary CT angiography-verified changes in plaque characteristics as an end point: evaluation of effect of statin intervention. JACC Cardiovasc Imaging 3:691–698CrossRef
26.
go back to reference Oktay O, Schlemper J, Folgoc LL et al (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint arXiv:180403999 Oktay O, Schlemper J, Folgoc LL et al (2018) Attention U-Net: learning where to look for the pancreas. arXiv preprint arXiv:180403999
27.
go back to reference Pan LS, Li CW, Su SF, Tay SY, Tran QV, Chan WP (2021) Coronary artery segmentation under class imbalance using a U-Net based architecture on computed tomography angiography images. Sci Rep 11:14493CrossRef Pan LS, Li CW, Su SF, Tay SY, Tran QV, Chan WP (2021) Coronary artery segmentation under class imbalance using a U-Net based architecture on computed tomography angiography images. Sci Rep 11:14493CrossRef
28.
go back to reference Siriapisith T, Kusakunniran W, Haddawy P (2021) A 3D deep learning approach to epicardial fat segmentation in non-contrast and post-contrast cardiac CT images. Peer J Comput Sci 7:e806 Siriapisith T, Kusakunniran W, Haddawy P (2021) A 3D deep learning approach to epicardial fat segmentation in non-contrast and post-contrast cardiac CT images. Peer J Comput Sci 7:e806
29.
go back to reference R Core Team (2019) R: a language and environment for statistical computing. R Foundation for Statistical Computing, 4.0.0 R Core Team (2019) R: a language and environment for statistical computing. R Foundation for Statistical Computing, 4.0.0
30.
go back to reference Bossuyt PM, Reitsma JB, Bruns DE et al (2015) STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Radiology 277:826–832CrossRef Bossuyt PM, Reitsma JB, Bruns DE et al (2015) STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies. Radiology 277:826–832CrossRef
31.
go back to reference Diaz-Zamudio M, Dey D, Schuhbaeck A et al (2015) Automated quantitative plaque burden from coronary CT angiography noninvasively predicts hemodynamic significance by using fractional flow reserve in intermediate coronary lesions. Radiology 276:408–415CrossRef Diaz-Zamudio M, Dey D, Schuhbaeck A et al (2015) Automated quantitative plaque burden from coronary CT angiography noninvasively predicts hemodynamic significance by using fractional flow reserve in intermediate coronary lesions. Radiology 276:408–415CrossRef
32.
go back to reference Park HB, Heo R, B Óh et al (2015) Atherosclerotic plaque characteristics by CT angiography identify coronary lesions that cause ischemia: a direct comparison to fractional flow reserve. JACC Cardiovasc Imaging 8:1-10 Park HB, Heo R, B Óh et al (2015) Atherosclerotic plaque characteristics by CT angiography identify coronary lesions that cause ischemia: a direct comparison to fractional flow reserve. JACC Cardiovasc Imaging 8:1-10
33.
go back to reference Nakazato R, Shalev A, Doh JH et al (2013) Aggregate plaque volume by coronary computed tomography angiography is superior and incremental to luminal narrowing for diagnosis of ischemic lesions of intermediate stenosis severity. J Am Coll Cardiol 62:460–467CrossRef Nakazato R, Shalev A, Doh JH et al (2013) Aggregate plaque volume by coronary computed tomography angiography is superior and incremental to luminal narrowing for diagnosis of ischemic lesions of intermediate stenosis severity. J Am Coll Cardiol 62:460–467CrossRef
34.
go back to reference Hell MM, Motwani M, Otaki Y et al (2017) Quantitative global plaque characteristics from coronary computed tomography angiography for the prediction of future cardiac mortality during long-term follow-up. Eur Heart J Cardiovasc Imaging 18:1331–1339CrossRef Hell MM, Motwani M, Otaki Y et al (2017) Quantitative global plaque characteristics from coronary computed tomography angiography for the prediction of future cardiac mortality during long-term follow-up. Eur Heart J Cardiovasc Imaging 18:1331–1339CrossRef
35.
go back to reference Zreik M, van Hamersvelt RW, Wolterink JM, Leiner T, Viergever MA, Isgum I (2019) A recurrent CNN for automatic detection and classification of coronary artery plaque and stenosis in coronary CT angiography. IEEE Trans Med Imaging 38:1588–1598CrossRef Zreik M, van Hamersvelt RW, Wolterink JM, Leiner T, Viergever MA, Isgum I (2019) A recurrent CNN for automatic detection and classification of coronary artery plaque and stenosis in coronary CT angiography. IEEE Trans Med Imaging 38:1588–1598CrossRef
36.
go back to reference Liu J, Jin C, Feng J, Du Y, Lu J, Zhou J (2019) A vessel-focused 3D convolutional network for automatic segmentation and classification of coronary artery plaques in cardiac CTA. Springer International Publishing, Cham, pp 131–141 Liu J, Jin C, Feng J, Du Y, Lu J, Zhou J (2019) A vessel-focused 3D convolutional network for automatic segmentation and classification of coronary artery plaques in cardiac CTA. Springer International Publishing, Cham, pp 131–141
Metadata
Title
Deep learning–based atherosclerotic coronary plaque segmentation on coronary CT angiography
Authors
Natasa Jávorszky
Bálint Homonnay
Gary Gerstenblith
David Bluemke
Péter Kiss
Mihály Török
David Celentano
Hong Lai
Shenghan Lai
Márton Kolossváry
Publication date
07-05-2022
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 10/2022
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-022-08801-8

Other articles of this Issue 10/2022

European Radiology 10/2022 Go to the issue