Skip to main content
Top
Published in: The International Journal of Cardiovascular Imaging 5/2013

01-06-2013 | Original Paper

Reproducibility of computed tomography angiography data analysis using semiautomated plaque quantification software: implications for the design of longitudinal studies

Authors: Stella-Lida Papadopoulou, Hector M. Garcia-Garcia, Alexia Rossi, Chrysafios Girasis, Anoeshka S. Dharampal, Pieter H. Kitslaar, Gabriel P. Krestin, Pim J. de Feyter

Published in: The International Journal of Cardiovascular Imaging | Issue 5/2013

Login to get access

Abstract

Reproducibility of the quantitative assessment of atherosclerosis by computed tomography coronary angiography (CTCA) is paramount for the design of longitudinal studies. The purpose of this study was to assess the inter- and intra-observer reproducibility using semiautomated CT plaque analysis software in symptomatic individuals. CTCA was performed in 10 symptomatic patients after percutaneous treatment of the culprit lesions and was repeated after 3 years. The plaque quantitative analysis was performed in untreated vessels with mild-to-moderate atherosclerosis and included geometrical and compositional characteristics using semiautomated CT plaque analysis software. A total of 945 matched cross-sections from 21 segments were analyzed independently by a second reviewer to assess inter-observer variability; the first observer repeated all the analyses after 3 months to assess intra-observer variability. The observer variability was also compared to the absolute plaque changes detected over time. Agreement was evaluated by Bland–Altman analysis and concordance correlation coefficient. Inter-observer relative differences for lumen, vessel, plaque area and plaque burden were 1.2, 0.6, 2.2, 1.6 % respectively. Intra-observer relative differences for lumen, vessel, plaque area and plaque burden were 1.0, 0.4, 0.2, 0.4 % respectively. For the average plaque attenuation values the inter- and intra-observer variability was 5 and 2 % respectively. For the % low-attenuation-plaque the inter- and intra-observer variability was 16 and 6 % respectively. The absolute intra-observer variability for the plaque burden was 1.30 ± 1.09 %, while the temporal plaque burden difference was 3.55 ± 3.02 % (p = 0.001). The present study shows that the geometrical assessment of coronary atherosclerosis by CTCA is highly reproducible within and between observers using semiautomated quantification software and that serial plaque changes can be detected beyond observer variability. The compositional measurements are more variable between observers than geometrical measurements.
Literature
1.
go back to reference Smith SC Jr, Jackson R, Pearson TA, Fuster V, Yusuf S, Faergeman O, Wood DA, Alderman M, Horgan J, Home P, Hunn M, Grundy SM (2004) Principles for national and regional guidelines on cardiovascular disease prevention: a scientific statement from the World Heart and Stroke Forum. Circulation 109(25):3112–3121. doi:10.1161/01.CIR.0000133427.35111.67 PubMedCrossRef Smith SC Jr, Jackson R, Pearson TA, Fuster V, Yusuf S, Faergeman O, Wood DA, Alderman M, Horgan J, Home P, Hunn M, Grundy SM (2004) Principles for national and regional guidelines on cardiovascular disease prevention: a scientific statement from the World Heart and Stroke Forum. Circulation 109(25):3112–3121. doi:10.​1161/​01.​CIR.​0000133427.​35111.​67 PubMedCrossRef
2.
go back to reference de Feyter PJ, Serruys PW, Davies MJ, Richardson P, Lubsen J, Oliver MF (1991) Quantitative coronary angiography to measure progression and regression of coronary atherosclerosis. Value, limitations, and implications for clinical trials. Circulation 84(1):412–423PubMedCrossRef de Feyter PJ, Serruys PW, Davies MJ, Richardson P, Lubsen J, Oliver MF (1991) Quantitative coronary angiography to measure progression and regression of coronary atherosclerosis. Value, limitations, and implications for clinical trials. Circulation 84(1):412–423PubMedCrossRef
3.
go back to reference Mintz GS, Garcia-Garcia HM, Nicholls SJ, Weissman NJ, Bruining N, Crowe T, Tardif JC, Serruys PW (2011) Clinical expert consensus document on standards for acquisition, measurement and reporting of intravascular ultrasound regression/progression studies. EuroIntervention 6(9):1123–1130, 1129. doi:10.4244/EIJV6I9A195 Mintz GS, Garcia-Garcia HM, Nicholls SJ, Weissman NJ, Bruining N, Crowe T, Tardif JC, Serruys PW (2011) Clinical expert consensus document on standards for acquisition, measurement and reporting of intravascular ultrasound regression/progression studies. EuroIntervention 6(9):1123–1130, 1129. doi:10.​4244/​EIJV6I9A195
4.
go back to reference Burgstahler C, Reimann A, Beck T, Kuettner A, Baumann D, Heuschmid M, Brodoefel H, Claussen CD, Kopp AF, Schroeder S (2007) Influence of a lipid-lowering therapy on calcified and noncalcified coronary plaques monitored by multislice detector computed tomography: results of the New Age II Pilot Study. Invest Radiol 42(3):189–195. doi:10.1097/01.rli.0000254408.96355.85 PubMedCrossRef Burgstahler C, Reimann A, Beck T, Kuettner A, Baumann D, Heuschmid M, Brodoefel H, Claussen CD, Kopp AF, Schroeder S (2007) Influence of a lipid-lowering therapy on calcified and noncalcified coronary plaques monitored by multislice detector computed tomography: results of the New Age II Pilot Study. Invest Radiol 42(3):189–195. doi:10.​1097/​01.​rli.​0000254408.​96355.​85 PubMedCrossRef
5.
go back to reference Uehara M, Funabashi N, Mikami Y, Shiina Y, Nakamura K, Komuro I (2008) Quantitative effect of atorvastatin on size and content of non-calcified plaques of coronary arteries 1 year after atorvastatin treatment by multislice computed tomography. Int J Cardiol 130(2):269–275. doi:10.1016/j.ijcard.2007.07.013 PubMedCrossRef Uehara M, Funabashi N, Mikami Y, Shiina Y, Nakamura K, Komuro I (2008) Quantitative effect of atorvastatin on size and content of non-calcified plaques of coronary arteries 1 year after atorvastatin treatment by multislice computed tomography. Int J Cardiol 130(2):269–275. doi:10.​1016/​j.​ijcard.​2007.​07.​013 PubMedCrossRef
6.
go back to reference Schmid M, Achenbach S, Ropers D, Komatsu S, Ropers U, Daniel WG, Pflederer T (2008) Assessment of changes in non-calcified atherosclerotic plaque volume in the left main and left anterior descending coronary arteries over time by 64-slice computed tomography. Am J Cardiol 101(5):579–584. doi:10.1016/j.amjcard.2007.10.016 PubMedCrossRef Schmid M, Achenbach S, Ropers D, Komatsu S, Ropers U, Daniel WG, Pflederer T (2008) Assessment of changes in non-calcified atherosclerotic plaque volume in the left main and left anterior descending coronary arteries over time by 64-slice computed tomography. Am J Cardiol 101(5):579–584. doi:10.​1016/​j.​amjcard.​2007.​10.​016 PubMedCrossRef
7.
go back to reference Lehman SJ, Schlett CL, Bamberg F, Lee H, Donnelly P, Shturman L, Kriegel MF, Brady TJ, Hoffmann U (2009) Assessment of coronary plaque progression in coronary computed tomography angiography using a semiquantitative score. JACC Cardiovasc Imaging 2(11):1262–1270. doi:10.1016/j.jcmg.2009.07.007 PubMedCrossRef Lehman SJ, Schlett CL, Bamberg F, Lee H, Donnelly P, Shturman L, Kriegel MF, Brady TJ, Hoffmann U (2009) Assessment of coronary plaque progression in coronary computed tomography angiography using a semiquantitative score. JACC Cardiovasc Imaging 2(11):1262–1270. doi:10.​1016/​j.​jcmg.​2009.​07.​007 PubMedCrossRef
8.
9.
go back to reference Inoue K, Motoyama S, Sarai M, Sato T, Harigaya H, Hara T, Sanda Y, Anno H, Kondo T, Wong ND, Narula J, Ozaki Y (2010) Serial coronary CT angiography-verified changes in plaque characteristics as an end point: evaluation of effect of statin intervention. JACC Cardiovasc Imaging 3(7):691–698. doi:10.1016/j.jcmg.2010.04.011 PubMedCrossRef Inoue K, Motoyama S, Sarai M, Sato T, Harigaya H, Hara T, Sanda Y, Anno H, Kondo T, Wong ND, Narula J, Ozaki Y (2010) Serial coronary CT angiography-verified changes in plaque characteristics as an end point: evaluation of effect of statin intervention. JACC Cardiovasc Imaging 3(7):691–698. doi:10.​1016/​j.​jcmg.​2010.​04.​011 PubMedCrossRef
10.
go back to reference Tardif JC, L’Allier PL, Ibrahim R, Gregoire JC, Nozza A, Cossette M, Kouz S, Lavoie MA, Paquin J, Brotz TM, Taub R, Pressacco J (2010) Treatment with 5-lipoxygenase inhibitor VIA-2291 (Atreleuton) in patients with recent acute coronary syndrome. Circ Cardiovasc Imaging 3(3):298–307. doi:10.1161/CIRCIMAGING.110.937169 PubMedCrossRef Tardif JC, L’Allier PL, Ibrahim R, Gregoire JC, Nozza A, Cossette M, Kouz S, Lavoie MA, Paquin J, Brotz TM, Taub R, Pressacco J (2010) Treatment with 5-lipoxygenase inhibitor VIA-2291 (Atreleuton) in patients with recent acute coronary syndrome. Circ Cardiovasc Imaging 3(3):298–307. doi:10.​1161/​CIRCIMAGING.​110.​937169 PubMedCrossRef
11.
go back to reference Papadopoulou SL, Neefjes LA, Garcia–Garcia HM, Flu WJ, Rossi A, Dharampal AS, Kitslaar PH, Mollet NR, Veldhof S, Nieman K, Stone GW, Serruys PW, Krestin GP, de Feyter PJ (2012) Natural history of coronary atherosclerosis by multislice computed tomography. JACC Cardiovasc Imaging 5(3 Suppl):S28–S37. doi:10.1016/j.jcmg.2012.01.009 PubMedCrossRef Papadopoulou SL, Neefjes LA, Garcia–Garcia HM, Flu WJ, Rossi A, Dharampal AS, Kitslaar PH, Mollet NR, Veldhof S, Nieman K, Stone GW, Serruys PW, Krestin GP, de Feyter PJ (2012) Natural history of coronary atherosclerosis by multislice computed tomography. JACC Cardiovasc Imaging 5(3 Suppl):S28–S37. doi:10.​1016/​j.​jcmg.​2012.​01.​009 PubMedCrossRef
12.
go back to reference Nissen SE, Nicholls SJ, Sipahi I, Libby P, Raichlen JS, Ballantyne CM, Davignon J, Erbel R, Fruchart JC, Tardif JC, Schoenhagen P, Crowe T, Cain V, Wolski K, Goormastic M, Tuzcu EM (2006) Effect of very high-intensity statin therapy on regression of coronary atherosclerosis: the ASTEROID trial. JAMA 295(13):1556–1565. doi:10.1001/jama.295.13.jpc60002 PubMedCrossRef Nissen SE, Nicholls SJ, Sipahi I, Libby P, Raichlen JS, Ballantyne CM, Davignon J, Erbel R, Fruchart JC, Tardif JC, Schoenhagen P, Crowe T, Cain V, Wolski K, Goormastic M, Tuzcu EM (2006) Effect of very high-intensity statin therapy on regression of coronary atherosclerosis: the ASTEROID trial. JAMA 295(13):1556–1565. doi:10.​1001/​jama.​295.​13.​jpc60002 PubMedCrossRef
13.
go back to reference Bongartz G, Golding SJ, Jurik AG, Leonardi M, van Persijn van Meerten E, Rodríguez R, Schneider K, Calzado A, Geleijns J, Jessen KA, Panzer W, Shrimpton PC, Tosi G (2004) CT quality criteria—appendix C. European Guidelines for Multislice Computed Tomography, European Commission. Available at: http://www.msct.eu/CT_Quality_Criteria.htm Bongartz G, Golding SJ, Jurik AG, Leonardi M, van Persijn van Meerten E, Rodríguez R, Schneider K, Calzado A, Geleijns J, Jessen KA, Panzer W, Shrimpton PC, Tosi G (2004) CT quality criteria—appendix C. European Guidelines for Multislice Computed Tomography, European Commission. Available at: http://​www.​msct.​eu/​CT_​Quality_​Criteria.​htm
14.
go back to reference Boogers MJ, Broersen A, van Velzen JE, de Graaf FR, El-Naggar HM, Kitslaar PH, Dijkstra J, Delgado V, Boersma E, de Roos A, Schuijf JD, Schalij MJ, Reiber JH, Bax JJ, Jukema JW (2012) Automated quantification of coronary plaque with computed tomography: comparison with intravascular ultrasound using a dedicated registration algorithm for fusion-based quantification. Eur Heart J 33(8):1007–1016. doi:10.1093/eurheartj/ehr465 PubMedCrossRef Boogers MJ, Broersen A, van Velzen JE, de Graaf FR, El-Naggar HM, Kitslaar PH, Dijkstra J, Delgado V, Boersma E, de Roos A, Schuijf JD, Schalij MJ, Reiber JH, Bax JJ, Jukema JW (2012) Automated quantification of coronary plaque with computed tomography: comparison with intravascular ultrasound using a dedicated registration algorithm for fusion-based quantification. Eur Heart J 33(8):1007–1016. doi:10.​1093/​eurheartj/​ehr465 PubMedCrossRef
15.
go back to reference Austen WG, Edwards JE, Frye RL, Gensini GG, Gott VL, Griffith LS, McGoon DC, Murphy ML, Roe BB (1975) A reporting system on patients evaluated for coronary artery disease. Report of the Ad Hoc Committee for Grading of Coronary Artery Disease, Council on Cardiovascular Surgery, American Heart Association. Circulation 51(4 Suppl):5–40PubMedCrossRef Austen WG, Edwards JE, Frye RL, Gensini GG, Gott VL, Griffith LS, McGoon DC, Murphy ML, Roe BB (1975) A reporting system on patients evaluated for coronary artery disease. Report of the Ad Hoc Committee for Grading of Coronary Artery Disease, Council on Cardiovascular Surgery, American Heart Association. Circulation 51(4 Suppl):5–40PubMedCrossRef
16.
go back to reference Lin LI (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45(1):255–268PubMedCrossRef Lin LI (1989) A concordance correlation coefficient to evaluate reproducibility. Biometrics 45(1):255–268PubMedCrossRef
17.
go back to reference Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1(8476):307–310PubMedCrossRef Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1(8476):307–310PubMedCrossRef
18.
go back to reference Motoyama S, Kondo T, Anno H, Sugiura A, Ito Y, Mori K, Ishii J, Sato T, Inoue K, Sarai M, Hishida H, Narula J (2007) Atherosclerotic plaque characterization by 0.5-mm-slice multislice computed tomographic imaging. Circ J 71(3):363–366PubMedCrossRef Motoyama S, Kondo T, Anno H, Sugiura A, Ito Y, Mori K, Ishii J, Sato T, Inoue K, Sarai M, Hishida H, Narula J (2007) Atherosclerotic plaque characterization by 0.5-mm-slice multislice computed tomographic imaging. Circ J 71(3):363–366PubMedCrossRef
19.
go back to reference Motoyama S, Sarai M, Harigaya H, Anno H, Inoue K, Hara T, Naruse H, Ishii J, Hishida H, Wong ND, Virmani R, Kondo T, Ozaki Y, Narula J (2009) Computed tomographic angiography characteristics of atherosclerotic plaques subsequently resulting in acute coronary syndrome. J Am Coll Cardiol 54(1):49–57. doi:10.1016/j.jacc.2009.02.068 PubMedCrossRef Motoyama S, Sarai M, Harigaya H, Anno H, Inoue K, Hara T, Naruse H, Ishii J, Hishida H, Wong ND, Virmani R, Kondo T, Ozaki Y, Narula J (2009) Computed tomographic angiography characteristics of atherosclerotic plaques subsequently resulting in acute coronary syndrome. J Am Coll Cardiol 54(1):49–57. doi:10.​1016/​j.​jacc.​2009.​02.​068 PubMedCrossRef
20.
go back to reference Rodriguez-Granillo GA, Vaina S, Garcia–Garcia HM, Valgimigli M, Duckers E, van Geuns RJ, Regar E, van der Giessen WJ, Bressers M, Goedhart D, Morel MA, de Feyter PJ, Serruys PW (2006) Reproducibility of intravascular ultrasound radiofrequency data analysis: implications for the design of longitudinal studies. Int J Cardiovasc Imaging 22(5):621–631. doi:10.1007/s10554-006-9080-0 PubMedCrossRef Rodriguez-Granillo GA, Vaina S, Garcia–Garcia HM, Valgimigli M, Duckers E, van Geuns RJ, Regar E, van der Giessen WJ, Bressers M, Goedhart D, Morel MA, de Feyter PJ, Serruys PW (2006) Reproducibility of intravascular ultrasound radiofrequency data analysis: implications for the design of longitudinal studies. Int J Cardiovasc Imaging 22(5):621–631. doi:10.​1007/​s10554-006-9080-0 PubMedCrossRef
21.
go back to reference Hartmann M, Mattern ES, Huisman J, van Houwelingen GK, de Man FH, Stoel MG, Danse PW, Louwerenburg HW, von Birgelen C (2009) Reproducibility of volumetric intravascular ultrasound radiofrequency-based analysis of coronary plaque composition in vivo. Int J Cardiovasc Imaging 25(1):13–23. doi:10.1007/s10554-008-9338-9 PubMedCrossRef Hartmann M, Mattern ES, Huisman J, van Houwelingen GK, de Man FH, Stoel MG, Danse PW, Louwerenburg HW, von Birgelen C (2009) Reproducibility of volumetric intravascular ultrasound radiofrequency-based analysis of coronary plaque composition in vivo. Int J Cardiovasc Imaging 25(1):13–23. doi:10.​1007/​s10554-008-9338-9 PubMedCrossRef
22.
go back to reference Heo JH, Brugaletta S, Garcia-Garcia HM, Gomez-Lara J, Ligthart JM, Witberg K, Magro M, Shin ES, Serruys PW (2011) Reproducibility of intravascular ultrasound iMAP for radiofrequency data analysis: implications for design of longitudinal studies. Catheter Cardiovasc Interv. doi:10.1002/ccd.23335 PubMed Heo JH, Brugaletta S, Garcia-Garcia HM, Gomez-Lara J, Ligthart JM, Witberg K, Magro M, Shin ES, Serruys PW (2011) Reproducibility of intravascular ultrasound iMAP for radiofrequency data analysis: implications for design of longitudinal studies. Catheter Cardiovasc Interv. doi:10.​1002/​ccd.​23335 PubMed
Metadata
Title
Reproducibility of computed tomography angiography data analysis using semiautomated plaque quantification software: implications for the design of longitudinal studies
Authors
Stella-Lida Papadopoulou
Hector M. Garcia-Garcia
Alexia Rossi
Chrysafios Girasis
Anoeshka S. Dharampal
Pieter H. Kitslaar
Gabriel P. Krestin
Pim J. de Feyter
Publication date
01-06-2013
Publisher
Springer Netherlands
Published in
The International Journal of Cardiovascular Imaging / Issue 5/2013
Print ISSN: 1569-5794
Electronic ISSN: 1875-8312
DOI
https://doi.org/10.1007/s10554-012-0167-5

Other articles of this Issue 5/2013

The International Journal of Cardiovascular Imaging 5/2013 Go to the issue