Top

International Journal of Computer Assisted Radiology and Surgery

Published in:

Open Access 01-07-2014 | Original Article

Evaluation of novice reader diagnostic performance in coronary CT angiography using an advanced cardiac software package

Authors: Peter Dankerl, Matthias Hammon, Alexey Tsymbal, Alexander Cavallaro, Stephan Achenbach, Michael Uder, Rolf Janka

Published in: International Journal of Computer Assisted Radiology and Surgery | Issue 4/2014

Abstract

Purpose

The purpose of this research was to evaluate whether a commercially available advanced cardiac software package for coronary CT angiography (CTA) interpretation may reliably assist inexperienced readers to screen for significant coronary artery stenoses.

Methods

Coronary CTA data sets of 61 consecutive patients with suspected coronary artery disease were evaluated by three novice readers with no experience in cardiac CT interpretation. In the first 15 patients, the novice readers were trained to use the advanced cardiac software package (includes automatic detection of coronary vessels, curved MPR and VRT reconstructions and a measurement too) knowing the results of an expert read. In the next 46 patients, the novice readers had to state whether there is a significant coronary artery stenosis (\(>\)50 %) and if they are confident with their diagnosis. The results of the novice readers were compared to the expert read.

Results

The 46 coronary CTA data sets contained 184 vessels with 15 stenoses in 9 patients. On a per-vessel analysis, novice reader 1/2/3 demonstrated 60 %/100 %/ 93% sensitivity, and 98 %/90 %/86 % specificity. Per patient, the readers diagnosed 36/28/29 cases correctly as free of stenoses, 6/9/8 correctly as having at least one stenosis, missed 3/0/1 cases with a stenosis and overdiagnosed 1/9/8 patients. Cohen’s kappa values for the three readers versus the expert were 0.60, 0.61 and 0.54. The three novice readers felt confident in the diagnosis of 36/33/30 patients. In these patients, they missed one significant stenosis, showed a sensitivity of 100 %/100 %/75 % and a specificity of 100 %/92 %/88 %.

Conclusions

The evaluated advanced cardiac software package successfully assists novice readers in interpreting coronary CTA data sets especially in ruling out significant coronary artery stenosis.

Ropers D, Baum U, Pohle K, Anders K, Ulzheimer S, Ohnesorge B, Schlundt C, Bautz W, Daniel WG, Achenbach S (2003) Detection of coronary artery stenoses with thin-slice multi-detector row spiral computed tomography and multiplanar reconstruction. Circulation 107:664–666PubMedCrossRef

Kuettner A, Beck T, Drosch T, Kettering K, Heuschmid M, Burgstahler C, Claussen CD, Kopp AF, Schroeder S (2005) Diagnostic accuracy of noninvasive coronary imaging using 16-detector slice spiral computed tomography with 188 ms temporal resolution. J Am Coll Cardiol 45:123–127PubMedCrossRef

Achenbach S, Ropers D, Pohle F-K, Raaz D, von Erffa J, Yilmaz A, Muschiol G, Daniel WG (2005) Detection of coronary artery stenoses using multi-detector CT with 16 x 0.75 collimation and 375 ms rotation. Eur Heart J 26:1978–1986PubMedCrossRef

Yeow T, Raju V, Venkatanarasimha N, Fox B, Roobottom C (2011) Pictorial review: computed tomography features of cardiovascular emergencies and associated imminent decompensation. Emerg Radiol 18:127–138PubMedCrossRef

Lell M, Marwan M, Schepis T, Pflederer T, Anders K, Flohr T, Allmendinger T, Kalender W, Ertel D, Thierfelder C, Kuettner A, Ropers D, Daniel WG, Achenbach S (2009) Prospectively ECG-triggered high-pitch spiral acquisition for coronary CT angiography using dual source CT: technique and initial experience. Eur Radiol 19:2576–2583PubMedCrossRef

Achenbach S, Marwan M, Ropers D, Schepis T, Pflederer T, Anders K, Kuettner A, Daniel WG, Uder M, Lell MM (2010) Coronary computed tomography angiography with a consistent dose below 1 mSv using prospectively electrocardiogram-triggered high-pitch spiral acquisition. Eur Heart J 31:340–346PubMedCrossRef

Dewey M, Zimmermann E, Deissenrieder F, Laule M, Dübel H-P, Schlattmann P, Knebel F, Rutsch W, Hamm B (2009) Noninvasive coronary angiography by 320-row computed tomography With lower radiation exposure and maintained diagnostic accuracy comparison of results With cardiac catheterization in a head-to-head pilot investigation. Circulation 120:867–875PubMedCrossRef

Redberg RF (2012) Coronary CT angiography for acute chest pain. N Engl J Med 367:375–376PubMedCrossRef

Saur S, Alkadhi H, Stolzmann P, Baumüller S, Leschka S, Scheffel H, Desbiolles L, Fuchs TJ, Szekely G, Cattin PC (2012) Effect of reader experience on variability, evaluation time and accuracy of coronary plaque detection with computed tomography coronary angiography. Eur Radiol 20:1599–1606CrossRef

10.

Budoff MJ, Achenbach S, Berman DS, Fayad ZA, Poon M, Taylor AJ, Uretsky BF, Williams KA (2008) Task force 13 training in advanced cardiovascular imaging (computed tomography). J Cardiovasc Comput Tomogr 2:130–135PubMedCrossRef

11.

Pugliese F, Hunink MGM, Gruszczynska K, Alberghina F, Malagó R, Van Pelt N (2009) Learning curve for coronary CT angiography: what constitutes sufficient training? Radiology 251:359–368

12.

Itagaki MW, Suh RD, Goldin JG (2009) Cardiac CT research: exponential growth. Radiology 252:468–476

13.

Achenbach S, Manolopoulos M, Schuhbäck A, Ropers D, Rixe J, Schneider C, Krombach GA, Uder M, Hamm C, Daniel WG, Lell M (2012) Influence of heart rate and phase of the cardiac cycle on the occurrence of motion artifact in dual-source CT angiography of the coronary arteries. J Cardiovasc Comput Tomogr 6:91–98

14.

McCollough CH, Primak AN, Saba O, Bruder H, Stierstorfer K, Raupach R, Suess C, Schmidt B, Ohnesorge BM, Flohr TG (2007) Dose performance of a 64-channel dual-source CT scanner. Radiology 243:775–784PubMedCrossRef

15.

Landis JR, Koch GG (1977) The measurement of observer agreement for categorical data. Biometrics 33:159–174PubMedCrossRef

16.

Fleiss JL (1973) Statistical methods for rates and proportions. Wiley, New York

17.

Meyer M, Schoepf UJ, Fink C, Goldenberg R, Apfaltrer P, Gruettner J, Vajcs D, Schoenberg SO, Henzler T (2013) Diagnostic performance evaluation of a computer-aided simple triage system for coronary CT angiography in patients with intermediate risk for acute coronary syndrome. Acad Radiol 20:980–986PubMedCrossRef

18.

Arnoldi E, Schoepf U, Rosenblum M, Zwerner PL, Goldenberg R, Reiser MF, Thilo C (2011) Computer-aided detection of coronary artery stenosis at computed tomography angiography: effect on performance of readers with different experience levels ECR 2011 Book of Abstracts-B- Scientific Sessions. Insights Imaging, 135–324

19.

Goldenberg R, Peled N (2011) Computer-aided simple triage. Int J Comput Assist Radiol Surg 6:705–711PubMedCrossRef

20.

Grimes DA, Schulz KF (2002) Uses and abuses of screening tests. Lancet 359:881–884PubMedCrossRef

21.

Anders K, Ropers U, Kuettner A, Wechsel M, Daniel WG, Uder M, Achenbach S (2011) Individually adapted, interactive multiplanar reformations vs. semi-automated coronary segmentation and curved planar reformations for stenosis detection in coronary computed tomography angiography. Eur J Radiol 80:89–95PubMedCrossRef

22.

Ferencik M, Ropers D, Abbara S, Cury RC, Hoffmann U, Nieman K, Brady TJ, Moselwski F, Daniel WG, Achenbach S (2007) Diagnostic accuracy of image postprocessing methods for the detection of coronary artery stenoses by using multidetector CT. Radiology 243:696–702PubMedCrossRef

23.

Glas AS, Lijmer JG, Prins MH, Bonsel GJ, Bossuyt PMM (2003) The diagnostic odds ratio: a single indicator of test performance. J Clin Epidemiol 56:1129–1135PubMedCrossRef

24.

Vogler N, Meyer M, Fink C, Schoepf UJ, Schönberg SO, Henzler T (2013) Predictive value of zero calcium score and low-end percentiles for the presence of significant coronary artery stenosis in stable patients with suspected coronary artery disease. Rofo 185:726–732PubMedCrossRef

25.

Herold G (2013) Innere Medizin. Gerd Herold, Köln

Title: Evaluation of novice reader diagnostic performance in coronary CT angiography using an advanced cardiac software package
Authors: Peter Dankerl
Matthias Hammon
Alexey Tsymbal
Alexander Cavallaro
Stephan Achenbach
Michael Uder
Rolf Janka
Publication date: 01-07-2014
Publisher: Springer Berlin Heidelberg
Published in: International Journal of Computer Assisted Radiology and Surgery / Issue 4/2014
Print ISSN: 1861-6410
Electronic ISSN: 1861-6429
DOI: https://doi.org/10.1007/s11548-013-0953-0

At a glance: The STEP trials

Springer Medicine

Evaluation of novice reader diagnostic performance in coronary CT angiography using an advanced cardiac software package

Abstract

Purpose

Methods

Results

Conclusions

At a glance: The STEP trials

Springer Medicine

Abstract

Purpose

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 4/2014

Design and initial evaluation of a treatment planning software system for MRI-guided laser ablation in the brain

Stent graft visualization and planning tool for endovascular surgery using finite element analysis

A morphological study of anatomical plates for acetabular posterior column

Simultaneous extraction of carotid artery intima-media interfaces in ultrasound images: assessment of wall thickness temporal variation during the cardiac cycle

Spectroscopy imaging in intraoperative MR suite: tissue characterization and optimization of tumor resection

A fast deformable registration method for 4D lung CT in hybrid framework