Top

Published in:

01-03-2015 | Computed Tomography

Computer-aided stenosis detection at coronary CT angiography: effect on performance of readers with different experience levels

Authors: Christian Thilo, Mulugeta Gebregziabher, Felix G. Meinel, Roman Goldenberg, John W. Nance Jr., Elisabeth M. Arnoldi, Lashonda D. Soma, Ullrich Ebersberger, Philip Blanke, Richard L. Coursey, Michael A. Rosenblum, Peter L. Zwerner, U. Joseph Schoepf

Published in: European Radiology | Issue 3/2015

Abstract

Objectives

To evaluate the effect of a computer-aided detection (CAD) algorithm for coronary CT angiography (cCTA) on the performance of readers with different experience levels.

Methods

We studied 50 patients (18 women, 58 ± 11 years) who had undergone cCTA and quantitative coronary angiography (QCA). Eight observers with varying experience levels evaluated all studies for ≥50 % coronary artery stenosis. After 3 months, the same observers re-evaluated all studies, this time guided by a CAD system. Their performance with and without the CAD system (sensitivity, specificity, positive predictive value and negative predictive value) was assessed using the Likelihood Ratio Χ² test both at the per-patient and per-vessel levels.

Results

The sensitivity of the CAD system alone for stenosis detection was 71 % per-vessel and 100 % per-patient. There were 54 false positive (FP) findings within 199 analyzed vessels, most of them associated with non-obstructive (<50 %) lesions. With CAD, one (out of three, 33 %) inexperienced reader’s per-patient sensitivity and negative predictive value significantly improved from 79 % to 100 % (P = 0.046) and from 90 % to 100 % (P = 0.034), respectively. Other readers’ performance indices showed no statistically significant change.

Conclusions

Our results suggest that CAD can improve some inexperienced readers’ sensitivity for diagnosing coronary artery stenosis at cCTA.

Key Points

• Computer-assisted algorithms can aid in detecting coronary artery stenosis at CT.

• The change in overall diagnostic performance is small across all experience levels.

• For some inexperienced readers a significant increase in sensitivity is observed.

Abidov A, Gallagher MJ, Chinnaiyan KM, Mehta LS, Wegner JH, Raff GL (2009) Clinical effectiveness of coronary computed tomographic angiography in the triage of patients to cardiac catheterization and revascularization after inconclusive stress testing: results of a 2-year prospective trial. J Nucl Cardiol 16:701–713CrossRefPubMed

Ravipati G, Aronow WS, Lai H et al (2008) Comparison of sensitivity, specificity, positive predictive value, and negative predictive value of stress testing versus 64-multislice coronary computed tomography angiography in predicting obstructive coronary artery disease diagnosed by coronary angiography. Am J Cardiol 101:774–775CrossRefPubMed

Sheth T, Amlani S, Ellins ML et al (2008) Computed tomographic coronary angiographic assessment of high-risk coronary anatomy in patients with suspected coronary artery disease and intermediate pretest probability. Am Heart J 155:918–923CrossRefPubMed

Gallagher MJ, Ross MA, Raff GL, Goldstein JA, O'Neill WW, O'Neil B (2007) The diagnostic accuracy of 64-slice computed tomography coronary angiography compared with stress nuclear imaging in emergency department low-risk chest pain patients. Ann Emerg Med 49:125–136CrossRefPubMed

Pugliese F, Mollet NR, Hunink MG et al (2008) Diagnostic performance of coronary CT angiography by using different generations of multisection scanners: single-center experience. Radiology 246:384–393CrossRefPubMed

Raff GL, Gallagher MJ, O'Neill WW, Goldstein JA (2005) Diagnostic accuracy of noninvasive coronary angiography using 64-slice spiral computed tomography. J Am Coll Cardiol 46:552–557CrossRefPubMed

Herzog C, Zwerner PL, Doll JR et al (2007) Significant coronary artery stenosis: comparison on per-patient and per-vessel or per-segment basis at 64-section CT angiography. Radiology 244:112–120CrossRefPubMed

Hoffmann MH, Shi H, Schmitz BL et al (2005) Noninvasive coronary angiography with multislice computed tomography. JAMA 293:2471–2478CrossRefPubMed

Pugliese F, Hunink MG, Gruszczynska K et al (2009) Learning curve for coronary CT angiography: what constitutes sufficient training? Radiology 251:359–368CrossRefPubMed

10.

Schroeder S, Achenbach S, Bengel F et al (2008) Cardiac computed tomography: indications, applications, limitations, and training requirements: report of a writing group deployed by the working group nuclear cardiology and cardiac CT of the european society of cardiology and the European council of nuclear cardiology. Eur Heart J 29:531–556CrossRefPubMed

11.

Armato SG, Li F, Giger ML, MacMahon H, Sone S, Doi K (2002) Lung cancer: performance of automated lung nodule detection applied to cancers missed in a CT screening program. Radiology 225:685–692CrossRefPubMed

12.

Baker ME, Bogoni L, Obuchowski NA et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149CrossRefPubMed

13.

Das M, Muhlenbruch G, Helm A et al (2008) Computer-aided detection of pulmonary embolism: influence on radiologists' detection performance with respect to vessel segments. Eur Radiol 18:1350–1355CrossRefPubMed

14.

Freer TW, Ulissey MJ (2001) Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. Radiology 220:781–786CrossRefPubMed

15.

Koss LG, Sherman ME, Cohen MB et al (1997) Significant reduction in the rate of false-negative cervical smears with neural network-based technology (PAPNET Testing System). Hum Pathol 28:1196–1203CrossRefPubMed

16.

Das M, Muhlenbruch G, Mahnken AH et al (2006) Small pulmonary nodules: effect of two computer-aided detection systems on radiologist performance. Radiology 241:564–571CrossRefPubMed

17.

Isgum I, Rutten A, Prokop M, van Ginneken B (2007) Detection of coronary calcifications from computed tomography scans for automated risk assessment of coronary artery disease. Med Phys 34:1450–1461CrossRefPubMed

18.

Reimann AJ, Tsiflikas I, Brodoefel H et al (2009) Efficacy of computer aided analysis in detection of significant coronary artery stenosis in cardiac using dual source computed tomography. Int J Cardiovasc Imaging 25:195–203CrossRefPubMed

19.

Sugahara T, Yamagihara Y, Sugimoto N, Kimura K, Awano K, Azumi T (1992) Computer-aided interpretation of coronary cineangiograms. Accuracy of automatic detection of stenotic lesions. Acta Radiol 33:6–9PubMed

20.

Flohr TG, Stierstorfer K, Ulzheimer S, Bruder H, Primak AN, McCollough CH (2005) Image reconstruction and image quality evaluation for a 64-slice CT scanner with z-flying focal spot. Med Phys 32:2536–2547CrossRefPubMed

21.

Budoff MJ, Achenbach S, Berman DS et al (2008) Task force 13: training in advanced cardiovascular imaging (computed tomography) endorsed by the American Society of Nuclear Cardiology, Society of Atherosclerosis Imaging and Prevention, Society for Cardiovascular Angiography and Interventions, and Society of Cardiovascular Computed Tomography. J Am Coll Cardiol 51:409–414CrossRefPubMed

22.

DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating characteristic curves: a nonparametric approach. Biometrics 44:837–845CrossRefPubMed

23.

Meyer M, Schoepf UJ, Fink C et al (2013) Diagnostic performance evaluation of a computer-aided simple triage system for coronary CT angiography in patients with intermediate risk for acute coronary syndrome. Acad Radiol 20:980–986CrossRefPubMed

24.

Arnoldi E, Gebregziabher M, Schoepf UJ et al (2010) Automated computer-aided stenosis detection at coronary CT angiography: initial experience. Eur Radiol 20:1160–1167CrossRefPubMed

25.

Halpern EJ, Halpern DJ (2011) Diagnosis of coronary stenosis with CT angiography comparison of automated computer diagnosis with expert readings. Acad Radiol 18:324–333CrossRefPubMed

26.

Kang KW, Chang HJ, Shim H et al (2012) Feasibility of an automatic computer-assisted algorithm for the detection of significant coronary artery disease in patients presenting with acute chest pain. Eur J Radiol 81:e640–e646CrossRefPubMed

27.

Min JH, Kim SM, Lee S, Choi JH, Chang SA, Choe YH (2014) Diagnostic performance of algorithm for computer-assisted detection of significant coronary artery disease in patients with acute chest pain: comparison with invasive coronary angiography. AJR Am J Roentgenol 202:730–737CrossRefPubMed

28.

Maizlin ZV, Vos PM, Godoy MC, Cooperberg PL (2007) Computer-aided detection of pulmonary embolism on CT angiography: initial experience. J Thorac Imaging 22:324–329CrossRefPubMed

29.

Summers RM, Johnson CD, Pusanik LM, Malley JD, Youssef AM, Reed JE (2001) Automated polyp detection at CT colonography: feasibility assessment in a human population. Radiology 219:51–59CrossRefPubMed

30.

Zhou C, Chan HP, Patel S et al (2005) Preliminary investigation of computer-aided detection of pulmonary embolism in three-dimensional computed tomography pulmonary angiography images. Acad Radiol 12:782–792CrossRefPubMedCentralPubMed

31.

Fenton JJ, Taplin SH, Carney PA et al (2007) Influence of computer-aided detection on performance of screening mammography. N Engl J Med 356:1399–1409CrossRefPubMedCentralPubMed

32.

Hamon M, Morello R, Riddell JW (2007) Coronary arteries: diagnostic performance of 16- versus 64-section spiral CT compared with invasive coronary angiography–meta-analysis. Radiology 245:720–731CrossRefPubMed

33.

Hendel RC, Patel MR, Kramer CM et al (2006) ACCF/ACR/SCCT/SCMR/ASNC/NASCI/SCAI/SIR 2006 appropriateness criteria for cardiac computed tomography and cardiac magnetic resonance imaging: a report of the American College of Cardiology Foundation Quality Strategic Directions Committee Appropriateness Criteria Working Group, American College of Radiology, Society of Cardiovascular Computed Tomography, Society for Cardiovascular Magnetic Resonance, American Society of Nuclear Cardiology, North American Society for Cardiac Imaging, Society for Cardiovascular Angiography and Interventions, and Society of Interventional Radiology. J Am Coll Cardiol 48:1475–1497CrossRefPubMed

Title: Computer-aided stenosis detection at coronary CT angiography: effect on performance of readers with different experience levels
Authors: Christian Thilo
Mulugeta Gebregziabher
Felix G. Meinel
Roman Goldenberg
John W. Nance Jr.
Elisabeth M. Arnoldi
Lashonda D. Soma
Ullrich Ebersberger
Philip Blanke
Richard L. Coursey
Michael A. Rosenblum
Peter L. Zwerner
U. Joseph Schoepf
Publication date: 01-03-2015
Publisher: Springer Berlin Heidelberg
Published in: European Radiology / Issue 3/2015
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI: https://doi.org/10.1007/s00330-014-3460-y

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Computer-aided stenosis detection at coronary CT angiography: effect on performance of readers with different experience levels

Abstract

Objectives

Methods

Results

Conclusions

Key Points

Keynote webinar | Spotlight on medication adherence

Springer Medicine

Abstract

Objectives

Methods

Results

Conclusions

Key Points

Please log in to get access to this content

Other articles of this Issue 3/2015

Interdependencies of acquisition, detection, and reconstruction techniques on the accuracy of iodine quantification in varying patient sizes employing dual-energy CT

γ-H2AX foci as in vivo effect biomarker in children emphasize the importance to minimize x-ray doses in paediatric CT imaging

Impact of splenic circulation: non-invasive microbubble-based assessment of portal hemodynamics

Dixon imaging-based partial volume correction improves quantification of choline detected by breast 3D-MRSI

Reduced white matter integrity and cognitive deficits in maintenance hemodialysis ESRD patients: A diffusion-tensor study

Diagnostic performance of the three-dimensional fast spin echo-Cube sequence in comparison with a conventional imaging protocol in evaluation of the lachrymal drainage system