Skip to main content
Top
Published in: European Radiology 6/2011

01-06-2011 | Chest

Computer-aided detection of pulmonary embolism at CT pulmonary angiography: can it improve performance of inexperienced readers?

Authors: Kevin N. Blackmon, Charles Florin, Luca Bogoni, Joshua W. McCain, James D. Koonce, Heon Lee, Gorka Bastarrika, Christian Thilo, Philip Costello, Marcos Salganicoff, U. Joseph Schoepf

Published in: European Radiology | Issue 6/2011

Login to get access

Abstract

Purpose

To evaluate the effect of a computer-aided detection (CAD) algorithm on the performance of novice readers for detection of pulmonary embolism (PE) at CT pulmonary angiography (CTPA).

Materials and Methods

We included CTPA examinations of 79 patients (50 female, 52 ± 18 years). Studies were evaluated by two independent inexperienced readers who marked all vessels containing PE. After 3 months all studies were reevaluated by the same two readers, this time aided by CAD prototype. A consensus read by three expert radiologists served as the reference standard. Statistical analysis used χ2 and McNemar testing.

Results

Expert consensus revealed 119 PEs in 32 studies. For PE detection, the sensitivity of CAD alone was 78%. Inexperienced readers’ initial interpretations had an average per-PE sensitivity of 50%, which improved to 71% (p < 0.001) with CAD as a second reader. False positives increased from 0.18 to 0.25 per study (p = 0.03). Per-study, the readers initially detected 27/32 positive studies (84%); with CAD this number increased to 29.5 studies (92%; p = 0.125).

Conclusion

Our results suggest that CAD significantly improves the sensitivity of PE detection for inexperienced readers with a small but appreciable increase in the rate of false positives.
Literature
1.
go back to reference van Strijen M, de Monye W, Schiereck J et al (2003) Single-detector helical computed tomography as the primary diagnostic test in suspected pulmonary embolism: a multicenter clinical management study of 510 patients. Ann Intern Med 138:307–314PubMed van Strijen M, de Monye W, Schiereck J et al (2003) Single-detector helical computed tomography as the primary diagnostic test in suspected pulmonary embolism: a multicenter clinical management study of 510 patients. Ann Intern Med 138:307–314PubMed
2.
go back to reference Musset D, Parent F, Meyer G et al (2002) Diagnostic strategy for patients with suspected pulmonary embolism: a prospective multicentre outcome study. Lancet 360:1914–1920PubMedCrossRef Musset D, Parent F, Meyer G et al (2002) Diagnostic strategy for patients with suspected pulmonary embolism: a prospective multicentre outcome study. Lancet 360:1914–1920PubMedCrossRef
3.
go back to reference Stein P, Fowler S, Goodman L et al (2006) Multidetector computed tomography for acute pulmonary embolism. N Engl J Med 354:2317–2327PubMedCrossRef Stein P, Fowler S, Goodman L et al (2006) Multidetector computed tomography for acute pulmonary embolism. N Engl J Med 354:2317–2327PubMedCrossRef
4.
go back to reference Schaefer-Prokop C, Prokop M (2005) MDCT for the diagnosis of acute pulmonary embolism. Eur Radiology 15(Suppl 4):D37–D41 Schaefer-Prokop C, Prokop M (2005) MDCT for the diagnosis of acute pulmonary embolism. Eur Radiology 15(Suppl 4):D37–D41
5.
go back to reference Baile E, King G, Muller N et al (2000) Spiral computed tomography is comparable to angiography for the diagnosis of pulmonary embolism. Am J Respir Crit Care Med 161:1010–1015PubMed Baile E, King G, Muller N et al (2000) Spiral computed tomography is comparable to angiography for the diagnosis of pulmonary embolism. Am J Respir Crit Care Med 161:1010–1015PubMed
6.
go back to reference Perrier A, Roy P, Sanchez O et al (2005) Multidetector-row computed tomography in suspected pulmonary embolism. N Engl J Med 352:1760–1768PubMedCrossRef Perrier A, Roy P, Sanchez O et al (2005) Multidetector-row computed tomography in suspected pulmonary embolism. N Engl J Med 352:1760–1768PubMedCrossRef
7.
go back to reference Schoepf U, Holzknecht N, Helmberger T et al (2002) Subsegmental pulmonary emboli: improved detection with thin-collimation multi-detector row spiral CT. Radiology 222:483–490PubMedCrossRef Schoepf U, Holzknecht N, Helmberger T et al (2002) Subsegmental pulmonary emboli: improved detection with thin-collimation multi-detector row spiral CT. Radiology 222:483–490PubMedCrossRef
8.
go back to reference Patel S, Kazerooni EA, Cascade PN (2003) Pulmonary embolism: optimization of small pulmonary artery visualization at multi-detector row CT. Radiology 227:455–460PubMedCrossRef Patel S, Kazerooni EA, Cascade PN (2003) Pulmonary embolism: optimization of small pulmonary artery visualization at multi-detector row CT. Radiology 227:455–460PubMedCrossRef
9.
go back to reference Ghaye B, Szapiro D, Mastora I et al (2001) Peripheral pulmonary arteries: how far in the lung does multi-detector row spiral CT allow analysis? Radiology 219:629–636PubMed Ghaye B, Szapiro D, Mastora I et al (2001) Peripheral pulmonary arteries: how far in the lung does multi-detector row spiral CT allow analysis? Radiology 219:629–636PubMed
10.
go back to reference Winston C, Wechsler R, Salazar A, Kurtz A, Spirn P (1996) Incidental pulmonary emboli detected at helical CT: effect on patient care. Radiology 201:23–27PubMed Winston C, Wechsler R, Salazar A, Kurtz A, Spirn P (1996) Incidental pulmonary emboli detected at helical CT: effect on patient care. Radiology 201:23–27PubMed
11.
go back to reference Ritchie G, McGurk S, McCreath C, Graham C, Murchison JT (2007) Prospective evaluation of unsuspected pulmonary embolism on contrast enhanced multidetector CT (MDCT) scanning. Thorax 62:536–540PubMedCrossRef Ritchie G, McGurk S, McCreath C, Graham C, Murchison JT (2007) Prospective evaluation of unsuspected pulmonary embolism on contrast enhanced multidetector CT (MDCT) scanning. Thorax 62:536–540PubMedCrossRef
12.
go back to reference Sebastian A, Paddon A (2006) Clinically unsuspected pulmonary embolism–an important secondary finding in oncology CT. Clin Radiol 61:81–85PubMedCrossRef Sebastian A, Paddon A (2006) Clinically unsuspected pulmonary embolism–an important secondary finding in oncology CT. Clin Radiol 61:81–85PubMedCrossRef
13.
go back to reference Gosselin M, Rubin G, Leung A, Huang J, Rizk N (1998) Unsuspected pulmonary embolism: prospective detection on routine helical CT scans. Radiology 208:209–215PubMed Gosselin M, Rubin G, Leung A, Huang J, Rizk N (1998) Unsuspected pulmonary embolism: prospective detection on routine helical CT scans. Radiology 208:209–215PubMed
14.
go back to reference Le Gal G, Righini M, Parent F, van Strijen M, Couturaud F (2006) Diagnosis and management of subsegmental pulmonary embolism. J Thromb Haemost 4:724–731PubMedCrossRef Le Gal G, Righini M, Parent F, van Strijen M, Couturaud F (2006) Diagnosis and management of subsegmental pulmonary embolism. J Thromb Haemost 4:724–731PubMedCrossRef
15.
go back to reference Ginsberg M, King V, Panicek D (2004) Comparison of interpretations of CT angiograms in the evaluation of suspected pulmonary embolism by on-call radiology fellows and subsequently by radiology faculty. AJR Am J Roentgenol 182:61–66PubMed Ginsberg M, King V, Panicek D (2004) Comparison of interpretations of CT angiograms in the evaluation of suspected pulmonary embolism by on-call radiology fellows and subsequently by radiology faculty. AJR Am J Roentgenol 182:61–66PubMed
16.
go back to reference Liang J, Bi J (2007) Computer Aided Detection of Pulmonary Embolism with Tobogganing and Multiple Instance Classification in CT Pulmonary Angiography. In: Proceedings of the 20th International Conference on Information Processing in Medical Imaging Liang J, Bi J (2007) Computer Aided Detection of Pulmonary Embolism with Tobogganing and Multiple Instance Classification in CT Pulmonary Angiography. In: Proceedings of the 20th International Conference on Information Processing in Medical Imaging
17.
go back to reference Fairfield J (1990) Toboggan contrast enhancement for contrast segmentation. In:IEEE Proceedings of 10th International Conference on Pattern Recognition. Atlantic City 712–716 Fairfield J (1990) Toboggan contrast enhancement for contrast segmentation. In:IEEE Proceedings of 10th International Conference on Pattern Recognition. Atlantic City 712–716
18.
go back to reference Vapnik V (1995) The nature of statistical learning theory. Springer, New York Vapnik V (1995) The nature of statistical learning theory. Springer, New York
19.
go back to reference Boser B, Guyon I, Vapnik V (1992) A training algorithm for optimal margin classifiers. In: Haussler D, ed. Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory 144–152 Boser B, Guyon I, Vapnik V (1992) A training algorithm for optimal margin classifiers. In: Haussler D, ed. Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory 144–152
20.
go back to reference Zhu J, Hastie T, Tibshirani R (eds) (2004) 1-norm support vector machines. MIT Press, Cambridge Zhu J, Hastie T, Tibshirani R (eds) (2004) 1-norm support vector machines. MIT Press, Cambridge
21.
go back to reference Freer T, Ulissey M (2001) Screening mammography with computer-aided detection: prospective study of 12, 860 patients in a community breast center. Radiology 220:781–786PubMedCrossRef Freer T, Ulissey M (2001) Screening mammography with computer-aided detection: prospective study of 12, 860 patients in a community breast center. Radiology 220:781–786PubMedCrossRef
22.
go back to reference Armato Sr, Li F, Giger M, MacMahon H, Sone S, Doi K (2002) Lung cancer: performance of automated lung nodule detection applied to cancers missed in a CT screening program. Radiology 225:685–692PubMedCrossRef Armato Sr, Li F, Giger M, MacMahon H, Sone S, Doi K (2002) Lung cancer: performance of automated lung nodule detection applied to cancers missed in a CT screening program. Radiology 225:685–692PubMedCrossRef
23.
go back to reference Baker M, Bogoni L, Obuchowski N et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149PubMedCrossRef Baker M, Bogoni L, Obuchowski N et al (2007) Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149PubMedCrossRef
24.
go back to reference Robinson C, Halligan S, Taylor S, Mallett S, Altman D (2008) CT colonography: a systematic review of standard of reporting for studies of computer-aided detection. Radiology 246:426–433PubMedCrossRef Robinson C, Halligan S, Taylor S, Mallett S, Altman D (2008) CT colonography: a systematic review of standard of reporting for studies of computer-aided detection. Radiology 246:426–433PubMedCrossRef
25.
go back to reference Das M, Muhlenbruch G, Helm A et al (2008) Computer-aided detection of pulmonary embolism: influence on radiologists’ detection performance with respect to vessel segments. Eur Radiol 18:1350–1355PubMedCrossRef Das M, Muhlenbruch G, Helm A et al (2008) Computer-aided detection of pulmonary embolism: influence on radiologists’ detection performance with respect to vessel segments. Eur Radiol 18:1350–1355PubMedCrossRef
26.
go back to reference Schoepf U, Schneider A, Das M, Wood S, Cheema J, Costello P (2007) Pulmonary embolism: computer-aided detection at multidetector row spiral computed tomography. J Thorac Imaging 22:319–323PubMedCrossRef Schoepf U, Schneider A, Das M, Wood S, Cheema J, Costello P (2007) Pulmonary embolism: computer-aided detection at multidetector row spiral computed tomography. J Thorac Imaging 22:319–323PubMedCrossRef
27.
go back to reference Buhmann S, Herzog P, Liang J et al (2007) Clinical evaluation of a computer-aided diagnosis (CAD) prototype for the detection of pulmonary embolism. Acad Radiol 14:651–658PubMedCrossRef Buhmann S, Herzog P, Liang J et al (2007) Clinical evaluation of a computer-aided diagnosis (CAD) prototype for the detection of pulmonary embolism. Acad Radiol 14:651–658PubMedCrossRef
28.
go back to reference Masutani Y, MacMahon H, Doi K (2002) Computerized detection of pulmonary embolism in spiral CT angiography based on volumetric image analysis. IEEE Trans Med Imag 21:1517–1523CrossRef Masutani Y, MacMahon H, Doi K (2002) Computerized detection of pulmonary embolism in spiral CT angiography based on volumetric image analysis. IEEE Trans Med Imag 21:1517–1523CrossRef
29.
go back to reference Zhou C, Chan H, Patel S et al (2005) Preliminary investigation of computer-aided detection of pulmonary embolism in three-dimensional computed tomography pulmonary angiography images. Acad Radiol 12:782–792PubMedCrossRef Zhou C, Chan H, Patel S et al (2005) Preliminary investigation of computer-aided detection of pulmonary embolism in three-dimensional computed tomography pulmonary angiography images. Acad Radiol 12:782–792PubMedCrossRef
30.
go back to reference Engelke C, Schmidt S, Bakai A, Auer F, Marten K (2008) Computer-assisted detection of pulmonary embolism: performance evaluation in consensus with experienced and inexperienced chest radiologists. Eur Radiol 18:298–307PubMedCrossRef Engelke C, Schmidt S, Bakai A, Auer F, Marten K (2008) Computer-assisted detection of pulmonary embolism: performance evaluation in consensus with experienced and inexperienced chest radiologists. Eur Radiol 18:298–307PubMedCrossRef
31.
go back to reference Maizlin Z, Vos P, Godoy M, Cooperberg P (2007) Computer-aided detection of pulmonary embolism on CT angiography: initial experience. J Thorac Imaging 22:324–329PubMedCrossRef Maizlin Z, Vos P, Godoy M, Cooperberg P (2007) Computer-aided detection of pulmonary embolism on CT angiography: initial experience. J Thorac Imaging 22:324–329PubMedCrossRef
32.
go back to reference Destounis SV, DiNitto P, Logan-Young W, Bonaccio E, Zuley ML, Willison KM (2004) Can computer-aided detection with double reading of screening mammograms help decrease the false-negative rate? Initial experience. Radiology 232:578–584PubMedCrossRef Destounis SV, DiNitto P, Logan-Young W, Bonaccio E, Zuley ML, Willison KM (2004) Can computer-aided detection with double reading of screening mammograms help decrease the false-negative rate? Initial experience. Radiology 232:578–584PubMedCrossRef
33.
go back to reference Zhou X, Obuchowski N, McClish D (2002) Statistical methods in diagnostic medicine. In. New York, NY, Wiley; 63-66 Zhou X, Obuchowski N, McClish D (2002) Statistical methods in diagnostic medicine. In. New York, NY, Wiley; 63-66
34.
go back to reference Zhou C, Chan H, Hadjiiski L et al (2007) Automated detection of pulmonary embolism (PE) in computed tomographic pulmonary angiographic (CTPA) images: multiscale hierarchical expectation-maximization segmentation of vesels and PEs. Proc SPIE 6514:2F1–2F8 Zhou C, Chan H, Hadjiiski L et al (2007) Automated detection of pulmonary embolism (PE) in computed tomographic pulmonary angiographic (CTPA) images: multiscale hierarchical expectation-maximization segmentation of vesels and PEs. Proc SPIE 6514:2F1–2F8
35.
go back to reference Jeudy J, Flukinger T, White C (2006) Evaluation of pulmonary embolism using an automated computer-aided detection tool. RSNA Program Book 255 Jeudy J, Flukinger T, White C (2006) Evaluation of pulmonary embolism using an automated computer-aided detection tool. RSNA Program Book 255
36.
go back to reference Das M, Schneider A, Schoepf U, et al (2003) Computer-aided diagnosis of peripheral pulmonary emboli. RSNA Program Book 351–352 Das M, Schneider A, Schoepf U, et al (2003) Computer-aided diagnosis of peripheral pulmonary emboli. RSNA Program Book 351–352
37.
go back to reference Digumarthy S, Kagay C, Legasto A, et al (2006) Computer-aided detection (CAD) of acute pulmonary emboli: evaluation in patients without significant pulmonary disease. RSNA Program Book 255 Digumarthy S, Kagay C, Legasto A, et al (2006) Computer-aided detection (CAD) of acute pulmonary emboli: evaluation in patients without significant pulmonary disease. RSNA Program Book 255
38.
go back to reference Das M, Salganicoff M, Bakai A, Muhlenbruch G, Gunther R, Wildberger J (2006) Computer-aided detection of pulmonary embolism: Assessment of sensitivity with regard to vessel segments. RSNA Program Book 487 Das M, Salganicoff M, Bakai A, Muhlenbruch G, Gunther R, Wildberger J (2006) Computer-aided detection of pulmonary embolism: Assessment of sensitivity with regard to vessel segments. RSNA Program Book 487
39.
go back to reference Wittenberg R, Peters J, Sonnemans J, Prokop M, Schaefer-Prokop C (2009) Computer-assisted detection of pulmonary embolism: evaluation of pulmonary CT angiograms performed in an on-call setting. Eur Radiol 20:801–806PubMedCrossRef Wittenberg R, Peters J, Sonnemans J, Prokop M, Schaefer-Prokop C (2009) Computer-assisted detection of pulmonary embolism: evaluation of pulmonary CT angiograms performed in an on-call setting. Eur Radiol 20:801–806PubMedCrossRef
Metadata
Title
Computer-aided detection of pulmonary embolism at CT pulmonary angiography: can it improve performance of inexperienced readers?
Authors
Kevin N. Blackmon
Charles Florin
Luca Bogoni
Joshua W. McCain
James D. Koonce
Heon Lee
Gorka Bastarrika
Christian Thilo
Philip Costello
Marcos Salganicoff
U. Joseph Schoepf
Publication date
01-06-2011
Publisher
Springer-Verlag
Published in
European Radiology / Issue 6/2011
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-010-2050-x

Other articles of this Issue 6/2011

European Radiology 6/2011 Go to the issue