Skip to main content
Top
Published in: Journal of Digital Imaging 3/2011

01-06-2011

Sensitivity and Specificity of a CAD Solution for Lung Nodule Detection on Chest Radiograph with CTA Correlation

Authors: William Moore, Jennifer Ripton-Snyder, George Wu, Craig Hendler

Published in: Journal of Imaging Informatics in Medicine | Issue 3/2011

Login to get access

Abstract

The objective of this research was to determine the sensitivity and specificity of a commercially available computer-aided detection (CAD) system for detection of lung nodule on posterior–anterior (PA) chest radiograph in a varied patient population who are referred to computed tomographic angiogram (CTA) of the chest as a reference standard. Patients who had a PA chest radiograph with concomitant CTA of the chest were included in this retrospective study. The PA chest radiograph was analyzed by a CAD device, and results were recorded. A qualitative assessment of the CAD results was performed using a 5-point Likert scale. The CTA was then reviewed to determine if there were correlative nodules. The presence of a correlative nodule between 0.5 cm and 1.5 cm was considered a positive result. The baseline sensitivity of the system was determined to be 0.707 (95% CI = 0.52–0.86), with a specificity of 0.50 (95% CI = 0.38–0.76). Positive predictive value was 0.30 (95% CI = 0.24–0.49), with a negative predictive value of 0.858 (95% CI = 0.82–0.95), and accuracy of 0.555 (95% CI = 0.40–0.66). When excluding nodules that were qualitatively determined by a thoracic radiologist to be false positives, the specificity was 0.781 (95% CI = 0.764–0.839), the positive predictive value was 0.564 (95% CI = 0.491–0.654), the negative predictive value was 0.829 (95% CI = 0.819–0.878), and the accuracy was 0.737 (95% CI = 0.721–0.801). The use of CAD for lung nodule detection on chest radiograph, when used in conjunction with an experienced radiologist, has a very good sensitivity, specificity, and accuracy.
Literature
1.
go back to reference American Cancer Society: Cancer Facts and Figures 2007. Atlanta, GA, American Cancer Society, 2007 American Cancer Society: Cancer Facts and Figures 2007. Atlanta, GA, American Cancer Society, 2007
2.
go back to reference Levi F, Lucchini F, Negri E, La Vecchia C: Worldwide patterns of cancer mortality: 1990–1994. Eur J Cancer Prev 8:381–400, 1999PubMedCrossRef Levi F, Lucchini F, Negri E, La Vecchia C: Worldwide patterns of cancer mortality: 1990–1994. Eur J Cancer Prev 8:381–400, 1999PubMedCrossRef
3.
go back to reference The international Early Lung cancer Action program Investigators: Survival of patients with stage 1 lung cancer detected on CT screening. NEJM 355:1763–1771, 2006CrossRef The international Early Lung cancer Action program Investigators: Survival of patients with stage 1 lung cancer detected on CT screening. NEJM 355:1763–1771, 2006CrossRef
4.
go back to reference National Institutes of Standards and Technology, an agency of the U.S. Commerce Department’s Technology Administration National Institutes of Standards and Technology, an agency of the U.S. Commerce Department’s Technology Administration
5.
go back to reference McLoud TC, Davis SD, Aquino SD, Batra PV, Goodman PC, Haramati LB, Khan A, Leung AN, Rosado de Chritenson ML, Rozenshtein A, White CS, Kaiser LR, Raoof S: Expert Panel on Thoracic Imaging. Routine admission and preoperative chest radiography. [online publication]. Reston (VA): American College of Radiology (ACR), 2006 McLoud TC, Davis SD, Aquino SD, Batra PV, Goodman PC, Haramati LB, Khan A, Leung AN, Rosado de Chritenson ML, Rozenshtein A, White CS, Kaiser LR, Raoof S: Expert Panel on Thoracic Imaging. Routine admission and preoperative chest radiography. [online publication]. Reston (VA): American College of Radiology (ACR), 2006
6.
go back to reference Austin JH, Romney BM, Goldmith LS: Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially resectable lesion evident in retrospect. Radiology 182:115–122, 1992PubMed Austin JH, Romney BM, Goldmith LS: Missed bronchogenic carcinoma: radiographic findings in 27 patients with a potentially resectable lesion evident in retrospect. Radiology 182:115–122, 1992PubMed
7.
go back to reference Kakeda S, Moriya J, Sato H, et al: Improved detection of lung nodules on chest radiographs using a commericial computer-aided diagnosis system. AJR 182:505–510, 2004PubMed Kakeda S, Moriya J, Sato H, et al: Improved detection of lung nodules on chest radiographs using a commericial computer-aided diagnosis system. AJR 182:505–510, 2004PubMed
8.
go back to reference Giger ML, Doi K, MacMahon H, Metz CE, Yin FF: Pulmonary nodules: computer-aided detection in digital chest images. Radio Graphics 10:41–51, 1990 Giger ML, Doi K, MacMahon H, Metz CE, Yin FF: Pulmonary nodules: computer-aided detection in digital chest images. Radio Graphics 10:41–51, 1990
9.
go back to reference Kobayashi T, Xu XW, MacMahon H, et al: Effect of a computer-aided diagnosis scheme on radiologists’ performance in detection of lung nodules on radiographs. Radiology 199:843–848, 1996PubMed Kobayashi T, Xu XW, MacMahon H, et al: Effect of a computer-aided diagnosis scheme on radiologists’ performance in detection of lung nodules on radiographs. Radiology 199:843–848, 1996PubMed
10.
go back to reference Reeves AP, Kostis WJ: Computer-aided diagnosis for lung cancer. Radiol Clin North Am 38:497–509, 2000PubMedCrossRef Reeves AP, Kostis WJ: Computer-aided diagnosis for lung cancer. Radiol Clin North Am 38:497–509, 2000PubMedCrossRef
11.
go back to reference Freedman MT, Lo SCB, Lure F, et al: Computer aided detection of lung cancer on chest radiographs: algorithm performance vs. radiologists’ performance by size of cancer. Prop SPIE 4319:150–159, 2001CrossRef Freedman MT, Lo SCB, Lure F, et al: Computer aided detection of lung cancer on chest radiographs: algorithm performance vs. radiologists’ performance by size of cancer. Prop SPIE 4319:150–159, 2001CrossRef
12.
go back to reference Freedman MT, Lo SCB, Osicka T, et al: Computer-aided detection of lung cancer on chest radiographs: effect of machine CAD false-positive locations on radiologists’ behavior. Prop SPIE 4684:1311–1319, 2002CrossRef Freedman MT, Lo SCB, Osicka T, et al: Computer-aided detection of lung cancer on chest radiographs: effect of machine CAD false-positive locations on radiologists’ behavior. Prop SPIE 4684:1311–1319, 2002CrossRef
13.
go back to reference Giger ML, Doi K, MacMahon H: Image feature analysis and computer-aided diagnosis in digital radiography. III. Automated detection of nodules in peripheral lung field. Med Phys 15:158–166, 1988PubMedCrossRef Giger ML, Doi K, MacMahon H: Image feature analysis and computer-aided diagnosis in digital radiography. III. Automated detection of nodules in peripheral lung field. Med Phys 15:158–166, 1988PubMedCrossRef
14.
go back to reference Kakeda S, Moriya J, Sato H, et al: Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system. AJR 182:505–510, 2004PubMed Kakeda S, Moriya J, Sato H, et al: Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system. AJR 182:505–510, 2004PubMed
15.
go back to reference Jin Z, Ma D, Song W, Fan L, et al: Improving radiological interpretation of chest digital radiograph images using a real-time interactive pulmonary nodule analysis system: a cross-center study, RSNA, Chicago, November, 2005 Jin Z, Ma D, Song W, Fan L, et al: Improving radiological interpretation of chest digital radiograph images using a real-time interactive pulmonary nodule analysis system: a cross-center study, RSNA, Chicago, November, 2005
16.
go back to reference van Beek E, Mullan B, Thompson B: Evaluation of a real-time interactive pulmonary nodule analysis system on chest digital radiographic images: a prospective study, RSNA, Chicago, November, 2006 van Beek E, Mullan B, Thompson B: Evaluation of a real-time interactive pulmonary nodule analysis system on chest digital radiographic images: a prospective study, RSNA, Chicago, November, 2006
17.
go back to reference Kakeda S, Moriya J, Sato H, et al: Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system. AJR 182:505–510, 2004PubMed Kakeda S, Moriya J, Sato H, et al: Improved detection of lung nodules on chest radiographs using a commercial computer-aided diagnosis system. AJR 182:505–510, 2004PubMed
18.
go back to reference Van Beek E: Evaluation of a real-time interactive pulmonary nodule analysis system on chest digital radiographic images: a prospective study. Acad Rad 15(5):571–575, 2008CrossRef Van Beek E: Evaluation of a real-time interactive pulmonary nodule analysis system on chest digital radiographic images: a prospective study. Acad Rad 15(5):571–575, 2008CrossRef
Metadata
Title
Sensitivity and Specificity of a CAD Solution for Lung Nodule Detection on Chest Radiograph with CTA Correlation
Authors
William Moore
Jennifer Ripton-Snyder
George Wu
Craig Hendler
Publication date
01-06-2011
Publisher
Springer-Verlag
Published in
Journal of Imaging Informatics in Medicine / Issue 3/2011
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-010-9284-7

Other articles of this Issue 3/2011

Journal of Digital Imaging 3/2011 Go to the issue