Skip to main content
Top
Published in: European Radiology 6/2010

01-06-2010 | Chest

Improved detection of pulmonary nodules on energy-subtracted chest radiographs with a commercial computer-aided diagnosis software: comparison with human observers

Authors: Zsolt Szucs-Farkas, Michael A. Patak, Seyran Yuksel-Hatz, Thomas Ruder, Peter Vock

Published in: European Radiology | Issue 6/2010

Login to get access

Abstract

Objective

To retrospectively analyze the performance of a commercial computer-aided diagnosis (CAD) software in the detection of pulmonary nodules in original and energy-subtracted (ES) chest radiographs.

Methods

Original and ES chest radiographs of 58 patients with 105 pulmonary nodules measuring 5–30 mm and images of 25 control subjects with no nodules were randomized. Five blinded readers evaluated firstly the original postero-anterior images alone and then together with the subtracted radiographs. In a second phase, original and ES images were analyzed by a commercial CAD program. CT was used as reference standard. CAD results were compared to the readers’ findings. True-positive (TP) and false-positive (FP) findings with CAD on subtracted and non-subtracted images were compared.

Results

Depending on the reader’s experience, CAD detected between 11 and 21 nodules missed by readers. Human observers found three to 16 lesions missed by the CAD software. CAD used with ES images produced significantly fewer FPs than with non-subtracted images: 1.75 and 2.14 FPs per image, respectively (p = 0.029). The difference for the TP nodules was not significant (40 nodules on ES images and 34 lesions in non-subtracted radiographs, p = 0.142).

Conclusion

CAD can improve lesion detection both on energy subtracted and non-subtracted chest images, especially for less experienced readers. The CAD program marked less FPs on energy-subtracted images than on original chest radiographs.
Literature
1.
go back to reference Bach PB, Kelley MJ, Tate RC, McCrory DC (2003) Screening for lung cancer: a review of the current literature. Chest 123:72S–82SCrossRefPubMed Bach PB, Kelley MJ, Tate RC, McCrory DC (2003) Screening for lung cancer: a review of the current literature. Chest 123:72S–82SCrossRefPubMed
2.
go back to reference McAdams HP, Samei E, Dobbins J 3rd, Tourassi GD, Ravin CE (2006) Recent advances in chest radiography. Radiology 241:663–683CrossRefPubMed McAdams HP, Samei E, Dobbins J 3rd, Tourassi GD, Ravin CE (2006) Recent advances in chest radiography. Radiology 241:663–683CrossRefPubMed
3.
go back to reference Ho JT, Kruger RA (1989) Comparison of dual-energy and conventional chest radiography for nodule detection. Invest Radiol 24:861–868CrossRefPubMed Ho JT, Kruger RA (1989) Comparison of dual-energy and conventional chest radiography for nodule detection. Invest Radiol 24:861–868CrossRefPubMed
4.
go back to reference Oestmann JW, Greene R, Rhea JT, Rosenthal H, Koenker RM, Tillotson CL, Pearsen KD, Hill JW, Velaj RH (1989) “Single-exposure” dual energy digital radiography in the detection of pulmonary nodules and calcifications. Invest Radiol 24:517–521CrossRefPubMed Oestmann JW, Greene R, Rhea JT, Rosenthal H, Koenker RM, Tillotson CL, Pearsen KD, Hill JW, Velaj RH (1989) “Single-exposure” dual energy digital radiography in the detection of pulmonary nodules and calcifications. Invest Radiol 24:517–521CrossRefPubMed
5.
go back to reference Ricke J, Fischbach F, Freund T, Teichgraber U, Hanninen EL, Rottgen R, Engert U, Eichstadt H, Felix R (2003) Clinical results of CsI-detector-based dual-exposure dual energy in chest radiography. Eur Radiol 13:2577–2582CrossRefPubMed Ricke J, Fischbach F, Freund T, Teichgraber U, Hanninen EL, Rottgen R, Engert U, Eichstadt H, Felix R (2003) Clinical results of CsI-detector-based dual-exposure dual energy in chest radiography. Eur Radiol 13:2577–2582CrossRefPubMed
6.
go back to reference Szucs-Farkas Z, Patak MA, Yuksel-Hatz S, Ruder T, Vock P (2008) Single-exposure dual-energy subtraction chest radiography: detection of pulmonary nodules and masses in clinical practice. Eur Radiol 18:24–31CrossRefPubMed Szucs-Farkas Z, Patak MA, Yuksel-Hatz S, Ruder T, Vock P (2008) Single-exposure dual-energy subtraction chest radiography: detection of pulmonary nodules and masses in clinical practice. Eur Radiol 18:24–31CrossRefPubMed
7.
go back to reference Kobayashi T, Xu XW, MacMahon H, Metz CE, Doi K (1996) Effect of a computer-aided diagnosis scheme on radiologists’ performance in detection of lung nodules on radiographs. Radiology 199:843–848PubMed Kobayashi T, Xu XW, MacMahon H, Metz CE, Doi K (1996) Effect of a computer-aided diagnosis scheme on radiologists’ performance in detection of lung nodules on radiographs. Radiology 199:843–848PubMed
8.
go back to reference MacMahon H, Engelmann R, Behlen FM, Hoffmann KR, Ishida T, Roe C, Metz CE, Doi K (1999) Computer-aided diagnosis of pulmonary nodules: results of a large-scale observer test. Radiology 213:723–726PubMed MacMahon H, Engelmann R, Behlen FM, Hoffmann KR, Ishida T, Roe C, Metz CE, Doi K (1999) Computer-aided diagnosis of pulmonary nodules: results of a large-scale observer test. Radiology 213:723–726PubMed
9.
go back to reference van Ginneken B, ter Haar Romeny BM, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241CrossRefPubMed van Ginneken B, ter Haar Romeny BM, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241CrossRefPubMed
10.
go back to reference Shiraishi J, Abe H, Engelmann R, Aoyama M, MacMahon H, Doi K (2003) Computer-aided diagnosis to distinguish benign from malignant solitary pulmonary nodules on radiographs: ROC analysis of radiologists’ performance—initial experience. Radiology 227:469–474CrossRefPubMed Shiraishi J, Abe H, Engelmann R, Aoyama M, MacMahon H, Doi K (2003) Computer-aided diagnosis to distinguish benign from malignant solitary pulmonary nodules on radiographs: ROC analysis of radiologists’ performance—initial experience. Radiology 227:469–474CrossRefPubMed
11.
go back to reference Bley TA, Baumann T, Saueressig U, Pache G, Treier M, Schaefer O, Neitzel U, Langer M, Kotter E (2008) Comparison of radiologist and CAD performance in the detection of CT-confirmed subtle pulmonary nodules on digital chest radiographs. Invest Radiol 43:343–348CrossRefPubMed Bley TA, Baumann T, Saueressig U, Pache G, Treier M, Schaefer O, Neitzel U, Langer M, Kotter E (2008) Comparison of radiologist and CAD performance in the detection of CT-confirmed subtle pulmonary nodules on digital chest radiographs. Invest Radiol 43:343–348CrossRefPubMed
12.
go back to reference Li F, Engelmann R, Metz CE, Doi K, MacMahon H (2008) Lung cancers missed on chest radiographs: results obtained with a commercial computer-aided detection program. Radiology 246:273–280PubMed Li F, Engelmann R, Metz CE, Doi K, MacMahon H (2008) Lung cancers missed on chest radiographs: results obtained with a commercial computer-aided detection program. Radiology 246:273–280PubMed
13.
go back to reference Kido S, Kuriyama K, Kuroda C, Nakamura H, Ito W, Shimura K, Kato H (2002) Detection of simulated pulmonary nodules by single-exposure dual-energy computed radiography of the chest: effect of a computer-aided diagnosis system (Part 2). Eur J Radiol 44:205–209CrossRefPubMed Kido S, Kuriyama K, Kuroda C, Nakamura H, Ito W, Shimura K, Kato H (2002) Detection of simulated pulmonary nodules by single-exposure dual-energy computed radiography of the chest: effect of a computer-aided diagnosis system (Part 2). Eur J Radiol 44:205–209CrossRefPubMed
14.
go back to reference Kundel HL (1981) Predictive value and threshold detectability of lung tumors. Radiology 139:25–29PubMed Kundel HL (1981) Predictive value and threshold detectability of lung tumors. Radiology 139:25–29PubMed
15.
go back to reference Aberle DR, Gamsu G, Henschke CI, Naidich DP, Swensen SJ (2001) A consensus statement of the Society of Thoracic Radiology: screening for lung cancer with helical computed tomography. J Thorac Imaging 16:65–68CrossRefPubMed Aberle DR, Gamsu G, Henschke CI, Naidich DP, Swensen SJ (2001) A consensus statement of the Society of Thoracic Radiology: screening for lung cancer with helical computed tomography. J Thorac Imaging 16:65–68CrossRefPubMed
16.
go back to reference MacMahon H, Austin JH, Gamsu G, Herold CJ, Jett JR, Naidich DP, Patz EF Jr, Swensen SJ (2005) Guidelines for management of small pulmonary nodules detected on CT scans: a statement from the Fleischner Society. Radiology 237:395–400CrossRefPubMed MacMahon H, Austin JH, Gamsu G, Herold CJ, Jett JR, Naidich DP, Patz EF Jr, Swensen SJ (2005) Guidelines for management of small pulmonary nodules detected on CT scans: a statement from the Fleischner Society. Radiology 237:395–400CrossRefPubMed
17.
go back to reference Libby DM, Smith JP, Altorki NK, Pasmantier MW, Yankelevitz D, Henschke CI (2004) Managing the small pulmonary nodule discovered by CT. Chest 125:1522–1529CrossRefPubMed Libby DM, Smith JP, Altorki NK, Pasmantier MW, Yankelevitz D, Henschke CI (2004) Managing the small pulmonary nodule discovered by CT. Chest 125:1522–1529CrossRefPubMed
18.
go back to reference Beigelman-Aubry C, Hill C, Grenier PA (2007) Management of an incidentally discovered pulmonary nodule. Eur Radiol 17:449–466CrossRefPubMed Beigelman-Aubry C, Hill C, Grenier PA (2007) Management of an incidentally discovered pulmonary nodule. Eur Radiol 17:449–466CrossRefPubMed
19.
go back to reference Matsumoto T, Yoshimura H, Giger ML, Doi K, MacMahon H, Montner SM, Nakanishi T (1992) Potential usefulness of computerized nodule detection in screening programs for lung cancer. Invest Radiol 27:471–475CrossRefPubMed Matsumoto T, Yoshimura H, Giger ML, Doi K, MacMahon H, Montner SM, Nakanishi T (1992) Potential usefulness of computerized nodule detection in screening programs for lung cancer. Invest Radiol 27:471–475CrossRefPubMed
20.
go back to reference Quekel LG, Kessels AG, Goei R, van Engelshoven JM (1999) Miss rate of lung cancer on the chest radiograph in clinical practice. Chest 115:720–724CrossRefPubMed Quekel LG, Kessels AG, Goei R, van Engelshoven JM (1999) Miss rate of lung cancer on the chest radiograph in clinical practice. Chest 115:720–724CrossRefPubMed
21.
go back to reference Quekel LG, Kessels AG, Goei R, van Engelshoven JM (2001) Detection of lung cancer on the chest radiograph: a study on observer performance. Eur J Radiol 39:111–116CrossRefPubMed Quekel LG, Kessels AG, Goei R, van Engelshoven JM (2001) Detection of lung cancer on the chest radiograph: a study on observer performance. Eur J Radiol 39:111–116CrossRefPubMed
22.
go back to reference Heelan RT, Flehinger BJ, Melamed MR, Zaman MB, Perchick WB, Caravelli JF, Martini N (1984) Non-small-cell lung cancer: results of the New York screening program. Radiology 151:289–293PubMed Heelan RT, Flehinger BJ, Melamed MR, Zaman MB, Perchick WB, Caravelli JF, Martini N (1984) Non-small-cell lung cancer: results of the New York screening program. Radiology 151:289–293PubMed
23.
go back to reference Monnier-Cholley L, Arrive L, Porcel A, Shehata K, Dahan H, Urban T, Febvre M, Lebeau B, Tubiana JM (2001) Characteristics of missed lung cancer on chest radiographs: a French experience. Eur Radiol 11:597–605CrossRefPubMed Monnier-Cholley L, Arrive L, Porcel A, Shehata K, Dahan H, Urban T, Febvre M, Lebeau B, Tubiana JM (2001) Characteristics of missed lung cancer on chest radiographs: a French experience. Eur Radiol 11:597–605CrossRefPubMed
Metadata
Title
Improved detection of pulmonary nodules on energy-subtracted chest radiographs with a commercial computer-aided diagnosis software: comparison with human observers
Authors
Zsolt Szucs-Farkas
Michael A. Patak
Seyran Yuksel-Hatz
Thomas Ruder
Peter Vock
Publication date
01-06-2010
Publisher
Springer-Verlag
Published in
European Radiology / Issue 6/2010
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-009-1667-0

Other articles of this Issue 6/2010

European Radiology 6/2010 Go to the issue