Top

Published in:

01-10-2004 | Chest

Computer-assisted detection of pulmonary nodules: performance evaluation of an expert knowledge-based detection system in consensus reading with experienced and inexperienced chest radiologists

Authors: Katharina Marten, Tobias Seyfarth, Florian Auer, Edzard Wiener, Andreas Grillhösl, Silvia Obenauer, Ernst J. Rummeny, Christoph Engelke

Published in: European Radiology | Issue 10/2004

Abstract

To evaluate the performance of experienced versus inexperienced radiologists in comparison and in consensus with an interactive computer-aided detection (CAD) system for detection of pulmonary nodules. Eighteen consecutive patients (mean age: 62.2 years; range 29–83 years) prospectively underwent routine 16-row multislice computed tomography (MSCT). Four blinded radiologists (experienced: readers 1, 2; inexperienced: readers 3, 4) assessed image data against CAD for pulmonary nodules. Thereafter, consensus readings of readers 1+3, reader 1+CAD and reader 3+CAD were performed. Data were compared against an independent gold standard. Statistical tests used to calculate interobserver agreement, reader performance and nodule size were Kappa, ROC and Mann–Whitney U. CAD and experienced readers outperformed inexperienced readers (Az=0.72, 0.71, 0.73, 0.49 and 0.50 for CAD, readers 1–4, respectively; P<0.05). Performance of reader 1+CAD was superior to single reader and reader 1+3 performances (Az=0.93, 0.72 for reader 1+CAD and reader 1+3 consensus, respectively, P<0.05). Reader 3+CAD did not perform superiorly to experienced readers or CAD (Az=0.79 for reader 3+CAD; P>0.05). Consensus of reader 1+CAD significantly outperformed all other readings, demonstrating a benefit in using CAD as an inexperienced reader replacement. It is questionable whether inexperienced readers can be regarded as adequate for interpretation of pulmonary nodules in consensus with CAD, replacing an experienced radiologist.

Fiebich M, Wietholt C, Renger BC, Armato S III, Hoffmann K, Wormanns D, Diederich S (1999) Automatic detection of pulmonary nodules in low-dose screening thoracic CT examinations. Proc SPIE 3661:1434–1439CrossRef

van Ginneken B, ter Haar Romeny BM, Viergever MA (2001) Computer-aided diagnosis in chest radiography: a survey. IEEE Trans Med Imaging 20:1228–1241CrossRefPubMed

Masutani Y, Macmahon H, Doi K (2002) Computerized detection of pulmonary embolism in spiral CT angiography based on volumetric image analysis. IEEE Trans Med Imaging 21:1517–1523CrossRefPubMed

Uppaluri R, Hoffman EA, Sonka M, Hunninghake GW, McLennan G (1999) Interstitial lung disease: a quantitative study using the adaptive multiple feature method. Am J Respir Crit Care Med 159:519–525PubMed

Ko JP, Betke M (2001) Chest CT: automated nodule detection and assessment of change over time-preliminary experience. Radiology 218:267–273PubMed

Zhao B, Gamsu G, Ginsber MS, Jiang L, Schwartz LH (2003) Automatic detection of small lung nodules on CT utilizing a local density maximum algorithm. J Appl Clin Med Phys 4:248–260CrossRefPubMed

Wormanns D, Fiebich M, Saidi M, Diederich S, Heindel W (2002) Automatic detection of pulmonary nodules at spiral CT: clinical application of a computer-aided diagnosis system. Eur Radiol 12:1052–1057CrossRefPubMed

Armato SG III, Li F, Giger ML, MacMahon H, Sone S, Doi K (2002) Lung cancer: performance of automated lung nodule detection applied to cancers missed in a CT screening program. Radiology 225:685–692PubMed

Awai K, Murao K, Ozawa A et al (2004) Pulmonary nodules at chest CT: effect of computer-aided diagnosis on radiologists’ detection performance. Radiology 230:347–352PubMed

10.

Giger ML, Bae KT, MacMahon H (1994) Computerized detection of pulmonary nodules in computed tomography images. Invest Radiol 29:459–465PubMed

11.

Armato SG III, Giger ML, MacMahon H (2001) Automated detection of lung nodules in CT scans: preliminary results. Med Phys 28:1552–1561CrossRefPubMed

12.

Fan L, Novak CL, Qian J, Kohl G, Naidich DP (2001) Automatic detection of lung nodules from multi-slice low-dose CT images. Proc SPIE 4322:1828–1835

13.

Satoh H, Ukai Y, Niki N, Eguchi K, Mori K, Ohmatsu H, Kakinuma R, Kaneko M, Moriyama N (1999) Computer aided diagnosis system for lung cancer based on retrospective helical CT images. Proc SPIE 3661:1324–1335CrossRef

14.

Okumura T, Miwa T, Kako J, Yamamoto S, Matsumoto M, Tateno Y, Linuma T, Matsumoto T (1998) Image processing for computer-aided diagnosis of lung cancer screening system by CT (LSCT). Proc SPIE 3338:1314–1322CrossRef

15.

Lee Y, Hara T, Fujita H, Itoh S, Ishigaki T (2001) Automated detection of pulmonary nodules in helical CT images based on an improved templated matching technique. IEEE Trans Med Imaging 20:595–604CrossRefPubMed

16.

Lou S, Chang C, Lin K, Chen T (1999) Object-based deformation technique for 3-D CT lung nodule detection. Proc SPIE 3661:1544–1552CrossRef

17.

Fan L, Novak CL, Naidich DP, Wei G, Quian J, Ko JP (2002) Improving optimal radiologic interpretation of low-dose multi-slice lung CT studies using ICAD. Radiology 225:475

18.

Press WH, Flamery BP, Teukolsky SA, Vetterling WT (1992) Numerical recipes, the art of scientific computing. Cambridge University Press, Cambridge

19.

Hanley JA, McNeil BJ (1982) The meaning and use of area under a receiver operating characteristic (ROC) curve. Radiology 143:29–36PubMed

20.

DeLong ER, DeLong DM, Clarke-Pearson DL (1988) Comparing the areas under two or more correlated receiver operating curves: a nonparametric approach. Biometrics 44:837–845PubMed

21.

Fleiss JL, Nee CM, Landis JR (1979) Large sample variance of kappa in the case of different sets of raters. Psychol Bull 86:974–977CrossRef

22.

Harding EF (1983) An efficient minimal storage procedure for calculating the Mann–Whitney U, generalised U and similar distributions. Appl Stat 33

23.

Henschke CI, McCauley DI, Yankelevitz DF, Naidich DP, McGuinness G, Miettinen OS, Libby D, Pasmantier M, Koizumi J, Altorki N, Smith JP (2001) Early lung cancer action project: a summary of the findings on baseline screening. Oncologist 6:147–152PubMed

24.

Kaneko M, Eguchi K, Ohmatsu H, Kakinuma R, Naruke T, Suemasu K, Moriyama N (1996) Peripheral lung cancer: screening and detection with low-dose spiral-CT versus radiography. Radiology 201:798–802PubMed

25.

Sone S, Li F, Yang ZG, Takashima S, Maruyama Y, Hasegawa M, Wang JC, Kawakami S, Honda T (2000) Characteristics of small lung cancers invisible on conventional chest radiography and detected by population based screening using spiral CT. Br J Radiol 73:137–145PubMed

26.

Yankelevitz DF, Gupta R, Zhao B, Henschke CI (1999) Small pulmonary nodules: evaluation with repeat CT—preliminary experience. Radiology 212:561–566PubMed

27.

Yankelevitz DF, Reeves AP, Kostis WJ, Zhao B, Henschke CI (2000) Small pulmonary nodules: volumetrically determined growth rates based on CT evaluation. Radiology 217:251–256PubMed

28.

Wormanns D, Kohl G, Klotz E, Marheine A, Beyer F, Heindel W, Diederich S (2004) Volumetric measurement of pulmonary nodules at multi-row detector CT: in vivo reproducibility. Eur Radiol 14:86–92CrossRefPubMed

29.

Yuan Y, Matsumoto T, Hiyama A, Miura G, Tanaka N, Emoto T, Kawamura T, Matsunaga N (2003) The probability of malignancy in small pulmonary nodules coexisting with potentially operable lung cancer detected by CT. Eur Radiol 13:2447–2453CrossRefPubMed

30.

Fischbach F, Knollmann F, Griesshaber V, Freund T, Akkol E, Felix R (2003) Detection of pulmonary nodules by multislice computed tomography: improved detection rate with reduced slice thickness. Eur Radiol 13:2378–2383CrossRefPubMed

31.

Naidich DP, Rusinek H, McGuinness G, Leitman B, McCauley DI, Henschke CI (1993) Variables affecting pulmonary nodule detection with computed tomography: evaluation with three-dimensional computer simulation. J Thorac Imaging 8:291–299PubMed

32.

Henschke CI, Yankelevitz DF, Libby D, Kimmel M (2002) CT screening for lung cancer: the first ten years. Cancer J 8:47–54PubMed

33.

Swensen SJ, Jett JR, Sloan JA, Midthun DE, Hartman TE, Sykes AM, Aughenbaugh GL, Zink FE, Hillman SL, Noetzel GR, Marks RS, Clayton AC, Pairolero PC (2002) Screening for lung cancer with low-dose spiral computed tomography. Am J Respir Crit Care Med 165:508–513PubMed

34.

Diederich S, Wormanns D, Semik M, Thomas M, Lenzen H, Roos N, Heindel W (2002) Screening for early lung cancer with low-dose spiral CT: prevalence in 817 asymptomatic smokers. Radiology 222:773–781PubMed

35.

Swensen SJ, Jett JR, Hartman TE, Midthun DE, Sloan JA, Sykes AM, Aughenbaugh GL, Clemens MA (2003) Lung cancer screening with CT: Mayo clinic experience. Radiology 226:756–761PubMed

36.

Friese SA, Rieber A, Fleiter T, Brambs HJ, Claussen CD (1994) Pulmonary nodules in spiral volumetric and single slice computed tomography. Eur J Radiol 18:48–51PubMed

37.

Karabulut N, Toru M, Gelebek V, Gulsun M, Ariurek OM (2002) Comparison of low-dose and standard-dose helical CT in the evaluation of pulmonary nodules. Eur Radiol 12:2764–2769PubMed

38.

Croisille P, Souto M, Cova M, Wood S, Afework Y, Kuhlman J, Zerhouni E (1995) Pulmonary nodules: improved detection with vascular segmentation and extraction with spiral CT. Radiology 197:397–401PubMed

39.

Armato SG III, Giger ML, Moran CJ, Blackburn JT, Doi K, MacMahon H (1999) Computerized detection of pulmonary nodules on CT scans. Radiographics 19:1303–1311PubMed

Title: Computer-assisted detection of pulmonary nodules: performance evaluation of an expert knowledge-based detection system in consensus reading with experienced and inexperienced chest radiologists
Authors: Katharina Marten
Tobias Seyfarth
Florian Auer
Edzard Wiener
Andreas Grillhösl
Silvia Obenauer
Ernst J. Rummeny
Christoph Engelke
Publication date: 01-10-2004
Publisher: Springer-Verlag
Published in: European Radiology / Issue 10/2004
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI: https://doi.org/10.1007/s00330-004-2389-y

At a glance: The STEP trials

Springer Medicine

Computer-assisted detection of pulmonary nodules: performance evaluation of an expert knowledge-based detection system in consensus reading with experienced and inexperienced chest radiologists

Abstract

At a glance: The STEP trials

Springer Medicine

Abstract

Please log in to get access to this content

Other articles of this Issue 10/2004

Use of the modified three-point Dixon technique in obtaining T1-weighted contrast-enhanced fat-saturated images on an open magnet

October 2004

Sonoanatomy of the ulnar nerve in the cubital tunnel: a multicentre study by the GEL

Imaging features of intraosseous ganglia: a report of 45 cases

Dobutamine stress MRI. Part I. Safety and feasibility of dobutamine cardiovascular magnetic resonance in patients suspected of myocardial ischemia

Simple models improve the discrimination of prostate cancers from the peripheral gland by T1-weighted dynamic MRI