Skip to main content
Top
Published in: European Radiology 1/2004

01-01-2004 | Physics

Comparison of visual grading analysis and determination of detective quantum efficiency for evaluating system performance in digital chest radiography

Authors: Patrik Sund, Magnus Båth, Susanne Kheddache, Lars Gunnar Månsson

Published in: European Radiology | Issue 1/2004

Login to get access

Abstract

A study was conducted to compare physical and clinical system performance in digital chest radiography. Four digital X-ray modalities, two storage-phosphor based systems and two generations of a CCD-based system, were evaluated in terms of both their imaging properties (determination of presampling MTF and DQE) and clinical image quality (grading of the reproduction of anatomical details of 23 healthy volunteers using both absolute and relative visual grading analysis). One of the two storage-phosphor systems performed best in both evaluations and the first generation of the CCD-based system was rated worst; however, the other two systems were ranked differently with the two methods. The newest CCD-based system yielded a higher clinical image quality than the second storage-phosphor system, although the latter presented a DQE substantially higher than the former. The results show that clinical performance cannot be predicted from determinations of DQE alone, and that a system with lower DQE, under the quantum-saturated conditions in chest radiography, can outperform a system with higher DQE if the image processing used on the former is more effective in presenting the information in the image to the radiologist.
Appendix
Available only for authorised users
Literature
1.
go back to reference Månsson LG (2000) Methods for the evaluation of image quality: a review. Radiat Prot Dosim 90:89–99 Månsson LG (2000) Methods for the evaluation of image quality: a review. Radiat Prot Dosim 90:89–99
2.
go back to reference Swets JA, Picket RM (1982) Evaluation of diagnostic systems: methods from signal detection theory. Academic Press, New York Swets JA, Picket RM (1982) Evaluation of diagnostic systems: methods from signal detection theory. Academic Press, New York
3.
go back to reference Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21:720–733PubMed Metz CE (1986) ROC methodology in radiologic imaging. Invest Radiol 21:720–733PubMed
4.
go back to reference Swensson RG (1996) Unified measurement of observer performance in detecting and localizing target objects on images. Med Phys 23:1709–1725CrossRefPubMed Swensson RG (1996) Unified measurement of observer performance in detecting and localizing target objects on images. Med Phys 23:1709–1725CrossRefPubMed
5.
go back to reference Metz CE (2000) Fundamental ROC analysis. In: Beutel J, Kundel HL, Van Metter RL (eds) Handbook of medical imaging, vol 1. Physics and psychophysics. SPIE Press, Bellingham, pp 751–769 Metz CE (2000) Fundamental ROC analysis. In: Beutel J, Kundel HL, Van Metter RL (eds) Handbook of medical imaging, vol 1. Physics and psychophysics. SPIE Press, Bellingham, pp 751–769
6.
go back to reference European Commission (1996) EUR 16260: European guidelines on quality criteria for diagnostic radiographic images. Office for Official Publications of the European Communities, Luxembourg European Commission (1996) EUR 16260: European guidelines on quality criteria for diagnostic radiographic images. Office for Official Publications of the European Communities, Luxembourg
7.
go back to reference Tingberg A, Herrmann C, Lanhede B, Almén A, Besjakov J, Mattsson S, Sund P, Kheddache S, Månsson LG (2000) Comparison of two methods for evaluation of the image quality of lumbar spine radiographs. Radiat Prot Dosim 90:165–168 Tingberg A, Herrmann C, Lanhede B, Almén A, Besjakov J, Mattsson S, Sund P, Kheddache S, Månsson LG (2000) Comparison of two methods for evaluation of the image quality of lumbar spine radiographs. Radiat Prot Dosim 90:165–168
8.
go back to reference Sund P, Herrmann C, Tingberg A, Kheddache S, Månsson LG, Almén A, Mattsson S (2000) Comparison of two methods for evaluating image quality of chest radiographs. In: Krupinski EA (ed) Medical imaging 2000: image perception and performance, Proceedings of SPIE, vol 3981, pp 251–257 Sund P, Herrmann C, Tingberg A, Kheddache S, Månsson LG, Almén A, Mattsson S (2000) Comparison of two methods for evaluating image quality of chest radiographs. In: Krupinski EA (ed) Medical imaging 2000: image perception and performance, Proceedings of SPIE, vol 3981, pp 251–257
9.
go back to reference Tingberg A (2000) Quantifying the quality of medical X-ray images: an evaluation based on normal anatomy for lumbar spine and chest images. (Thesis). Lund University, Lund Tingberg A (2000) Quantifying the quality of medical X-ray images: an evaluation based on normal anatomy for lumbar spine and chest images. (Thesis). Lund University, Lund
10.
go back to reference Dainty JC, Shaw R (1974) Image science. Academic Press, London Dainty JC, Shaw R (1974) Image science. Academic Press, London
11.
go back to reference Båth M, Sund P, Månsson LG (2002) Evaluation of the imaging properties of two generations of a CCD-based system for digital chest radiography. Med Phys 29:2286–2297CrossRefPubMed Båth M, Sund P, Månsson LG (2002) Evaluation of the imaging properties of two generations of a CCD-based system for digital chest radiography. Med Phys 29:2286–2297CrossRefPubMed
12.
go back to reference Hillen W, Schiebel U, Zaengel T (1987) Imaging performance of a digital storage phosphor system. Med Phys 14:744–751PubMed Hillen W, Schiebel U, Zaengel T (1987) Imaging performance of a digital storage phosphor system. Med Phys 14:744–751PubMed
13.
go back to reference Workman A, Cowen AR, Brettle DS (1994) Physical evaluation of computed radiography as a mammographic X-ray imaging system. Br J Radiol 67:988–996PubMed Workman A, Cowen AR, Brettle DS (1994) Physical evaluation of computed radiography as a mammographic X-ray imaging system. Br J Radiol 67:988–996PubMed
14.
go back to reference Stierstorfer K, Spahn M (1999) Self-normalizing method to measure the detective quantum efficiency of a wide range of X-ray detectors. Med Phys 26:1312–1319CrossRefPubMed Stierstorfer K, Spahn M (1999) Self-normalizing method to measure the detective quantum efficiency of a wide range of X-ray detectors. Med Phys 26:1312–1319CrossRefPubMed
15.
go back to reference Dobbins JT III, Ergun DL, Rutz L, Hinshaw DA, Blume H, Clark DC (1995) DQE(f) of four generations of computed radiography acquisition devices. Med Phys 22:1581–1593PubMed Dobbins JT III, Ergun DL, Rutz L, Hinshaw DA, Blume H, Clark DC (1995) DQE(f) of four generations of computed radiography acquisition devices. Med Phys 22:1581–1593PubMed
16.
go back to reference Dobbins JT III (1995) Effects of undersampling on the proper interpretation of modulation transfer function, noise power spectra, and noise equivalent quanta of digital imaging systems. Med Phys 22:171–181CrossRefPubMed Dobbins JT III (1995) Effects of undersampling on the proper interpretation of modulation transfer function, noise power spectra, and noise equivalent quanta of digital imaging systems. Med Phys 22:171–181CrossRefPubMed
17.
go back to reference Fujita H, Tsai D-Y, Itoh T, Doi K, Morishita J, Ueda K, Ohtsuka A (1992) A simple method for determining the modulation transfer function in digital radiography. IEEE Trans Med Imaging 11:34–39CrossRef Fujita H, Tsai D-Y, Itoh T, Doi K, Morishita J, Ueda K, Ohtsuka A (1992) A simple method for determining the modulation transfer function in digital radiography. IEEE Trans Med Imaging 11:34–39CrossRef
18.
go back to reference The Institute of Physics and Engineering in Medicine (1997) IPEM report no. 78: Catalogue of diagnostic X-ray spectra and other data. The Institute of Physics and Engineering in Medicine, York. CD-ROM The Institute of Physics and Engineering in Medicine (1997) IPEM report no. 78: Catalogue of diagnostic X-ray spectra and other data. The Institute of Physics and Engineering in Medicine, York. CD-ROM
19.
go back to reference Samei E, Flynn MJ (2002) An experimental comparison of detector performance for computed radiography systems. Med Phys 29:447–459CrossRefPubMed Samei E, Flynn MJ (2002) An experimental comparison of detector performance for computed radiography systems. Med Phys 29:447–459CrossRefPubMed
20.
go back to reference International Commission on Radiation Units and Measurements (1992) ICRU report 48: Phantoms and computational models in therapy, diagnosis and protection. International Commission on Radiation Units and Measurements, Bethesda International Commission on Radiation Units and Measurements (1992) ICRU report 48: Phantoms and computational models in therapy, diagnosis and protection. International Commission on Radiation Units and Measurements, Bethesda
21.
go back to reference Lanhede B, Båth M, Kheddache S, Sund P, Björneld L, Widell M, Almén A, Besjakov J, Mattsson S, Tingberg A, Herrmann C, Panzer W, Zankl M, Månsson LG (2002) The influence of different technique factors on image quality of chest radiographs as evaluated by modified CEC image quality criteria. Br J Radiol 75:38–49PubMed Lanhede B, Båth M, Kheddache S, Sund P, Björneld L, Widell M, Almén A, Besjakov J, Mattsson S, Tingberg A, Herrmann C, Panzer W, Zankl M, Månsson LG (2002) The influence of different technique factors on image quality of chest radiographs as evaluated by modified CEC image quality criteria. Br J Radiol 75:38–49PubMed
22.
go back to reference Miller RG Jr (1980) Simultaneous statistical inference, 2nd edn. Springer, Berlin Heidelberg New York Miller RG Jr (1980) Simultaneous statistical inference, 2nd edn. Springer, Berlin Heidelberg New York
23.
go back to reference Månsson LG (1994) Evaluation of radiographic procedures: investigations related to chest imaging. (Thesis). Göteborg University, Göteborg Månsson LG (1994) Evaluation of radiographic procedures: investigations related to chest imaging. (Thesis). Göteborg University, Göteborg
24.
go back to reference Samei E, Flynn MJ, Eyler WR (1999) Detection of subtle lung nodules: relative influence of quantum and anatomic noise on chest radiographs. Radiology 213:727–734PubMed Samei E, Flynn MJ, Eyler WR (1999) Detection of subtle lung nodules: relative influence of quantum and anatomic noise on chest radiographs. Radiology 213:727–734PubMed
25.
go back to reference Samei E, Eyler W, Baron L (2000) Effects of anatomical structure on signal detection. In: Beutel J, Kundel HL, Van Metter RL (eds) Handbook of medical imaging, vol 1. Physics and psychophysics. SPIE Press, Bellingham, pp 655–682 Samei E, Eyler W, Baron L (2000) Effects of anatomical structure on signal detection. In: Beutel J, Kundel HL, Van Metter RL (eds) Handbook of medical imaging, vol 1. Physics and psychophysics. SPIE Press, Bellingham, pp 655–682
26.
go back to reference Hoeschen C, Buhr E, Döhring W (2000) Determination of the spatial frequency limit of anatomical structures in the X-ray pattern of a thorax examination. Radiat Prot Dosim 90:109–112 Hoeschen C, Buhr E, Döhring W (2000) Determination of the spatial frequency limit of anatomical structures in the X-ray pattern of a thorax examination. Radiat Prot Dosim 90:109–112
27.
go back to reference Bochud FO, Valley J-F, Verdun FR, Hessler C, Schnyder P (1999) Estimation of the noisy component of anatomical backgrounds. Med Phys 26:1365–1370CrossRefPubMed Bochud FO, Valley J-F, Verdun FR, Hessler C, Schnyder P (1999) Estimation of the noisy component of anatomical backgrounds. Med Phys 26:1365–1370CrossRefPubMed
28.
go back to reference International Electrotechnical Commission (1978) IEC 627/1978: Characteristics of anti-scatter grids used in X-ray equipment. International Electrotechnical Commission, Geneva International Electrotechnical Commission (1978) IEC 627/1978: Characteristics of anti-scatter grids used in X-ray equipment. International Electrotechnical Commission, Geneva
29.
go back to reference Niklason LT, Sorenson JA, Nelson JA (1981) Scattered radiation in chest radiography. Med Phys 8:677–681CrossRefPubMed Niklason LT, Sorenson JA, Nelson JA (1981) Scattered radiation in chest radiography. Med Phys 8:677–681CrossRefPubMed
30.
go back to reference Moy JP (2000) Signal-to-noise ratio and spatial resolution in X-ray electronic imagers: Is the MTF a relevant parameter? Med Phys 27:86–93CrossRefPubMed Moy JP (2000) Signal-to-noise ratio and spatial resolution in X-ray electronic imagers: Is the MTF a relevant parameter? Med Phys 27:86–93CrossRefPubMed
31.
go back to reference Geijer H, Verdonck B, Beckman K-W, Andersson T, Persliden J (2001) Digital radiography of scoliosis with a scanning method: initial evaluation. Radiology 218:402–410PubMed Geijer H, Verdonck B, Beckman K-W, Andersson T, Persliden J (2001) Digital radiography of scoliosis with a scanning method: initial evaluation. Radiology 218:402–410PubMed
32.
go back to reference Leitz WK, Månsson LG, Hedberg-Vikström BRK, Kheddache S (1993) In search of optimum chest radiography techniques. Br J Radiol 66:314–321PubMed Leitz WK, Månsson LG, Hedberg-Vikström BRK, Kheddache S (1993) In search of optimum chest radiography techniques. Br J Radiol 66:314–321PubMed
33.
go back to reference Almén A, Tingberg A, Mattsson S, Besjakov J, Kheddache S, Lanhede B, Månsson LG, Zankl M (2000) The influence of different technique factors on image quality of lumbar spine radiographs as evaluated by established CEC image criteria. Br J Radiol 73:1192–1199 Almén A, Tingberg A, Mattsson S, Besjakov J, Kheddache S, Lanhede B, Månsson LG, Zankl M (2000) The influence of different technique factors on image quality of lumbar spine radiographs as evaluated by established CEC image criteria. Br J Radiol 73:1192–1199
34.
go back to reference Brennan PC, Devereux SA (2002) An assessment of the usefulness of screen-film speed classifications. Eur Radiol 12:1577–1583CrossRefPubMed Brennan PC, Devereux SA (2002) An assessment of the usefulness of screen-film speed classifications. Eur Radiol 12:1577–1583CrossRefPubMed
35.
go back to reference Okamura T, Tanaka S, Koyama K, Norihumi N, Daikokuya H, Matsuoka T, Kishimoto K, Hatagawa M, Kudoh H, Yamada R (2002) Clinical evaluation of digital radiography based on a large-area cesium iodide-amorphous silicon flat-panel detector compared with screen-film radiography for skeletal system and abdomen. Eur Radiol 12:1741–1747CrossRefPubMed Okamura T, Tanaka S, Koyama K, Norihumi N, Daikokuya H, Matsuoka T, Kishimoto K, Hatagawa M, Kudoh H, Yamada R (2002) Clinical evaluation of digital radiography based on a large-area cesium iodide-amorphous silicon flat-panel detector compared with screen-film radiography for skeletal system and abdomen. Eur Radiol 12:1741–1747CrossRefPubMed
36.
go back to reference Dobbins JT III (2000) Image quality metrics for digital systems. In: Beutel J, Kundel HL, Van Metter RL (eds) Handbook of medical imaging, vol 1. Physics and psychophysics. SPIE Press, Bellingham, pp 161–222 Dobbins JT III (2000) Image quality metrics for digital systems. In: Beutel J, Kundel HL, Van Metter RL (eds) Handbook of medical imaging, vol 1. Physics and psychophysics. SPIE Press, Bellingham, pp 161–222
Metadata
Title
Comparison of visual grading analysis and determination of detective quantum efficiency for evaluating system performance in digital chest radiography
Authors
Patrik Sund
Magnus Båth
Susanne Kheddache
Lars Gunnar Månsson
Publication date
01-01-2004
Publisher
Springer-Verlag
Published in
European Radiology / Issue 1/2004
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-003-1971-z

Other articles of this Issue 1/2004

European Radiology 1/2004 Go to the issue