Skip to main content
Top
Published in: European Radiology 8/2020

Open Access 01-08-2020 | Computed Tomography | Computed Tomography

3D printing of anatomically realistic phantoms with detection tasks to assess the diagnostic performance of CT images

Authors: Gracia Lana Ardila Pardo, Juliane Conzelmann, Ulrich Genske, Bernd Hamm, Michael Scheel, Paul Jahnke

Published in: European Radiology | Issue 8/2020

Login to get access

Abstract

Objectives

Detectability experiments performed to assess the diagnostic performance of computed tomography (CT) images should represent the clinical situation realistically. The purpose was to develop anatomically realistic phantoms with low-contrast lesions for detectability experiments.

Methods

Low-contrast lesions were digitally inserted into a neck CT image of a patient. The original and the manipulated CT images were used to create five phantoms: four phantoms with lesions of 10, 20, 30, and 40 HU contrast and one phantom without any lesion. Radiopaque 3D printing with potassium-iodide-doped ink (600 mg/mL) was used. The phantoms were scanned with different CT settings. Lesion contrast was analyzed using HU measurement. A 2-alternative forced choice experiment was performed with seven radiologists to study the impact of lesion contrast on detection accuracy and reader confidence (1 = lowest, 5 = highest).

Results

The phantoms reproduced patient size, shape, and anatomy. Mean ± SD contrast values of the low-contrast lesions were 9.7 ± 1.2, 18.2 ± 2, 30.2 ± 2.7, and 37.7 ± 3.1 HU for the 10, 20, 30, and 40 HU contrast lesions, respectively. Mean ± SD detection accuracy and confidence values were not significantly different for 10 and 20 HU lesion contrast (82.1 ± 6.3% vs. 83.9 ± 9.4%, p = 0.863 and 1.7 ± 0.4 vs. 1.8 ± 0.5, p = 0.159). They increased to 95 ± 5.7% and 2.6 ± 0.7 for 30 HU lesion contrast and 99.5 ± 0.9% and 3.8 ± 0.7 for 40 HU lesion contrast (p < 0.005).

Conclusions

A CT image was manipulated to produce anatomically realistic phantoms for low-contrast detectability experiments. The phantoms and our initial experiments provide a groundwork for the assessment of CT image quality in a clinical context.

Key Points

Phantoms generated from manipulated CT images provide patient anatomy and can be used for detection tasks to evaluate the diagnostic performance of CT images.
Radiologists are unconfident and unreliable in detecting hypodense lesions of 20 HU contrast and less in an anatomical neck background.
Detectability experiments with anatomically realistic phantoms can assess CT image quality in a clinical context.
Appendix
Available only for authorised users
Literature
1.
go back to reference Christianson O, Chen JJ, Yang Z et al (2015) An improved index of image quality for task-based performance of CT iterative reconstruction across three commercial implementations. Radiology 275:725–734CrossRef Christianson O, Chen JJ, Yang Z et al (2015) An improved index of image quality for task-based performance of CT iterative reconstruction across three commercial implementations. Radiology 275:725–734CrossRef
2.
go back to reference Richard S, Husarik DB, Yadava G, Murphy SN, Samei E (2012) Towards task-based assessment of CT performance: system and object MTF across different reconstruction algorithms. Med Phys 39:4115–4122CrossRef Richard S, Husarik DB, Yadava G, Murphy SN, Samei E (2012) Towards task-based assessment of CT performance: system and object MTF across different reconstruction algorithms. Med Phys 39:4115–4122CrossRef
3.
go back to reference Ahn SJ, Kim JH, Lee SM, Park SJ, Han JK (2019) CT reconstruction algorithms affect histogram and texture analysis: evidence for liver parenchyma, focal solid liver lesions, and renal cysts. Eur Radiol 29:4008–4015CrossRef Ahn SJ, Kim JH, Lee SM, Park SJ, Han JK (2019) CT reconstruction algorithms affect histogram and texture analysis: evidence for liver parenchyma, focal solid liver lesions, and renal cysts. Eur Radiol 29:4008–4015CrossRef
4.
go back to reference Greffier J, Frandon J, Larbi A, Beregi JP, Pereira F (2020) CT iterative reconstruction algorithms: a task-based image quality assessment. Eur Radiol 30:487–500CrossRef Greffier J, Frandon J, Larbi A, Beregi JP, Pereira F (2020) CT iterative reconstruction algorithms: a task-based image quality assessment. Eur Radiol 30:487–500CrossRef
5.
go back to reference Vaishnav JY, Jung WC, Popescu LM, Zeng R, Myers KJ (2014) Objective assessment of image quality and dose reduction in CT iterative reconstruction. Med Phys 41:071904CrossRef Vaishnav JY, Jung WC, Popescu LM, Zeng R, Myers KJ (2014) Objective assessment of image quality and dose reduction in CT iterative reconstruction. Med Phys 41:071904CrossRef
6.
go back to reference Barrett HH, Myers KJ, Hoeschen C, Kupinski MA, Little MP (2015) Task-based measures of image quality and their relation to radiation dose and patient risk. Phys Med Biol 60:R1–R75CrossRef Barrett HH, Myers KJ, Hoeschen C, Kupinski MA, Little MP (2015) Task-based measures of image quality and their relation to radiation dose and patient risk. Phys Med Biol 60:R1–R75CrossRef
7.
go back to reference Solomon J, Ba A, Bochud F, Samei E (2016) Comparison of low-contrast detectability between two CT reconstruction algorithms using voxel-based 3D printed textured phantoms. Med Phys 43:6497CrossRef Solomon J, Ba A, Bochud F, Samei E (2016) Comparison of low-contrast detectability between two CT reconstruction algorithms using voxel-based 3D printed textured phantoms. Med Phys 43:6497CrossRef
8.
go back to reference Jahnke P, Limberg FR, Gerbl A et al (2017) Radiopaque three-dimensional printing: a method to create realistic CT phantoms. Radiology 282:569–575CrossRef Jahnke P, Limberg FR, Gerbl A et al (2017) Radiopaque three-dimensional printing: a method to create realistic CT phantoms. Radiology 282:569–575CrossRef
9.
go back to reference Jahnke P, Schwarz S, Ziegert M, Schwarz FB, Hamm B, Scheel M (2019) Paper-based 3D printing of anthropomorphic CT phantoms: feasibility of two construction techniques. Eur Radiol 29:1384–1390CrossRef Jahnke P, Schwarz S, Ziegert M, Schwarz FB, Hamm B, Scheel M (2019) Paper-based 3D printing of anthropomorphic CT phantoms: feasibility of two construction techniques. Eur Radiol 29:1384–1390CrossRef
10.
go back to reference Groell R, Rienmueller R, Schaffler GJ, Portugaller HR, Graif E, Willfurth P (2000) CT number variations due to different image acquisition and reconstruction parameters: a thorax phantom study. Comput Med Imaging Graph 24:53–58CrossRef Groell R, Rienmueller R, Schaffler GJ, Portugaller HR, Graif E, Willfurth P (2000) CT number variations due to different image acquisition and reconstruction parameters: a thorax phantom study. Comput Med Imaging Graph 24:53–58CrossRef
11.
go back to reference Paul J, Krauss B, Banckwitz R, Maentele W, Bauer RW, Vogl TJ (2012) Relationships of clinical protocols and reconstruction kernels with image quality and radiation dose in a 128-slice CT scanner: study with an anthropomorphic and water phantom. Eur J Radiol 81:e699–e703CrossRef Paul J, Krauss B, Banckwitz R, Maentele W, Bauer RW, Vogl TJ (2012) Relationships of clinical protocols and reconstruction kernels with image quality and radiation dose in a 128-slice CT scanner: study with an anthropomorphic and water phantom. Eur J Radiol 81:e699–e703CrossRef
12.
go back to reference Kalva SP, Sahani DV, Hahn PF, Saini S (2006) Using the K-edge to improve contrast conspicuity and to lower radiation dose with a 16-MDCT: a phantom and human study. J Comput Assist Tomogr 30:391–397CrossRef Kalva SP, Sahani DV, Hahn PF, Saini S (2006) Using the K-edge to improve contrast conspicuity and to lower radiation dose with a 16-MDCT: a phantom and human study. J Comput Assist Tomogr 30:391–397CrossRef
13.
go back to reference Scholtz JE, Kaup M, Kraft J et al (2015) Objective and subjective image quality of primary and recurrent squamous cell carcinoma on head and neck low-tube-voltage 80-kVp computed tomography. Neuroradiology 57:645–651CrossRef Scholtz JE, Kaup M, Kraft J et al (2015) Objective and subjective image quality of primary and recurrent squamous cell carcinoma on head and neck low-tube-voltage 80-kVp computed tomography. Neuroradiology 57:645–651CrossRef
14.
go back to reference Euler A, Stieltjes B, Szucs-Farkas Z et al (2017) Impact of model-based iterative reconstruction on low-contrast lesion detection and image quality in abdominal CT: a 12-reader-based comparative phantom study with filtered back projection at different tube voltages. Eur Radiol 27:5252–5259CrossRef Euler A, Stieltjes B, Szucs-Farkas Z et al (2017) Impact of model-based iterative reconstruction on low-contrast lesion detection and image quality in abdominal CT: a 12-reader-based comparative phantom study with filtered back projection at different tube voltages. Eur Radiol 27:5252–5259CrossRef
15.
go back to reference Brinkley MF, Ramirez-Giraldo JC, Samei E et al (2016) Effects of automatic tube potential selection on radiation dose index, image quality, and lesion detectability in pediatric abdominopelvic CT and CTA: a phantom study. Eur Radiol 26:157–166CrossRef Brinkley MF, Ramirez-Giraldo JC, Samei E et al (2016) Effects of automatic tube potential selection on radiation dose index, image quality, and lesion detectability in pediatric abdominopelvic CT and CTA: a phantom study. Eur Radiol 26:157–166CrossRef
16.
go back to reference Schindera ST, Odedra D, Raza SA et al (2013) Iterative reconstruction algorithm for CT: can radiation dose be decreased while low-contrast detectability is preserved? Radiology 269:511–518CrossRef Schindera ST, Odedra D, Raza SA et al (2013) Iterative reconstruction algorithm for CT: can radiation dose be decreased while low-contrast detectability is preserved? Radiology 269:511–518CrossRef
17.
go back to reference Solomon J, Mileto A, Ramirez-Giraldo JC, Samei E (2015) Diagnostic performance of an advanced modeled iterative reconstruction algorithm for low-contrast detectability with a third-generation dual-source multidetector CT scanner: potential for radiation dose reduction in a multireader study. Radiology 275:735–745CrossRef Solomon J, Mileto A, Ramirez-Giraldo JC, Samei E (2015) Diagnostic performance of an advanced modeled iterative reconstruction algorithm for low-contrast detectability with a third-generation dual-source multidetector CT scanner: potential for radiation dose reduction in a multireader study. Radiology 275:735–745CrossRef
18.
go back to reference Samei E, Bakalyar D, Boedeker KL et al (2019) Performance evaluation of computed tomography systems: summary of AAPM task group 233. Med Phys 46:e735–e756CrossRef Samei E, Bakalyar D, Boedeker KL et al (2019) Performance evaluation of computed tomography systems: summary of AAPM task group 233. Med Phys 46:e735–e756CrossRef
19.
go back to reference Solomon J, Samei E (2014) A generic framework to simulate realistic lung, liver and renal pathologies in CT imaging. Phys Med Biol 59:6637–6657CrossRef Solomon J, Samei E (2014) A generic framework to simulate realistic lung, liver and renal pathologies in CT imaging. Phys Med Biol 59:6637–6657CrossRef
20.
go back to reference Dilger SKN, Yu L, Chen B et al (2019) Localization of liver lesions in abdominal CT imaging: I. correlation of human observer performance between anatomical and uniform backgrounds. Phys Med Biol 64:105011CrossRef Dilger SKN, Yu L, Chen B et al (2019) Localization of liver lesions in abdominal CT imaging: I. correlation of human observer performance between anatomical and uniform backgrounds. Phys Med Biol 64:105011CrossRef
Metadata
Title
3D printing of anatomically realistic phantoms with detection tasks to assess the diagnostic performance of CT images
Authors
Gracia Lana Ardila Pardo
Juliane Conzelmann
Ulrich Genske
Bernd Hamm
Michael Scheel
Paul Jahnke
Publication date
01-08-2020
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 8/2020
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-020-06808-7

Other articles of this Issue 8/2020

European Radiology 8/2020 Go to the issue