Skip to main content
Top
Published in: Radiation Oncology 1/2021

Open Access 01-12-2021 | Radiotherapy | Research

Generating synthetic CT from low-dose cone-beam CT by using generative adversarial networks for adaptive radiotherapy

Authors: Liugang Gao, Kai Xie, Xiaojin Wu, Zhengda Lu, Chunying Li, Jiawei Sun, Tao Lin, Jianfeng Sui, Xinye Ni

Published in: Radiation Oncology | Issue 1/2021

Login to get access

Abstract

Objective

To develop high-quality synthetic CT (sCT) generation method from low-dose cone-beam CT (CBCT) images by using attention-guided generative adversarial networks (AGGAN) and apply these images to dose calculations in radiotherapy.

Methods

The CBCT/planning CT images of 170 patients undergoing thoracic radiotherapy were used for training and testing. The CBCT images were scanned under a fast protocol with 50% less clinical projection frames compared with standard chest M20 protocol. Training with aligned paired images was performed using conditional adversarial networks (so-called pix2pix), and training with unpaired images was carried out with cycle-consistent adversarial networks (cycleGAN) and AGGAN, through which sCT images were generated. The image quality and Hounsfield unit (HU) value of the sCT images generated by the three neural networks were compared. The treatment plan was designed on CT and copied to sCT images to calculated dose distribution.

Results

The image quality of sCT images by all the three methods are significantly improved compared with original CBCT images. The AGGAN achieves the best image quality in the testing patients with the smallest mean absolute error (MAE, 43.5 ± 6.69), largest structural similarity (SSIM, 93.7 ± 3.88) and peak signal-to-noise ratio (PSNR, 29.5 ± 2.36). The sCT images generated by all the three methods showed superior dose calculation accuracy with higher gamma passing rates compared with original CBCT image. The AGGAN offered the highest gamma passing rates (91.4 ± 3.26) under the strictest criteria of 1 mm/1% compared with other methods. In the phantom study, the sCT images generated by AGGAN demonstrated the best image quality and the highest dose calculation accuracy.

Conclusions

High-quality sCT images were generated from low-dose thoracic CBCT images by using the proposed AGGAN through unpaired CBCT and CT images. The dose distribution could be calculated accurately based on sCT images in radiotherapy.
Literature
1.
go back to reference Sorcini B, Tilikidis A. Clinical application of image-guided radiotherapy, IGRT (on the Varian OBI platform). Cancer/Radiother. 2006;10:252–7.CrossRef Sorcini B, Tilikidis A. Clinical application of image-guided radiotherapy, IGRT (on the Varian OBI platform). Cancer/Radiother. 2006;10:252–7.CrossRef
2.
go back to reference Wang X, Li J, Wang P, et al. Image guided radiation therapy boost in combination with high-dose-rate intracavitary brachytherapy for the treatment of cervical cancer. Brachytherapy. 2016;8:122–7.CrossRef Wang X, Li J, Wang P, et al. Image guided radiation therapy boost in combination with high-dose-rate intracavitary brachytherapy for the treatment of cervical cancer. Brachytherapy. 2016;8:122–7.CrossRef
3.
go back to reference Boda-Heggemann J, Lohr F, Wenz F, et al. kV cone-beam CT-based IGRT. Strahlenther Onkol. 2011;187:284–91.CrossRef Boda-Heggemann J, Lohr F, Wenz F, et al. kV cone-beam CT-based IGRT. Strahlenther Onkol. 2011;187:284–91.CrossRef
4.
go back to reference Endo M, Tsunoo T, Nakamori N, et al. Effect of scattered radiation on image noise in cone beam CT. Med Phys. 2001;28:469–74.CrossRef Endo M, Tsunoo T, Nakamori N, et al. Effect of scattered radiation on image noise in cone beam CT. Med Phys. 2001;28:469–74.CrossRef
5.
go back to reference Xu Y, Bai T, Yan H, et al. A practical cone-beam CT scatter correction method with optimized Monte Carlo simulations for image-guided radiation therapy. Phys Med Biol. 2015;60:3567.CrossRef Xu Y, Bai T, Yan H, et al. A practical cone-beam CT scatter correction method with optimized Monte Carlo simulations for image-guided radiation therapy. Phys Med Biol. 2015;60:3567.CrossRef
6.
go back to reference Kan MW, Leung LH, Wong W, et al. Radiation dose from cone beam computed tomography for image-guided radiation therapy. Int J Radiat Oncol Biol Phys. 2008;70(1):272–9.CrossRef Kan MW, Leung LH, Wong W, et al. Radiation dose from cone beam computed tomography for image-guided radiation therapy. Int J Radiat Oncol Biol Phys. 2008;70(1):272–9.CrossRef
7.
go back to reference Song Y, Zhang W, Zhang H, et al. Low-dose cone-beam CT (LD-CBCT) reconstruction for image-guided radiation therapy (IGRT) by three-dimensional dual-dictionary learning. Radiat Oncol. 2020;15(1):192.CrossRef Song Y, Zhang W, Zhang H, et al. Low-dose cone-beam CT (LD-CBCT) reconstruction for image-guided radiation therapy (IGRT) by three-dimensional dual-dictionary learning. Radiat Oncol. 2020;15(1):192.CrossRef
8.
go back to reference Rijcke BD, Geeteruyen RV, Rijcke ED, et al. Fast 3D CBCT imaging for lung SBRT: is image quality preserved? Radiother Oncol. 2017;123:S85–6.CrossRef Rijcke BD, Geeteruyen RV, Rijcke ED, et al. Fast 3D CBCT imaging for lung SBRT: is image quality preserved? Radiother Oncol. 2017;123:S85–6.CrossRef
9.
go back to reference Dunlop A, McQuaid D, Nill S, et al. Comparison of CT number calibration techniques for CBCT-based dose calculation. Strahlenther Onkol. 2015;191(12):970–8.CrossRef Dunlop A, McQuaid D, Nill S, et al. Comparison of CT number calibration techniques for CBCT-based dose calculation. Strahlenther Onkol. 2015;191(12):970–8.CrossRef
10.
go back to reference Giacometti V, King RB, Agnew CE, et al. An evaluation of techniques for dose calculation on cone beam computed tomography. Br J Radiol. 2019;92(1096):20180383.CrossRef Giacometti V, King RB, Agnew CE, et al. An evaluation of techniques for dose calculation on cone beam computed tomography. Br J Radiol. 2019;92(1096):20180383.CrossRef
11.
go back to reference Stankovic U, Ploeger LS, van Herk M, et al. Optimal combination of anti-scatter grids and software correction for CBCT imaging. Med Phys. 2017;44:4437–51.CrossRef Stankovic U, Ploeger LS, van Herk M, et al. Optimal combination of anti-scatter grids and software correction for CBCT imaging. Med Phys. 2017;44:4437–51.CrossRef
12.
go back to reference Sisniega A, Zbijewski W, Badal A, et al. Monte Carlo study of the effects of system geometry and antiscatter grids on cone-beam CT scatter distribution. Med Phys. 2013;40:051915.CrossRef Sisniega A, Zbijewski W, Badal A, et al. Monte Carlo study of the effects of system geometry and antiscatter grids on cone-beam CT scatter distribution. Med Phys. 2013;40:051915.CrossRef
13.
go back to reference Sun M, Star-Lack JM. Improved scatter correction using adaptive scatter kernel superposition. Phys Med Biol. 2010;55:6695–720.CrossRef Sun M, Star-Lack JM. Improved scatter correction using adaptive scatter kernel superposition. Phys Med Biol. 2010;55:6695–720.CrossRef
14.
go back to reference Kurz C, Kamp F, Park Y-K, et al. Investigating deformable image registration and scatter correction for CBCT-based dose calculation in adaptive IMPT: CBCT correction to enable IMPT dose calculation. Med Phys. 2016;43(10):5635–46.CrossRef Kurz C, Kamp F, Park Y-K, et al. Investigating deformable image registration and scatter correction for CBCT-based dose calculation in adaptive IMPT: CBCT correction to enable IMPT dose calculation. Med Phys. 2016;43(10):5635–46.CrossRef
15.
go back to reference Duan L, Ni X, Liu Q, et al. Unsupervised learning for deformable registration of thoracic CT and cone-beam CT based on multiscale features matching with spatially adaptive weighting. Med Phys. 2020;47:5632–47.CrossRef Duan L, Ni X, Liu Q, et al. Unsupervised learning for deformable registration of thoracic CT and cone-beam CT based on multiscale features matching with spatially adaptive weighting. Med Phys. 2020;47:5632–47.CrossRef
16.
go back to reference Arai K, Kadoya N, Kato T, et al. Feasibility of CBCT-based proton dose calculation using a histogram-matching algorithm in proton beam therapy. Phys Med. 2017;33:68.CrossRef Arai K, Kadoya N, Kato T, et al. Feasibility of CBCT-based proton dose calculation using a histogram-matching algorithm in proton beam therapy. Phys Med. 2017;33:68.CrossRef
17.
go back to reference Mainegra-Hing E, Kawrakow I. Fast Monte Carlo calculation of scatter corrections for CBCT images. J Phys Conf Ser. 2008;102:012017.CrossRef Mainegra-Hing E, Kawrakow I. Fast Monte Carlo calculation of scatter corrections for CBCT images. J Phys Conf Ser. 2008;102:012017.CrossRef
18.
go back to reference Li J, Yao W, Xiao Y, et al. Feasibility of improving cone-beam CT number consistency using a scatter correction algorithm. J Appl Clin Med Phys. 2013;14(6):167–76.CrossRef Li J, Yao W, Xiao Y, et al. Feasibility of improving cone-beam CT number consistency using a scatter correction algorithm. J Appl Clin Med Phys. 2013;14(6):167–76.CrossRef
19.
go back to reference Niu T, Sun M, Star-Lack J, et al. Shading correction for on-board cone-beam CT in radiation therapy using planning MDCT images. Med Phys. 2010;37(10):5395–406.CrossRef Niu T, Sun M, Star-Lack J, et al. Shading correction for on-board cone-beam CT in radiation therapy using planning MDCT images. Med Phys. 2010;37(10):5395–406.CrossRef
20.
go back to reference Park YK, Sharp GC, Phillips J, et al. Proton dose calculation on scatter-corrected CBCT image: Feasibility study for adaptive proton therapy. Med Phys. 2015;42(8):4449–59.CrossRef Park YK, Sharp GC, Phillips J, et al. Proton dose calculation on scatter-corrected CBCT image: Feasibility study for adaptive proton therapy. Med Phys. 2015;42(8):4449–59.CrossRef
21.
go back to reference Li Y, Zhu J, Liu Z, et al. A preliminary study of using a deep convolution neural network to generate synthesized CT images based on CBCT for adaptive radiotherapy of nasopharyngeal carcinoma. Phys Med Biol. 2019;64(14):145010.CrossRef Li Y, Zhu J, Liu Z, et al. A preliminary study of using a deep convolution neural network to generate synthesized CT images based on CBCT for adaptive radiotherapy of nasopharyngeal carcinoma. Phys Med Biol. 2019;64(14):145010.CrossRef
22.
go back to reference Chen L, Liang X, Shen C, et al. Synthetic CT generation from CBCT images via deep learning. Med Phys. 2020;47(3):1115–25.CrossRef Chen L, Liang X, Shen C, et al. Synthetic CT generation from CBCT images via deep learning. Med Phys. 2020;47(3):1115–25.CrossRef
23.
go back to reference Liang X, Chen L, Nguyen D, et al. Generating synthesized computed tomography (CT) from cone-beam computed tomography (CBCT) using CycleGAN for adaptive radiation therapy. Phys Med Biol. 2019;64(12):CrossRef Liang X, Chen L, Nguyen D, et al. Generating synthesized computed tomography (CT) from cone-beam computed tomography (CBCT) using CycleGAN for adaptive radiation therapy. Phys Med Biol. 2019;64(12):CrossRef
24.
go back to reference Harms J, Lei Y, Wang T, et al. Paired cycleGAN based image correction for quantitative cone-beam CT. Med Phys. 2019;46(9):3998–4009.CrossRef Harms J, Lei Y, Wang T, et al. Paired cycleGAN based image correction for quantitative cone-beam CT. Med Phys. 2019;46(9):3998–4009.CrossRef
25.
go back to reference Liu Y, Lei Y, Wang T, et al. CBCT-based synthetic CT generation using deep-attention cycleGAN for pancreatic adaptive radiotherapy. Med Phys. 2020;47(6):2472–83.CrossRef Liu Y, Lei Y, Wang T, et al. CBCT-based synthetic CT generation using deep-attention cycleGAN for pancreatic adaptive radiotherapy. Med Phys. 2020;47(6):2472–83.CrossRef
26.
go back to reference Kida S, Kaji S, Nawa K, et al. Visual enhancement of cone-beam CT by use of CycleGAN. Med Phys. 2020;47(3):998–1010.CrossRef Kida S, Kaji S, Nawa K, et al. Visual enhancement of cone-beam CT by use of CycleGAN. Med Phys. 2020;47(3):998–1010.CrossRef
27.
go back to reference Barateau A, De Crevoisier R, Largent A, et al. Comparison of CBCT-based dose calculation methods in head and neck cancer radiotherapy: from Hounsfield unit to density calibration curve to deep learning. Med Phys. 2020;47:4683–93.CrossRef Barateau A, De Crevoisier R, Largent A, et al. Comparison of CBCT-based dose calculation methods in head and neck cancer radiotherapy: from Hounsfield unit to density calibration curve to deep learning. Med Phys. 2020;47:4683–93.CrossRef
28.
go back to reference Hansen DC, Landry G, Kamp F, et al. ScatterNet: a convolutional neural network for cone-beam CT intensity correction. Med Phys. 2018;45(11):4916–26.CrossRef Hansen DC, Landry G, Kamp F, et al. ScatterNet: a convolutional neural network for cone-beam CT intensity correction. Med Phys. 2018;45(11):4916–26.CrossRef
29.
go back to reference Lalonde A, Winey B, Verburg J, et al. Evaluation of CBCT scatter correction using deep convolutional neural networks for head and neck adaptive proton therapy. Phys Med Biol. 2020;65(24):245022.CrossRef Lalonde A, Winey B, Verburg J, et al. Evaluation of CBCT scatter correction using deep convolutional neural networks for head and neck adaptive proton therapy. Phys Med Biol. 2020;65(24):245022.CrossRef
30.
go back to reference Landry G, Hansen D, Kamp F, et al. Comparing Unet training with three different datasets to correct CBCT images for prostate radiotherapy dose calculations. Phys Med Biol. 2019;64(3):035011. Landry G, Hansen D, Kamp F, et al. Comparing Unet training with three different datasets to correct CBCT images for prostate radiotherapy dose calculations. Phys Med Biol. 2019;64(3):035011.
31.
go back to reference Thummerer A, Zaffino P, Meijers A, et al. Comparison of CBCT based synthetic CT methods suitable for proton dose calculations in adaptive proton therapy. Phys Med Biol. 2020;65(9):095002.CrossRef Thummerer A, Zaffino P, Meijers A, et al. Comparison of CBCT based synthetic CT methods suitable for proton dose calculations in adaptive proton therapy. Phys Med Biol. 2020;65(9):095002.CrossRef
32.
go back to reference Ronneberger O, Fischer P, Brox T, et al. U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. 2015. p. 234–41. Ronneberger O, Fischer P, Brox T, et al. U-Net: convolutional networks for biomedical image segmentation. In: International conference on medical image computing and computer-assisted intervention. 2015. p. 234–41.
33.
go back to reference Goodfellow I, Pougetabadie J, Mirza M, et al. Generative adversarial nets. Neural Inf Process Syst. 2014;27:2672–80. Goodfellow I, Pougetabadie J, Mirza M, et al. Generative adversarial nets. Neural Inf Process Syst. 2014;27:2672–80.
34.
go back to reference Dong Y, Xu D, Zhou SK, et al, Automatic liver segmentation using an adversarial image-to-image network. In: International conference on medical image computing and computer assisted intervention (MICCAI). 2017. p. 507–15. Dong Y, Xu D, Zhou SK, et al, Automatic liver segmentation using an adversarial image-to-image network. In: International conference on medical image computing and computer assisted intervention (MICCAI). 2017. p. 507–15.
35.
go back to reference Rezaei M , Harmuth K , Gierke W , et al, A conditional adversarial network for semantic segmentation of brain tumor. In: International conference on medical image computing and computer assisted intervention. 2017. p. 241–52. Rezaei M , Harmuth K , Gierke W , et al, A conditional adversarial network for semantic segmentation of brain tumor. In: International conference on medical image computing and computer assisted intervention. 2017. p. 241–52.
36.
go back to reference Madani A, Moradi M, Karargyris A, et al. Semi-supervised learning with generative adversarial networks for chest x-ray classification with ability of data domain adaptation. In: The IEEE international symposium on biomedical imaging. 2018. p. 1038–42. Madani A, Moradi M, Karargyris A, et al. Semi-supervised learning with generative adversarial networks for chest x-ray classification with ability of data domain adaptation. In: The IEEE international symposium on biomedical imaging. 2018. p. 1038–42.
37.
go back to reference McCollough CH, Bartley AC, Carter RE, et al. Low-dose ct for the detection and classification of metastatic liver lesions. Med Phys. 2017;44(10):e339–52.CrossRef McCollough CH, Bartley AC, Carter RE, et al. Low-dose ct for the detection and classification of metastatic liver lesions. Med Phys. 2017;44(10):e339–52.CrossRef
38.
go back to reference Maspero M, Savenije MHF, Dinkla AM, et al. Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy. Phys Med Biol. 2018;63:185001.CrossRef Maspero M, Savenije MHF, Dinkla AM, et al. Dose evaluation of fast synthetic-CT generation using a generative adversarial network for general pelvis MR-only radiotherapy. Phys Med Biol. 2018;63:185001.CrossRef
39.
go back to reference Cusumano D, Lenkowicz J, Votta C, et al. A deep learning approach to generate synthetic CT in low field MR-guided adaptive radiotherapy for abdominal and pelvic cases. Radiother Oncol. 2020;153:205–12.CrossRef Cusumano D, Lenkowicz J, Votta C, et al. A deep learning approach to generate synthetic CT in low field MR-guided adaptive radiotherapy for abdominal and pelvic cases. Radiother Oncol. 2020;153:205–12.CrossRef
40.
go back to reference Quan TM, Nguyen-Duc T, Jeong WK. Compressed sensing MRI reconstruction using a generative adversarial network with a cyclic loss. IEEE Trans Med Imaging. 2018;37(6):1488–97.CrossRef Quan TM, Nguyen-Duc T, Jeong WK. Compressed sensing MRI reconstruction using a generative adversarial network with a cyclic loss. IEEE Trans Med Imaging. 2018;37(6):1488–97.CrossRef
41.
go back to reference Isola P, Zhu J, Zhou T, et al. Image-to-image translation with conditional adversarial networks. In: 2017 IEEE conference on computer vision and pattern recognition, CVPR 2017. p. 5967–76. Isola P, Zhu J, Zhou T, et al. Image-to-image translation with conditional adversarial networks. In: 2017 IEEE conference on computer vision and pattern recognition, CVPR 2017. p. 5967–76.
42.
go back to reference Zhu J, Park T, Isola P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE international conference on computer vision, ICCV 2017. p. 2242–51 Zhu J, Park T, Isola P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks. In: IEEE international conference on computer vision, ICCV 2017. p. 2242–51
43.
go back to reference Nie D, Trullo R, Lian J, et al. Medical image Synthesis with context aware generative adversarial networks. In: International conference on medical image computing and computer assisted intervention (MICCAI), 2017. vol. 10435. p. 417–25. Nie D, Trullo R, Lian J, et al. Medical image Synthesis with context aware generative adversarial networks. In: International conference on medical image computing and computer assisted intervention (MICCAI), 2017. vol. 10435. p. 417–25.
44.
go back to reference Tang Hao, Xu Dan, Sebe Nicu, et al, Attention-guided generative adversarial networks for unsupervised image-to-image translation. In: International joint conference on neural networks (IJCNN). 2019. Tang Hao, Xu Dan, Sebe Nicu, et al, Attention-guided generative adversarial networks for unsupervised image-to-image translation. In: International joint conference on neural networks (IJCNN). 2019.
45.
go back to reference Bogaert E, Monten C, Wagter CD, et al. Investigation of a fast CBCT protocol for supine accelerated whole breast. Irradiat Radiother Oncol. 2016;119:S434.CrossRef Bogaert E, Monten C, Wagter CD, et al. Investigation of a fast CBCT protocol for supine accelerated whole breast. Irradiat Radiother Oncol. 2016;119:S434.CrossRef
46.
go back to reference Mao X, Li Q, Xie H, et al. Least squares generative adversarial networks. In: IEEE international conference on computer vision (ICCV), 2017. Mao X, Li Q, Xie H, et al. Least squares generative adversarial networks. In: IEEE international conference on computer vision (ICCV), 2017.
Metadata
Title
Generating synthetic CT from low-dose cone-beam CT by using generative adversarial networks for adaptive radiotherapy
Authors
Liugang Gao
Kai Xie
Xiaojin Wu
Zhengda Lu
Chunying Li
Jiawei Sun
Tao Lin
Jianfeng Sui
Xinye Ni
Publication date
01-12-2021
Publisher
BioMed Central
Keyword
Radiotherapy
Published in
Radiation Oncology / Issue 1/2021
Electronic ISSN: 1748-717X
DOI
https://doi.org/10.1186/s13014-021-01928-w

Other articles of this Issue 1/2021

Radiation Oncology 1/2021 Go to the issue