Skip to main content
Top

Open Access 02-05-2024 | Positron Emission Tomography | Original Article

Multicenter PET image harmonization using generative adversarial networks

Authors: David Haberl, Clemens P. Spielvogel, Zewen Jiang, Fanny Orlhac, David Iommi, Ignasi Carrió, Irène Buvat, Alexander R. Haug, Laszlo Papp

Published in: European Journal of Nuclear Medicine and Molecular Imaging

Login to get access

Abstract

Purpose

To improve reproducibility and predictive performance of PET radiomic features in multicentric studies by cycle-consistent generative adversarial network (GAN) harmonization approaches.

Methods

GAN-harmonization was developed to harmonize whole-body PET scans to perform image style and texture translation between different centers and scanners. GAN-harmonization was evaluated by application to two retrospectively collected open datasets and different tasks. First, GAN-harmonization was performed on a dual-center lung cancer cohort (127 female, 138 male) where the reproducibility of radiomic features in healthy liver tissue was evaluated. Second, GAN-harmonization was applied to a head and neck cancer cohort (43 female, 154 male) acquired from three centers. Here, the clinical impact of GAN-harmonization was analyzed by predicting the development of distant metastases using a logistic regression model incorporating first-order statistics and texture features from baseline 18F-FDG PET before and after harmonization.

Results

Image quality remained high (structural similarity: left kidney \(\ge\) 0.800, right kidney \(\ge\) 0.806, liver \(\ge\) 0.780, lung \(\ge\) 0.838, spleen \(\ge\) 0.793, whole-body \(\ge\) 0.832) after image harmonization across all utilized datasets. Using GAN-harmonization, inter-site reproducibility of radiomic features in healthy liver tissue increased at least by \(\ge\) 5 ± 14% (first-order), \(\ge\) 16 ± 7% (GLCM), \(\ge\) 19 ± 5% (GLRLM), \(\ge\) 16 ± 8% (GLSZM), \(\ge\) 17 ± 6% (GLDM), and \(\ge\) 23 ± 14% (NGTDM). In the head and neck cancer cohort, the outcome prediction improved from AUC 0.68 (95% CI 0.66–0.71) to AUC 0.73 (0.71–0.75) by application of GAN-harmonization.

Conclusions

GANs are capable of performing image harmonization and increase reproducibility and predictive performance of radiomic features derived from different centers and scanners.
Appendix
Available only for authorised users
Literature
1.
go back to reference Hoekstra CJ, Stroobants SG, Smit EF, Vansteenkiste J, van Tinteren H, Postmus PE, et al. Prognostic relevance of response evaluation using [ 18 F]-2-fluoro-2-deoxy-D-glucose positron emission tomography in patients with locally advanced non–small-cell lung cancer. J Clin Oncol. 2005;23:8362–70. Available from: https://ascopubs.org/doi/10.1200/JCO.2005.01.1189. Accessed 18 Jan 2024 Hoekstra CJ, Stroobants SG, Smit EF, Vansteenkiste J, van Tinteren H, Postmus PE, et al. Prognostic relevance of response evaluation using [ 18 F]-2-fluoro-2-deoxy-D-glucose positron emission tomography in patients with locally advanced non–small-cell lung cancer. J Clin Oncol. 2005;23:8362–70. Available from: https://​ascopubs.​org/​doi/​10.​1200/​JCO.​2005.​01.​1189. Accessed 18 Jan 2024
6.
go back to reference Blanc-Durand P, Jégou S, Kanoun S, Berriolo-Riedinger A, Bodet-Milin C, Kraeber-Bodéré F, et al. Fully automatic segmentation of diffuse large B cell lymphoma lesions on 3D FDG-PET/CT for total metabolic tumour volume prediction using a convolutional neural network. Eur J Nucl Med Mol Imaging. 2021;48:1362–70. Available from: https://link.springer.com/10.1007/s00259-020-05080-7. Accessed 18 Jan 2024 Blanc-Durand P, Jégou S, Kanoun S, Berriolo-Riedinger A, Bodet-Milin C, Kraeber-Bodéré F, et al. Fully automatic segmentation of diffuse large B cell lymphoma lesions on 3D FDG-PET/CT for total metabolic tumour volume prediction using a convolutional neural network. Eur J Nucl Med Mol Imaging. 2021;48:1362–70. Available from: https://​link.​springer.​com/​10.​1007/​s00259-020-05080-7. Accessed 18 Jan 2024
13.
16.
go back to reference Chatterjee A, Vallieres M, Dohan A, Levesque IR, Ueno Y, Saif S, et al. Creating robust predictive radiomic models for data from independent institutions using normalization. IEEE Trans Radiat Plasma Med Sci. 2019;3:210–5. Available from: https://ieeexplore.ieee.org/document/8616907/. Accessed 18 Jan 2024 Chatterjee A, Vallieres M, Dohan A, Levesque IR, Ueno Y, Saif S, et al. Creating robust predictive radiomic models for data from independent institutions using normalization. IEEE Trans Radiat Plasma Med Sci. 2019;3:210–5. Available from: https://​ieeexplore.​ieee.​org/​document/​8616907/​. Accessed 18 Jan 2024
43.
44.
go back to reference Triumbari EKA, Gatta R, Maiolo E, De Summa M, Boldrini L, Mayerhoefer ME, et al. Baseline 18F-FDG PET/CT radiomics in classical Hodgkin’s lymphoma: the predictive role of the largest and the hottest lesions. Diagnostics. 2023;13:1391. Available from: https://www.mdpi.com/2075-4418/13/8/1391. Accessed 18 Jan 2024 Triumbari EKA, Gatta R, Maiolo E, De Summa M, Boldrini L, Mayerhoefer ME, et al. Baseline 18F-FDG PET/CT radiomics in classical Hodgkin’s lymphoma: the predictive role of the largest and the hottest lesions. Diagnostics. 2023;13:1391. Available from: https://​www.​mdpi.​com/​2075-4418/​13/​8/​1391. Accessed 18 Jan 2024
Metadata
Title
Multicenter PET image harmonization using generative adversarial networks
Authors
David Haberl
Clemens P. Spielvogel
Zewen Jiang
Fanny Orlhac
David Iommi
Ignasi Carrió
Irène Buvat
Alexander R. Haug
Laszlo Papp
Publication date
02-05-2024
Publisher
Springer Berlin Heidelberg
Published in
European Journal of Nuclear Medicine and Molecular Imaging
Print ISSN: 1619-7070
Electronic ISSN: 1619-7089
DOI
https://doi.org/10.1007/s00259-024-06708-8