Skip to main content
Top
Published in: European Radiology 10/2022

08-06-2022 | Lymphoma | Head and Neck

A deep learning model combining multimodal radiomics, clinical and imaging features for differentiating ocular adnexal lymphoma from idiopathic orbital inflammation

Authors: Xiaoyang Xie, Lijuan Yang, Fengjun Zhao, Dong Wang, Hui Zhang, Xuelei He, Xin Cao, Huangjian Yi, Xiaowei He, Yuqing Hou

Published in: European Radiology | Issue 10/2022

Login to get access

Abstract

Objectives

To evaluate the value of deep learning (DL) combining multimodal radiomics and clinical and imaging features for differentiating ocular adnexal lymphoma (OAL) from idiopathic orbital inflammation (IOI).

Methods

Eighty-nine patients with histopathologically confirmed OAL (n = 39) and IOI (n = 50) were divided into training and validation groups. Convolutional neural networks and multimodal fusion layers were used to extract multimodal radiomics features from the T1-weighted image (T1WI), T2-weighted image, and contrast-enhanced T1WI. These multimodal radiomics features were then combined with clinical and imaging features and used together to differentiate between OAL and IOI. The area under the curve (AUC) was used to evaluate DL models with different features under five-fold cross-validation. The Student t-test, chi-squared, or Fisher exact test was used for comparison of different groups.

Results

In the validation group, the diagnostic AUC of the DL model using combined features was 0.953 (95% CI, 0.895–1.000), higher than that of the DL model using multimodal radiomics features (0.843, 95% CI, 0.786–0.898, p < 0.01) or clinical and imaging features only (0.882, 95% CI, 0.782–0.982, p = 0.13). The DL model built on multimodal radiomics features outperformed those built on most bimodalities and unimodalities (p < 0.05). In addition, the DL-based analysis with the orbital cone area (covering both the orbital mass and surrounding tissues) was superior to that with the region of interest (ROI) covering only the mass area, although the difference was not significant (p = 0.33).

Conclusions

DL-based analysis that combines multimodal radiomics features with clinical and imaging features may help to differentiate between OAL and IOI.

Key Points

• It is difficult to differentiate OAL from IOI due to the overlap in clinical and imaging manifestations.
• Radiomics has shown potential for noninvasive diagnosis of different orbital lymphoproliferative disorders.
• DL-based analysis combining radiomics and imaging and clinical features may help the differentiation between OAL and IOI.
Appendix
Available only for authorised users
Literature
1.
go back to reference Li EY, Yuen HK, Cheuk W (2015) Lymphoproliferative Disease of the Orbit. Asia Pac J Ophthalmol (Phila) 4:106–111 Li EY, Yuen HK, Cheuk W (2015) Lymphoproliferative Disease of the Orbit. Asia Pac J Ophthalmol (Phila) 4:106–111
2.
go back to reference Cytryn AS, Putterman AM, Schneck GL, Beckman E, Valvassori GE (1997) Predictability of magnetic resonance imaging in differentiation of orbital lymphoma from orbital inflammatory syndrome. Ophthal Plast Reconstr Surg 13:129–134PubMedCrossRef Cytryn AS, Putterman AM, Schneck GL, Beckman E, Valvassori GE (1997) Predictability of magnetic resonance imaging in differentiation of orbital lymphoma from orbital inflammatory syndrome. Ophthal Plast Reconstr Surg 13:129–134PubMedCrossRef
3.
go back to reference Bairey O, Kremer I, Rakowsky E, Hadar H, Shaklai M (1994) Orbital and adnexal involvement in systemic non-Hodgkin's lymphoma. Cancer 73:2395–2399PubMedCrossRef Bairey O, Kremer I, Rakowsky E, Hadar H, Shaklai M (1994) Orbital and adnexal involvement in systemic non-Hodgkin's lymphoma. Cancer 73:2395–2399PubMedCrossRef
4.
go back to reference Ferry JA, Fung CY, Zukerberg L et al (2007) Lymphoma of the Ocular Adnexa: A Study of 353 Cases. Am J Surg Pathol 31:170–184PubMedCrossRef Ferry JA, Fung CY, Zukerberg L et al (2007) Lymphoma of the Ocular Adnexa: A Study of 353 Cases. Am J Surg Pathol 31:170–184PubMedCrossRef
5.
go back to reference Watkins LM, Carter KD, Nerad JA (2011) Ocular adnexal lymphoma of the extraocular muscles: case series from the University of Iowa and review of the literature. Ophthal Plast Reconstr Surg 27:471–476PubMedCrossRef Watkins LM, Carter KD, Nerad JA (2011) Ocular adnexal lymphoma of the extraocular muscles: case series from the University of Iowa and review of the literature. Ophthal Plast Reconstr Surg 27:471–476PubMedCrossRef
6.
go back to reference Ponzoni M, Govi S, Licata G et al (2013) A reappraisal of the diagnostic and therapeutic management of uncommon histologies of primary ocular adnexal lymphoma. Oncologist 18:876–884PubMedPubMedCentralCrossRef Ponzoni M, Govi S, Licata G et al (2013) A reappraisal of the diagnostic and therapeutic management of uncommon histologies of primary ocular adnexal lymphoma. Oncologist 18:876–884PubMedPubMedCentralCrossRef
8.
go back to reference Sniegowski MC, Roberts D, Bakhoum M et al (2014) Ocular adnexal lymphoma: validation of American Joint Committee on Cancer seventh edition staging guidelines. Br J Ophthalmol 98:1255–1260PubMedCrossRef Sniegowski MC, Roberts D, Bakhoum M et al (2014) Ocular adnexal lymphoma: validation of American Joint Committee on Cancer seventh edition staging guidelines. Br J Ophthalmol 98:1255–1260PubMedCrossRef
9.
go back to reference Coupland SE, Krause L, Delecluse H-J et al (1998) Lymphoproliferative lesions of the ocular adnexa. Ophthalmology 105:1430–1441PubMedCrossRef Coupland SE, Krause L, Delecluse H-J et al (1998) Lymphoproliferative lesions of the ocular adnexa. Ophthalmology 105:1430–1441PubMedCrossRef
10.
go back to reference Fung CY, Tarbell NJ, Lucarelli MJ et al (2003) Ocular adnexal lymphoma: Clinical behavior of distinct World Health Organization classification subtypes. Int J Radiat Oncol Biol Phys 57:1382–1391PubMedCrossRef Fung CY, Tarbell NJ, Lucarelli MJ et al (2003) Ocular adnexal lymphoma: Clinical behavior of distinct World Health Organization classification subtypes. Int J Radiat Oncol Biol Phys 57:1382–1391PubMedCrossRef
11.
go back to reference Sullivan TJ, Whitehead K, Williamson R et al (2005) Lymphoproliferative disease of the ocular adnexa: a clinical and pathologic study with statistical analysis of 69 patients. Ophthal Plast Reconstr Surg 21:177–188PubMedCrossRef Sullivan TJ, Whitehead K, Williamson R et al (2005) Lymphoproliferative disease of the ocular adnexa: a clinical and pathologic study with statistical analysis of 69 patients. Ophthal Plast Reconstr Surg 21:177–188PubMedCrossRef
12.
go back to reference William M, Lessner AM (2010) Orbital pseudotumor. Am J Clin Oncol 33:304–306CrossRef William M, Lessner AM (2010) Orbital pseudotumor. Am J Clin Oncol 33:304–306CrossRef
13.
go back to reference Rubin PA, Foster CS (2004) Etiology and management of idiopathic orbital inflammation. Am J Ophthalmol 138:1041–1043PubMedCrossRef Rubin PA, Foster CS (2004) Etiology and management of idiopathic orbital inflammation. Am J Ophthalmol 138:1041–1043PubMedCrossRef
14.
go back to reference Rosenbaum JT, Phal PM, Lutt JR, Lim LL (2008) Orbital inflammatory disease. Semin Arthritis Rheum 37:207–222PubMedCrossRef Rosenbaum JT, Phal PM, Lutt JR, Lim LL (2008) Orbital inflammatory disease. Semin Arthritis Rheum 37:207–222PubMedCrossRef
15.
16.
go back to reference Gordon LK (2006) Orbital inflammatory disease: a diagnostic and therapeutic challenge. Eye (Lond) 20:1196–1206 Gordon LK (2006) Orbital inflammatory disease: a diagnostic and therapeutic challenge. Eye (Lond) 20:1196–1206
17.
go back to reference Swamy BN, McCluskey P, Nemet A et al (2007) Idiopathic orbital inflammatory syndrome: clinical features and treatment outcomes. Br J Ophthalmol 91:1667–1670PubMedPubMedCentralCrossRef Swamy BN, McCluskey P, Nemet A et al (2007) Idiopathic orbital inflammatory syndrome: clinical features and treatment outcomes. Br J Ophthalmol 91:1667–1670PubMedPubMedCentralCrossRef
18.
go back to reference Akansel G, Hendrix L, Erickson BA et al (2005) MRI patterns in orbital malignant lymphoma and atypical lymphocytic infiltrates. Eur J Radiol 53:175–181PubMedCrossRef Akansel G, Hendrix L, Erickson BA et al (2005) MRI patterns in orbital malignant lymphoma and atypical lymphocytic infiltrates. Eur J Radiol 53:175–181PubMedCrossRef
19.
go back to reference Roshdy N, Shahin M, Kishk H et al (2010) MRI in diagnosis of orbital masses. Curr Eye Res 35:986–991PubMedCrossRef Roshdy N, Shahin M, Kishk H et al (2010) MRI in diagnosis of orbital masses. Curr Eye Res 35:986–991PubMedCrossRef
20.
go back to reference Kalogeropoulos D, Papoudou-Bai A, Kanavaros P, Kalogeropoulos C (2018) Ocular adnexal marginal zone lymphoma of mucosa-associated lymphoid tissue. Clin Exp Med 18:151–163PubMedCrossRef Kalogeropoulos D, Papoudou-Bai A, Kanavaros P, Kalogeropoulos C (2018) Ocular adnexal marginal zone lymphoma of mucosa-associated lymphoid tissue. Clin Exp Med 18:151–163PubMedCrossRef
21.
go back to reference Uehara F, Ohba N (2002) Diagnostic imaging in patients with orbital cellulitis and inflammatory pseudotumor. Int Ophthalmol Clin 42:133–142PubMedCrossRef Uehara F, Ohba N (2002) Diagnostic imaging in patients with orbital cellulitis and inflammatory pseudotumor. Int Ophthalmol Clin 42:133–142PubMedCrossRef
22.
go back to reference Gordon LK (2003) Diagnostic dilemmas in orbital inflammatory disease. Ocul Immunol Inflamm 11:3–15PubMedCrossRef Gordon LK (2003) Diagnostic dilemmas in orbital inflammatory disease. Ocul Immunol Inflamm 11:3–15PubMedCrossRef
23.
go back to reference Brannan P (2007) A review of sclerosing idiopathic orbital inflammation. Curr Opin Ophthalmol 5:402–404CrossRef Brannan P (2007) A review of sclerosing idiopathic orbital inflammation. Curr Opin Ophthalmol 5:402–404CrossRef
24.
go back to reference Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446PubMedPubMedCentralCrossRef Lambin P, Rios-Velazquez E, Leijenaar R et al (2012) Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer 48:441–446PubMedPubMedCentralCrossRef
25.
go back to reference Woolf DK, Ahmed M, Plowman PN (2012) Primary lymphoma of the ocular adnexa (orbital lymphoma) and primary intraocular lymphoma. Clin Oncol (R Coll Radiol) 24:339–344CrossRef Woolf DK, Ahmed M, Plowman PN (2012) Primary lymphoma of the ocular adnexa (orbital lymphoma) and primary intraocular lymphoma. Clin Oncol (R Coll Radiol) 24:339–344CrossRef
26.
go back to reference Decaudin D, de Cremoux P, Vincent-Salomon A, Dendale R, Rouic LL (2006) Ocular adnexal lymphoma: a review of clinicopathologic features and treatment options. Blood 108:1451–1460PubMedCrossRef Decaudin D, de Cremoux P, Vincent-Salomon A, Dendale R, Rouic LL (2006) Ocular adnexal lymphoma: a review of clinicopathologic features and treatment options. Blood 108:1451–1460PubMedCrossRef
27.
go back to reference Xian J, Zhang Z, Wang Z et al (2010) Value of MR imaging in the differentiation of benign and malignant orbital tumors in adults. Eur Radiol 20:1692–1702PubMedPubMedCentralCrossRef Xian J, Zhang Z, Wang Z et al (2010) Value of MR imaging in the differentiation of benign and malignant orbital tumors in adults. Eur Radiol 20:1692–1702PubMedPubMedCentralCrossRef
28.
go back to reference Ferreira TA, Saraiva P, Genders SW, Buchem MV, Luyten GPM, Beenakker JW (2018) CT and MR imaging of orbital inflammation. Neuroradiology 60:1253–1266PubMedPubMedCentralCrossRef Ferreira TA, Saraiva P, Genders SW, Buchem MV, Luyten GPM, Beenakker JW (2018) CT and MR imaging of orbital inflammation. Neuroradiology 60:1253–1266PubMedPubMedCentralCrossRef
29.
go back to reference Ben Simon GJ, Annunziata CC, Fink J, Villablanca P, McCann JD, Goldberg RA (2005) Rethinking orbital imaging establishing guidelines for interpreting orbital imaging studies and evaluating their predictive value in patients with orbital tumors. Ophthalmology 112:2196–2207PubMedCrossRef Ben Simon GJ, Annunziata CC, Fink J, Villablanca P, McCann JD, Goldberg RA (2005) Rethinking orbital imaging establishing guidelines for interpreting orbital imaging studies and evaluating their predictive value in patients with orbital tumors. Ophthalmology 112:2196–2207PubMedCrossRef
30.
go back to reference Haradome K, Haradome H, Usui Y et al (2014) Orbital lymphoproliferative disorders (OLPDs): value of MR imaging for differentiating orbital lymphoma from benign OPLDs. AJNR Am J Neuroradiol 35:1976–1982PubMedPubMedCentralCrossRef Haradome K, Haradome H, Usui Y et al (2014) Orbital lymphoproliferative disorders (OLPDs): value of MR imaging for differentiating orbital lymphoma from benign OPLDs. AJNR Am J Neuroradiol 35:1976–1982PubMedPubMedCentralCrossRef
31.
go back to reference Yuan Y, Chu G, Gong T et al (2021) To explore MR imaging radiomics for the differentiation of orbital lymphoma and IgG4-related ophthalmic disease. Biomed Res Int 2021:6668510PubMedPubMedCentralCrossRef Yuan Y, Chu G, Gong T et al (2021) To explore MR imaging radiomics for the differentiation of orbital lymphoma and IgG4-related ophthalmic disease. Biomed Res Int 2021:6668510PubMedPubMedCentralCrossRef
32.
go back to reference Xu XQ, Hu H, Liu H et al (2017) Benign and malignant orbital lymphoproliferative disorders: Differentiating using multiparametric MRI at 3.0T. J Magn Reson Imaging 45:167–176PubMedCrossRef Xu XQ, Hu H, Liu H et al (2017) Benign and malignant orbital lymphoproliferative disorders: Differentiating using multiparametric MRI at 3.0T. J Magn Reson Imaging 45:167–176PubMedCrossRef
33.
go back to reference Jiang H, Wang S, Li Z et al (2020) Improving diagnostic performance of differentiating ocular adnexal lymphoma and idiopathic orbital inflammation using intravoxel incoherent motion diffusion-weighted MRI. Eur J Radiol 130:109191PubMedCrossRef Jiang H, Wang S, Li Z et al (2020) Improving diagnostic performance of differentiating ocular adnexal lymphoma and idiopathic orbital inflammation using intravoxel incoherent motion diffusion-weighted MRI. Eur J Radiol 130:109191PubMedCrossRef
34.
go back to reference Guo J, Liu Z, Shen C et al (2018) MR-based radiomics signature in differentiating ocular adnexal lymphoma from idiopathic orbital inflammation. Eur Radiol 28:3872–3881PubMedCrossRef Guo J, Liu Z, Shen C et al (2018) MR-based radiomics signature in differentiating ocular adnexal lymphoma from idiopathic orbital inflammation. Eur Radiol 28:3872–3881PubMedCrossRef
35.
go back to reference Hou Y, Xie X, Chen J et al (2020) Bag-of-features-based radiomics for differentiation of ocular adnexal lymphoma and idiopathic orbital inflammation from contrast-enhanced MRI. Eur Radiol 31:24–33PubMedCrossRef Hou Y, Xie X, Chen J et al (2020) Bag-of-features-based radiomics for differentiation of ocular adnexal lymphoma and idiopathic orbital inflammation from contrast-enhanced MRI. Eur Radiol 31:24–33PubMedCrossRef
36.
go back to reference Klingenstein A, Garip-Kuebler A, Priglinger S, Hintschich C, Mueller-Lisse UG (2021) Morphologic cross-sectional imaging features of IgG4-related orbitopathy in comparison to ocular adnexal lymphoma. Clin Ophthalmol 15:1119–1127PubMedPubMedCentralCrossRef Klingenstein A, Garip-Kuebler A, Priglinger S, Hintschich C, Mueller-Lisse UG (2021) Morphologic cross-sectional imaging features of IgG4-related orbitopathy in comparison to ocular adnexal lymphoma. Clin Ophthalmol 15:1119–1127PubMedPubMedCentralCrossRef
38.
go back to reference Visvikis D, Cheze Le Rest C, Jaouen V, Hatt M (2019) Artificial intelligence, machine (deep) learning and radio(geno)mics: definitions and nuclear medicine imaging applications. Eur J Nucl Med Mol Imaging 46:2630–2637PubMedCrossRef Visvikis D, Cheze Le Rest C, Jaouen V, Hatt M (2019) Artificial intelligence, machine (deep) learning and radio(geno)mics: definitions and nuclear medicine imaging applications. Eur J Nucl Med Mol Imaging 46:2630–2637PubMedCrossRef
39.
go back to reference Duron L, Heraud A, Charbonneau F et al (2021) A magnetic resonance imaging radiomics signature to distinguish benign from malignant orbital lesions. Invest Radiol 56:173–180PubMedCrossRef Duron L, Heraud A, Charbonneau F et al (2021) A magnetic resonance imaging radiomics signature to distinguish benign from malignant orbital lesions. Invest Radiol 56:173–180PubMedCrossRef
40.
go back to reference Afshar P, Mohammadi A, Plataniotis KN, Oikonomou A, Benali H (2019) From handcrafted to deep-learning-based cancer radiomics: challenges and opportunities. IEEE Signal Process Mag 36:132–160CrossRef Afshar P, Mohammadi A, Plataniotis KN, Oikonomou A, Benali H (2019) From handcrafted to deep-learning-based cancer radiomics: challenges and opportunities. IEEE Signal Process Mag 36:132–160CrossRef
41.
go back to reference Zhou L, Zhang Z, Chen Y-C, Zhao Z-Y, Yin X-D, Jiang H-B (2019) A deep learning-based radiomics model for differentiating benign and malignant renal tumors. Transl Oncol 12:292–300PubMedCrossRef Zhou L, Zhang Z, Chen Y-C, Zhao Z-Y, Yin X-D, Jiang H-B (2019) A deep learning-based radiomics model for differentiating benign and malignant renal tumors. Transl Oncol 12:292–300PubMedCrossRef
42.
go back to reference Hosny A, Parmar C, Coroller TP et al (2018) Deep learning for lung cancer prognostication: a retrospective multi-cohort radiomics study. PLoS Med 15:e1002711PubMedPubMedCentralCrossRef Hosny A, Parmar C, Coroller TP et al (2018) Deep learning for lung cancer prognostication: a retrospective multi-cohort radiomics study. PLoS Med 15:e1002711PubMedPubMedCentralCrossRef
43.
go back to reference Sun H, Zeng X, Xu T, Peng G, Ma Y (2020) Computer-aided diagnosis in histopathological images of the endometrium using a convolutional neural network and attention mechanisms. IEEE J Biomed Health Inform 24:1664–1676PubMedCrossRef Sun H, Zeng X, Xu T, Peng G, Ma Y (2020) Computer-aided diagnosis in histopathological images of the endometrium using a convolutional neural network and attention mechanisms. IEEE J Biomed Health Inform 24:1664–1676PubMedCrossRef
44.
go back to reference Choi J-H, Lee J-S (2019) EmbraceNet: a robust deep learning architecture for multimodal classification. Inf Fusion 51:259–270CrossRef Choi J-H, Lee J-S (2019) EmbraceNet: a robust deep learning architecture for multimodal classification. Inf Fusion 51:259–270CrossRef
45.
go back to reference Sullivan TJ, Valenzuela AA (2006) Imaging features of ocular adnexal lymphoproliferative disease. Eye (Lond) 20:1189–1195CrossRef Sullivan TJ, Valenzuela AA (2006) Imaging features of ocular adnexal lymphoproliferative disease. Eye (Lond) 20:1189–1195CrossRef
46.
go back to reference Xu L, Wan Y, Luo C et al (2021) Integrating intratumoral and peritumoral features to predict tumor recurrence in intrahepatic cholangiocarcinoma. Phys Med Biol 66:125001CrossRef Xu L, Wan Y, Luo C et al (2021) Integrating intratumoral and peritumoral features to predict tumor recurrence in intrahepatic cholangiocarcinoma. Phys Med Biol 66:125001CrossRef
47.
go back to reference Hu Y, Xie C, Yang H et al (2020) Assessment of intratumoral and peritumoral computed tomography radiomics for predicting pathological complete response to neoadjuvant chemoradiation in patients with esophageal squamous cell carcinoma. JAMA Netw Open 3:e2015927PubMedPubMedCentralCrossRef Hu Y, Xie C, Yang H et al (2020) Assessment of intratumoral and peritumoral computed tomography radiomics for predicting pathological complete response to neoadjuvant chemoradiation in patients with esophageal squamous cell carcinoma. JAMA Netw Open 3:e2015927PubMedPubMedCentralCrossRef
48.
go back to reference Politi LS, Forghani R, Godi C et al (2010) Ocular Adnexal Lymphoma: Diffusion-weighted MR Imaging for Differential Diagnosis and Therapeutic Monitoring. Radiology 256:565–574PubMedCrossRef Politi LS, Forghani R, Godi C et al (2010) Ocular Adnexal Lymphoma: Diffusion-weighted MR Imaging for Differential Diagnosis and Therapeutic Monitoring. Radiology 256:565–574PubMedCrossRef
49.
go back to reference Hu H, Xu X-Q, Liu H, Hong X-N, Shi H-B, Wu F-Y (2017) Orbital benign and malignant lymphoproliferative disorders: differentiation using semi-quantitative and quantitative analysis of dynamic contrast-enhanced magnetic resonance imaging. Eur J Radiol 88:88–94PubMedCrossRef Hu H, Xu X-Q, Liu H, Hong X-N, Shi H-B, Wu F-Y (2017) Orbital benign and malignant lymphoproliferative disorders: differentiation using semi-quantitative and quantitative analysis of dynamic contrast-enhanced magnetic resonance imaging. Eur J Radiol 88:88–94PubMedCrossRef
Metadata
Title
A deep learning model combining multimodal radiomics, clinical and imaging features for differentiating ocular adnexal lymphoma from idiopathic orbital inflammation
Authors
Xiaoyang Xie
Lijuan Yang
Fengjun Zhao
Dong Wang
Hui Zhang
Xuelei He
Xin Cao
Huangjian Yi
Xiaowei He
Yuqing Hou
Publication date
08-06-2022
Publisher
Springer Berlin Heidelberg
Published in
European Radiology / Issue 10/2022
Print ISSN: 0938-7994
Electronic ISSN: 1432-1084
DOI
https://doi.org/10.1007/s00330-022-08857-6

Other articles of this Issue 10/2022

European Radiology 10/2022 Go to the issue