Skip to main content
Top

17-06-2024 | COVID-19

Removing Adversarial Noise in X-ray Images via Total Variation Minimization and Patch-Based Regularization for Robust Deep Learning-based Diagnosis

Authors: Burhan Ul Haque Sheikh, Aasim Zafar

Published in: Journal of Imaging Informatics in Medicine

Login to get access

Abstract

Deep learning has significantly advanced the field of radiology-based disease diagnosis, offering enhanced accuracy and efficiency in detecting various medical conditions through the analysis of complex medical images such as X-rays. This technology’s ability to discern subtle patterns and anomalies has proven invaluable for swift and accurate disease identification. The relevance of deep learning in radiology has been particularly highlighted during the COVID-19 pandemic, where rapid and accurate diagnosis is crucial for effective treatment and containment. However, recent research has uncovered vulnerabilities in deep learning models when exposed to adversarial attacks, leading to incorrect predictions. In response to this critical challenge, we introduce a novel approach that leverages total variation minimization to combat adversarial noise within X-ray images effectively. Our focus narrows to COVID-19 diagnosis as a case study, where we initially construct a classification model through transfer learning designed to accurately classify lung X-ray images encompassing no pneumonia, COVID-19 pneumonia, and non-COVID pneumonia cases. Subsequently, we extensively evaluated the model’s susceptibility to targeted and un-targeted adversarial attacks by employing the fast gradient sign gradient (FGSM) method. Our findings reveal a substantial reduction in the model’s performance, with the average accuracy plummeting from 95.56 to 19.83% under adversarial conditions. However, the experimental results demonstrate the exceptional efficacy of the proposed denoising approach in enhancing the performance of diagnosis models when applied to adversarial examples. Post-denoising, the model exhibits a remarkable accuracy improvement, surging from 19.83 to 88.23% on adversarial images. These promising outcomes underscore the potential of denoising techniques to fortify the resilience and reliability of AI-based COVID-19 diagnostic systems, laying the foundation for their successful deployment in clinical settings.
Literature
1.
go back to reference West, C. P., Montori, V. M. & Sampathkumar, P. Covid-19 testing: the threat of false-negative results. Mayo Clin. Proceeding (2020). West, C. P., Montori, V. M. & Sampathkumar, P. Covid-19 testing: the threat of false-negative results. Mayo Clin. Proceeding (2020).
2.
go back to reference Fang Y, Zhang H, Xie J, Lin M, Ying L, Pang P, Ji W. Sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology 2020:200432. Fang Y, Zhang H, Xie J, Lin M, Ying L, Pang P, Ji W. Sensitivity of chest CT for COVID-19: comparison to RT-PCR. Radiology 2020:200432.
3.
go back to reference Li Y, Yao L, Li J, Chen L, Song Y, Cai Z, Yang C. Stability issues of RT-PCR testing of SARS-CoV-2 for hospitalized patients clinically diagnosed with COVID-19. Journal of Medical Virology. 2020. Li Y, Yao L, Li J, Chen L, Song Y, Cai Z, Yang C. Stability issues of RT-PCR testing of SARS-CoV-2 for hospitalized patients clinically diagnosed with COVID-19. Journal of Medical Virology. 2020.
4.
go back to reference Li D, Wang D, Dong J, Wang N, Huang H, Xu H, Xia C. False-negative results of real-time reverse-transcriptase polymerase chain reaction for severe acute respiratory syndrome coronavirus 2: role of deep-learning-based CT diagnosis and insights from two cases. Korean J Radiol 2020;21(4):505–8.CrossRefPubMedPubMedCentral Li D, Wang D, Dong J, Wang N, Huang H, Xu H, Xia C. False-negative results of real-time reverse-transcriptase polymerase chain reaction for severe acute respiratory syndrome coronavirus 2: role of deep-learning-based CT diagnosis and insights from two cases. Korean J Radiol 2020;21(4):505–8.CrossRefPubMedPubMedCentral
5.
go back to reference Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, Xia L. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology 2020:200642. Ai T, Yang Z, Hou H, Zhan C, Chen C, Lv W, Xia L. Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology 2020:200642.
6.
go back to reference Sheridan C. Fast, portable tests come online to curb coronavirus pandemic. Nat Biotechnol. 2020. Sheridan C. Fast, portable tests come online to curb coronavirus pandemic. Nat Biotechnol. 2020.
7.
go back to reference Abdel-Zaher AM, Eldeib AM (2016) Breast cancer classification using deep belief networks. ExpertSyst Appl 46:139–144.CrossRef Abdel-Zaher AM, Eldeib AM (2016) Breast cancer classification using deep belief networks. ExpertSyst Appl 46:139–144.CrossRef
8.
go back to reference Sun W, Tseng TB, Zhang J, Qian W (2017) Computerized medical imaging and graphics enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data. ComputMed Imaging Graph 57:4–9.CrossRef Sun W, Tseng TB, Zhang J, Qian W (2017) Computerized medical imaging and graphics enhancing deep convolutional neural network scheme for breast cancer diagnosis with unlabeled data. ComputMed Imaging Graph 57:4–9.CrossRef
9.
go back to reference D. C. Cires¸an, A. Giusti, L. M. Gambardella, and J. Schmidhuber, “Mitosis detection in breast cancer histology images with deep neural networks,” in International conference on medical image computing and computer-assisted intervention, 2013, pp. 411–418. D. C. Cires¸an, A. Giusti, L. M. Gambardella, and J. Schmidhuber, “Mitosis detection in breast cancer histology images with deep neural networks,” in International conference on medical image computing and computer-assisted intervention, 2013, pp. 411–418.
10.
go back to reference Liu S, Liu S, Cai W, et al. Early diagnosis of Alzheimer’s disease with deep learning. In: International symposium on biomedical imaging, Beijing, China 2014, 1015–18. Liu S, Liu S, Cai W, et al. Early diagnosis of Alzheimer’s disease with deep learning. In: International symposium on biomedical imaging, Beijing, China 2014, 1015–18.
11.
go back to reference Brosch T, Tam R. Manifold learning of brain MRIs by deep learning. Med Image Comput Comput Assist Interv 2013;16:633–40PubMed Brosch T, Tam R. Manifold learning of brain MRIs by deep learning. Med Image Comput Comput Assist Interv 2013;16:633–40PubMed
12.
go back to reference Majumdar A, Singhal V (2017) Noisy deep dictionary learning: application to Alzheimer’s disease classification. In: Neural networks (IJCNN), 2017 international joint conference on. IEEE, pp 2679–2683] Majumdar A, Singhal V (2017) Noisy deep dictionary learning: application to Alzheimer’s disease classification. In: Neural networks (IJCNN), 2017 international joint conference on. IEEE, pp 2679–2683]
13.
go back to reference R. Li, W. Zhang, H. I. Suk, L. Wang, J. Li, D. Shen, and S. Ji, “Deep learning based imaging data completion for improved brain disease diagnosis,” Med Image Comput Comput Assist Interv, vol. 17, no. Pt 3, pp. 305–312, 2014.PubMedPubMedCentral R. Li, W. Zhang, H. I. Suk, L. Wang, J. Li, D. Shen, and S. Ji, “Deep learning based imaging data completion for improved brain disease diagnosis,” Med Image Comput Comput Assist Interv, vol. 17, no. Pt 3, pp. 305–312, 2014.PubMedPubMedCentral
14.
go back to reference Jin B, Che C, Liu Z, Zhang S, Yin X, Wei X (2018) Predicting the risk of heart failure with EHR sequential data modeling. IEEE Access 6:9256–9261.CrossRef Jin B, Che C, Liu Z, Zhang S, Yin X, Wei X (2018) Predicting the risk of heart failure with EHR sequential data modeling. IEEE Access 6:9256–9261.CrossRef
17.
go back to reference Horry, M. J., Chakraborty, S., Paul, M., Ulhaq, A., Pradhan, B., Saha, M., & Shukla, N. (2020). COVID-19 detection through transfer learning using multimodal imaging data. Ieee Access, 8, 149808-149824.CrossRefPubMed Horry, M. J., Chakraborty, S., Paul, M., Ulhaq, A., Pradhan, B., Saha, M., & Shukla, N. (2020). COVID-19 detection through transfer learning using multimodal imaging data. Ieee Access, 8, 149808-149824.CrossRefPubMed
18.
go back to reference Apostolopoulos, I. D., & Mpesiana, T. A. (2020). Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Physical and engineering sciences in medicine, 43(2), 635-640.CrossRefPubMedPubMedCentral Apostolopoulos, I. D., & Mpesiana, T. A. (2020). Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Physical and engineering sciences in medicine, 43(2), 635-640.CrossRefPubMedPubMedCentral
19.
go back to reference Wang, L., Lin, Z. Q., & Wong, A. (2020). Covid-net: a tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images. Scientific Reports, 10(1), 1-12. Wang, L., Lin, Z. Q., & Wong, A. (2020). Covid-net: a tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images. Scientific Reports, 10(1), 1-12.
20.
go back to reference Zhang, X., Lu, S., Wang, S. H., Yu, X., Wang, S. J., Yao, L., & Zhang, Y. D. (2022). Diagnosis of COVID-19 pneumonia via a novel deep learning architecture. Journal of computer science and technology, 37(2), 330–343. Zhang, X., Lu, S., Wang, S. H., Yu, X., Wang, S. J., Yao, L., & Zhang, Y. D. (2022). Diagnosis of COVID-19 pneumonia via a novel deep learning architecture. Journal of computer science and technology, 37(2), 330–343.
21.
go back to reference Göreke, V., Sarı, V., & Kockanat, S. (2021). A novel classifier architecture based on deep neural network for COVID-19 detection using laboratory findings. Applied Soft Computing, 106, 107329.CrossRefPubMedPubMedCentral Göreke, V., Sarı, V., & Kockanat, S. (2021). A novel classifier architecture based on deep neural network for COVID-19 detection using laboratory findings. Applied Soft Computing, 106, 107329.CrossRefPubMedPubMedCentral
25.
go back to reference S. B. Ul Haque, A. Zafar and K. Roshan, "Security Vulnerability in Face Mask Monitoring System," 2023 10th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 2023, pp. 231-237 S. B. Ul Haque, A. Zafar and K. Roshan, "Security Vulnerability in Face Mask Monitoring System," 2023 10th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 2023, pp. 231-237
26.
go back to reference K. Roshan, A. Zafar and S. B. Ul Haque, "A Novel Deep Learning based Model to Defend Network Intrusion Detection System against Adversarial Attacks," 2023 10th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 2023, pp. 386-391 K. Roshan, A. Zafar and S. B. Ul Haque, "A Novel Deep Learning based Model to Defend Network Intrusion Detection System against Adversarial Attacks," 2023 10th International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, India, 2023, pp. 386-391
28.
go back to reference He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778). He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 770–778).
29.
30.
go back to reference Tramer, F., & Boneh, D. (2019). Adversarial training and robustness for multiple perturbations. Advances in neural information processing systems, 32. Tramer, F., & Boneh, D. (2019). Adversarial training and robustness for multiple perturbations. Advances in neural information processing systems, 32.
31.
34.
go back to reference Meng, Y., Bridge, J., Addison, C., Wang, M., Merritt, C., Franks, S., Mackey, M., Messenger, S., Sun, R., Fitzmaurice, T., McCann, C., Li, Q., Zhao, Y., & Zheng, Y. (2023). Bilateral adaptive graph convolutional network on CT based Covid-19 diagnosis with uncertainty-aware consensus-assisted multiple instance learning. Medical Image Analysis, 84, 102722. https://doi.org/10.1016/j.media.2022.102722. Meng, Y., Bridge, J., Addison, C., Wang, M., Merritt, C., Franks, S., Mackey, M., Messenger, S., Sun, R., Fitzmaurice, T., McCann, C., Li, Q., Zhao, Y., & Zheng, Y. (2023). Bilateral adaptive graph convolutional network on CT based Covid-19 diagnosis with uncertainty-aware consensus-assisted multiple instance learning. Medical Image Analysis, 84, 102722. https://​doi.​org/​10.​1016/​j.​media.​2022.​102722.
35.
go back to reference Gao, K., Su, J., Jiang, Z., Zeng, L. L., Feng, Z., Shen, H., Rong, P., Xu, X., Qin, J., Yang, Y., Wang, W., & Hu, D. (2021, January). Dual-branch combination network (DCN): towards accurate diagnosis and lesion segmentation of COVID-19 using CT images. Medical Image Analysis, 67, 101836. https://doi.org/10.1016/j.media.2020.101836 Gao, K., Su, J., Jiang, Z., Zeng, L. L., Feng, Z., Shen, H., Rong, P., Xu, X., Qin, J., Yang, Y., Wang, W., & Hu, D. (2021, January). Dual-branch combination network (DCN): towards accurate diagnosis and lesion segmentation of COVID-19 using CT images. Medical Image Analysis, 67, 101836. https://​doi.​org/​10.​1016/​j.​media.​2020.​101836
41.
go back to reference H. Hirano, K. Koga, K. Takemoto, Vulnerability of deep neural networks for detecting COVID-19 cases from chest X-ray images to universal adversarial attacks, PLoS One 15 (12) (2020). H. Hirano, K. Koga, K. Takemoto, Vulnerability of deep neural networks for detecting COVID-19 cases from chest X-ray images to universal adversarial attacks, PLoS One 15 (12) (2020).
42.
go back to reference Pal, B., Gupta, D., Rashed-Al-Mahfuz, M., Alyami, S. A., & Moni, M. A. (2021). Vulnerability in deep transfer learning models to adversarial fast gradient sign attack for covid-19 prediction from chest radiography images. Applied Sciences, 11(9), 4233.CrossRef Pal, B., Gupta, D., Rashed-Al-Mahfuz, M., Alyami, S. A., & Moni, M. A. (2021). Vulnerability in deep transfer learning models to adversarial fast gradient sign attack for covid-19 prediction from chest radiography images. Applied Sciences, 11(9), 4233.CrossRef
44.
go back to reference Gongye, C., Li, H., Zhang, X., Sabbagh, M., Yuan, G., Lin, X., & Fei, Y. (2020). New passive and active attacks on deep neural networks in medical applications. In Proceedings of the 39th international conference on computer-aided design (pp. 1–9). Gongye, C., Li, H., Zhang, X., Sabbagh, M., Yuan, G., Lin, X., & Fei, Y. (2020). New passive and active attacks on deep neural networks in medical applications. In Proceedings of the 39th international conference on computer-aided design (pp. 1–9).
45.
go back to reference Gougeh, R. A. (2021). How adversarial attacks affect deep neural networks detecting COVID-19?., Gougeh, R. A. (2021). How adversarial attacks affect deep neural networks detecting COVID-19?.,
47.
go back to reference Yapıcı, M. M., Tekerek, A., & Topaloğlu, N. (2019, October). Performance comparison of convolutional neural network models on GPU. In 2019 IEEE 13th International Conference on Application of Information and Communication Technologies (AICT) (pp. 1–4). IEEE. Yapıcı, M. M., Tekerek, A., & Topaloğlu, N. (2019, October). Performance comparison of convolutional neural network models on GPU. In 2019 IEEE 13th International Conference on Application of Information and Communication Technologies (AICT) (pp. 1–4). IEEE.
48.
go back to reference Deng, J., Dong, W., Socher, R., Li, L. J., Li, K., & Fei-Fei, L. (2009, June). Imagenet: a large-scale hierarchical image database]. In 2009 IEEE conference on computer vision and pattern recognition (pp. 248–255). Ieee. Deng, J., Dong, W., Socher, R., Li, L. J., Li, K., & Fei-Fei, L. (2009, June). Imagenet: a large-scale hierarchical image database]. In 2009 IEEE conference on computer vision and pattern recognition (pp. 248–255). Ieee.
50.
go back to reference Carlini, N., & Wagner, D. (2017, May). Towards evaluating the robustness of neural networks. In 2017 IEEE symposium on security and privacy (sp) (pp. 39–57). Ieee. Carlini, N., & Wagner, D. (2017, May). Towards evaluating the robustness of neural networks. In 2017 IEEE symposium on security and privacy (sp) (pp. 39–57). Ieee.
51.
Metadata
Title
Removing Adversarial Noise in X-ray Images via Total Variation Minimization and Patch-Based Regularization for Robust Deep Learning-based Diagnosis
Authors
Burhan Ul Haque Sheikh
Aasim Zafar
Publication date
17-06-2024
Publisher
Springer International Publishing
Published in
Journal of Imaging Informatics in Medicine
Print ISSN: 2948-2925
Electronic ISSN: 2948-2933
DOI
https://doi.org/10.1007/s10278-023-00919-5