Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Evoked Potential | Research

The classification of flash visual evoked potential based on deep learning

Authors: Na Liang, Chengliang Wang, Shiying Li, Xin Xie, Jun Lin, Wen Zhong

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Visual electrophysiology is an objective visual function examination widely used in clinical work and medical identification that can objectively evaluate visual function and locate lesions according to waveform changes. However, in visual electrophysiological examinations, the flash visual evoked potential (FVEP) varies greatly among individuals, resulting in different waveforms in different normal subjects. Moreover, most of the FVEP wave labelling is performed automatically by a machine, and manually corrected by professional clinical technicians. These labels may have biases due to the individual variations in subjects, incomplete clinical examination data, different professional skills, personal habits and other factors. Through the retrospective study of big data, an artificial intelligence algorithm is used to maintain high generalization abilities in complex situations and improve the accuracy of prescreening.

Methods

A novel multi-input neural network based on convolution and confidence branching (MCAC-Net) for retinitis pigmentosa RP recognition and out-of-distribution detection is proposed. The MCAC-Net with global and local feature extraction is designed for the FVEP signal that has different local and global information, and a confidence branch is added for out-of-distribution sample detection. For the proposed manual features,a new input layer is added.

Results

The model is verified by a clinically collected FVEP dataset, and an accuracy of 90.7% is achieved in the classification task and 93.3% in the out-of-distribution detection task.

Conclusion

We built a deep learning-based FVEP classification algorithm that promises to be an excellent tool for screening RP diseases by using FVEP signals.
Literature
1.
go back to reference Zhang M, Ouyang W, Wang H, Meng X, Li S, Yin ZQ. Quantitative assessment of visual pathway function in blind retinitis pigmentosa patients. Clin Neurophysiol. 2021;132(2):392–403.CrossRef Zhang M, Ouyang W, Wang H, Meng X, Li S, Yin ZQ. Quantitative assessment of visual pathway function in blind retinitis pigmentosa patients. Clin Neurophysiol. 2021;132(2):392–403.CrossRef
2.
go back to reference Kentaro K, Katsuhiro H, Yoshihiro H. Clinical and genetic findings of a Japanese patient with RP1-related autosomal recessive retinitis pigmentosa. Doc Ophthalmol. 2018;137:47.CrossRef Kentaro K, Katsuhiro H, Yoshihiro H. Clinical and genetic findings of a Japanese patient with RP1-related autosomal recessive retinitis pigmentosa. Doc Ophthalmol. 2018;137:47.CrossRef
3.
go back to reference Wyatt-McElvain KE, Arruda JE, Rainey VR. Reliability of the flash visual evoked potential P2: double-stimulation study. Appl Psychophysiol Biofeedback. 2018;43(2):153–9.CrossRef Wyatt-McElvain KE, Arruda JE, Rainey VR. Reliability of the flash visual evoked potential P2: double-stimulation study. Appl Psychophysiol Biofeedback. 2018;43(2):153–9.CrossRef
4.
go back to reference Qiao N, Song M, Ye Z, He W, Ma Z, Wang Y, Zhang Y, Shou X. Deep learning for automatically visual evoked potential classification during surgical decompression of sellar region tumors. Transl Vis Sci Technol. 2019;8(6):21–21.CrossRef Qiao N, Song M, Ye Z, He W, Ma Z, Wang Y, Zhang Y, Shou X. Deep learning for automatically visual evoked potential classification during surgical decompression of sellar region tumors. Transl Vis Sci Technol. 2019;8(6):21–21.CrossRef
5.
go back to reference Acharya JN, Hani AJ, Cheek J, Thirumala P, Tsuchida TN. American clinical neurophysiology society guideline 2: guidelines for standard electrode position nomenclature. Neurodiagnostic J. 2016;56(4):245–52.CrossRef Acharya JN, Hani AJ, Cheek J, Thirumala P, Tsuchida TN. American clinical neurophysiology society guideline 2: guidelines for standard electrode position nomenclature. Neurodiagnostic J. 2016;56(4):245–52.CrossRef
6.
go back to reference McCulloch DL, Marmor MF, Brigell MG, Hamilton R, Holder GE, Tzekov R, Bach M. ISCEV Standard for full-field clinical electroretinography (2015 update). Doc Ophthalmol. 2015;130(1):1–12.CrossRef McCulloch DL, Marmor MF, Brigell MG, Hamilton R, Holder GE, Tzekov R, Bach M. ISCEV Standard for full-field clinical electroretinography (2015 update). Doc Ophthalmol. 2015;130(1):1–12.CrossRef
7.
go back to reference Kim HM, Ko T, Choi IY, Myong J-P. Asbestosis diagnosis algorithm combining the lung segmentation method and deep learning model in computed tomography image. Int J Med Inform. 2022;158: 104667.CrossRef Kim HM, Ko T, Choi IY, Myong J-P. Asbestosis diagnosis algorithm combining the lung segmentation method and deep learning model in computed tomography image. Int J Med Inform. 2022;158: 104667.CrossRef
8.
go back to reference Kuo K-M, Talley PC, Chang C-S. The accuracy of machine learning approaches using non-image data for the prediction of COVID-19: A meta-analysis. Int J Med Inform 2022;104791 Kuo K-M, Talley PC, Chang C-S. The accuracy of machine learning approaches using non-image data for the prediction of COVID-19: A meta-analysis. Int J Med Inform 2022;104791
9.
go back to reference Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 2921–29. Zhou B, Khosla A, Lapedriza A, Oliva A, Torralba A. Learning deep features for discriminative localization. In: Proceedings of the IEEE conference on computer vision and pattern recognition; 2016. p. 2921–29.
10.
go back to reference Waytowich N, Lawhern VJ, Garcia JO, Cummings J, Faller J, Sajda P, Vettel JM. Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials. J Neural Eng. 2018;15(6): 066031.CrossRef Waytowich N, Lawhern VJ, Garcia JO, Cummings J, Faller J, Sajda P, Vettel JM. Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials. J Neural Eng. 2018;15(6): 066031.CrossRef
11.
go back to reference Parthiban N, Sudha N. Improving performance through novel enhanced hierarchial attention neural network. Technical report, EasyChair; 2020. Parthiban N, Sudha N. Improving performance through novel enhanced hierarchial attention neural network. Technical report, EasyChair; 2020.
12.
go back to reference Er MB. A novel approach for classification of speech emotions based on deep and acoustic features. IEEE Access. 2020;8:221640–53.CrossRef Er MB. A novel approach for classification of speech emotions based on deep and acoustic features. IEEE Access. 2020;8:221640–53.CrossRef
13.
go back to reference Er MB, Aydilek IB. Music emotion recognition by using chroma spectrogram and deep visual features. Int J Comput Intell Syst. 2019;12(2):1622–34.CrossRef Er MB, Aydilek IB. Music emotion recognition by using chroma spectrogram and deep visual features. Int J Comput Intell Syst. 2019;12(2):1622–34.CrossRef
14.
go back to reference Barandas M, Folgado D, Fernandes L, Santos S, Abreu M, Bota P, Liu H, Schultz T, Gamboa H. Tsfel: Time series feature extraction library. SoftwareX. 2020;11: 100456.CrossRef Barandas M, Folgado D, Fernandes L, Santos S, Abreu M, Bota P, Liu H, Schultz T, Gamboa H. Tsfel: Time series feature extraction library. SoftwareX. 2020;11: 100456.CrossRef
15.
go back to reference Brigham EO. The fast Fourier transform and its applications. Upper Saddle River: Prentice-Hall Inc; 1988. Brigham EO. The fast Fourier transform and its applications. Upper Saddle River: Prentice-Hall Inc; 1988.
16.
17.
go back to reference Varshavsky R, Gottlieb A, Linial M, Horn D. Novel unsupervised feature filtering of biological data. Bioinformatics. 2006;22(14):507–13.CrossRef Varshavsky R, Gottlieb A, Linial M, Horn D. Novel unsupervised feature filtering of biological data. Bioinformatics. 2006;22(14):507–13.CrossRef
18.
go back to reference Benesty J, Chen J, Huang Y, Cohen I. Pearson correlation coefficient. In: Noise reduction in speech processing. Berlin: Springer;2009. p. 1–4. Benesty J, Chen J, Huang Y, Cohen I. Pearson correlation coefficient. In: Noise reduction in speech processing. Berlin: Springer;2009. p. 1–4.
19.
go back to reference Lara-Benítez P, Carranza-García M, Riquelme JC. An experimental review on deep learning architectures for time series forecasting. Int J Neural Syst. 2021;31(03):2130001.CrossRef Lara-Benítez P, Carranza-García M, Riquelme JC. An experimental review on deep learning architectures for time series forecasting. Int J Neural Syst. 2021;31(03):2130001.CrossRef
20.
go back to reference Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015; p. 3431–40. Long J, Shelhamer E, Darrell T. Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2015; p. 3431–40.
21.
go back to reference He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016; p. 770–8. He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 2016; p. 770–8.
22.
go back to reference Karim F, Majumdar S, Darabi H, Chen S. LSTM fully convolutional networks for time series classification. IEEE Access. 2017;6:1662–9.CrossRef Karim F, Majumdar S, Darabi H, Chen S. LSTM fully convolutional networks for time series classification. IEEE Access. 2017;6:1662–9.CrossRef
23.
go back to reference Breunig MM, Kriegel H-P, Ng RT, Sander J. LOF: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD international conference on management of data, 2000; p. 93–104. Breunig MM, Kriegel H-P, Ng RT, Sander J. LOF: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD international conference on management of data, 2000; p. 93–104.
24.
go back to reference Li K-L, Huang H-K, Tian S-F, Xu W. Improving one-class svm for anomaly detection. In: Proceedings of the 2003 international conference on machine learning and cybernetics (IEEE Cat. No. 03EX693), vol. 5. IEEE; 2003. p. 3077–81. Li K-L, Huang H-K, Tian S-F, Xu W. Improving one-class svm for anomaly detection. In: Proceedings of the 2003 international conference on machine learning and cybernetics (IEEE Cat. No. 03EX693), vol. 5. IEEE; 2003. p. 3077–81.
25.
go back to reference Hubert M, Debruyne M. Minimum covariance determinant. Wiley Interdiscip Rev Comput Stat. 2010;2(1):36–43.CrossRef Hubert M, Debruyne M. Minimum covariance determinant. Wiley Interdiscip Rev Comput Stat. 2010;2(1):36–43.CrossRef
Metadata
Title
The classification of flash visual evoked potential based on deep learning
Authors
Na Liang
Chengliang Wang
Shiying Li
Xin Xie
Jun Lin
Wen Zhong
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02107-5

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue