Skip to main content
Top
Published in: BMC Medical Informatics and Decision Making 1/2023

Open Access 01-12-2023 | Motor Evoked Potential | Research

Opportunities and challenges of supervised machine learning for the classification of motor evoked potentials according to muscles

Authors: Jonathan Wermelinger, Qendresa Parduzi, Murat Sariyar, Andreas Raabe, Ulf C. Schneider, Kathleen Seidel

Published in: BMC Medical Informatics and Decision Making | Issue 1/2023

Login to get access

Abstract

Background

Even for an experienced neurophysiologist, it is challenging to look at a single graph of an unlabeled motor evoked potential (MEP) and identify the corresponding muscle. We demonstrate that supervised machine learning (ML) can successfully perform this task.

Methods

Intraoperative MEP data from supratentorial surgery on 36 patients was included for the classification task with 4 muscles: Extensor digitorum (EXT), abductor pollicis brevis (APB), tibialis anterior (TA) and abductor hallucis (AH). Three different supervised ML classifiers (random forest (RF), k-nearest neighbors (kNN) and logistic regression (LogReg)) were trained and tested on either raw or compressed data. Patient data was classified considering either all 4 muscles simultaneously, 2 muscles within the same extremity (EXT versus APB), or 2 muscles from different extremities (EXT versus TA).

Results

In all cases, RF classifiers performed best and kNN second best. The highest performances were achieved on raw data (4 muscles 83%, EXT versus APB 89%, EXT versus TA 97% accuracy).

Conclusions

Standard ML methods show surprisingly high performance on a classification task with intraoperative MEP signals. This study illustrates the power and challenges of standard ML algorithms when handling intraoperative signals and may lead to intraoperative safety improvements.
Appendix
Available only for authorised users
Literature
1.
go back to reference Deletis V, Shils JL, Sala F, Seidel K. Neurophysiology in neurosurgery: a modern approach. 2020. Deletis V, Shils JL, Sala F, Seidel K. Neurophysiology in neurosurgery: a modern approach. 2020.
2.
go back to reference Kothbauer KF, Deletis V, Epstein FJ. Motor-evoked potential monitoring for intramedullary spinal cord tumor surgery: correlation of clinical and neurophysiological data in a series of 100 consecutive procedures. Neurosurg Focus. 1998;4(5):E3. Kothbauer KF, Deletis V, Epstein FJ. Motor-evoked potential monitoring for intramedullary spinal cord tumor surgery: correlation of clinical and neurophysiological data in a series of 100 consecutive procedures. Neurosurg Focus. 1998;4(5):E3.
3.
go back to reference Deletis V, Isgum V, Amassian VE. Neurophysiological mechanisms underlying motor evoked potentials in anesthetized humans: part 1. Recovery time of corticospinal tract direct waves elicited by pairs of transcranial electrical stimuli. Clin Neurophysiol. 2001;112:438–44.PubMed Deletis V, Isgum V, Amassian VE. Neurophysiological mechanisms underlying motor evoked potentials in anesthetized humans: part 1. Recovery time of corticospinal tract direct waves elicited by pairs of transcranial electrical stimuli. Clin Neurophysiol. 2001;112:438–44.PubMed
4.
go back to reference Deletis V, Rodi Z, Amassian VE. Neurophysiological mechanisms underlying motor evoked potentials in anesthetized humans: Part 2. Relationship between epidurally and muscle recorded MEPs in man. Clin Neurophysiol. 2001;112:445–52.PubMed Deletis V, Rodi Z, Amassian VE. Neurophysiological mechanisms underlying motor evoked potentials in anesthetized humans: Part 2. Relationship between epidurally and muscle recorded MEPs in man. Clin Neurophysiol. 2001;112:445–52.PubMed
5.
go back to reference Sala F, Kržan MJ, Deletis V. Intraoperative neurophysiological monitoring in pediatric neurosurgery: why, when, how? Childs Nerv Syst. 2002;18:264–87.PubMed Sala F, Kržan MJ, Deletis V. Intraoperative neurophysiological monitoring in pediatric neurosurgery: why, when, how? Childs Nerv Syst. 2002;18:264–87.PubMed
6.
go back to reference MacDonald DB. Intraoperative motor evoked potential monitoring: overview and update. J Clin Monit Comput. 2006;20:347–77.PubMed MacDonald DB. Intraoperative motor evoked potential monitoring: overview and update. J Clin Monit Comput. 2006;20:347–77.PubMed
7.
go back to reference Neuloh G, Pechstein U, Schramm J. Motor tract monitoring during insular glioma surgery. J Neurosurg. 2007;106(4):582–92.PubMed Neuloh G, Pechstein U, Schramm J. Motor tract monitoring during insular glioma surgery. J Neurosurg. 2007;106(4):582–92.PubMed
8.
go back to reference Seidel K, Beck J, Stieglitz L, Schucht P, Raabe A. The warning-sign hierarchy between quantitative subcortical motor mapping and continuous motor evoked potential monitoring during resection of supratentorial brain tumors. J Neurosurg. 2013;118(2):287–96.PubMed Seidel K, Beck J, Stieglitz L, Schucht P, Raabe A. The warning-sign hierarchy between quantitative subcortical motor mapping and continuous motor evoked potential monitoring during resection of supratentorial brain tumors. J Neurosurg. 2013;118(2):287–96.PubMed
9.
go back to reference Macdonald DB, Skinner S, Shils J, Yingling C. Intraoperative motor evoked potential monitoring - a position statement by the American Society of Neurophysiological Monitoring. Clin Neurophysiol. 2013;124:2291–316.PubMed Macdonald DB, Skinner S, Shils J, Yingling C. Intraoperative motor evoked potential monitoring - a position statement by the American Society of Neurophysiological Monitoring. Clin Neurophysiol. 2013;124:2291–316.PubMed
10.
go back to reference Asimakidou E, Abut PA, Raabe A, Seidel K. Motor Evoked potential warning criteria in supratentorial surgery: a scoping review. Cancers. 2021;13:2803.PubMedPubMedCentral Asimakidou E, Abut PA, Raabe A, Seidel K. Motor Evoked potential warning criteria in supratentorial surgery: a scoping review. Cancers. 2021;13:2803.PubMedPubMedCentral
11.
go back to reference Szelényi A, Fernández-Conejero I, Kodama K. Surgery and intraoperative neurophysiologic monitoring for aneurysm clipping. Handbook Clin Neurol. 2022;186:375–93 (Elsevier). Szelényi A, Fernández-Conejero I, Kodama K. Surgery and intraoperative neurophysiologic monitoring for aneurysm clipping. Handbook Clin Neurol. 2022;186:375–93 (Elsevier).
12.
go back to reference Yingling CD. Are there false-negative and false-positive motor-evoked potentials? J Clin Neurophysiol. 2011;28(6):607–10.PubMed Yingling CD. Are there false-negative and false-positive motor-evoked potentials? J Clin Neurophysiol. 2011;28(6):607–10.PubMed
13.
go back to reference Craik A, He Y, Contreras-Vidal JL. Deep learning for electroencephalogram (EEG) classification tasks: a review. J Neural Eng. 2019;16(3):031001.PubMed Craik A, He Y, Contreras-Vidal JL. Deep learning for electroencephalogram (EEG) classification tasks: a review. J Neural Eng. 2019;16(3):031001.PubMed
14.
go back to reference Ray J, Wijesekera L, Cirstea S. Machine learning and clinical neurophysiology. J Neurol. 2022;269:6678–84.PubMed Ray J, Wijesekera L, Cirstea S. Machine learning and clinical neurophysiology. J Neurol. 2022;269:6678–84.PubMed
15.
go back to reference Tannemaat MR, Kefalas M, Geraedts VJ, Remijn-Nelissen L, Verschuuren AJM, Koch M, et al. Distinguishing normal, neuropathic and myopathic EMG with an automated machine learning approach. Clin Neurophysiol. 2023;146:49–54.PubMed Tannemaat MR, Kefalas M, Geraedts VJ, Remijn-Nelissen L, Verschuuren AJM, Koch M, et al. Distinguishing normal, neuropathic and myopathic EMG with an automated machine learning approach. Clin Neurophysiol. 2023;146:49–54.PubMed
16.
go back to reference Park D, Kim I. Application of machine learning in the field of intraoperative neurophysiological monitoring: a narrative review. Appl Sci. 2022;12:7943. Park D, Kim I. Application of machine learning in the field of intraoperative neurophysiological monitoring: a narrative review. Appl Sci. 2022;12:7943.
17.
go back to reference Holze M, Rensch L, Prell J, Scheller C, Simmermacher S, Scheer M, et al. Learning from EMG: semi-automated grading of facial nerve function. J Clin Monit Comput. 2022;36:1509–17.PubMedPubMedCentral Holze M, Rensch L, Prell J, Scheller C, Simmermacher S, Scheer M, et al. Learning from EMG: semi-automated grading of facial nerve function. J Clin Monit Comput. 2022;36:1509–17.PubMedPubMedCentral
18.
go back to reference Jamaludin MR, Lai KW, Chuah JH, Zaki MA, Hasikin K, Abd Razak NA, et al. Machine learning application of transcranial motor-evoked potential to predict positive functional outcomes of patients. Comput Intell Neurosci. 2022;2022:1–13. Jamaludin MR, Lai KW, Chuah JH, Zaki MA, Hasikin K, Abd Razak NA, et al. Machine learning application of transcranial motor-evoked potential to predict positive functional outcomes of patients. Comput Intell Neurosci. 2022;2022:1–13.
19.
go back to reference Zha X, Wehbe L, Sclabassi RJ, Mace Z, Liang YV, Yu A, et al. A deep learning model for automated classification of intraoperative continuous emg. IEEE Transact Med Robot Bionics. 2020;3(1):44–52. Zha X, Wehbe L, Sclabassi RJ, Mace Z, Liang YV, Yu A, et al. A deep learning model for automated classification of intraoperative continuous emg. IEEE Transact Med Robot Bionics. 2020;3(1):44–52.
21.
go back to reference Géron A. Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow. 2022. Géron A. Hands-on machine learning with Scikit-Learn, Keras, and TensorFlow. 2022.
22.
go back to reference Farhangi F. Investigating the role of data preprocessing, hyperparameters tuning, and type of machine learning algorithm in the improvement of drowsy EEG signal modeling. Intell Syst Appl. 2022;15:200100. Farhangi F. Investigating the role of data preprocessing, hyperparameters tuning, and type of machine learning algorithm in the improvement of drowsy EEG signal modeling. Intell Syst Appl. 2022;15:200100.
23.
go back to reference Jesse CM, Alvarez Abut P, Wermelinger J, Raabe A, Schär RT, Seidel K. Functional outcome in spinal meningioma surgery and use of intraoperative neurophysiological monitoring. Cancers. 2022;14:3989.PubMedPubMedCentral Jesse CM, Alvarez Abut P, Wermelinger J, Raabe A, Schär RT, Seidel K. Functional outcome in spinal meningioma surgery and use of intraoperative neurophysiological monitoring. Cancers. 2022;14:3989.PubMedPubMedCentral
24.
go back to reference Van Rossum G, Drake FL. Python 3 Reference Manual. 2009. Van Rossum G, Drake FL. Python 3 Reference Manual. 2009.
25.
go back to reference Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine Learning in {P}ython. J Mach Learn Res. 2011;12:2825–30. Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine Learning in {P}ython. J Mach Learn Res. 2011;12:2825–30.
26.
go back to reference Ho TK. Random decision forests. In: Proceedings of 3rd international conference on document analysis and recognition. Montreal: IEEE; 1995. p. 278–82. Ho TK. Random decision forests. In: Proceedings of 3rd international conference on document analysis and recognition. Montreal: IEEE; 1995. p. 278–82.
27.
go back to reference Cover T, Hart P. Nearest neighbor pattern classification. IEEE Trans Inf Theory. 1967;13:21–7. Cover T, Hart P. Nearest neighbor pattern classification. IEEE Trans Inf Theory. 1967;13:21–7.
28.
go back to reference Berkson J. Why I prefer logits to probits. Biometrics. 1951;7(4):327–39. Berkson J. Why I prefer logits to probits. Biometrics. 1951;7(4):327–39.
29.
go back to reference Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57. Chawla NV, Bowyer KW, Hall LO, Kegelmeyer WP. SMOTE: synthetic minority over-sampling technique. J Artif Intell Res. 2002;16:321–57.
30.
go back to reference Velliangiri S, Alagumuthukrishnan S, Thankumar Joseph SI. A Review of Dimensionality Reduction Techniques for Efficient Computation. Procedia Computer Sci. 2019;165:104–11. Velliangiri S, Alagumuthukrishnan S, Thankumar Joseph SI. A Review of Dimensionality Reduction Techniques for Efficient Computation. Procedia Computer Sci. 2019;165:104–11.
31.
go back to reference Hasan BMS, Abdulazeez AM. A review of principal component analysis algorithm for dimensionality reduction. J Soft Comput Data Mining. 2021;2(1):20–30. Hasan BMS, Abdulazeez AM. A review of principal component analysis algorithm for dimensionality reduction. J Soft Comput Data Mining. 2021;2(1):20–30.
32.
go back to reference Gudivada V, Apon A, Ding J. Data quality considerations for big data and machine learning: going beyond data cleaning and transformations. Int J Adv Softw. 2017;10:1–20. Gudivada V, Apon A, Ding J. Data quality considerations for big data and machine learning: going beyond data cleaning and transformations. Int J Adv Softw. 2017;10:1–20.
33.
go back to reference Haixiang G, Yijing L, Shang J, Mingyun G, Yuanyue H, Bing G. Learning from class-imbalanced data: review of methods and applications. Expert Syst Appl. 2017;73:220–39. Haixiang G, Yijing L, Shang J, Mingyun G, Yuanyue H, Bing G. Learning from class-imbalanced data: review of methods and applications. Expert Syst Appl. 2017;73:220–39.
34.
go back to reference Domingos P. A unified bias-variance decomposition. In: Proceedings of the seventeenth international conference on machine learning. San Fransisco: Morgan Kaufmann; 2000. p. 231–38. Domingos P. A unified bias-variance decomposition. In: Proceedings of the seventeenth international conference on machine learning. San Fransisco: Morgan Kaufmann; 2000. p. 231–38.
35.
go back to reference Ying X. An overview of overfitting and its solutions. J Phys Conf Ser. 2019;1168:022022. Ying X. An overview of overfitting and its solutions. J Phys Conf Ser. 2019;1168:022022.
36.
go back to reference Sagi O, Rokach L. Ensemble learning: a survey. Wiley Interdiscip Rev. 2018;8:e1249. Sagi O, Rokach L. Ensemble learning: a survey. Wiley Interdiscip Rev. 2018;8:e1249.
37.
go back to reference He H, Garcia EA. Learning from Imbalanced Data. IEEE Trans Knowl Data Eng. 2009;21:1263–84. He H, Garcia EA. Learning from Imbalanced Data. IEEE Trans Knowl Data Eng. 2009;21:1263–84.
38.
go back to reference Sahare M, Gupta H. A review of multi-class classification for imbalanced data. Int J Adv Comput Res. 2012;2:160. Sahare M, Gupta H. A review of multi-class classification for imbalanced data. Int J Adv Comput Res. 2012;2:160.
39.
go back to reference Khalid S, Khalil T, Nasreen S. A survey of feature selection and feature extraction techniques in machine learning. Sci Inform Conference. 2014;2014:372–8. Khalid S, Khalil T, Nasreen S. A survey of feature selection and feature extraction techniques in machine learning. Sci Inform Conference. 2014;2014:372–8.
40.
go back to reference Modi HN, Suh S-W, Yang J-H, Yoon J-Y. False-negative transcranial motor-evoked potentials during scoliosis surgery causing paralysis: a case report with literature review. Spine. 2009;34(24):E896–900.PubMed Modi HN, Suh S-W, Yang J-H, Yoon J-Y. False-negative transcranial motor-evoked potentials during scoliosis surgery causing paralysis: a case report with literature review. Spine. 2009;34(24):E896–900.PubMed
41.
go back to reference Chen JX. The evolution of computing: AlphaGo. Comput Sci Eng. 2016;18(4):4–7. Chen JX. The evolution of computing: AlphaGo. Comput Sci Eng. 2016;18(4):4–7.
42.
go back to reference Silver D, Hubert T, Schrittwieser J, Antonoglou I, Lai M, Guez A, et al. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science. 2018;362(6419):1140–4.PubMed Silver D, Hubert T, Schrittwieser J, Antonoglou I, Lai M, Guez A, et al. A general reinforcement learning algorithm that masters chess, shogi, and Go through self-play. Science. 2018;362(6419):1140–4.PubMed
44.
go back to reference Zbinden C, Strickler M, Sariyar M, Bürkle T, Seidel K. Digitizing Data Management for Intraoperative Neuromonitoring. Stud Health Technol Informatics. 2021;278:211–6. Zbinden C, Strickler M, Sariyar M, Bürkle T, Seidel K. Digitizing Data Management for Intraoperative Neuromonitoring. Stud Health Technol Informatics. 2021;278:211–6.
45.
go back to reference Halevy A, Norvig P, Pereira F. The unreasonable effectiveness of data. IEEE Intell Syst. 2009;24(2):8–12. Halevy A, Norvig P, Pereira F. The unreasonable effectiveness of data. IEEE Intell Syst. 2009;24(2):8–12.
46.
go back to reference Gosiewska A, Kozak A, Biecek P. Simpler is better: Lifting interpretability-performance trade-off via automated feature engineering. Decis Support Syst. 2021;150:113556. Gosiewska A, Kozak A, Biecek P. Simpler is better: Lifting interpretability-performance trade-off via automated feature engineering. Decis Support Syst. 2021;150:113556.
47.
go back to reference Norori N, Hu Q, Aellen FM, Faraci FD, Tzovara A. Addressing bias in big data and AI for health care: a call for open science. Patterns. 2021;2(10): 100347.PubMedPubMedCentral Norori N, Hu Q, Aellen FM, Faraci FD, Tzovara A. Addressing bias in big data and AI for health care: a call for open science. Patterns. 2021;2(10): 100347.PubMedPubMedCentral
Metadata
Title
Opportunities and challenges of supervised machine learning for the classification of motor evoked potentials according to muscles
Authors
Jonathan Wermelinger
Qendresa Parduzi
Murat Sariyar
Andreas Raabe
Ulf C. Schneider
Kathleen Seidel
Publication date
01-12-2023
Publisher
BioMed Central
Published in
BMC Medical Informatics and Decision Making / Issue 1/2023
Electronic ISSN: 1472-6947
DOI
https://doi.org/10.1186/s12911-023-02276-3

Other articles of this Issue 1/2023

BMC Medical Informatics and Decision Making 1/2023 Go to the issue