Skip to main content
Top

04-04-2024

Machine learning based analysis and detection of trend outliers for electromyographic neuromuscular monitoring

Authors: Michaël Verdonck, Hugo Carvalho, Thomas Fuchs-Buder, Sorin J. Brull, Jan Poelaert

Published in: Journal of Clinical Monitoring and Computing

Login to get access

Abstract

Purpose

Neuromuscular monitoring is frequently plagued by artefacts, which along with the frequent unawareness of the principles of this subtype of monitoring by many clinicians, tends to lead to a cynical attitute by clinicians towards these monitors. As such, the present study aims to derive a feature set and evaluate its discriminative performance for the purpose of Train-of-Four Ratio (TOF-R) outlier analysis during continuous intraoperative EMG-based neuromuscular monitoring.

Methods

Patient data was sourced from two devices: (1) Datex-Ohmeda Electromyography (EMG) E-NMT: a dataset derived from a prospective observational trial including 136 patients (21,891 TOF-R observations), further subdivided in two based on the type of features included; and (2) TetraGraph: a clinical case repository dataset of 388 patients (97,838 TOF-R observations). The two datasets were combined to create a synthetic set, which included shared features across the two. This process led to the training of four distinct models.

Results

The models showed an adequate bias/variance balance, suggesting no overfitting or underfitting. Models 1 and 2 consistently outperformed the others, with the former achieving an F1 score of 0.41 (0.31, 0.50) and an average precision score (95% CI) of 0.48 (0.35, 0.60). A random forest model analysis indicated that engineered TOF-R features were proportionally more influential in model performance than basic features.

Conclusions

Engineered TOF-R trend features and the resulting Cost-Sensitive Logistic Regression (CSLR) models provide useful insights and serve as a potential first step towards the automated removal of outliers for neuromuscular monitoring devices.

Trial registration

NCT04518761 (clinicaltrials.gov), registered on 19 August 2020.
Appendix
Available only for authorised users
Literature
1.
go back to reference Cammu G. Residual neuromuscular blockade and postoperative pulmonary complications: what does the recent evidence demonstrate? Curr. Anesthesiol Rep 1 (2020). Cammu G. Residual neuromuscular blockade and postoperative pulmonary complications: what does the recent evidence demonstrate? Curr. Anesthesiol Rep 1 (2020).
8.
go back to reference Kopman AF, Kumar S, Klewicka MM, Neuman GG. The staircase phenomenon: implications for monitoring of neuromuscular transmission. J Am Soc Anesthesiol. 2001;95:403–7.CrossRef Kopman AF, Kumar S, Klewicka MM, Neuman GG. The staircase phenomenon: implications for monitoring of neuromuscular transmission. J Am Soc Anesthesiol. 2001;95:403–7.CrossRef
9.
go back to reference Carvalho H, Verdonck M, Eleveld DJ, Ramirez D, D’Haese J, Flamée P, Geerts L, Wylleman J, Cools W, Barbe K. Others: neuromuscular end-point predictive capability of published rocuronium pharmacokinetic/pharmacodynamic models: an observational trial. J Clin Anesth. 2023;90:111225.CrossRefPubMed Carvalho H, Verdonck M, Eleveld DJ, Ramirez D, D’Haese J, Flamée P, Geerts L, Wylleman J, Cools W, Barbe K. Others: neuromuscular end-point predictive capability of published rocuronium pharmacokinetic/pharmacodynamic models: an observational trial. J Clin Anesth. 2023;90:111225.CrossRefPubMed
10.
go back to reference Thilen SR, Weigel WA, Todd MM, Dutton RP, Lien CA, Grant SA, Szokol JW, Eriksson LI, Yaster M, Grant MD., others: American Society of Anesthesiologists practice guidelines for monitoring and antagonism of neuromuscular blockade: a report by the American Society of Anesthesiologists task force on neuromuscular blockade. Anesthesiology. 2023;138:13–41.CrossRefPubMed Thilen SR, Weigel WA, Todd MM, Dutton RP, Lien CA, Grant SA, Szokol JW, Eriksson LI, Yaster M, Grant MD., others: American Society of Anesthesiologists practice guidelines for monitoring and antagonism of neuromuscular blockade: a report by the American Society of Anesthesiologists task force on neuromuscular blockade. Anesthesiology. 2023;138:13–41.CrossRefPubMed
11.
go back to reference Fuchs-Buder T, Romero CS, Lewald H, Lamperti M, Afshari A, Hristovska A-M, Schmartz D, Hinkelbein J, Longrois D, Popp M. others: peri-operative management of neuromuscular blockade: a guideline from the European Society of Anaesthesiology and Intensive Care. Eur J Anaesthesiol EJA. 2023;40:82–94.CrossRef Fuchs-Buder T, Romero CS, Lewald H, Lamperti M, Afshari A, Hristovska A-M, Schmartz D, Hinkelbein J, Longrois D, Popp M. others: peri-operative management of neuromuscular blockade: a guideline from the European Society of Anaesthesiology and Intensive Care. Eur J Anaesthesiol EJA. 2023;40:82–94.CrossRef
14.
go back to reference Nemes R, Lengyel S, Nagy G, Hampton DR, Gray M, Renew JR, Tassonyi E, Fülesdi B, Brull SJ. Ipsilateral and simultaneous comparison of responses from acceleromyography-and electromyography-based neuromuscular monitors. Anesthesiology. 2021;135:597–611.CrossRefPubMed Nemes R, Lengyel S, Nagy G, Hampton DR, Gray M, Renew JR, Tassonyi E, Fülesdi B, Brull SJ. Ipsilateral and simultaneous comparison of responses from acceleromyography-and electromyography-based neuromuscular monitors. Anesthesiology. 2021;135:597–611.CrossRefPubMed
15.
go back to reference Fuchs-Buder T, Brull SJ, Fagerlund MJ, Renew RJ, Cammu G, Murphy GS, Warlé M, Vested M, Fülesdi B, Nemes R. Others: good clinical research practice (GCRP) in pharmacodynamic studies of neuromuscular blocking agents III: the 2023 Geneva revision. Acta Anaesthesiol Scand. (2023). Fuchs-Buder T, Brull SJ, Fagerlund MJ, Renew RJ, Cammu G, Murphy GS, Warlé M, Vested M, Fülesdi B, Nemes R. Others: good clinical research practice (GCRP) in pharmacodynamic studies of neuromuscular blocking agents III: the 2023 Geneva revision. Acta Anaesthesiol Scand. (2023).
18.
go back to reference Aghazadeh-Attari J, Mobaraki K, Ahmadzadeh J, Mansorian B, Mohebbi I. Quality of observational studies in prestigious journals of occupational medicine and health based on strengthening the reporting of Observational studies in Epidemiology (STROBE) Statement: a cross-sectional study. BMC Res Notes. 2018;11:1–7.CrossRef Aghazadeh-Attari J, Mobaraki K, Ahmadzadeh J, Mansorian B, Mohebbi I. Quality of observational studies in prestigious journals of occupational medicine and health based on strengthening the reporting of Observational studies in Epidemiology (STROBE) Statement: a cross-sectional study. BMC Res Notes. 2018;11:1–7.CrossRef
21.
go back to reference Lee CK, Hofer I, Eilon G, Baldi P, Cannesson M. Development and validation of a deep neural network model for prediction of postoperative In-hospital mortality. Anesthesiology. 1–14 (2018). Lee CK, Hofer I, Eilon G, Baldi P, Cannesson M. Development and validation of a deep neural network model for prediction of postoperative In-hospital mortality. Anesthesiology. 1–14 (2018).
23.
go back to reference Haq AU, Zhang D, Peng H, Rahman SU. Combining multiple feature-ranking techniques and clustering of variables for feature selection. IEEE Access. 2019;7:151482–92.CrossRef Haq AU, Zhang D, Peng H, Rahman SU. Combining multiple feature-ranking techniques and clustering of variables for feature selection. IEEE Access. 2019;7:151482–92.CrossRef
24.
go back to reference Churchill-Davidson H, Christie T. The diagnosis of neuromuscular block in man. Br J Anaesth. 1959;31:290–301.CrossRefPubMed Churchill-Davidson H, Christie T. The diagnosis of neuromuscular block in man. Br J Anaesth. 1959;31:290–301.CrossRefPubMed
25.
go back to reference Christie T, Churchill-Davidson H. The St. Thomas’s hospital nerve stimulator in the diagnosis of prolonged apnoea. Lancet. 1958;271:776.CrossRef Christie T, Churchill-Davidson H. The St. Thomas’s hospital nerve stimulator in the diagnosis of prolonged apnoea. Lancet. 1958;271:776.CrossRef
27.
go back to reference Faulk DJ, Austin TM, Thomas JJ, Strupp K, Macrae AW, Yaster M. A survey of the Society for Pediatric Anesthesia on the use, monitoring, and antagonism of neuromuscular blockade. Anesth Analg. 2021;132:1518–26.CrossRefPubMed Faulk DJ, Austin TM, Thomas JJ, Strupp K, Macrae AW, Yaster M. A survey of the Society for Pediatric Anesthesia on the use, monitoring, and antagonism of neuromuscular blockade. Anesth Analg. 2021;132:1518–26.CrossRefPubMed
28.
go back to reference Renew JR, Tobias JD, Brull SJ. The Time to Seriously Reassess the Use and Misuse of Neuromuscular Blockade in Children Is Now, (2021). Renew JR, Tobias JD, Brull SJ. The Time to Seriously Reassess the Use and Misuse of Neuromuscular Blockade in Children Is Now, (2021).
29.
go back to reference Philips S, Stewart PA, Bilgin AB. A survey of the management of neuromuscular blockade monitoring in Australia and New Zealand. Anaesth Intensive Care. 2013;41:374–9.CrossRef Philips S, Stewart PA, Bilgin AB. A survey of the management of neuromuscular blockade monitoring in Australia and New Zealand. Anaesth Intensive Care. 2013;41:374–9.CrossRef
30.
go back to reference Cai L, Zhu Y. Data Sci J. 2015;14:2–2. The challenges of data quality and data quality assessment in the big data era. Cai L, Zhu Y. Data Sci J. 2015;14:2–2. The challenges of data quality and data quality assessment in the big data era.
31.
go back to reference Maheshwari K, Shimada T, Yang D, Khanna S, Cywinski JB, Irefin SA, Ayad S, Turan A, Ruetzler K, Qiu Y. Others: hypotension prediction index for prevention of hypotension during moderate-to high-risk noncardiac surgery: a pilot randomized trial. Anesthesiology. 2020;133:1214–22.CrossRefPubMed Maheshwari K, Shimada T, Yang D, Khanna S, Cywinski JB, Irefin SA, Ayad S, Turan A, Ruetzler K, Qiu Y. Others: hypotension prediction index for prevention of hypotension during moderate-to high-risk noncardiac surgery: a pilot randomized trial. Anesthesiology. 2020;133:1214–22.CrossRefPubMed
Metadata
Title
Machine learning based analysis and detection of trend outliers for electromyographic neuromuscular monitoring
Authors
Michaël Verdonck
Hugo Carvalho
Thomas Fuchs-Buder
Sorin J. Brull
Jan Poelaert
Publication date
04-04-2024
Publisher
Springer Netherlands
Published in
Journal of Clinical Monitoring and Computing
Print ISSN: 1387-1307
Electronic ISSN: 1573-2614
DOI
https://doi.org/10.1007/s10877-024-01141-6