Skip to main content
Top
Published in: Knee Surgery, Sports Traumatology, Arthroscopy 12/2023

24-09-2023 | Arthroscopy | KNEE

Assessment of learning in simulator-based arthroscopy training with the diagnostic arthroscopy skill score (DASS) and neurophysiological measures

Authors: Mehmet Emin Aksoy, Baris Kocaoglu, Kurtulus İzzetoglu, Atahan Agrali, Serhat Ilgaz Yoner, Mert Deniz Polat, Mahmut Enes Kayaalp, Tahir Koray Yozgatli, Alper Kaya, Roland Becker

Published in: Knee Surgery, Sports Traumatology, Arthroscopy | Issue 12/2023

Login to get access

Abstract

Purpose

Virtual arthroscopic training has become increasingly popular. However, there is a lack of efficiency-based tracking of the trainee, which may be critical for determining the specifics of training programs and adapting them for the needs of each trainee. This study aims to evaluate and compare the measures obtained with a non-invasive neurophysiological method with The Diagnostic Arthroscopy Skill Score (DASS), a commonly used assessment tool for evaluating arthroscopic skills.

Methods

The study collected simulator performance scores, consisting of “Triangulation Right Hand”, “Triangulation Left Hand”, “Catch the Stars” and “Three Rings” and DASS scores from 22 participants (11 novices, 11 experts). These scores were obtained while participants underwent a structured program of exercises for the fundamentals of arthroscopic surgery training (FAST) and knee module using a simulator-based arthroscopy device. During the evaluation, data on oxy-hemoglobin and deoxy-hemoglobin levels in the prefrontal cortex were collected using the Functional Near-Infrared Spectroscopy (fNIRS) imaging system. Performance scores, DASS scores, and fNIRS data were subsequently analyzed to determine any correlation between performance and cortex activity.

Results

The simulator performance scores and the DASSPart2 scores were significantly higher in the expert group compared to the novice group (200.1 ± 28.5 vs 172.5 ± 48.9, p = 0.04 and 9.4 ± 5.6 vs. 5.4 ± 5.6 p = 0.02). In the expert group, fNIRS data showed a significantly lower prefrontal cortex activation during fundamental tasks in the FAST module, indicating significantly more efficient mental resource use.

Conclusion

The analysis of cognitive workload changes during simulation-based arthroscopy training revealed a significant correlation between the trainees’ DASS scores and fNIRS data. This correlation suggests the potential use of fNIRS data and DASS scores as additional metrics to create adaptive training protocols for each participant. By incorporating these metrics, the training process can be optimized, leading to more efficient arthroscopic training and better preparedness for clinical operations.

Level of evidence

III.
Appendix
Available only for authorised users
Literature
2.
go back to reference Aksoy E, Izzetoglu K, Onaral B, Kitapcioglu D, Sayali ME, Guven F (2019) Assessing correlation between virtual reality based serious gaming performance and cognitive workload changes via functional near infrared spectroscopy. In: Schmorrow DD, Fidopiastis CM (eds) Augmented Cognition. Springer International Publishing, Cham, pp 375–383CrossRef Aksoy E, Izzetoglu K, Onaral B, Kitapcioglu D, Sayali ME, Guven F (2019) Assessing correlation between virtual reality based serious gaming performance and cognitive workload changes via functional near infrared spectroscopy. In: Schmorrow DD, Fidopiastis CM (eds) Augmented Cognition. Springer International Publishing, Cham, pp 375–383CrossRef
3.
go back to reference Aksoy ME, Izzetoglu K, Agrali A, Kitapcioglu D, Gungor M, Simsek A (2020) Effect of robotic surgery simulators in training assessed by functional near-infrared spectroscopy (fNIRs). In: Schmorrow DD, Fidopiastis CM (eds) Augmented Cognition Human Cognition and Behavior. Springer International Publishing, Cham, pp 271–278CrossRef Aksoy ME, Izzetoglu K, Agrali A, Kitapcioglu D, Gungor M, Simsek A (2020) Effect of robotic surgery simulators in training assessed by functional near-infrared spectroscopy (fNIRs). In: Schmorrow DD, Fidopiastis CM (eds) Augmented Cognition Human Cognition and Behavior. Springer International Publishing, Cham, pp 271–278CrossRef
4.
go back to reference Anetzberger H, Becker R, Eickhoff H, Seibert FJ, Döring B, Haasters F, Mohr M, Reppenhagen S (2022) The diagnostic arthroscopy skill score (DASS): a reliable and suitable assessment tool for arthroscopic skill training. Knee Surg Sports Traumatol Arthrosc 30(1):349–360CrossRefPubMed Anetzberger H, Becker R, Eickhoff H, Seibert FJ, Döring B, Haasters F, Mohr M, Reppenhagen S (2022) The diagnostic arthroscopy skill score (DASS): a reliable and suitable assessment tool for arthroscopic skill training. Knee Surg Sports Traumatol Arthrosc 30(1):349–360CrossRefPubMed
5.
go back to reference Anetzberger H, Reppenhagen S, Eickhoff H, Seibert FJ, Döring B, Haasters F, Mohr M, Becker R (2022) Ten hours of simulator training in arthroscopy are insufficient to reach the target level based on the diagnostic arthroscopic skill score. Knee Surg Sports Traumatol Arthrosc 30(4):1471–1479CrossRefPubMed Anetzberger H, Reppenhagen S, Eickhoff H, Seibert FJ, Döring B, Haasters F, Mohr M, Becker R (2022) Ten hours of simulator training in arthroscopy are insufficient to reach the target level based on the diagnostic arthroscopic skill score. Knee Surg Sports Traumatol Arthrosc 30(4):1471–1479CrossRefPubMed
6.
go back to reference Ayaz H, Shewokis PA, Bunce S, Izzetoglu K, Willems B, Onaral B (2012) Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59(1):36–47CrossRefPubMed Ayaz H, Shewokis PA, Bunce S, Izzetoglu K, Willems B, Onaral B (2012) Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59(1):36–47CrossRefPubMed
9.
go back to reference Bunce SC, Izzetoglu M, Izzetoglu K, Onaral B, Pourrezaei K (2006) Functional near-infrared spectroscopy. IEEE Eng Med Biol Mag 25(4):54–62CrossRefPubMed Bunce SC, Izzetoglu M, Izzetoglu K, Onaral B, Pourrezaei K (2006) Functional near-infrared spectroscopy. IEEE Eng Med Biol Mag 25(4):54–62CrossRefPubMed
10.
go back to reference Cui X, Bray S, Bryant DM, Glover GH, Reiss AL (2011) A quantitative comparison of NIRS and fMRI across multiple cognitive tasks. Neuroimage 54(4):2808–2821CrossRefPubMed Cui X, Bray S, Bryant DM, Glover GH, Reiss AL (2011) A quantitative comparison of NIRS and fMRI across multiple cognitive tasks. Neuroimage 54(4):2808–2821CrossRefPubMed
11.
go back to reference Cychosz CC, Tofte JN, Johnson A, Gao Y, Phisitkul P (2018) Fundamentals of arthroscopic surgery training program improves knee arthroscopy simulator performance in arthroscopic trainees. Arthroscopy 34(5):1543–1549CrossRefPubMed Cychosz CC, Tofte JN, Johnson A, Gao Y, Phisitkul P (2018) Fundamentals of arthroscopic surgery training program improves knee arthroscopy simulator performance in arthroscopic trainees. Arthroscopy 34(5):1543–1549CrossRefPubMed
12.
go back to reference Dotson MP, Gustafson ML, Tager A, Peterson LM (2018) Air medical simulation training: a retrospective review of cost and effectiveness. Air Med J 37(2):131–137CrossRefPubMed Dotson MP, Gustafson ML, Tager A, Peterson LM (2018) Air medical simulation training: a retrospective review of cost and effectiveness. Air Med J 37(2):131–137CrossRefPubMed
13.
go back to reference Frank RM, Wang KC, Davey A, Cotter EJ, Cole BJ, Romeo AA, Bush-Joseph CA, Bach BR, Verma NN (2018) Utility of modern arthroscopic simulator training models: a meta-analysis and updated systematic review. Arthroscopy 34(5):1650–1677CrossRefPubMed Frank RM, Wang KC, Davey A, Cotter EJ, Cole BJ, Romeo AA, Bush-Joseph CA, Bach BR, Verma NN (2018) Utility of modern arthroscopic simulator training models: a meta-analysis and updated systematic review. Arthroscopy 34(5):1650–1677CrossRefPubMed
14.
go back to reference Izzetoglu K, Aksoy ME, Agrali A, Kitapcioglu D, Gungor M, Simsek A (2021) Studying brain activation during skill acquisition via robot-assisted surgery training. Brain Sci 11(7):937CrossRefPubMedPubMedCentral Izzetoglu K, Aksoy ME, Agrali A, Kitapcioglu D, Gungor M, Simsek A (2021) Studying brain activation during skill acquisition via robot-assisted surgery training. Brain Sci 11(7):937CrossRefPubMedPubMedCentral
15.
go back to reference Izzetoglu K, Ayaz H, Merzagora A, Izzetoglu M, Shewokis PA, Bunce SC, Pourrezaei K, Rosen A, Onaral B (2011) The evolution of field deployable fNIR spectroscopy from bench to clinical settings. J Innov Opt Health Sci 04(03):239–250CrossRef Izzetoglu K, Ayaz H, Merzagora A, Izzetoglu M, Shewokis PA, Bunce SC, Pourrezaei K, Rosen A, Onaral B (2011) The evolution of field deployable fNIR spectroscopy from bench to clinical settings. J Innov Opt Health Sci 04(03):239–250CrossRef
16.
go back to reference Izzetoglu K, Bunce S, Onaral B, Pourrezaei K, Chance B (2004) Functional optical brain imaging using near-infrared during cognitive tasks. Int J Hum Comput Interact 17(2):211–227CrossRef Izzetoglu K, Bunce S, Onaral B, Pourrezaei K, Chance B (2004) Functional optical brain imaging using near-infrared during cognitive tasks. Int J Hum Comput Interact 17(2):211–227CrossRef
17.
go back to reference Izzetoglu K, Dale R (2019) Human performance assessment: evaluation of wearable sensors for monitoring brain activity. In: Vidulich M, Tsang P (eds) Improving aviation performance through applying engineering psychology: advances in aviation psychology, 1st edn. CRC Press, Boca Raton, pp 163–180CrossRef Izzetoglu K, Dale R (2019) Human performance assessment: evaluation of wearable sensors for monitoring brain activity. In: Vidulich M, Tsang P (eds) Improving aviation performance through applying engineering psychology: advances in aviation psychology, 1st edn. CRC Press, Boca Raton, pp 163–180CrossRef
18.
go back to reference James DRC, Orihuela-Espina F, Leff DR, Mylonas GP, Kwok K-W, Darzi AW, Yang G-Z (2010) Cognitive burden estimation for visuomotor learning with fNIRS. Med Image Comput Comput Assist Interv 13(Pt 3):319–326PubMed James DRC, Orihuela-Espina F, Leff DR, Mylonas GP, Kwok K-W, Darzi AW, Yang G-Z (2010) Cognitive burden estimation for visuomotor learning with fNIRS. Med Image Comput Comput Assist Interv 13(Pt 3):319–326PubMed
19.
go back to reference Jöbsis FF (1977) Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. Science 198(4323):1264–1267CrossRefPubMed Jöbsis FF (1977) Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters. Science 198(4323):1264–1267CrossRefPubMed
20.
go back to reference Koehler RJ, Amsdell S, Arendt EA, Bisson LJ, Braman JP, Butler A, Cosgarea AJ, Harner CD, Garrett WE, Olson T, Warme WJ, Nicandri GT (2013) The arthroscopic surgical skill evaluation tool (ASSET). Am J Sports Med 41(6):1229–1237CrossRefPubMedPubMedCentral Koehler RJ, Amsdell S, Arendt EA, Bisson LJ, Braman JP, Butler A, Cosgarea AJ, Harner CD, Garrett WE, Olson T, Warme WJ, Nicandri GT (2013) The arthroscopic surgical skill evaluation tool (ASSET). Am J Sports Med 41(6):1229–1237CrossRefPubMedPubMedCentral
24.
go back to reference Middleton RM, Alvand A, Garfjeld Roberts P, Hargrove C, Kirby G, Rees JL (2017) Simulation-based training platforms for arthroscopy: a randomized comparison of virtual reality learning to benchtop learning. Arthroscopy 33(5):996–1003CrossRefPubMed Middleton RM, Alvand A, Garfjeld Roberts P, Hargrove C, Kirby G, Rees JL (2017) Simulation-based training platforms for arthroscopy: a randomized comparison of virtual reality learning to benchtop learning. Arthroscopy 33(5):996–1003CrossRefPubMed
25.
go back to reference Nemani A, Kruger U, Cooper CA, Schwaitzberg SD, Intes X, De S (2019) Objective assessment of surgical skill transfer using non-invasive brain imaging. Surg Endosc 33(8):2485–2494CrossRefPubMed Nemani A, Kruger U, Cooper CA, Schwaitzberg SD, Intes X, De S (2019) Objective assessment of surgical skill transfer using non-invasive brain imaging. Surg Endosc 33(8):2485–2494CrossRefPubMed
26.
go back to reference Obrig H, Villringer A (2003) Beyond the visible—imaging the human brain with light. J Cereb Blood Flow Metab 23(1):1–18CrossRefPubMed Obrig H, Villringer A (2003) Beyond the visible—imaging the human brain with light. J Cereb Blood Flow Metab 23(1):1–18CrossRefPubMed
27.
go back to reference Paas F, Tuovinen JE, Tabbers H, Van Gerven PWM (2003) Cognitive load measurement as a means to advance cognitive load theory. Educ Psychol 38(1):63–71CrossRef Paas F, Tuovinen JE, Tabbers H, Van Gerven PWM (2003) Cognitive load measurement as a means to advance cognitive load theory. Educ Psychol 38(1):63–71CrossRef
28.
go back to reference Palma S, Giannoudis V, Patel P, Palan J, Guy S, Pandit H, Van Duren B (2021) Patients generally may return to driving 4 weeks after hip arthroscopy and 6 weeks after knee arthroscopy: a systematic review and meta-analysis. Arthrosc Sports Med Rehabil 3(6):e2067–e2092CrossRefPubMedPubMedCentral Palma S, Giannoudis V, Patel P, Palan J, Guy S, Pandit H, Van Duren B (2021) Patients generally may return to driving 4 weeks after hip arthroscopy and 6 weeks after knee arthroscopy: a systematic review and meta-analysis. Arthrosc Sports Med Rehabil 3(6):e2067–e2092CrossRefPubMedPubMedCentral
30.
go back to reference Pedowitz RA, Marsh JL (2012) Motor skills training in orthopaedic surgery: a paradigm shift toward a simulation-based educational curriculum. J Am Acad Orthop Surg 20(7):407–409CrossRefPubMed Pedowitz RA, Marsh JL (2012) Motor skills training in orthopaedic surgery: a paradigm shift toward a simulation-based educational curriculum. J Am Acad Orthop Surg 20(7):407–409CrossRefPubMed
31.
go back to reference Kerr J, Molloy C, Reddy P, Shewokis PA, Izzetoglu K (2021) Individual differences in fNIRS measures of cognitive workload during a UAS mission. In: Schmorrow D, Fidopiastis C (eds) Augmented Cognition. HCII 2021. Lecture Notes in Computer Science, vol. 12776. Springer, Cham, pp. 49–62. https://doi.org/10.1007/978-3-030-78114-9_4 Kerr J, Molloy C, Reddy P, Shewokis PA, Izzetoglu K (2021) Individual differences in fNIRS measures of cognitive workload during a UAS mission. In: Schmorrow D,  Fidopiastis C (eds) Augmented Cognition. HCII 2021. Lecture Notes in Computer Science, vol. 12776. Springer, Cham, pp. 49–62. https://​doi.​org/​10.​1007/​978-3-030-78114-9_​4
33.
go back to reference Robertson EM, Tormos JM, Maeda F, Pascual-Leone A (2001) The role of the dorsolateral prefrontal cortex during sequence learning is specific for spatial information. Cereb Cortex 11(7):628–635CrossRefPubMed Robertson EM, Tormos JM, Maeda F, Pascual-Leone A (2001) The role of the dorsolateral prefrontal cortex during sequence learning is specific for spatial information. Cereb Cortex 11(7):628–635CrossRefPubMed
35.
go back to reference Ryall T, Judd BK, Gordon CJ (2016) Simulation-based assessments in health professional education: a systematic review. J Multidiscip Healthc 9:69–82PubMedPubMedCentral Ryall T, Judd BK, Gordon CJ (2016) Simulation-based assessments in health professional education: a systematic review. J Multidiscip Healthc 9:69–82PubMedPubMedCentral
36.
go back to reference Shewokis PA, Ayaz H, Panait L, Liu Y, Syed M, Greenawald L, Shariff FU, Castellanos A, Scott Lind D (2015) Brain-in-the-loop learning using fNIR and simulated virtual reality surgical tasks: hemodynamic and behavioral effects. In: Schmorrow DD, Fidopiastis CM (eds) Foundations of Augmented Cognition. Springer International Publishing, Cham, pp 324–335CrossRef Shewokis PA, Ayaz H, Panait L, Liu Y, Syed M, Greenawald L, Shariff FU, Castellanos A, Scott Lind D (2015) Brain-in-the-loop learning using fNIR and simulated virtual reality surgical tasks: hemodynamic and behavioral effects. In: Schmorrow DD, Fidopiastis CM (eds) Foundations of Augmented Cognition. Springer International Publishing, Cham, pp 324–335CrossRef
37.
go back to reference Singh H, Modi HN, Ranjan S, Dilley JWR, Airantzis D, Yang G-Z, Darzi A, Leff DR (2018) Robotic surgery improves technical performance and enhances prefrontal activation during high temporal demand. Ann Biomed Eng 46(10):1621–1636CrossRefPubMedPubMedCentral Singh H, Modi HN, Ranjan S, Dilley JWR, Airantzis D, Yang G-Z, Darzi A, Leff DR (2018) Robotic surgery improves technical performance and enhances prefrontal activation during high temporal demand. Ann Biomed Eng 46(10):1621–1636CrossRefPubMedPubMedCentral
38.
go back to reference Stunt JJ, Kerkhoffs GMMJ, van Dijk CN, Tuijthof GJM (2015) Validation of the ArthroS virtual reality simulator for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 23(11):3436–3442CrossRefPubMed Stunt JJ, Kerkhoffs GMMJ, van Dijk CN, Tuijthof GJM (2015) Validation of the ArthroS virtual reality simulator for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 23(11):3436–3442CrossRefPubMed
39.
go back to reference Waterman BR, Martin KD, Cameron KL, Owens BD, Belmont PJ (2016) Simulation training improves surgical proficiency and safety during diagnostic shoulder arthroscopy performed by residents. Orthopedics 39(3):e479-485CrossRefPubMed Waterman BR, Martin KD, Cameron KL, Owens BD, Belmont PJ (2016) Simulation training improves surgical proficiency and safety during diagnostic shoulder arthroscopy performed by residents. Orthopedics 39(3):e479-485CrossRefPubMed
40.
go back to reference Westfall J, Kenny DA, Judd CM (2014) Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. J Exp Psychol Gen 143(5):2020–2045CrossRefPubMed Westfall J, Kenny DA, Judd CM (2014) Statistical power and optimal design in experiments in which samples of participants respond to samples of stimuli. J Exp Psychol Gen 143(5):2020–2045CrossRefPubMed
Metadata
Title
Assessment of learning in simulator-based arthroscopy training with the diagnostic arthroscopy skill score (DASS) and neurophysiological measures
Authors
Mehmet Emin Aksoy
Baris Kocaoglu
Kurtulus İzzetoglu
Atahan Agrali
Serhat Ilgaz Yoner
Mert Deniz Polat
Mahmut Enes Kayaalp
Tahir Koray Yozgatli
Alper Kaya
Roland Becker
Publication date
24-09-2023
Publisher
Springer Berlin Heidelberg
Published in
Knee Surgery, Sports Traumatology, Arthroscopy / Issue 12/2023
Print ISSN: 0942-2056
Electronic ISSN: 1433-7347
DOI
https://doi.org/10.1007/s00167-023-07571-0

Other articles of this Issue 12/2023

Knee Surgery, Sports Traumatology, Arthroscopy 12/2023 Go to the issue