Skip to main content
Top
Published in: Surgical Endoscopy 10/2017

01-10-2017

Validation of the mobile serious game application Touch Surgery™ for cognitive training and assessment of laparoscopic cholecystectomy

Authors: Karl-Friedrich Kowalewski, Jonathan D. Hendrie, Mona W. Schmidt, Tanja Proctor, Sai Paul, Carly R. Garrow, Hannes G. Kenngott, Beat P. Müller-Stich, Felix Nickel

Published in: Surgical Endoscopy | Issue 10/2017

Login to get access

Abstract

Background

Touch Surgery (TS) is a serious gaming application for cognitive task simulation and rehearsal of key steps in surgical procedures. The aim was to establish face, content, and construct validity of TS for laparoscopic cholecystectomy (LC). Furthermore, learning curves with TS and a virtual reality (VR) trainer were compared in a randomized trial.

Methods

The performance of medical students and general surgeons was compared for all three modules of LC in TS to establish construct validity. Questionnaires assessed face and content validity. For analysis of learning curves, students were randomized to train on VR or TS first, and then switched to the other training modality. Performance data were recorded.

Results

54 Surgeons and 51 medical students completed the validation study. Surgeons outperformed students with TS: patient preparation (students = 45.0 ± 19.1%; surgeons = 57.3 ± 15.2%; p < 0.001), access and laparoscopy (students = 70.2 ± 10.9%; surgeons = 75.9 ± 9.7%; p = 0.008) and LC (students = 69.8 ± 12.4%; surgeons = 77.7 ± 9.6%; p < 0.001). Both groups agreed that TS was a highly useful and realistic application. 46 students were randomized for learning curve analysis. It took them 2–4 attempts to reach a 100% score with TS. Training with TS first did not improve students’ performance on the VR trainer; however, students who trained with VR first scored significantly higher in module 3 of TS.

Conclusion

TS is an accepted serious gaming application for learning cognitive aspects of LC with established construct, face, and content validity. There appeared to be a synergy between TS and the VR trainer. Therefore, the two training modalities should accompany one another in a multimodal training approach to laparoscopy.
Literature
1.
go back to reference Nickel F, Hendrie JD, Bruckner T, Kowalewski KF, Kenngott HG, Muller-Stich BP et al (2016) Successful learning of surgical liver anatomy in a computer-based teaching module. Int J Comput Assist Radiol Surg 11:2295–2301CrossRef Nickel F, Hendrie JD, Bruckner T, Kowalewski KF, Kenngott HG, Muller-Stich BP et al (2016) Successful learning of surgical liver anatomy in a computer-based teaching module. Int J Comput Assist Radiol Surg 11:2295–2301CrossRef
2.
go back to reference Pape-Koehler C, Chmelik C, Aslund AM, Heiss MM (2010) An interactive and multimedia-based manual of surgical procedures: Webop–an approach to improve surgical education. Zentralbl Chir 135(5):467–471CrossRefPubMed Pape-Koehler C, Chmelik C, Aslund AM, Heiss MM (2010) An interactive and multimedia-based manual of surgical procedures: Webop–an approach to improve surgical education. Zentralbl Chir 135(5):467–471CrossRefPubMed
3.
go back to reference Mutter D, Rubino F, Temporal MS, Marescaux J (2005) Surgical education and Internet-based simulation: The World Virtual University. Minim Invasive Ther Allied Technol 14(4):267–274CrossRefPubMed Mutter D, Rubino F, Temporal MS, Marescaux J (2005) Surgical education and Internet-based simulation: The World Virtual University. Minim Invasive Ther Allied Technol 14(4):267–274CrossRefPubMed
4.
go back to reference Mutter D, Vix M, Dallemagne B, Perretta S, Leroy J, Marescaux J (2011) WeBSurg: an innovative educational Web site in minimally invasive surgery-principles and results. Surg Innov 18(1):8–14CrossRefPubMed Mutter D, Vix M, Dallemagne B, Perretta S, Leroy J, Marescaux J (2011) WeBSurg: an innovative educational Web site in minimally invasive surgery-principles and results. Surg Innov 18(1):8–14CrossRefPubMed
5.
go back to reference O’Leary DP, Corrigan MA, McHugh SM, Hill AD, Redmond HP (2012) From theater to the world wide web—a new online era for surgical education. J Surg Educ 69(4):483–486CrossRefPubMed O’Leary DP, Corrigan MA, McHugh SM, Hill AD, Redmond HP (2012) From theater to the world wide web—a new online era for surgical education. J Surg Educ 69(4):483–486CrossRefPubMed
6.
go back to reference Vapenstad C, Buzink SN (2013) Procedural virtual reality simulation in minimally invasive surgery. Surg Endosc 27(2):364–377CrossRefPubMed Vapenstad C, Buzink SN (2013) Procedural virtual reality simulation in minimally invasive surgery. Surg Endosc 27(2):364–377CrossRefPubMed
7.
go back to reference Akdemir A, Sendag F, Oztekin MK (2014) Laparoscopic virtual reality simulator and box trainer in gynecology. Int J Gynaecol Obstet 125(2):181–185CrossRefPubMed Akdemir A, Sendag F, Oztekin MK (2014) Laparoscopic virtual reality simulator and box trainer in gynecology. Int J Gynaecol Obstet 125(2):181–185CrossRefPubMed
8.
go back to reference Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G et al (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241(2):364–372CrossRefPubMedPubMedCentral Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G et al (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241(2):364–372CrossRefPubMedPubMedCentral
9.
go back to reference Nickel F, Jede F, Minassian A, Gondan M, Hendrie JD, Gehrig T et al (2014) One or two trainees per workplace in a structured multimodality training curriculum for laparoscopic surgery? Study protocol for a randomized controlled trial—DRKS00004675. Trials 15:137CrossRefPubMedPubMedCentral Nickel F, Jede F, Minassian A, Gondan M, Hendrie JD, Gehrig T et al (2014) One or two trainees per workplace in a structured multimodality training curriculum for laparoscopic surgery? Study protocol for a randomized controlled trial—DRKS00004675. Trials 15:137CrossRefPubMedPubMedCentral
10.
go back to reference Nickel F, Brzoska JA, Gondan M, Rangnick HM, Chu J, Kenngott HG et al (2015) Virtual reality training versus blended learning of laparoscopic cholecystectomy: a randomized controlled trial with laparoscopic novices. Med (Baltim) 94(20):e764CrossRef Nickel F, Brzoska JA, Gondan M, Rangnick HM, Chu J, Kenngott HG et al (2015) Virtual reality training versus blended learning of laparoscopic cholecystectomy: a randomized controlled trial with laparoscopic novices. Med (Baltim) 94(20):e764CrossRef
11.
go back to reference Willis RE, Richa J, Oppeltz R, Nguyen P, Wagner K, Van Sickle KR et al (2012) Comparing three pedagogical approaches to psychomotor skills acquisition. Am J Surg 203(1):8–13CrossRefPubMed Willis RE, Richa J, Oppeltz R, Nguyen P, Wagner K, Van Sickle KR et al (2012) Comparing three pedagogical approaches to psychomotor skills acquisition. Am J Surg 203(1):8–13CrossRefPubMed
12.
go back to reference Nehme J, Bahsoun AN, Chow A (2016) Development and evaluation of a novel pan-specialty virtual reality surgical simulator for smartphones. Stud Health Technol Inform 220:251–255PubMed Nehme J, Bahsoun AN, Chow A (2016) Development and evaluation of a novel pan-specialty virtual reality surgical simulator for smartphones. Stud Health Technol Inform 220:251–255PubMed
13.
go back to reference Djaouti D, Alvarez J, Jessel J-P (2011) Classifying serious games: the G/P/S model. Handb Res Improv Learn Mot Through Educ Games 2:118–136CrossRef Djaouti D, Alvarez J, Jessel J-P (2011) Classifying serious games: the G/P/S model. Handb Res Improv Learn Mot Through Educ Games 2:118–136CrossRef
14.
go back to reference Verdaasdonk EGG, Dankelman J, Schijven MP, Lange JF, Wentink M, Stassen LPS (2009) Serious gaming and voluntary laparoscopic skills training: A multicenter study. Minim Invasive Ther Allied Technol 18(4):232–238CrossRefPubMed Verdaasdonk EGG, Dankelman J, Schijven MP, Lange JF, Wentink M, Stassen LPS (2009) Serious gaming and voluntary laparoscopic skills training: A multicenter study. Minim Invasive Ther Allied Technol 18(4):232–238CrossRefPubMed
15.
go back to reference Jalink MB, Goris J, Heineman E, Pierie JP, ten Cate Hoedemaker HO (2014) Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills. Surg Endosc 28(2):537–542CrossRefPubMed Jalink MB, Goris J, Heineman E, Pierie JP, ten Cate Hoedemaker HO (2014) Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills. Surg Endosc 28(2):537–542CrossRefPubMed
16.
go back to reference Giannotti D, Patrizi G, Di Rocco G, Vestri AR, Semproni CP, Fiengo L et al (2013) Play to become a surgeon: impact of Nintendo Wii training on laparoscopic skills. PLoS ONE 8(2):e57372CrossRefPubMedPubMedCentral Giannotti D, Patrizi G, Di Rocco G, Vestri AR, Semproni CP, Fiengo L et al (2013) Play to become a surgeon: impact of Nintendo Wii training on laparoscopic skills. PLoS ONE 8(2):e57372CrossRefPubMedPubMedCentral
17.
go back to reference Lewis FR, Klingensmith ME (2012) Issues in general surgery residency training–2012. Ann Surg 256(4):553–559CrossRefPubMed Lewis FR, Klingensmith ME (2012) Issues in general surgery residency training–2012. Ann Surg 256(4):553–559CrossRefPubMed
18.
go back to reference Lopez-Gonzalez L, Pickens GT, Washington R, Weiss AJ (2006) Characteristics of Medicaid and Uninsured Hospitalizations, 2012: Statistical Brief #182. Healthcare Cost and Utilization Project (HCUP) Statistical Briefs. Rockville (MD): Agency for Health Care Policy and Research (US) Lopez-Gonzalez L, Pickens GT, Washington R, Weiss AJ (2006) Characteristics of Medicaid and Uninsured Hospitalizations, 2012: Statistical Brief #182. Healthcare Cost and Utilization Project (HCUP) Statistical Briefs. Rockville (MD): Agency for Health Care Policy and Research (US)
19.
go back to reference Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge D, Ghitulescu G et al (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 240(3):518–525 discussion 25–8.CrossRefPubMedPubMedCentral Fried GM, Feldman LS, Vassiliou MC, Fraser SA, Stanbridge D, Ghitulescu G et al (2004) Proving the value of simulation in laparoscopic surgery. Ann Surg 240(3):518–525 discussion 25–8.CrossRefPubMedPubMedCentral
20.
go back to reference Nickel F, Hendrie JD, Stock C, Salama M, Preukschas AA, Senft JD et al (2016) Direct observation versus endoscopic video recording-based rating with the objective structured assessment of technical skills for training of laparoscopic cholecystectomy. Eur Surg Res 57(1–2):1–9CrossRefPubMed Nickel F, Hendrie JD, Stock C, Salama M, Preukschas AA, Senft JD et al (2016) Direct observation versus endoscopic video recording-based rating with the objective structured assessment of technical skills for training of laparoscopic cholecystectomy. Eur Surg Res 57(1–2):1–9CrossRefPubMed
21.
go back to reference Mosier CI (1947) A critical examination of the concepts of face validity. Educ Psychol Meas 7(2):191–205CrossRefPubMed Mosier CI (1947) A critical examination of the concepts of face validity. Educ Psychol Meas 7(2):191–205CrossRefPubMed
23.
go back to reference Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(9):741CrossRef Messick S (1995) Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. Am Psychol 50(9):741CrossRef
24.
go back to reference Sugand K, Mawkin M, Gupte C (2015) Validating Touch Surgery: a cognitive task simulation and rehearsal app for intramedullary femoral nailing. Injury 46(11):2212–2216CrossRefPubMed Sugand K, Mawkin M, Gupte C (2015) Validating Touch Surgery: a cognitive task simulation and rehearsal app for intramedullary femoral nailing. Injury 46(11):2212–2216CrossRefPubMed
25.
go back to reference Crandall B, Klein GA, Hoffman RR (2006) Working minds: a practitioner’s guide to cognitive task analysis. MIT Press, Cambridge Crandall B, Klein GA, Hoffman RR (2006) Working minds: a practitioner’s guide to cognitive task analysis. MIT Press, Cambridge
26.
go back to reference Kosiol E (2013) Organisation der unternehmung. Springer, Wiesbaden Kosiol E (2013) Organisation der unternehmung. Springer, Wiesbaden
27.
go back to reference Pape-Koehler C, Immenroth M, Sauerland S, Lefering R, Lindlohr C, Toaspern J et al (2013) Multimedia-based training on internet platforms improves surgical performance: a randomized controlled trial. Surg Endosc 27(5):1737–1747CrossRefPubMedPubMedCentral Pape-Koehler C, Immenroth M, Sauerland S, Lefering R, Lindlohr C, Toaspern J et al (2013) Multimedia-based training on internet platforms improves surgical performance: a randomized controlled trial. Surg Endosc 27(5):1737–1747CrossRefPubMedPubMedCentral
28.
go back to reference Groenier M, Schraagen JM, Miedema HA, Broeders IA (2014) The role of cognitive abilities in laparoscopic simulator training. Adv Health Sci Educ 19(2):203–217.CrossRef Groenier M, Schraagen JM, Miedema HA, Broeders IA (2014) The role of cognitive abilities in laparoscopic simulator training. Adv Health Sci Educ 19(2):203–217.CrossRef
29.
go back to reference Nickel F, Bintintan VV, Gehrig T, Kenngott HG, Fischer L, Gutt CN et al (2013) Virtual reality does not meet expectations in a pilot study on multimodal laparoscopic surgery training. World J Surg 37(5):965–973CrossRefPubMed Nickel F, Bintintan VV, Gehrig T, Kenngott HG, Fischer L, Gutt CN et al (2013) Virtual reality does not meet expectations in a pilot study on multimodal laparoscopic surgery training. World J Surg 37(5):965–973CrossRefPubMed
30.
go back to reference Zevin B, Aggarwal R, Grantcharov T (2012) Simulation-based training and learning curves in laparoscopic Roux-en-Y gastric bypass. Br J Surg 99(7):887–895CrossRefPubMed Zevin B, Aggarwal R, Grantcharov T (2012) Simulation-based training and learning curves in laparoscopic Roux-en-Y gastric bypass. Br J Surg 99(7):887–895CrossRefPubMed
31.
go back to reference Kum CK, Eypasch E, Aljaziri A, Troidl H (1996) Randomized comparison of pulmonary function after the ‘French’and ‘American’techniques of laparoscopic cholecystectomy. Br J Surg 83(7):938–941CrossRefPubMed Kum CK, Eypasch E, Aljaziri A, Troidl H (1996) Randomized comparison of pulmonary function after the ‘French’and ‘American’techniques of laparoscopic cholecystectomy. Br J Surg 83(7):938–941CrossRefPubMed
Metadata
Title
Validation of the mobile serious game application Touch Surgery™ for cognitive training and assessment of laparoscopic cholecystectomy
Authors
Karl-Friedrich Kowalewski
Jonathan D. Hendrie
Mona W. Schmidt
Tanja Proctor
Sai Paul
Carly R. Garrow
Hannes G. Kenngott
Beat P. Müller-Stich
Felix Nickel
Publication date
01-10-2017
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 10/2017
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-017-5452-x

Other articles of this Issue 10/2017

Surgical Endoscopy 10/2017 Go to the issue