Skip to main content
Top
Published in: Surgical Endoscopy 2/2014

01-02-2014

Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills

Authors: M. B. Jalink, J. Goris, E. Heineman, J. P. E. N. Pierie, H. O. ten Cate Hoedemaker

Published in: Surgical Endoscopy | Issue 2/2014

Login to get access

Abstract

Background

Virtual reality (VR) laparoscopic simulators have been around for more than 10 years and have proven to be cost- and time-effective in laparoscopic skills training. However, most simulators are, in our experience, considered less interesting by residents and are often poorly accessible. Consequently, these devices are rarely used in actual training. In an effort to make a low-cost and more attractive simulator, a custom-made Nintendo Wii game was developed. This game could ultimately be used to train the same basic skills as VR laparoscopic simulators ought to. Before such a video game can be implemented into a surgical training program, it has to be validated according to international standards.

Methods

The main goal of this study was to test construct and concurrent validity of the controls of a prototype of the game. In this study, the basic laparoscopic skills of experts (surgeons, urologists, and gynecologists, n = 15) were compared to those of complete novices (internists, n = 15) using the Wii Laparoscopy (construct validity). Scores were also compared to the Fundamentals of Laparoscopy (FLS) Peg Transfer test, an already established assessment method for measuring basic laparoscopic skills (concurrent validity).

Results

Results showed that experts were 111 % faster (P = 0.001) on the Wii Laparoscopy task than novices. Also, scores of the FLS Peg Transfer test and the Wii Laparoscopy showed a significant, high correlation (r = 0.812, P < 0.001).

Conclusions

The prototype setup of the Wii Laparoscopy possesses solid construct and concurrent validity.
Literature
1.
go back to reference Cooper JB, Taqueti VR (2004) A brief history of the development of mannequin simulators for clinical education and training. Qual Saf Health Care 13(Suppl 1):i11–i18PubMedCentralPubMedCrossRef Cooper JB, Taqueti VR (2004) A brief history of the development of mannequin simulators for clinical education and training. Qual Saf Health Care 13(Suppl 1):i11–i18PubMedCentralPubMedCrossRef
2.
go back to reference Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246(5):771–779PubMedCrossRef Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246(5):771–779PubMedCrossRef
3.
go back to reference Ahlberg G, Enochsson L, Gallagher AG et al (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193(6):797–804PubMedCrossRef Ahlberg G, Enochsson L, Gallagher AG et al (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193(6):797–804PubMedCrossRef
4.
go back to reference Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91(2):146–150PubMedCrossRef Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91(2):146–150PubMedCrossRef
5.
go back to reference Larsen CR, Oestergaard J, Ottesen BS, Soerensen JL (2012) The efficacy of virtual reality simulation training in laparoscopy: a systematic review of randomized trials. Acta Obstet Gynecol Scand 91(9):1015–1028PubMedCrossRef Larsen CR, Oestergaard J, Ottesen BS, Soerensen JL (2012) The efficacy of virtual reality simulation training in laparoscopy: a systematic review of randomized trials. Acta Obstet Gynecol Scand 91(9):1015–1028PubMedCrossRef
6.
go back to reference Schlickum MK, Hedman L, Enochsson L, Kjellin A, Felländer-Tsai L (2009) Systematic video game training in surgical novices improves performance in virtual reality endoscopic surgical simulators: a prospective randomized study. World J Surg 33(11):2360–2367PubMedCrossRef Schlickum MK, Hedman L, Enochsson L, Kjellin A, Felländer-Tsai L (2009) Systematic video game training in surgical novices improves performance in virtual reality endoscopic surgical simulators: a prospective randomized study. World J Surg 33(11):2360–2367PubMedCrossRef
7.
go back to reference Rosenthal R, Geuss S, Dell-Kuster S, Schäfer J, Hahnloser D, Demartines N (2011) Video gaming in children improves performance on a virtual reality trainer but does not yet make a laparoscopic surgeon. Surg Innov 18(2):160–170PubMedCrossRef Rosenthal R, Geuss S, Dell-Kuster S, Schäfer J, Hahnloser D, Demartines N (2011) Video gaming in children improves performance on a virtual reality trainer but does not yet make a laparoscopic surgeon. Surg Innov 18(2):160–170PubMedCrossRef
8.
go back to reference Badurdeen S, Abdul-Samad O, Story G, Wilson C, Down S, Harris A (2010) Nintendo Wii video-gaming ability predicts laparoscopic skill. Surg Endosc 24(8):1824–1828PubMedCrossRef Badurdeen S, Abdul-Samad O, Story G, Wilson C, Down S, Harris A (2010) Nintendo Wii video-gaming ability predicts laparoscopic skill. Surg Endosc 24(8):1824–1828PubMedCrossRef
9.
go back to reference Bokhari R, Bollman-McGregor J, Kahoi K, Smith M, Feinstein A, Ferrara J (2010) Design, development, and validation of a take-home simulator for fundamental laparoscopic skills: using Nintendo Wii for surgical training. Am Surg 76(6):583–586PubMed Bokhari R, Bollman-McGregor J, Kahoi K, Smith M, Feinstein A, Ferrara J (2010) Design, development, and validation of a take-home simulator for fundamental laparoscopic skills: using Nintendo Wii for surgical training. Am Surg 76(6):583–586PubMed
10.
go back to reference Mann BD, Eidelson BM, Fukuchi SG, Nissman SA, Robertson S, Jardines L (2002) The development of an interactive game-based tool for learning surgical management algorithms via computer. Am J Surg 183(3):305–308PubMedCrossRef Mann BD, Eidelson BM, Fukuchi SG, Nissman SA, Robertson S, Jardines L (2002) The development of an interactive game-based tool for learning surgical management algorithms via computer. Am J Surg 183(3):305–308PubMedCrossRef
11.
go back to reference Carter FJ, Schijven MP, Aggarwal R et al (2005) Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19(12):1523–1532PubMedCrossRef Carter FJ, Schijven MP, Aggarwal R et al (2005) Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19(12):1523–1532PubMedCrossRef
12.
go back to reference Schijven MP, Jakimowicz JJ (2005) Validation of virtual reality simulators: key to the successful integration of a novel teaching technology into minimal access surgery. Minim Invasive Ther Allied Technol 14(4):244–246PubMedCrossRef Schijven MP, Jakimowicz JJ (2005) Validation of virtual reality simulators: key to the successful integration of a novel teaching technology into minimal access surgery. Minim Invasive Ther Allied Technol 14(4):244–246PubMedCrossRef
13.
go back to reference Zhang A, Hünerbein M, Dai Y, Schlag PM, Beller S (2008) Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator. Surg Endosc 22(6):1440–1444PubMedCrossRef Zhang A, Hünerbein M, Dai Y, Schlag PM, Beller S (2008) Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator. Surg Endosc 22(6):1440–1444PubMedCrossRef
14.
go back to reference Van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21(8):1413–1417PubMedCrossRef Van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21(8):1413–1417PubMedCrossRef
15.
go back to reference Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17(5):803–810PubMedCrossRef Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17(5):803–810PubMedCrossRef
16.
go back to reference Madan AK, Frantzides CT, Park WC, Tebbit CL, Kumari NV, O’Leary PJ (2005) Predicting baseline laparoscopic surgery skills. Surg Endosc 19(1):101–104PubMedCrossRef Madan AK, Frantzides CT, Park WC, Tebbit CL, Kumari NV, O’Leary PJ (2005) Predicting baseline laparoscopic surgery skills. Surg Endosc 19(1):101–104PubMedCrossRef
17.
go back to reference Rosser JC Jr, Lynch PJ, Cuddihy L, Gentile DA, Klonsky J, Merrell R (2007) The impact of video games on training surgeons in the 21st century. Arch Surg 142(2):181–186PubMedCrossRef Rosser JC Jr, Lynch PJ, Cuddihy L, Gentile DA, Klonsky J, Merrell R (2007) The impact of video games on training surgeons in the 21st century. Arch Surg 142(2):181–186PubMedCrossRef
18.
go back to reference Thorson CM, Kelly JP, Forse RA, Turaga KK (2011) Can we continue to ignore gender differences in performance on simulation trainers? J Laparoendosc Adv Surg Tech A 21(4):329–333PubMedCrossRef Thorson CM, Kelly JP, Forse RA, Turaga KK (2011) Can we continue to ignore gender differences in performance on simulation trainers? J Laparoendosc Adv Surg Tech A 21(4):329–333PubMedCrossRef
20.
go back to reference Fried GM (2008) FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg 12(2):210–212PubMedCrossRef Fried GM (2008) FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg 12(2):210–212PubMedCrossRef
21.
go back to reference Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14(2):107–112PubMedCrossRef Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14(2):107–112PubMedCrossRef
23.
go back to reference Peters JH, Fried GM, Swanstrom LL (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135(1):21–27PubMedCrossRef Peters JH, Fried GM, Swanstrom LL (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135(1):21–27PubMedCrossRef
24.
go back to reference Fraser SA, Feldman LS, Stanbridge D, Fried GM (2005) Characterizing the learning curve for a basic laparoscopic drill. Surg Endosc 19(12):1572–1578PubMedCrossRef Fraser SA, Feldman LS, Stanbridge D, Fried GM (2005) Characterizing the learning curve for a basic laparoscopic drill. Surg Endosc 19(12):1572–1578PubMedCrossRef
25.
go back to reference Ritter EM, Kindelan TW, Michael C, Pimentel EA, Bowyer MW (2007) Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS). Surg Endosc 21(8):1441–1445PubMedCrossRef Ritter EM, Kindelan TW, Michael C, Pimentel EA, Bowyer MW (2007) Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS). Surg Endosc 21(8):1441–1445PubMedCrossRef
26.
go back to reference Field A (2005) Discovering statistics using SPSS, 2nd edn. SAGE Publications, London Field A (2005) Discovering statistics using SPSS, 2nd edn. SAGE Publications, London
27.
go back to reference Chmarra MK, Grimbergen CA, Jansen FW, Dankelman J (2010) How to objectively classify residents based on their psychomotor laparoscopic skills? Minim Invasive Ther Allied Technol 19(1):2–11PubMedCrossRef Chmarra MK, Grimbergen CA, Jansen FW, Dankelman J (2010) How to objectively classify residents based on their psychomotor laparoscopic skills? Minim Invasive Ther Allied Technol 19(1):2–11PubMedCrossRef
28.
go back to reference McCartan DP, Fleming FJ, Hill AD (2012) Patient and surgeon factors are associated with the use of laparoscopy in appendicitis. Colorectal Dis 14(2):243–249PubMedCrossRef McCartan DP, Fleming FJ, Hill AD (2012) Patient and surgeon factors are associated with the use of laparoscopy in appendicitis. Colorectal Dis 14(2):243–249PubMedCrossRef
Metadata
Title
Construct and concurrent validity of a Nintendo Wii video game made for training basic laparoscopic skills
Authors
M. B. Jalink
J. Goris
E. Heineman
J. P. E. N. Pierie
H. O. ten Cate Hoedemaker
Publication date
01-02-2014
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 2/2014
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-013-3199-6

Other articles of this Issue 2/2014

Surgical Endoscopy 2/2014 Go to the issue