Skip to main content
Top
Published in: Surgical Endoscopy 8/2007

Open Access 01-08-2007

Construct validity of the LapSim: Can the LapSim virtual reality simulator distinguish between novices and experts?

Authors: K. W. van Dongen, E. Tournoij, D. C. van der Zee, M. P. Schijven, I. A. M. J. Broeders

Published in: Surgical Endoscopy | Issue 8/2007

Login to get access

Abstract

Background

Virtual reality simulators may be invaluable in training and assessing future endoscopic surgeons. The purpose of this study was to investigate if the results of a training session reflect the actual skill of the trainee who is being assessed and thereby establish construct validity for the LapSim virtual reality simulator (Surgical Science Ltd., Gothenburg, Sweden).

Methods

Forty-eight subjects were assigned to one of three groups: 16 novices (0 endoscopic procedures), 16 surgical residents in training (>10 but <100 endoscopic procedures), and 16 experienced endoscopic surgeons (>100 endoscopic procedures). Performance was measured by a relative scoring system that combines single parameters measured by the computer.

Results

The higher the level of endoscopic experience of a participant, the higher the score. Experienced surgeons and surgical residents in training showed statistically significant higher scores than novices for both overall score and efficiency, speed, and precision parameters.

Conclusions

Our results show that performance of the various tasks on the simulator corresponds to the respective level of endoscopic experience in our research population. This study demonstrates construct validity for the LapSim virtual reality simulator. It thus measures relevant skills and can be integrated in an endoscopic training and assessment program.
Literature
1.
go back to reference Bais JE, Bartelsman JF, Bonjer HJ, Cuesta MA, Go PM, Klinkenberg-Knol EC, van Lanschot JJ, Nadorp JH, Smout AJ, van der Graaf Y, Gooszen HG (2000) Laparoscopic or conventional Nissen fundoplication for gastro-oesophageal reflux disease: randomised clinical trial. The Netherlands Antireflux Surgery Study Group. Lancet 355: 170–174PubMedCrossRef Bais JE, Bartelsman JF, Bonjer HJ, Cuesta MA, Go PM, Klinkenberg-Knol EC, van Lanschot JJ, Nadorp JH, Smout AJ, van der Graaf Y, Gooszen HG (2000) Laparoscopic or conventional Nissen fundoplication for gastro-oesophageal reflux disease: randomised clinical trial. The Netherlands Antireflux Surgery Study Group. Lancet 355: 170–174PubMedCrossRef
2.
go back to reference Carter FJ, Schijven MP, Aggarwal R, Grancharov T, Francis NK, Hanna GB, Jakimowicz JJ: Working Group for Evaluation and Implementation of Simulators and Skills Training (2005) Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19: 1523–1532PubMedCrossRef Carter FJ, Schijven MP, Aggarwal R, Grancharov T, Francis NK, Hanna GB, Jakimowicz JJ: Working Group for Evaluation and Implementation of Simulators and Skills Training (2005) Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19: 1523–1532PubMedCrossRef
3.
go back to reference Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19: 401–405PubMedCrossRef Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19: 401–405PubMedCrossRef
4.
go back to reference Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19: 1216–1219PubMedCrossRef Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19: 1216–1219PubMedCrossRef
5.
go back to reference Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30: 617–620PubMedCrossRef Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30: 617–620PubMedCrossRef
6.
go back to reference Gallagher AG, Richie K, McClure N, McGuigan J (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg 25: 1478–1483PubMedCrossRef Gallagher AG, Richie K, McClure N, McGuigan J (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg 25: 1478–1483PubMedCrossRef
7.
go back to reference Gouma DJ, Go PM (1994) Bile duct injury during laparoscopic and conventional cholecystectomy. J Am Coll Surg 178: 229–233PubMed Gouma DJ, Go PM (1994) Bile duct injury during laparoscopic and conventional cholecystectomy. J Am Coll Surg 178: 229–233PubMed
8.
go back to reference Hanna GB, Cuschieri A (1999) Influence of the optical axis-to-target view angle on endoscopic task performance. Surg Endosc 13: 371–375PubMedCrossRef Hanna GB, Cuschieri A (1999) Influence of the optical axis-to-target view angle on endoscopic task performance. Surg Endosc 13: 371–375PubMedCrossRef
9.
go back to reference Hanna GB, Shimi SM, Cuschieri A (1998) Randomised study of influence of two-dimensional versus three-dimensional imaging on performance of laparoscopic cholecystectomy. Lancet 351: 248–251PubMedCrossRef Hanna GB, Shimi SM, Cuschieri A (1998) Randomised study of influence of two-dimensional versus three-dimensional imaging on performance of laparoscopic cholecystectomy. Lancet 351: 248–251PubMedCrossRef
10.
go back to reference McCloy R, Stone R (2001) Science, medicine, and the future. Virtual reality in surgery. BMJ 323: 912–915 McCloy R, Stone R (2001) Science, medicine, and the future. Virtual reality in surgery. BMJ 323: 912–915
11.
go back to reference Moore MJ, Bennett CL (1995) The learning curve for laparoscopic cholecystectomy. The Southern Surgeons Club. Am J Surg 170: 55–59PubMedCrossRef Moore MJ, Bennett CL (1995) The learning curve for laparoscopic cholecystectomy. The Southern Surgeons Club. Am J Surg 170: 55–59PubMedCrossRef
12.
go back to reference Sariego J, Spitzer L, Matsumoto T (1993) The “learning curve” in the performance of laparoscopic cholecystectomy. Int Surg 78: 1–3PubMed Sariego J, Spitzer L, Matsumoto T (1993) The “learning curve” in the performance of laparoscopic cholecystectomy. Int Surg 78: 1–3PubMed
13.
go back to reference Satava RM (1993) Virtual reality surgical simulator. The first steps. Surg Endosc 7: 203–205CrossRef Satava RM (1993) Virtual reality surgical simulator. The first steps. Surg Endosc 7: 203–205CrossRef
14.
go back to reference Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17: 803–810PubMedCrossRef Schijven M, Jakimowicz J (2003) Construct validity: experts and novices performing on the Xitact LS500 laparoscopy simulator. Surg Endosc 17: 803–810PubMedCrossRef
15.
go back to reference Schijven MP, Jakimowicz JJ, Broeders IA, Tseng LN (2005) The Eindhoven laparoscopic cholecystectomy training course—improving operating room performance using virtual reality training: results from the first E.A.E.S. accredited virtual reality trainings curriculum. Surg Endosc 19: 1220–1226PubMedCrossRef Schijven MP, Jakimowicz JJ, Broeders IA, Tseng LN (2005) The Eindhoven laparoscopic cholecystectomy training course—improving operating room performance using virtual reality training: results from the first E.A.E.S. accredited virtual reality trainings curriculum. Surg Endosc 19: 1220–1226PubMedCrossRef
16.
go back to reference Sherman V, Feldman LS, Stanbridge D, Kazmi R, Fried GM (2005) Assessing the learning curve for the acquisition of laparoscopic skills on a virtual reality simulator. Surg Endosc 19: 678–682PubMedCrossRef Sherman V, Feldman LS, Stanbridge D, Kazmi R, Fried GM (2005) Assessing the learning curve for the acquisition of laparoscopic skills on a virtual reality simulator. Surg Endosc 19: 678–682PubMedCrossRef
17.
go back to reference Taffinder N, Sutton C, Fishwick RJ, McManus IC, Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform 50: 124–130PubMed Taffinder N, Sutton C, Fishwick RJ, McManus IC, Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MIST VR laparoscopic simulator. Stud Health Technol Inform 50: 124–130PubMed
Metadata
Title
Construct validity of the LapSim: Can the LapSim virtual reality simulator distinguish between novices and experts?
Authors
K. W. van Dongen
E. Tournoij
D. C. van der Zee
M. P. Schijven
I. A. M. J. Broeders
Publication date
01-08-2007
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 8/2007
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-006-9188-2

Other articles of this Issue 8/2007

Surgical Endoscopy 8/2007 Go to the issue