Skip to main content
Top
Published in: Surgical Endoscopy 3/2016

01-03-2016

Face and construct validation of a next generation virtual reality (Gen2-VR©) surgical simulator

Authors: Ganesh Sankaranarayanan, Baichun Li, Kelly Manser, Stephanie B. Jones, Daniel B. Jones, Steven Schwaitzberg, Caroline G. L. Cao, Suvranu De

Published in: Surgical Endoscopy | Issue 3/2016

Login to get access

Abstract

Introduction

Surgical performance is affected by distractors and interruptions to surgical workflow that exist in the operating room. However, traditional surgical simulators are used to train surgeons in a skills laboratory that does not recreate these conditions. To overcome this limitation, we have developed a novel, immersive virtual reality (Gen2-VR©) system to train surgeons in these environments. This study was to establish face and construct validity of our system.

Methods and procedures

The study was a within-subjects design, with subjects repeating a virtual peg transfer task under three different conditions: Case I: traditional VR; Case II: Gen2-VR© with no distractions and Case III: Gen2-VR© with distractions and interruptions. In Case III, to simulate the effects of distractions and interruptions, music was played intermittently, the camera lens was fogged for 10 s and tools malfunctioned for 15 s at random points in time during the simulation. At the completion of the study subjects filled in a 5-point Likert scale feedback questionnaire. A total of sixteen subjects participated in this study.

Results

Friedman test showed significant difference in scores between the three conditions (p < 0.0001). Post hoc analysis using Wilcoxon signed-rank tests with Bonferroni correction further showed that all the three conditions were significantly different from each other (Case I, Case II, p < 0.0001), (Case I, Case III, p < 0.0001) and (Case II, Case III, p = 0.009). Subjects rated that fog (mean 4.18) and tool malfunction (median 4.56) significantly hindered their performance.

Conclusion

The results showed that Gen2-VR© simulator has both face and construct validity and that it can accurately and realistically present distractions and interruptions in a simulated OR, in spite of limitations of the current HMD hardware technology.
Literature
1.
go back to reference Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967CrossRefPubMed Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967CrossRefPubMed
2.
go back to reference Arikatla VS, Sankaranarayanan G, Ahn W, Chellali A, De S, Caroline GL et al (2013) Face and construct validation of a virtual peg transfer simulator. Surg Endosc 27(5):1721–1729.PubMedCentralCrossRefPubMed Arikatla VS, Sankaranarayanan G, Ahn W, Chellali A, De S, Caroline GL et al (2013) Face and construct validation of a virtual peg transfer simulator. Surg Endosc 27(5):1721–1729.PubMedCentralCrossRefPubMed
3.
go back to reference Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P et al (2004) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19(3):401–405CrossRefPubMed Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P et al (2004) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19(3):401–405CrossRefPubMed
4.
go back to reference Shiralkar U (2011) Smart surgeons sharp decisions: cognitive skills to avoid errors and achieve results, 1st edn. Tfm Pub Ltd, Harley Shiralkar U (2011) Smart surgeons sharp decisions: cognitive skills to avoid errors and achieve results, 1st edn. Tfm Pub Ltd, Harley
5.
go back to reference Healey AN, Sevdalis N, Vincent CA (2006) Measuring intra-operative interference from distraction and interruption observed in the operating theatre. Ergonomics 49(5–6):589–604CrossRefPubMed Healey AN, Sevdalis N, Vincent CA (2006) Measuring intra-operative interference from distraction and interruption observed in the operating theatre. Ergonomics 49(5–6):589–604CrossRefPubMed
6.
go back to reference Zheng B, Martinec DV, Cassera MA, Swanström LL (2008) A quantitative study of disruption in the operating room during laparoscopic antireflux surgery. Surg Endosc 22(10):2171–2177CrossRefPubMed Zheng B, Martinec DV, Cassera MA, Swanström LL (2008) A quantitative study of disruption in the operating room during laparoscopic antireflux surgery. Surg Endosc 22(10):2171–2177CrossRefPubMed
7.
go back to reference Wiegmann DA, ElBardissi AW, Dearani JA, Daly RC, Sundt TM III (2007) Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. Surgery 142(5):658–665CrossRefPubMed Wiegmann DA, ElBardissi AW, Dearani JA, Daly RC, Sundt TM III (2007) Disruptions in surgical flow and their relationship to surgical errors: an exploratory investigation. Surgery 142(5):658–665CrossRefPubMed
9.
go back to reference Lave J, Wenger E (1991) Situated learning: legitimate peripheral participation, 1st edn. Cambridge University Press, CambridgeCrossRef Lave J, Wenger E (1991) Situated learning: legitimate peripheral participation, 1st edn. Cambridge University Press, CambridgeCrossRef
11.
go back to reference Tsuda S, Scott D, Doyle J, Jones DB (2009) Surgical skills training and simulation. Curr Probl Surg 46(4):271–370CrossRefPubMed Tsuda S, Scott D, Doyle J, Jones DB (2009) Surgical skills training and simulation. Curr Probl Surg 46(4):271–370CrossRefPubMed
12.
13.
go back to reference Arikatla VS, Sankaranarayanan G, Ahn W, Chellali A, Cao CGL, De S (2013) Development and validation of VBLaST-PT©: a virtual peg transfer simulator. Stud Health Technol Inf 184:24–30 Arikatla VS, Sankaranarayanan G, Ahn W, Chellali A, Cao CGL, De S (2013) Development and validation of VBLaST-PT©: a virtual peg transfer simulator. Stud Health Technol Inf 184:24–30
14.
go back to reference Chellali A, Zhang L, Sankaranarayanan G, Arikatla VS, Ahn W, Derevianko A et al (2014) Validation of the VBLaST peg transfer task: a first step toward an alternate training standard. Surg Endosc 28(10):2856–2862PubMedCentralCrossRefPubMed Chellali A, Zhang L, Sankaranarayanan G, Arikatla VS, Ahn W, Derevianko A et al (2014) Validation of the VBLaST peg transfer task: a first step toward an alternate training standard. Surg Endosc 28(10):2856–2862PubMedCentralCrossRefPubMed
15.
16.
go back to reference Hasfeldt D, Laerkner E, Birkelund R (2010) Noise in the operating room–what do we know? A review of the literature. J Perianesth Nurs 25(6):380–386CrossRefPubMed Hasfeldt D, Laerkner E, Birkelund R (2010) Noise in the operating room–what do we know? A review of the literature. J Perianesth Nurs 25(6):380–386CrossRefPubMed
17.
go back to reference Pluyter JR, Buzink SN, Rutkowski A-F, Jakimowicz JJ (2010) Do absorption and realistic distraction influence performance of component task surgical procedure? Surg Endosc 24(4):902–907PubMedCentralCrossRefPubMed Pluyter JR, Buzink SN, Rutkowski A-F, Jakimowicz JJ (2010) Do absorption and realistic distraction influence performance of component task surgical procedure? Surg Endosc 24(4):902–907PubMedCentralCrossRefPubMed
18.
go back to reference Persoon MC, Broos HJHP, Witjes JA, Hendrikx AJM, Scherpbier AJJM (2011) The effect of distractions in the operating room during endourological procedures. Surg Endosc 25(2):437–443PubMedCentralCrossRefPubMed Persoon MC, Broos HJHP, Witjes JA, Hendrikx AJM, Scherpbier AJJM (2011) The effect of distractions in the operating room during endourological procedures. Surg Endosc 25(2):437–443PubMedCentralCrossRefPubMed
19.
go back to reference Siu K-C, Suh IH, Mukherjee M, Oleynikov D, Stergiou N (2010) The impact of environmental noise on robot-assisted laparoscopic surgical performance. Surgery 147(1):107–113CrossRefPubMed Siu K-C, Suh IH, Mukherjee M, Oleynikov D, Stergiou N (2010) The impact of environmental noise on robot-assisted laparoscopic surgical performance. Surgery 147(1):107–113CrossRefPubMed
20.
go back to reference Conrad C, Konuk Y, Werner P, Cao CG, Warshaw A, Rattner D et al (2010) The effect of defined auditory conditions versus mental loading on the laparoscopic motor skill performance of experts. Surg Endosc 24(6):1347–1352CrossRefPubMed Conrad C, Konuk Y, Werner P, Cao CG, Warshaw A, Rattner D et al (2010) The effect of defined auditory conditions versus mental loading on the laparoscopic motor skill performance of experts. Surg Endosc 24(6):1347–1352CrossRefPubMed
21.
go back to reference Miskovic D, Rosenthal R, Zingg U, Oertli D, Metzger U, Jancke L (2008) Randomized controlled trial investigating the effect of music on the virtual reality laparoscopic learning performance of novice surgeons. Surg Endosc 22(11):2416–2420CrossRefPubMed Miskovic D, Rosenthal R, Zingg U, Oertli D, Metzger U, Jancke L (2008) Randomized controlled trial investigating the effect of music on the virtual reality laparoscopic learning performance of novice surgeons. Surg Endosc 22(11):2416–2420CrossRefPubMed
22.
go back to reference Moorthy K, Munz Y, Undre S, Darzi A (2004) Objective evaluation of the effect of noise on the performance of a complex laparoscopic task. Surgery 136(1):25–30 (discussion 31) CrossRefPubMed Moorthy K, Munz Y, Undre S, Darzi A (2004) Objective evaluation of the effect of noise on the performance of a complex laparoscopic task. Surgery 136(1):25–30 (discussion 31) CrossRefPubMed
23.
24.
go back to reference Siu K-C, Suh IH, Mukherjee M, Oleynikov D, Stergiou N (2010) The effect of music on robot-assisted laparoscopic surgical performance. Surg Innov 17(4):306–311CrossRefPubMed Siu K-C, Suh IH, Mukherjee M, Oleynikov D, Stergiou N (2010) The effect of music on robot-assisted laparoscopic surgical performance. Surg Innov 17(4):306–311CrossRefPubMed
25.
go back to reference Goodell KH, Cao CGL, Schwaitzberg SD (2006) Effects of cognitive distraction on performance of laparoscopic surgical tasks. J Laparoendosc Adv Surg Tech 16(2):94–98CrossRef Goodell KH, Cao CGL, Schwaitzberg SD (2006) Effects of cognitive distraction on performance of laparoscopic surgical tasks. J Laparoendosc Adv Surg Tech 16(2):94–98CrossRef
26.
go back to reference Hsu KE, Man F-Y, Gizicki RA, Feldman LS, Fried GM (2008) Experienced surgeons can do more than one thing at a time: effect of distraction on performance of a simple laparoscopic and cognitive task by experienced and novice surgeons. Surg Endosc 22(1):196–201CrossRefPubMed Hsu KE, Man F-Y, Gizicki RA, Feldman LS, Fried GM (2008) Experienced surgeons can do more than one thing at a time: effect of distraction on performance of a simple laparoscopic and cognitive task by experienced and novice surgeons. Surg Endosc 22(1):196–201CrossRefPubMed
27.
go back to reference Pashler H, Johnston JC, Ruthruff E (2001) Attention and Performance. Annu Rev Psychol 52(1):629–651CrossRefPubMed Pashler H, Johnston JC, Ruthruff E (2001) Attention and Performance. Annu Rev Psychol 52(1):629–651CrossRefPubMed
Metadata
Title
Face and construct validation of a next generation virtual reality (Gen2-VR©) surgical simulator
Authors
Ganesh Sankaranarayanan
Baichun Li
Kelly Manser
Stephanie B. Jones
Daniel B. Jones
Steven Schwaitzberg
Caroline G. L. Cao
Suvranu De
Publication date
01-03-2016
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 3/2016
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-015-4278-7

Other articles of this Issue 3/2016

Surgical Endoscopy 3/2016 Go to the issue