Skip to main content
Top
Published in: Surgical Endoscopy 10/2008

01-10-2008 | New Technology

Construct validation of a novel hybrid virtual-reality simulator for training and assessing laparoscopic colectomy; results from the first course for experienced senior laparoscopic surgeons

Authors: Paul C. Neary, Emily Boyle, Conor P. Delaney, Anthony J. Senagore, Frank B. V. Keane, Anthony G. Gallagher

Published in: Surgical Endoscopy | Issue 10/2008

Login to get access

Abstract

Objectives

The objective of the study was to determine whether the metrics from a left-sided laparoscopic colectomy (LC) simulator could distinguish between the objectively scored performance of minimally invasive colorectal expert and novice surgeons. We report our results from the first virtual reality-based laparoscopic colorectal training course for experienced laparoscopic surgeons.

Methods

Eleven surgeons, experienced but novice in LC, constituted the novice group, and three experienced laparoscopic colorectal surgeons (>300 LCs) served as our experts. Novice subjects received didactic educational sessions and instruction in practice of LC from the experts. All subjects received instruction, demonstration, and supervision on the surgical technique to perform a LC on the simulator. All subjects then performed a laparoscopic colectomy on the simulator. Experts performed the same case as the novices. Outcomes measured by the simulator were time to perform the procedure, instrument path length, and smoothness of the trajectory of the instruments. Anatomy trays from the simulator were objectively scored for explicitly predefined intraoperative errors after each procedure.

Results

Expert surgeons performed significantly better then the novice colorectal surgeons with regard to instrument path length, instrument smoothness, and time taken to complete the procedure. Of the 13 predetermined errors, experts made significantly fewer errors in total then the novices (mean score 2.67 versus 4.7, p = 0.03), and performed better in 8 out of 13 errors.

Conclusion

The parameters assessed by the ProMIS VR simulator for laparoscopic colorectal training distinguished between novice and expert colorectal surgeons, despite using otherwise experienced novices who had extensive training before the procedure and expert mentoring during it. Experts performed the simulated procedure significantly faster with more efficient use of their instruments, and made fewer intraoperative errors. Thus the simulator demonstrated construct validity.
Literature
1.
go back to reference Coleman J, Nduka CC, Darzi A (1994) Virtual reality and laparoscopic surgery. Br J Surg 81:1709–1711PubMedCrossRef Coleman J, Nduka CC, Darzi A (1994) Virtual reality and laparoscopic surgery. Br J Surg 81:1709–1711PubMedCrossRef
2.
go back to reference Riva G (2003) Applications of Virtual Environments in Medicine. Methods Inf Med 42(5):524–534PubMed Riva G (2003) Applications of Virtual Environments in Medicine. Methods Inf Med 42(5):524–534PubMed
3.
go back to reference Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery; a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR). Endosc 31:310–313CrossRef Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery; a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR). Endosc 31:310–313CrossRef
4.
go back to reference Taffinder N, Sutton C, Fishwick RJ, McManus IC and Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MISTVR laparoscopic simulator. In: Westwood JD, Hoffman HM, Stredney D, Weghorst SJ (eds) Medicine meets virtual reality. IOS Press and Ohmsha Taffinder N, Sutton C, Fishwick RJ, McManus IC and Darzi A (1998) Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomised controlled studies using the MISTVR laparoscopic simulator. In: Westwood JD, Hoffman HM, Stredney D, Weghorst SJ (eds) Medicine meets virtual reality. IOS Press and Ohmsha
5.
6.
go back to reference Seymour N, Gallagher A, Roman S, et al (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–464PubMedCrossRef Seymour N, Gallagher A, Roman S, et al (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–464PubMedCrossRef
7.
go back to reference Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenerg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenerg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150PubMedCrossRef
8.
go back to reference Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA 3rd, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804PubMedCrossRef Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA 3rd, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804PubMedCrossRef
9.
go back to reference Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A, Fried MP (2005) Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg 131:217–221PubMedCrossRef Arora H, Uribe J, Ralph W, Zeltsan M, Cuellar H, Gallagher A, Fried MP (2005) Assessment of construct validity of the endoscopic sinus surgery simulator. Arch Otolaryngol Head Neck Surg 131:217–221PubMedCrossRef
10.
go back to reference Gallagher AG, Satava RM (2002) Objective assessment of experienced, junior and novice laparoscopic performance with virtual reality: Learning curves and reliability measures. Surg Endosc 16:1746–1752PubMedCrossRef Gallagher AG, Satava RM (2002) Objective assessment of experienced, junior and novice laparoscopic performance with virtual reality: Learning curves and reliability measures. Surg Endosc 16:1746–1752PubMedCrossRef
11.
go back to reference Gallagher AG, McGuigan J, Ritchie K, McClure N (2001) Objective psychomotor assessment of senior, junior and novice laparoscopists with virtual reality. World J Surg 25:1478–1483PubMedCrossRef Gallagher AG, McGuigan J, Ritchie K, McClure N (2001) Objective psychomotor assessment of senior, junior and novice laparoscopists with virtual reality. World J Surg 25:1478–1483PubMedCrossRef
12.
go back to reference Patel AD, Gallagher AG, Nicholson WJ, Cates CU (2006) Learning curves and reliability measures for virtual reality simulation in the performance assessment of carotid angiography. J Am Coll Cardiol 47:1796–1802PubMedCrossRef Patel AD, Gallagher AG, Nicholson WJ, Cates CU (2006) Learning curves and reliability measures for virtual reality simulation in the performance assessment of carotid angiography. J Am Coll Cardiol 47:1796–1802PubMedCrossRef
13.
go back to reference Guillou PJ, Quirke P, et al (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer. Lancet 365(9472):1718–1726PubMedCrossRef Guillou PJ, Quirke P, et al (2005) Short-term endpoints of conventional versus laparoscopic-assisted surgery in patients with colorectal cancer. Lancet 365(9472):1718–1726PubMedCrossRef
14.
go back to reference Clinical Outcomes of Surgical Therapy Group (2004) A Comparison of laparoscopically- assisted and open colectomy for colon cancer. N Eng J Med 350:2050–2059CrossRef Clinical Outcomes of Surgical Therapy Group (2004) A Comparison of laparoscopically- assisted and open colectomy for colon cancer. N Eng J Med 350:2050–2059CrossRef
15.
go back to reference Veldkamp R, Kuhry E, Hop WC, Jecklel J, Kazemier G, Bonjer HJ, et al (2005) Laparoscopic surgery versus open surgery for colon cancer: short term outcomes of a randomised trial. Lancet Oncol 6:477–484PubMedCrossRef Veldkamp R, Kuhry E, Hop WC, Jecklel J, Kazemier G, Bonjer HJ, et al (2005) Laparoscopic surgery versus open surgery for colon cancer: short term outcomes of a randomised trial. Lancet Oncol 6:477–484PubMedCrossRef
16.
go back to reference Tekkis PP, Senegore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91PubMedCrossRef Tekkis PP, Senegore AJ, Delaney CP, Fazio VW (2005) Evaluation of the learning curve in laparoscopic colorectal surgery: comparison of right-sided and left-sided resections. Ann Surg 242:83–91PubMedCrossRef
17.
go back to reference Schalachta CM, Mamazzo J, Seshadri PA, Caddedu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222CrossRef Schalachta CM, Mamazzo J, Seshadri PA, Caddedu M, Gregoire R, Poulin EC (2001) Defining a learning curve for laparoscopic colorectal resections. Dis Colon Rectum 44:217–222CrossRef
18.
go back to reference Simons AJ, Anthone GJ, Ortega AE, Franklin M, Fleeshnam J, Geis WP, Beart RW (1995) Laparoscopic-assisted colectomy learning curve. Dis Colon Rectum 38:600–603PubMedCrossRef Simons AJ, Anthone GJ, Ortega AE, Franklin M, Fleeshnam J, Geis WP, Beart RW (1995) Laparoscopic-assisted colectomy learning curve. Dis Colon Rectum 38:600–603PubMedCrossRef
19.
go back to reference Gallagher AG, Ritter EM, Satava R (2003) Fundamental principles of validation and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef Gallagher AG, Ritter EM, Satava R (2003) Fundamental principles of validation and reliability: rigorous science for the assessment of surgical education and training. Surg Endosc 17:1525–1529PubMedCrossRef
20.
go back to reference Delaney CP, Neary PC, Heriot AG, Senagore AJ (2007) Operative techniques in laparoscopic colorectal surgery. Lipincott Williams and Wilkins, Philapelphia Delaney CP, Neary PC, Heriot AG, Senagore AJ (2007) Operative techniques in laparoscopic colorectal surgery. Lipincott Williams and Wilkins, Philapelphia
21.
go back to reference American Psychological Association (APA) (1974) American Educational Research Association and National Council on Measurement in Education. Standards for educational and psychological tests. APA, Washington DC American Psychological Association (APA) (1974) American Educational Research Association and National Council on Measurement in Education. Standards for educational and psychological tests. APA, Washington DC
22.
go back to reference Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19:1216–1219PubMedCrossRef Eriksen JR, Grantcharov T (2005) Objective assessment of laparoscopic skills using a virtual reality stimulator. Surg Endosc 19:1216–1219PubMedCrossRef
23.
go back to reference Van Sickle KR, McClusky DA 3rd, Gallagher AG, Smith CD (2005) Construct validation of the ProMIS simulator using a novel laparoscopic suturing task. Surg Endosc 19:1227–1231PubMedCrossRef Van Sickle KR, McClusky DA 3rd, Gallagher AG, Smith CD (2005) Construct validation of the ProMIS simulator using a novel laparoscopic suturing task. Surg Endosc 19:1227–1231PubMedCrossRef
24.
go back to reference Bandura A (1971) Social learning theory. General Learning, Moristown, NJ Bandura A (1971) Social learning theory. General Learning, Moristown, NJ
25.
go back to reference Gallagher AG, Ritter EM, Champion H, Fried MP, Higgins G, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372PubMedCrossRef Gallagher AG, Ritter EM, Champion H, Fried MP, Higgins G, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372PubMedCrossRef
Metadata
Title
Construct validation of a novel hybrid virtual-reality simulator for training and assessing laparoscopic colectomy; results from the first course for experienced senior laparoscopic surgeons
Authors
Paul C. Neary
Emily Boyle
Conor P. Delaney
Anthony J. Senagore
Frank B. V. Keane
Anthony G. Gallagher
Publication date
01-10-2008
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 10/2008
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-008-9900-5

Other articles of this Issue 10/2008

Surgical Endoscopy 10/2008 Go to the issue

News and notices

News and Notices