Skip to main content
Top
Published in: Surgical Endoscopy 5/2003

01-05-2003

Construct validity

Authors: M. Schijven, J. Jakimowicz

Published in: Surgical Endoscopy | Issue 5/2003

Login to get access

Abstract

Background: This study was undertaken to establish construct validity of the Xitact LS500, a virtual reality laparoscopic cholecystectomy simulator. The primary research statement is: “The clip-and-cut task on the Xitact LS500 virtual reality laparoscopic cholecystectomy simulator mimics the surgical procedure of the clipping and cutting of the cystic duct and artery during the laparoscopic cholecystectomy adequately.” Methods: According to the level of experience of the surgeon, an “expert group opinion” was formed resulting from 37 surgeons having performed over 100 laparoscopic cholecystectomies, and a “novice group opinion” was formed resulting of 37 surgeons having no experience at all with performing laparoscopic cholecystectomy. Participants received an instructed hands-on “tour” on the Xitact simulator and performed three formal simulation runs. Results: The “novice group” is younger and more surgeons are female. Performance scores in the “expert” group are significantly higher on the second (p value 0.011) and third (p value 0.005) run, compared to the novices’ scores. Experts are significantly faster on completion of all three runs. There is an increase in score over runs in both groups, which is statistically significant in the “expert group.” Less than one-third of surgeons in either group are able to correctly predict their performance score as generated by Xitact. Both “experts” and “novices” feel it is useful to train with Xitact LS500 in the surgical curriculum. Conclusions: Three hypotheses, formulated to operationalize the primary research statement, could be answered affirmatively. Although further validation studies are needed, the Xitact LS500 simulator seems to be able to discriminate between expert and novice surgeons in this research setting, and thus the construct for this setting is considered to be valid.
Literature
1.
go back to reference Ault, G, et al. 2001Exporting a technical skills evaluation technology to other sites.Am J Surg182254256CrossRefPubMed Ault, G,  et al. 2001Exporting a technical skills evaluation technology to other sites.Am J Surg182254256CrossRefPubMed
2.
go back to reference Chaudhry, A, et al. 1999Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human–computer interface.Ann R Coll Surg Engl81281286 Chaudhry, A,  et al. 1999Learning rate for laparoscopic surgical skills on MIST VR, a virtual reality simulator: quality of human–computer interface.Ann R Coll Surg Engl81281286
3.
go back to reference Coleman, J, Nduka, CC, Darzi, A 1994Virtual reality and laparoscopic surgery.Br J Surg8117091711PubMed Coleman, J, Nduka, CC, Darzi, A 1994Virtual reality and laparoscopic surgery.Br J Surg8117091711PubMed
4.
go back to reference Derossis, AM, Antoniuk, M, Fried, GM 1999Evaluation of laparoscopic skills: a 2-year follow-up during residency training.Can J Surg42293296PubMed Derossis, AM, Antoniuk, M, Fried, GM 1999Evaluation of laparoscopic skills: a 2-year follow-up during residency training.Can J Surg42293296PubMed
5.
go back to reference Gaberson, KB 1997Measurement reliability and validity.AORN J6610921094PubMed Gaberson, KB 1997Measurement reliability and validity.AORN J6610921094PubMed
6.
go back to reference Gallagher, AG, et al. 1999Virtual reality training in laparoscopic surgery: a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR).Endoscopy31310313CrossRefPubMed Gallagher, AG,  et al. 1999Virtual reality training in laparoscopic surgery: a preliminary assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR).Endoscopy31310313CrossRefPubMed
7.
go back to reference Gallagher A, Crothers I, Satava R (2001) Comprehensive objective assessment of fundamental skills for laparoscopic surgery. In 19th International Congress of the European Association for Endoscopic Surgery, Maastricht, The Netherlands Gallagher A, Crothers I, Satava R (2001) Comprehensive objective assessment of fundamental skills for laparoscopic surgery. In 19th International Congress of the European Association for Endoscopic Surgery, Maastricht, The Netherlands
8.
go back to reference Gallagher AG, et al. (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg DOI: 10.1007/s00268-001-0133-1 Gallagher AG, et al. (2001) Objective psychomotor skills assessment of experienced, junior, and novice laparoscopists with virtual reality. World J Surg DOI: 10.1007/s00268-001-0133-1
9.
go back to reference Gallagher AG, et al. (2002) From VR to OR: a prospective, randomized, double-blind controlled trial of virtual reality (VR) training for operating room (OR) performance of laparoscopic cholecystectomy. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal Gallagher AG, et al. (2002) From VR to OR: a prospective, randomized, double-blind controlled trial of virtual reality (VR) training for operating room (OR) performance of laparoscopic cholecystectomy. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal
10.
go back to reference Grantcharov, TP, et al. 2001Virtual reality computer simulation: an objective method for the evaluation of laparoscopic surgical skills.Surg Endosc15242244CrossRefPubMed Grantcharov, TP,  et al. 2001Virtual reality computer simulation: an objective method for the evaluation of laparoscopic surgical skills.Surg Endosc15242244CrossRefPubMed
11.
go back to reference Grantcharov TP (2002) Teaching and testing surgical skills on a VR laparoscopy simulator—learning curves and effect of previous operative experience on performance. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal Grantcharov TP (2002) Teaching and testing surgical skills on a VR laparoscopy simulator—learning curves and effect of previous operative experience on performance. In 10th International Congress of the European Association for Endoscopic Surgery, Centro de Congresses, Lisboa, Portugal
12.
go back to reference Hyltander A et al. (2002) The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc DOI: 10.1007/s00464-001-9184-5 Hyltander A et al. (2002) The transfer of basic skills learned in a laparoscopic simulator to the operating room. Surg Endosc DOI: 10.1007/s00464-001-9184-5
13.
go back to reference Jordan, J-A, et al. 2000A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition.Am J Surg180208211PubMed Jordan, J-A,  et al. 2000A comparison between randomly alternating imaging, normal laparoscopic imaging, and virtual reality training in laparoscopic psychomotor skill acquisition.Am J Surg180208211PubMed
14.
go back to reference Karras, D 1997Statistical methodology: II. Reliability and validity assessment in study design, part B.Acad Emerg Med4144147PubMed Karras, D 1997Statistical methodology: II. Reliability and validity assessment in study design, part B.Acad Emerg Med4144147PubMed
15.
go back to reference McNatt, SS, Smith, SGT 2001A computer-based laparoscopic skills assessment device differentiates experienced from novice surgeons.Surg Endosc1510851089 McNatt, SS, Smith, SGT 2001A computer-based laparoscopic skills assessment device differentiates experienced from novice surgeons.Surg Endosc1510851089
16.
go back to reference Nelson, AA 1980Research design: measurement, reliability and validity.Am J Hosp Pharm37851857PubMed Nelson, AA 1980Research design: measurement, reliability and validity.Am J Hosp Pharm37851857PubMed
17.
go back to reference Ota, D, et al. 1995Virtual reality in surgical education.Comput Biol Med25127137 Ota, D,  et al. 1995Virtual reality in surgical education.Comput Biol Med25127137
18.
go back to reference Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Feasibility, reliability and validity of new assessment form for use with basic surgical trainees.Am J Surg1822429CrossRefPubMed Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Feasibility, reliability and validity of new assessment form for use with basic surgical trainees.Am J Surg1822429CrossRefPubMed
19.
go back to reference Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Validity of surgical simulation for the assessment of operative skill.Br J Surg8815251532CrossRefPubMed Paisly, AM, Baldwin, P, Paterson-Brown, S 2001Validity of surgical simulation for the assessment of operative skill.Br J Surg8815251532CrossRefPubMed
20.
go back to reference Prystowski, JB, et al. 1999A virtual reality module for intravenous catheter placement.Am J Surg177171175CrossRefPubMed Prystowski, JB,  et al. 1999A virtual reality module for intravenous catheter placement.Am J Surg177171175CrossRefPubMed
21.
go back to reference Reznick, RK 1993Teaching and testing technical skills.Am J Surg165358361PubMed Reznick, RK 1993Teaching and testing technical skills.Am J Surg165358361PubMed
22.
go back to reference Reznick, R, et al. 1997Testing technical skills via an innovative “Bench Examination.”Am J Surg173226230CrossRefPubMed Reznick, R,  et al. 1997Testing technical skills via an innovative “Bench Examination.”Am J Surg173226230CrossRefPubMed
23.
go back to reference Satava, RM 2001Accomplishments and challenges of surgical simulation. Dawning of the next-generation surgical education.Surg Endosc15232241CrossRefPubMed Satava, RM 2001Accomplishments and challenges of surgical simulation. Dawning of the next-generation surgical education.Surg Endosc15232241CrossRefPubMed
24.
go back to reference Schijven MP, Jakimowicz J (2002) Face, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator. Surg Endosc DOI: 10.1007/s00464-001-9229-9 Schijven MP, Jakimowicz J (2002) Face, expert, and referent validity of the Xitact LS500 Laparoscopy Simulator. Surg Endosc DOI: 10.1007/s00464-001-9229-9
25.
go back to reference Schijven MP, Jakimowicz J, Schot C (2002) The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance. Surg Endosc DOI: 10.1007/s00464-001-9146-y Schijven MP, Jakimowicz J, Schot C (2002) The Advanced Dundee Endoscopic Psychomotor Tester (ADEPT) objectifying subjective psychomotor test performance. Surg Endosc DOI: 10.1007/s00464-001-9146-y
26.
go back to reference Taffinder, N, et al. 1998Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomized controlled studies using the MIST VR laparoscopic simulator.Westwood, JD eds. Technology and Informatics 50: Proceedings of Medicine Meets Virtual Reality, 28–31 January 1998IOS Press and Ohmsha AmsterdamSan Diego Taffinder, N,  et al. 1998Validation of virtual reality to teach and assess psychomotor skills in laparoscopic surgery: results from randomized controlled studies using the MIST VR laparoscopic simulator.Westwood, JD eds. Technology and Informatics 50: Proceedings of Medicine Meets Virtual Reality, 28–31 January 1998IOS Press and Ohmsha AmsterdamSan Diego
27.
go back to reference Taffinder, NJ, et al. 1998An objective assessment of surgeons’ psychomotor skills: validation of the MIST-VR laparoscopic simulator.Br J Surg8575PubMed Taffinder, NJ,  et al. 1998An objective assessment of surgeons’ psychomotor skills: validation of the MIST-VR laparoscopic simulator.Br J Surg8575PubMed
28.
go back to reference Torkington, J, et al. 2001Skill transfer from virtual reality to a real laparoscopic task.Surg Endosc1510761079PubMed Torkington, J,  et al. 2001Skill transfer from virtual reality to a real laparoscopic task.Surg Endosc1510761079PubMed
29.
go back to reference Whitney, JD 1999Notes on methodology. Validity and reliability: basic research concepts.J WOCN26240249 Whitney, JD 1999Notes on methodology. Validity and reliability: basic research concepts.J WOCN26240249
30.
go back to reference Wilson, MS, et al. 1997MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance.Ann R Coll Surg Engl79403404PubMed Wilson, MS,  et al. 1997MIST VR: a virtual reality trainer for laparoscopic surgery assesses performance.Ann R Coll Surg Engl79403404PubMed
Metadata
Title
Construct validity
Authors
M. Schijven
J. Jakimowicz
Publication date
01-05-2003
Publisher
Springer-Verlag
Published in
Surgical Endoscopy / Issue 5/2003
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-002-9151-9

Other articles of this Issue 5/2003

Surgical Endoscopy 5/2003 Go to the issue