Skip to main content
Top
Published in: World Journal of Surgery 8/2010

01-08-2010

Procedural Performance in Gastrointestinal Endoscopy: Live and Simulated

Authors: Sudip K. Sarker, Tark Albrani, Atiquaz Zaman, Isis Kumar

Published in: World Journal of Surgery | Issue 8/2010

Login to get access

Abstract

Background

The purpose of the present study was to compare the use of a human and a computer-based technical skills assessment tool in live and simulated gastrointestinal endoscopies performed by consultants and trainees.

Methods

Validated human-based Likert scales were used individually for generic and specific technical skills for two procedures. Two observers assessed each procedure independently and blindly. Computer-based assessment tools were also used, assessing aspects of the mucosa as well as various procedural times. The two tools were then compared.

Results

A total of 210 live and simulated endoscopies (107 esophagogastroduodenoscopy [OGD], 103 sigmoidoscopy) were performed by 18 consultants and 37 trainees. Mean inter-rater reliability using Cronbach alpha was good for the human-based tool (range: p = 0.62–0.75). Construct validity was good for the human-based tool (analysis of variance [ANOVA] range: p = 0.000–0.002) but not for the computer-based tool (ANOVA range: p = 0.263–0.701).

Conclusions

This human-based technical skills assessment tool of gastrointestinal endoscopies seems to have face, content, concurrent, and construct validities compared to computer-based assessment parameters. The tool has the possibility of being used in training, self-appraisal, and revalidation.
Literature
1.
go back to reference Moorthy K, Muntz Y, Sarker SK et al (2003) Objective assessment of technical skills in surgery. BMJ 327:1032–1037CrossRefPubMed Moorthy K, Muntz Y, Sarker SK et al (2003) Objective assessment of technical skills in surgery. BMJ 327:1032–1037CrossRefPubMed
3.
go back to reference Kopta JA (1971) An approach to the evaluation of operative skills. Surgery 70:297–303PubMed Kopta JA (1971) An approach to the evaluation of operative skills. Surgery 70:297–303PubMed
4.
go back to reference Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177:28–32CrossRefPubMed Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177:28–32CrossRefPubMed
5.
go back to reference Ross DG, Harris CA, Jones DJ (2002) A comparison of operative experience for basic surgical trainees in 1992 and 2000. Br J Surg 89(Suppl 1):60 Ross DG, Harris CA, Jones DJ (2002) A comparison of operative experience for basic surgical trainees in 1992 and 2000. Br J Surg 89(Suppl 1):60
6.
go back to reference Skidmore FD (1997) Junior surgeons are becoming deskilled as result of Calman proposals. BMJ 314:1281PubMed Skidmore FD (1997) Junior surgeons are becoming deskilled as result of Calman proposals. BMJ 314:1281PubMed
7.
go back to reference Darzi A, Smith S, Taffinder N (1999) Assessing operative skill needs to become more objective. BMJ 318:887–888PubMed Darzi A, Smith S, Taffinder N (1999) Assessing operative skill needs to become more objective. BMJ 318:887–888PubMed
8.
go back to reference McCloy R, Stone R (2001) Science, medicine, and the future. Virtual reality in surgery. BMJ 323:912–915CrossRefPubMed McCloy R, Stone R (2001) Science, medicine, and the future. Virtual reality in surgery. BMJ 323:912–915CrossRefPubMed
9.
go back to reference Satava RM, Cuschieri A, Hamdorf J (2003) Metrics for objective assessment. Surg Endosc 17:220–226CrossRefPubMed Satava RM, Cuschieri A, Hamdorf J (2003) Metrics for objective assessment. Surg Endosc 17:220–226CrossRefPubMed
10.
go back to reference Grantcharov TP, Bardram L, Funch-Jensen PM et al (2001) Virtual reality computer simulation as a tool for training and assessment of skills in laparoscopic surgery. Ugeskr Laeger 163:3651–3653PubMed Grantcharov TP, Bardram L, Funch-Jensen PM et al (2001) Virtual reality computer simulation as a tool for training and assessment of skills in laparoscopic surgery. Ugeskr Laeger 163:3651–3653PubMed
11.
go back to reference Grantcharov TP, Rosenberg J, Pahle E et al (2001) Virtual reality computer simulation—an objective method for evaluation of laparoscopic surgical skills. Surg Endosc 15:242–244CrossRefPubMed Grantcharov TP, Rosenberg J, Pahle E et al (2001) Virtual reality computer simulation—an objective method for evaluation of laparoscopic surgical skills. Surg Endosc 15:242–244CrossRefPubMed
12.
go back to reference Sarker SK, Chang A, Albrani T et al (2008) Constructing a hierarchical task analysis in surgery. Surg Endosc 22:107–111CrossRefPubMed Sarker SK, Chang A, Albrani T et al (2008) Constructing a hierarchical task analysis in surgery. Surg Endosc 22:107–111CrossRefPubMed
13.
go back to reference Sarker SK, Chang A, Vincent C et al (2006) Development of assessing generic & specific technical skills in laparoscopic surgery. Am J Surg 191:238–244CrossRefPubMed Sarker SK, Chang A, Vincent C et al (2006) Development of assessing generic & specific technical skills in laparoscopic surgery. Am J Surg 191:238–244CrossRefPubMed
14.
go back to reference Albrani T, Zaman A, Patel B et al (2007) Self appraisal and assessment of technical skills in endoscopic procedures. Gut 56:A86 Albrani T, Zaman A, Patel B et al (2007) Self appraisal and assessment of technical skills in endoscopic procedures. Gut 56:A86
15.
go back to reference Moorthy K, Munz Y, Jiwanji M et al (2004) Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback. Surg Endosc 18:328–333CrossRefPubMed Moorthy K, Munz Y, Jiwanji M et al (2004) Validity and reliability of a virtual reality upper gastrointestinal simulator and cross validation using structured assessment of individual performance with video playback. Surg Endosc 18:328–333CrossRefPubMed
16.
go back to reference Moorthy K, Munz Y, Orchard TR et al (2004) An innovative method for the assessment of skills in lower gastrointestinal endoscopy. Surg Endosc 18:1613–1619PubMed Moorthy K, Munz Y, Orchard TR et al (2004) An innovative method for the assessment of skills in lower gastrointestinal endoscopy. Surg Endosc 18:1613–1619PubMed
17.
go back to reference Sedlack RE, Kolars JC, Alexander JA (2004) Computer simulation training enhances patient comfort during endoscopy. Clin Gastroenterol Hepatol 2:348–352CrossRefPubMed Sedlack RE, Kolars JC, Alexander JA (2004) Computer simulation training enhances patient comfort during endoscopy. Clin Gastroenterol Hepatol 2:348–352CrossRefPubMed
18.
go back to reference Sedlack RE, Kolars JC (2004) Computer simulator training enhances the competency of gastroenterology fellows at colonoscopy: results of a pilot study. Am J Gastroenterol 99:33–37CrossRefPubMed Sedlack RE, Kolars JC (2004) Computer simulator training enhances the competency of gastroenterology fellows at colonoscopy: results of a pilot study. Am J Gastroenterol 99:33–37CrossRefPubMed
19.
go back to reference Sedlack RE, Kolars JC (2003) Validation of a computer-based colonoscopy simulator. Gastrointest Endosc 57:214–218CrossRefPubMed Sedlack RE, Kolars JC (2003) Validation of a computer-based colonoscopy simulator. Gastrointest Endosc 57:214–218CrossRefPubMed
20.
go back to reference Sedlack RE (2007) Validation of computer simulation training for esophagogastroduodenoscopy: pilot study. J Gastroenterol Hepatol 22:1214–1219CrossRefPubMed Sedlack RE (2007) Validation of computer simulation training for esophagogastroduodenoscopy: pilot study. J Gastroenterol Hepatol 22:1214–1219CrossRefPubMed
21.
go back to reference Koch AD, Buzink SN, Heemskerk J et al (2008) Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc 22:158–162CrossRefPubMed Koch AD, Buzink SN, Heemskerk J et al (2008) Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc 22:158–162CrossRefPubMed
22.
go back to reference Immenroth M, Burger T, Brenner J et al (2007) Mental training in surgical education: a randomized controlled trial. Ann Surg 245:385–391CrossRefPubMed Immenroth M, Burger T, Brenner J et al (2007) Mental training in surgical education: a randomized controlled trial. Ann Surg 245:385–391CrossRefPubMed
23.
go back to reference Aggarwal R, Grantcharov TP, Eriksen JR et al (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMed Aggarwal R, Grantcharov TP, Eriksen JR et al (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314CrossRefPubMed
24.
go back to reference Ferlitsch A, Glauninger P, Gupper A et al (2002) Evaluation of a virtual endoscopy simulator for training in gastrointestinal endoscopy. Endoscopy 34:698–702CrossRefPubMed Ferlitsch A, Glauninger P, Gupper A et al (2002) Evaluation of a virtual endoscopy simulator for training in gastrointestinal endoscopy. Endoscopy 34:698–702CrossRefPubMed
25.
go back to reference Felsher JJ, Olesevich M, Farres H et al (2005) Validation of a flexible endoscopy simulator. Am J Surg 189:497–500CrossRefPubMed Felsher JJ, Olesevich M, Farres H et al (2005) Validation of a flexible endoscopy simulator. Am J Surg 189:497–500CrossRefPubMed
Metadata
Title
Procedural Performance in Gastrointestinal Endoscopy: Live and Simulated
Authors
Sudip K. Sarker
Tark Albrani
Atiquaz Zaman
Isis Kumar
Publication date
01-08-2010
Publisher
Springer-Verlag
Published in
World Journal of Surgery / Issue 8/2010
Print ISSN: 0364-2313
Electronic ISSN: 1432-2323
DOI
https://doi.org/10.1007/s00268-010-0579-0

Other articles of this Issue 8/2010

World Journal of Surgery 8/2010 Go to the issue