Skip to main content
Top
Published in: BMC Surgery 1/2019

Open Access 01-12-2019 | Laparoscopy | Research article

Simulation as tool for evaluating and improving technical skills in laparoscopic gynecological surgery

Authors: Paolo Mannella, Elisa Malacarne, Andrea Giannini, Eleonora Russo, Marta Caretto, Francesca Papini, Maria Magdalena Montt Guevara, Federica Pancetti, Tommaso Simoncini

Published in: BMC Surgery | Issue 1/2019

Login to get access

Abstract

Background

Simulation in laparoscopic surgery is nowadays recognized as a valid instrument for learning and training surgeons in different procedures. However, its role as evaluation test and self-assessment tool to verify basic surgical skills is still under discussion.

Methods

Thirty-three residents in obstetrics and gynecology at University of Pisa, Italy were recruited, and they received a simulation program consisting of 5 tasks. They had to perform basic laparoscopic surgery maneuvers as creating pneumoperitoneum, positioning trocars under vision, demonstrating the appropriate use of dominant and non-dominant hand and making single stitch and knot. They were evaluated with a modified OSATs scale.

Results

Senior trainees had better score than junior trainees (p value< 0,005) and after different sessions of simulation scores of both groups significantly improved (p < 0,001), especially for the junior group. All the trainees reported self-assessments that matched with the evaluation of external observers demonstrating the importance of simulation also as auto-evaluation test.

Conclusions

In this study, we demonstrated the role of simulation as powerful tool to evaluate and to self-assess surgical technical skills and to improve own capacities, with the use of a modified OSATs scale adapted to specific exercises.
Literature
1.
go back to reference Kohn L, Corrigan J, Donaldson M. To Err Is Human: Building a Safer Health System. Washington, DC: Institute of Medicine; 2000. Kohn L, Corrigan J, Donaldson M. To Err Is Human: Building a Safer Health System. Washington, DC: Institute of Medicine; 2000.
2.
go back to reference Kairys JC, McGuire K, Crawford AG, Yeo CJ. Cumulative operative experience is decreasing during general surgery residency: a worrisome trend for surgical trainees? J Am Coll Surg. 2008;206:804–11 discussion 811-803.CrossRef Kairys JC, McGuire K, Crawford AG, Yeo CJ. Cumulative operative experience is decreasing during general surgery residency: a worrisome trend for surgical trainees? J Am Coll Surg. 2008;206:804–11 discussion 811-803.CrossRef
3.
go back to reference Agha RA, Fowler AJ. The role and validity of surgical simulation. Int Surg. 2015;100:350–7.CrossRef Agha RA, Fowler AJ. The role and validity of surgical simulation. Int Surg. 2015;100:350–7.CrossRef
4.
go back to reference Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002;236:458–63 discussion 463-454.CrossRef Seymour NE, Gallagher AG, Roman SA, et al. Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg. 2002;236:458–63 discussion 463-454.CrossRef
5.
go back to reference Zendejas B, Brydges R, Hamstra SJ, Cook DA. State of the evidence on simulation-based training for laparoscopic surgery: a systematic review. Ann Surg. 2013;257:586–93.CrossRef Zendejas B, Brydges R, Hamstra SJ, Cook DA. State of the evidence on simulation-based training for laparoscopic surgery: a systematic review. Ann Surg. 2013;257:586–93.CrossRef
7.
go back to reference Hilal Z, Kumpernatz AK, Rezniczek GA, Cetin C, Tempfer-Bentz EK, Tempfer CB. A randomized comparison of video demonstration versus hands-on training of medical students for vacuum delivery using Objective Structured Assessment of Technical Skills (OSATS). Medicine. 2017;96:e6355.CrossRef Hilal Z, Kumpernatz AK, Rezniczek GA, Cetin C, Tempfer-Bentz EK, Tempfer CB. A randomized comparison of video demonstration versus hands-on training of medical students for vacuum delivery using Objective Structured Assessment of Technical Skills (OSATS). Medicine. 2017;96:e6355.CrossRef
8.
go back to reference Buerkle B, Rueter K, Hefler LA, Tempfer-Bentz EK, Tempfer CB. Objective structured assessment of technical skills (OSATS) evaluation of theoretical versus hands-on training of vaginal breech delivery management: a randomized trial. Eur J Obstet Gynecol Reprod Biol. 2013;171:252–6.CrossRef Buerkle B, Rueter K, Hefler LA, Tempfer-Bentz EK, Tempfer CB. Objective structured assessment of technical skills (OSATS) evaluation of theoretical versus hands-on training of vaginal breech delivery management: a randomized trial. Eur J Obstet Gynecol Reprod Biol. 2013;171:252–6.CrossRef
9.
go back to reference Mannella P, Antonelli R, Montt-Guevara M, et al. Simulation of childbirth improves clinical management capacity and self-confidence in medical students. BMJ Simul Technol Enhanced Learn. 2018;4:184–89. Mannella P, Antonelli R, Montt-Guevara M, et al. Simulation of childbirth improves clinical management capacity and self-confidence in medical students. BMJ Simul Technol Enhanced Learn. 2018;4:184–89.
10.
go back to reference Mannella P, Palla G, Cuttano A, Boldrini A, Simoncini T. Effect of high-fidelity shoulder dystocia simulation on emergency obstetric skills and crew resource management skills among residents. Int J Gynaecol Obstet. 2016;135:338–42.CrossRef Mannella P, Palla G, Cuttano A, Boldrini A, Simoncini T. Effect of high-fidelity shoulder dystocia simulation on emergency obstetric skills and crew resource management skills among residents. Int J Gynaecol Obstet. 2016;135:338–42.CrossRef
11.
go back to reference Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–8.CrossRef Martin JA, Regehr G, Reznick R, et al. Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg. 1997;84:273–8.CrossRef
12.
go back to reference Shah J, Darzi A. Surgical skills assessment: an ongoing debate. BJU Int. 2001;88:655–60.CrossRef Shah J, Darzi A. Surgical skills assessment: an ongoing debate. BJU Int. 2001;88:655–60.CrossRef
13.
go back to reference Janssens S, Beckmann M, Bonney D. Introducing a laparoscopic simulation training and credentialing program in gynaecology: an observational study. Aust N Z J Obstet Gynaecol. 2015;55:374–8.CrossRef Janssens S, Beckmann M, Bonney D. Introducing a laparoscopic simulation training and credentialing program in gynaecology: an observational study. Aust N Z J Obstet Gynaecol. 2015;55:374–8.CrossRef
14.
go back to reference Crochet P, Agostini A, Knight S, Resseguier N, Berdah S, Aggarwal R. The performance gap for residents in transfer of Intracorporeal suturing skills from box trainer to operating room. J Surg Educ. 2017;74:1019–27.CrossRef Crochet P, Agostini A, Knight S, Resseguier N, Berdah S, Aggarwal R. The performance gap for residents in transfer of Intracorporeal suturing skills from box trainer to operating room. J Surg Educ. 2017;74:1019–27.CrossRef
15.
go back to reference van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J. Objective assessment of technical surgical skills. Br J Surg. 2010;97:972–87.CrossRef van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J. Objective assessment of technical surgical skills. Br J Surg. 2010;97:972–87.CrossRef
16.
go back to reference Goff BA, Lentz GM, Lee D, Fenner D, Morris J, Mandel LS. Development of a bench station objective structured assessment of technical skills. Obstet Gynecol. 2001;98:412–6.PubMed Goff BA, Lentz GM, Lee D, Fenner D, Morris J, Mandel LS. Development of a bench station objective structured assessment of technical skills. Obstet Gynecol. 2001;98:412–6.PubMed
17.
go back to reference Datta V, Bann S, Beard J, Mandalia M, Darzi A. Comparison of bench test evaluations of surgical skill with live operating performance assessments. J Am Coll Surg. 2004;199:603–6.CrossRef Datta V, Bann S, Beard J, Mandalia M, Darzi A. Comparison of bench test evaluations of surgical skill with live operating performance assessments. J Am Coll Surg. 2004;199:603–6.CrossRef
18.
go back to reference Hopmans CJ, den Hoed PT, van der Laan L, et al. Assessment of surgery residents’ operative skills in the operating theater using a modified objective structured assessment of technical skills (OSATS): a prospective multicenter study. Surgery. 2014;156:1078–88.CrossRef Hopmans CJ, den Hoed PT, van der Laan L, et al. Assessment of surgery residents’ operative skills in the operating theater using a modified objective structured assessment of technical skills (OSATS): a prospective multicenter study. Surgery. 2014;156:1078–88.CrossRef
19.
go back to reference Chang OH, King LP, Modest AM, Hur HC. Developing an objective structured assessment of technical skills for laparoscopic suturing and Intracorporeal knot tying. J Surg Educ. 2016;73:258–63.CrossRef Chang OH, King LP, Modest AM, Hur HC. Developing an objective structured assessment of technical skills for laparoscopic suturing and Intracorporeal knot tying. J Surg Educ. 2016;73:258–63.CrossRef
20.
go back to reference Knight S, Aggarwal R, Agostini A, Loundou A, Berdah S, Crochet P. Development of an objective assessment tool for total laparoscopic hysterectomy: a Delphi method among experts and evaluation on a virtual reality simulator. PLoS One. 2018;13:e0190580.CrossRef Knight S, Aggarwal R, Agostini A, Loundou A, Berdah S, Crochet P. Development of an objective assessment tool for total laparoscopic hysterectomy: a Delphi method among experts and evaluation on a virtual reality simulator. PLoS One. 2018;13:e0190580.CrossRef
21.
go back to reference Rao R, Dumon KR, Neylan CJ, et al. Can simulated team tasks be used to improve nontechnical skills in the operating room? J Surg Educ. 2016;73:e42–7.CrossRef Rao R, Dumon KR, Neylan CJ, et al. Can simulated team tasks be used to improve nontechnical skills in the operating room? J Surg Educ. 2016;73:e42–7.CrossRef
22.
go back to reference Lathrop A, Winningham B, VandeVusse L. Simulation-based learning for midwives: background and pilot implementation. J Midwifery Womens Health. 2007;52:492–8.CrossRef Lathrop A, Winningham B, VandeVusse L. Simulation-based learning for midwives: background and pilot implementation. J Midwifery Womens Health. 2007;52:492–8.CrossRef
23.
go back to reference Crochet P, Schmitt A, Rambeaud C, et al. Mandatory completion of a box trainer curriculum prior to laparoscopic apprenticeship in the OR for surgical residents: a before and after study. J Gynecol Obstet Hum Reprod. 2018;47:157–61.CrossRef Crochet P, Schmitt A, Rambeaud C, et al. Mandatory completion of a box trainer curriculum prior to laparoscopic apprenticeship in the OR for surgical residents: a before and after study. J Gynecol Obstet Hum Reprod. 2018;47:157–61.CrossRef
24.
go back to reference Donald K. Evaluating Training Programs: The Four Levels: McGraw-hill Education; 1994. Berrett-Koehler Publishers; 1st edition (November 1, 1994). Donald K. Evaluating Training Programs: The Four Levels: McGraw-hill Education; 1994. Berrett-Koehler Publishers; 1st edition (November 1, 1994).
25.
go back to reference Sturm LP, Windsor JA, Cosman PH, Cregan P, Hewett PJ, Maddern GJ. A systematic review of skills transfer after surgical simulation training. Ann Surg. 2008;248:166–79.CrossRef Sturm LP, Windsor JA, Cosman PH, Cregan P, Hewett PJ, Maddern GJ. A systematic review of skills transfer after surgical simulation training. Ann Surg. 2008;248:166–79.CrossRef
Metadata
Title
Simulation as tool for evaluating and improving technical skills in laparoscopic gynecological surgery
Authors
Paolo Mannella
Elisa Malacarne
Andrea Giannini
Eleonora Russo
Marta Caretto
Francesca Papini
Maria Magdalena Montt Guevara
Federica Pancetti
Tommaso Simoncini
Publication date
01-12-2019
Publisher
BioMed Central
Keyword
Laparoscopy
Published in
BMC Surgery / Issue 1/2019
Electronic ISSN: 1471-2482
DOI
https://doi.org/10.1186/s12893-019-0610-9

Other articles of this Issue 1/2019

BMC Surgery 1/2019 Go to the issue