Skip to main content
Top
Published in: Hernia 4/2020

01-08-2020 | Original Article

Validation and educational impact study of the NANEP high-fidelity simulation model for open preperitoneal mesh repair of umbilical hernia

Authors: U. Friedrich, J. Backhaus, C. T. Zipper, S. König, S. Mavroveli, A. Wiegering, S. Olbrecht, F. Puppe, U. A. Dietz

Published in: Hernia | Issue 4/2020

Login to get access

Abstract

Objective

The aim of the study was to develop, validate and analyze the educational impact of a high-fidelity simulation model for open preperitoneal mesh repair of an umbilical hernia.

Summary of background data

The number of surgical simulators available for training residents is limited. Primary for ethical reasons and secondary for the emerging pay-per-quality policies, practicing-on simulators rather than patients is considered gold standard. Validated full-procedural surgical models will become more and more important in training residents. Such models may assure that evidence-based standards regarding technical aspects of the procedures become integral part of the curriculum. Furthermore, they can be employed as a quality control of residents’ skills (Fonseca et al. in J Surg Educ 70:129–137, 2013).

Methods

In a repeated measures design, medical students, residents in their last year of training and attending surgeons performed an open preperitoneal mesh repair on the NANEP model [NANEP stands for the German acronym Nabelhernien-Netzimplatation-Präperitonal (English: Umbilical hernia mesh implantation preperitoneal)]. Subjects were categorized as “Beginners” (internship students) or “Experts” (residents and surgeons). Content validity was analyzed by criteria of subject-matter-experts. Blinded raters assessed surgical skills by means of the Competency Assessment Tool (CAT) using the online platform “CATLIVE”. Differential validity was measured by group differences. Proficiency gain was analyzed by monitoring the learning curve (Gallagher et al. in Ann Surg 241:364–372, 2005). Post-operative examination of the simulators shed light on criterion validity.

Results

The NANEP model-proofed content and construct-valid significant Bonferroni-corrected differences were found between beginners and experts (p < 0.05). Beginners showed a significant learning increase from the first to the second surgery (p < 0.05). Post-operative examination data confirmed criterion validity.

Conclusion

The NANEP model is an inexpensive, simple and efficient simulation model. It has highly realistic features, it has been shown to be of high-fidelity, full-procedural and benchtop-model. The NANEP model meets the main needs of surgical educational courses at the beginning of residency.
Literature
1.
2.
go back to reference Fonseca AL, Evans LV, Gusberg RJ (2013) Open surgical simulation in residency training: a review of its status and a case for its incorporation. J Surg Educ 70:129–137CrossRef Fonseca AL, Evans LV, Gusberg RJ (2013) Open surgical simulation in residency training: a review of its status and a case for its incorporation. J Surg Educ 70:129–137CrossRef
3.
go back to reference Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372PubMedPubMedCentralCrossRef Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241:364–372PubMedPubMedCentralCrossRef
4.
go back to reference Flin R, O’Connor P, Mearns K (2002) Crew resource management: improving team work in high reliability industries. Team performance management. An Int J 8:68–78 Flin R, O’Connor P, Mearns K (2002) Crew resource management: improving team work in high reliability industries. Team performance management. An Int J 8:68–78
5.
go back to reference Daniel M, Makary MA (2016) Medical error—the third leading cause of death in the US. BMJ 353:i2139PubMed Daniel M, Makary MA (2016) Medical error—the third leading cause of death in the US. BMJ 353:i2139PubMed
6.
go back to reference Weller J, Boyd M, Cumin D (2014) Teams, tribes and patient safety: overcoming barriers to effective teamwork in healthcare. Postgrad Med J 90:149–154PubMedCrossRef Weller J, Boyd M, Cumin D (2014) Teams, tribes and patient safety: overcoming barriers to effective teamwork in healthcare. Postgrad Med J 90:149–154PubMedCrossRef
7.
8.
9.
go back to reference Badash I, Burttt K, Solorzano CA, Carey JN (2016) Innovations in surgery simulation: a review of past, current and future techniques. Ann Transl Med 4:453PubMedPubMedCentralCrossRef Badash I, Burttt K, Solorzano CA, Carey JN (2016) Innovations in surgery simulation: a review of past, current and future techniques. Ann Transl Med 4:453PubMedPubMedCentralCrossRef
10.
go back to reference Brydges R, Hatala R, Zendejas B, Erwin PJ, Cook DA (2015) Linking simulation-based educational assessments and patient-related outcomes: a systematic review and meta-analysis. Acad Med 90:246–256PubMedCrossRef Brydges R, Hatala R, Zendejas B, Erwin PJ, Cook DA (2015) Linking simulation-based educational assessments and patient-related outcomes: a systematic review and meta-analysis. Acad Med 90:246–256PubMedCrossRef
11.
go back to reference McCulloch P, Altman DG, Campbell WB et al (2009) No surgical innovation without evaluation: the IDEAL recommendations. Lancet 374:1105–1112PubMedCrossRef McCulloch P, Altman DG, Campbell WB et al (2009) No surgical innovation without evaluation: the IDEAL recommendations. Lancet 374:1105–1112PubMedCrossRef
12.
go back to reference Dietz UA, Menzel S, Lock J, Wiegering A (2018) The Treatment of Incisional Hernia. Dtsch Arztebl Int 115:31–37PubMed Dietz UA, Menzel S, Lock J, Wiegering A (2018) The Treatment of Incisional Hernia. Dtsch Arztebl Int 115:31–37PubMed
13.
go back to reference Davies J, Khatib M, Bello F (2019) Open surgical simulation—a review. J Surg Educ 70:618–627CrossRef Davies J, Khatib M, Bello F (2019) Open surgical simulation—a review. J Surg Educ 70:618–627CrossRef
14.
go back to reference Vick LR, Vick KD, BormanKR Salameh JR (2007) Face, content, and construct validities of inanimate intestinal anastomoses simulation. J Surg Educ 64:365–368PubMedCrossRef Vick LR, Vick KD, BormanKR Salameh JR (2007) Face, content, and construct validities of inanimate intestinal anastomoses simulation. J Surg Educ 64:365–368PubMedCrossRef
15.
go back to reference Miskovic D (2012) Proficiency gain and competency assessment in laparoscopic colorectal surgery. PhD Thesis. Imperial College London Miskovic D (2012) Proficiency gain and competency assessment in laparoscopic colorectal surgery. PhD Thesis. Imperial College London
16.
go back to reference Haynes SN, Richard D, Kubany ES (1995) Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess 7:238–247CrossRef Haynes SN, Richard D, Kubany ES (1995) Content validity in psychological assessment: a functional approach to concepts and methods. Psychol Assess 7:238–247CrossRef
17.
go back to reference Yaghmale F (2003) Content validity and its estimation. J Med Educ 3:25–27 Yaghmale F (2003) Content validity and its estimation. J Med Educ 3:25–27
18.
go back to reference Bühner M (2011) Einführung in die Test-und Fragebogenkonstruktion. Pearson Deutschland GmbH Bühner M (2011) Einführung in die Test-und Fragebogenkonstruktion. Pearson Deutschland GmbH
19.
go back to reference Polit DF, Beck CT (2006) The content validity index: are you sure you know what's being reported? Critique and recommendations. Res Nurs Health 29:489–497PubMedCrossRef Polit DF, Beck CT (2006) The content validity index: are you sure you know what's being reported? Critique and recommendations. Res Nurs Health 29:489–497PubMedCrossRef
20.
go back to reference Polit DF, Beck CT, Owen SV (2007) Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 30:459–467PubMedCrossRef Polit DF, Beck CT, Owen SV (2007) Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health 30:459–467PubMedCrossRef
21.
go back to reference Tavakol M, Mohagheghi MA, Dennick R (2008) Assessing the skills of surgical residents using simulation. J Surg Educ 65:77–83PubMedCrossRef Tavakol M, Mohagheghi MA, Dennick R (2008) Assessing the skills of surgical residents using simulation. J Surg Educ 65:77–83PubMedCrossRef
22.
go back to reference Satava RM (2006) Assessing surgery skills through simulation. Clin Teacher 3:107–111CrossRef Satava RM (2006) Assessing surgery skills through simulation. Clin Teacher 3:107–111CrossRef
23.
go back to reference Fisseni HJ (2004) Lehrbuch der psychologischen Diagnostik: mit Hinweisen zur Intervention. Hogrefe Verlag, Göttingen Fisseni HJ (2004) Lehrbuch der psychologischen Diagnostik: mit Hinweisen zur Intervention. Hogrefe Verlag, Göttingen
24.
go back to reference Nunnally JC (1967) Psychometric theory. McGraw-Hill, New York Nunnally JC (1967) Psychometric theory. McGraw-Hill, New York
25.
go back to reference Bowling A (2014) Research methods in health: investigating health and health services. Maidenhead, McGraw-Hill Education Bowling A (2014) Research methods in health: investigating health and health services. Maidenhead, McGraw-Hill Education
26.
go back to reference Lehmann IJ (1965) Educational measurements and their interpretation. Wadworth Publishing Co, Belmont Lehmann IJ (1965) Educational measurements and their interpretation. Wadworth Publishing Co, Belmont
27.
go back to reference Finn RH (1970) A note on estimating the reliability of categorical data. Educ Psychol Meas 30:71–76CrossRef Finn RH (1970) A note on estimating the reliability of categorical data. Educ Psychol Meas 30:71–76CrossRef
28.
go back to reference Eichhorn T (2011) Systematische psychologisch-diagnostische Gesprächsführung und Verhaltensbeobachtung zur Erfassung leistungsrelevanter Arbeitshaltungen. University of Vienna, Vienna Eichhorn T (2011) Systematische psychologisch-diagnostische Gesprächsführung und Verhaltensbeobachtung zur Erfassung leistungsrelevanter Arbeitshaltungen. University of Vienna, Vienna
29.
go back to reference Stratford PW, Riddle DL (2005) Assessing sensitivity to change: choosing the appropriate change coefficient. Health Qual Life Out 3:23CrossRef Stratford PW, Riddle DL (2005) Assessing sensitivity to change: choosing the appropriate change coefficient. Health Qual Life Out 3:23CrossRef
30.
go back to reference Rasch D, Guiard V (2004) The robustness of parametric statistical methods. Psychol Sci 46:175–208 Rasch D, Guiard V (2004) The robustness of parametric statistical methods. Psychol Sci 46:175–208
31.
go back to reference Guiard V, Rasch D (2004) The robustness of two sample tests for means. A reply on von Eye’s comment. Psychol Sci 46:549–554 Guiard V, Rasch D (2004) The robustness of two sample tests for means. A reply on von Eye’s comment. Psychol Sci 46:549–554
32.
go back to reference Scalese RJ, Obeso VZ, Issenberg SB (2008) Simulation technology for skills training and competency assessment in medical education. J Gen Int Med 23:46–49CrossRef Scalese RJ, Obeso VZ, Issenberg SB (2008) Simulation technology for skills training and competency assessment in medical education. J Gen Int Med 23:46–49CrossRef
33.
go back to reference Miskovic D, Ni M, Wyles SM et al (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257:476–482PubMedCrossRef Miskovic D, Ni M, Wyles SM et al (2013) Is competency assessment at the specialist level achievable? A study for the national training programme in laparoscopic colorectal surgery in England. Ann Surg 257:476–482PubMedCrossRef
34.
go back to reference Dreyfus SE, Dreyfus HL (1980) A five-stage model of the mental activities involved in directed skill acquisition. California Univ Berkeley Operations Research Center, CaliforniaCrossRef Dreyfus SE, Dreyfus HL (1980) A five-stage model of the mental activities involved in directed skill acquisition. California Univ Berkeley Operations Research Center, CaliforniaCrossRef
35.
go back to reference Eraut M (2002) Developing professional knowledge and competence. Routledge, LondonCrossRef Eraut M (2002) Developing professional knowledge and competence. Routledge, LondonCrossRef
36.
go back to reference Bradley P (2006) The history of simulation in medical education and possible future directions. Med Educ 40:254–262PubMedCrossRef Bradley P (2006) The history of simulation in medical education and possible future directions. Med Educ 40:254–262PubMedCrossRef
38.
go back to reference Hammoud MM, Nuthalapaty FS, Goepfert AR et al (2008) To the point: medical education review of the role of simulators in surgical training. Am J Obstet Gynecol 199:338–343PubMedCrossRef Hammoud MM, Nuthalapaty FS, Goepfert AR et al (2008) To the point: medical education review of the role of simulators in surgical training. Am J Obstet Gynecol 199:338–343PubMedCrossRef
39.
go back to reference Grober ED, Hamstra SJ, Wanzel KR, Reznik RK, Matsumoto ED, Sidhu RS, Jarvi KA (2004) The educational impact of bench model fidelity on the acquisition of technical skill: the use of clinically relevant outcome measures. Ann Surg 240:374–381PubMedPubMedCentralCrossRef Grober ED, Hamstra SJ, Wanzel KR, Reznik RK, Matsumoto ED, Sidhu RS, Jarvi KA (2004) The educational impact of bench model fidelity on the acquisition of technical skill: the use of clinically relevant outcome measures. Ann Surg 240:374–381PubMedPubMedCentralCrossRef
40.
go back to reference McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ (2006) Effect of practice on standardised learning outcomes in simulation-based medical education. Med Educ 40:792–797PubMedCrossRef McGaghie WC, Issenberg SB, Petrusa ER, Scalese RJ (2006) Effect of practice on standardised learning outcomes in simulation-based medical education. Med Educ 40:792–797PubMedCrossRef
41.
go back to reference Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ (2005) Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teacher 27:10–28CrossRef Issenberg SB, McGaghie WC, Petrusa ER, Lee Gordon D, Scalese RJ (2005) Features and uses of high-fidelity medical simulations that lead to effective learning: a BEME systematic review. Med Teacher 27:10–28CrossRef
42.
go back to reference Maran NJ, Glavin RJ (2003) Low-to high-fidelity simulation–a continuum of medical education? Med Educ 37:22–28PubMedCrossRef Maran NJ, Glavin RJ (2003) Low-to high-fidelity simulation–a continuum of medical education? Med Educ 37:22–28PubMedCrossRef
43.
go back to reference Kneebone R, Nestel D, Vincent C, Darzi A (2007) Complexity, risk and simulation in learning procedural skills. Med Educ 41:808–814PubMedCrossRef Kneebone R, Nestel D, Vincent C, Darzi A (2007) Complexity, risk and simulation in learning procedural skills. Med Educ 41:808–814PubMedCrossRef
44.
go back to reference Khatib M, Nald N, Brenton H, Barakat NF, Sarker SK, Standfield N, Ziprin P, Kneebone R, Bello F (2014) Validation of open inguinal hernia repair simulation model: a randomized controlled educational trial. Am J Surg 208:295–301PubMedCrossRef Khatib M, Nald N, Brenton H, Barakat NF, Sarker SK, Standfield N, Ziprin P, Kneebone R, Bello F (2014) Validation of open inguinal hernia repair simulation model: a randomized controlled educational trial. Am J Surg 208:295–301PubMedCrossRef
45.
go back to reference Laubert T (2017) Ausbildung in laparoskopischen Techniken. Minimalinvasive Viszeralchirurgie. Springer, Heidelberg, pp 23–31CrossRef Laubert T (2017) Ausbildung in laparoskopischen Techniken. Minimalinvasive Viszeralchirurgie. Springer, Heidelberg, pp 23–31CrossRef
Metadata
Title
Validation and educational impact study of the NANEP high-fidelity simulation model for open preperitoneal mesh repair of umbilical hernia
Authors
U. Friedrich
J. Backhaus
C. T. Zipper
S. König
S. Mavroveli
A. Wiegering
S. Olbrecht
F. Puppe
U. A. Dietz
Publication date
01-08-2020
Publisher
Springer Paris
Published in
Hernia / Issue 4/2020
Print ISSN: 1265-4906
Electronic ISSN: 1248-9204
DOI
https://doi.org/10.1007/s10029-019-02004-9

Other articles of this Issue 4/2020

Hernia 4/2020 Go to the issue