Top

Irish Journal of Medical Science (1971 -)

Published in:

01-08-2019 | Original Article

Validation of a virtual reality laparoscopic appendicectomy simulator: a novel process using cognitive task analysis

Authors: Sandeep Krishan Nayar, Liam Musto, Roland Fernandes, Rasiah Bharathan

Published in: Irish Journal of Medical Science (1971 -) | Issue 3/2019

Abstract

Background

Virtual reality (VR) simulation is a vital component of surgical training with demonstrated improvements in surgical quality and clinical outcome.

Aims

To validate the LAP Mentor (Simbionix™) laparoscopic appendicectomy (LA) VR simulator with inclusion of a novel tool, Cognitive Task Analysis (CTA).

Methods

Thirty-two novices and nine experienced surgeons performed two simulated LAs. An expert-consensus questionnaire guided face validity assessment. Content validity was assessed using CTA-derived questions encompassing eight operative steps and four decision points. Construct validity was evaluated using dexterity metrics, masked assessment of surgical quality using the OSATS global rating scale, and mental workload from two validated tools: the NASA-TLX and SMEQ. Ten novices performed eight further LAs for learning curve assessment.

Results

Face validity was demonstrated across all domains. Considering content validity, the essential technical and non-technical steps were evident. The experienced group performed the procedure quicker (median time 361 vs. 538 s, P = 0.0039) with fewer total movements (426 vs. 641, P < 0.0001) and shorter idle time (131 vs. 199 s, P = 0.0006). This correlated with higher OSATS scores (median 33.5 vs. 22.2, P < 0.0001) and lower mental demand (NASA-TLX: 9.0 vs. 13.75, P = 0.012; SMEQ: 60 vs. 80, P = 0.0025), indicating construct validity. Learning curve data showed statistically significant improvements after the 7th session for procedure time, total movements and idle time, which correlated with reduction in mental demand.

Conclusions

The LAP Mentor demonstrates face, content and construct validity for LA; thus, it can be used as an effective tool in surgical training. Task repetition leads to achievement of expert benchmarks.

HES Hospital episode statistics. Health and Social Care Information Centre. http://www.hesonline.nhs.uk. Accessed 19th July 2017

Owings MF, Kozak LJ (1998) Ambulatory and inpatient procedures in the United States, 1996. Vital Health Stat 13(139):1–119

Biondi A, Di Stefano C, Ferrara F, Bellia A, Vacante M, Piazza L (2016) Laparoscopic versus open appendectomy: a retrospective cohort study assessing outcomes and cost-effectiveness. World J Emerg Surg 11(1):44. https://doi.org/10.1186/s13017-016-0102-5 CrossRefPubMedPubMedCentral

Yu MC, Feng YJ, Wang W, Fan W, Cheng HT, Xu J (2017) Is laparoscopic appendectomy feasible for complicated appendicitis ?A systematic review and meta-analysis. Int J Surg 40:187–197. https://doi.org/10.1016/j.ijsu.2017.03.022 CrossRefPubMed

Di Saverio S, Birindelli A, Kelly MD, Catena F, Weber DG, Sartelli M, Sugrue M, De Moya M, Gomes CA, Bhangu A, Agresta F, Moore EE, Soreide K, Griffiths E, De Castro S, Kashuk J, Kluger Y, Leppaniemi A, Ansaloni L, Andersson M, Coccolini F, Coimbra R, Gurusamy KS, Campanile FC, Biffl W, Chiara O, Moore F, Peitzman AB, Fraga GP, Costa D, Maier RV, Rizoli S, Balogh ZJ, Bendinelli C, Cirocchi R, Tonini V, Piccinini A, Tugnoli G, Jovine E, Persiani R, Biondi A, Scalea T, Stahel P, Ivatury R, Velmahos G, Andersson R (2016) WSES Jerusalem guidelines for diagnosis and treatment of acute appendicitis. World J Emerg Surg 11(34):34. https://doi.org/10.1186/s13017-016-0090-5 CrossRefPubMedPubMedCentral

Agresta F, De Simone P, Leone L, Arezzo A, Biondi A, Bottero L, Catena F, Conzo G, Del Genio G, Fersini A, Guerrieri M, Illomei G, Tonelli P, Vitellaro M, Docimo G, Crucitti A (2004) Laparoscopic appendectomy in Italy: an appraisal of 26,863 cases. J Laparoendosc Adv Surg Tech A 14(1):1–8. https://doi.org/10.1089/109264204322862270 CrossRefPubMed

Jaffer U, Cameron AE (2008) Laparoscopic appendectomy: a junior trainee’s learning curve. JSLS 12(3):288–291PubMedPubMedCentral

Thompson JE, Egger S, Bohm M, Haynes AM, Matthews J, Rasiah K, Stricker PD (2014) Superior quality of life and improved surgical margins are achievable with robotic radical prostatectomy after a long learning curve: a prospective single-surgeon study of 1552 consecutive cases. Eur Urol 65(3):521–531. https://doi.org/10.1016/j.eururo.2013.10.030 CrossRefPubMed

Gallagher AG, Ritter EM, Champion H, Higgins G, Fried MP, Moses G, Smith CD, Satava RM (2005) Virtual reality simulation for the operating room: proficiency-based training as a paradigm shift in surgical skills training. Ann Surg 241(2):364–372CrossRefPubMedPubMedCentral

10.

Yiannakopoulou E, Nikiteas N, Perrea D, Tsigris C (2015) Virtual reality simulators and training in laparoscopic surgery. Int J Surg 13:60–64. https://doi.org/10.1016/j.ijsu.2014.11.014 CrossRefPubMed

11.

Aucar JA, Groch NR, Troxel SA, Eubanks SW (2005) A review of surgical simulation with attention to validation methodology. Surg Laparosc Endosc Percutan Tech 15(2):82–89CrossRefPubMed

12.

McDougall EM (2007) Validation of surgical simulators. J Endourol 21(3):244–247. https://doi.org/10.1089/end.2007.9985 CrossRefPubMed

13.

Spencer FC (1978) Teaching and measuring surgical techniques: the technical evaluation of competence. Bull Am Coll Surg 64:9–12

14.

Smink DS, Peyre SE, Soybel DI, Tavakkolizadeh A, Vernon AH, Anastakis DJ (2012) Utilization of a cognitive task analysis for laparoscopic appendectomy to identify differentiated intraoperative teaching objectives. Am J Surg 203(4):540–545. https://doi.org/10.1016/j.amjsurg.2011.11.002 CrossRefPubMed

15.

Pugh CM, DaRosa DA, Santacaterina S, Clark RE (2011) Faculty evaluation of simulation-based modules for assessment of intraoperative decision making. Surgery 149(4):534–542. https://doi.org/10.1016/j.surg.2010.10.010 CrossRefPubMed

16.

Crandall B, Klein GA, Hoffman RR (2006) Working minds: a practitioner’s guide to cognitive task analysis. MIT Press, CambridgeCrossRef

17.

Velmahos GC, Toutouzas KG, Sillin LF, Chan L, Clark RE, Theodorou D, Maupin F (2004) Cognitive task analysis for teaching technical skills in an inanimate surgical skills laboratory. Am J Surg 187(1):114–119CrossRefPubMed

18.

Luker KR, Sullivan ME, Peyre SE, Sherman R, Grunwald T (2008) The use of a cognitive task analysis-based multimedia program to teach surgical decision making in flexor tendon repair. Am J Surg 195(1):11–15. https://doi.org/10.1016/j.amjsurg.2007.08.052 CrossRefPubMed

19.

Paro JAM, Luan A, Lee GK (2017) Validation of a cognitive task simulation and rehearsal tool for open carpal tunnel release. Arch Plast Surg 44(3):223–227. https://doi.org/10.5999/aps.2017.44.3.223 CrossRefPubMedPubMedCentral

20.

Xu S, Perez M, Perrenot C, Hubert N, Hubert J (2016) Face, content, construct, and concurrent validity of a novel robotic surgery patient-side simulator: the Xperience Team Trainer. Surg Endosc 30(8):3334–3344. https://doi.org/10.1007/s00464-015-4607-x CrossRefPubMed

21.

Barsness KA, Rooney DM, Davis LM, O'Brien E (2015) Evaluation of three sources of validity evidence for a laparoscopic duodenal atresia repair simulator. J Laparoendosc Adv Surg Tech A 25(3):256–260. https://doi.org/10.1089/lap.2014.0358 CrossRefPubMed

22.

Escamirosa FP, Flores RM, Garcia IO, Vidal CR, Martinez AM (2015) Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons. Surg Endosc 29(11):3392–3403. https://doi.org/10.1007/s00464-014-4032-6 CrossRefPubMed

23.

Kawaguchi K, Egi H, Hattori M, Sawada H, Suzuki T, Ohdan H (2014) Validation of a novel basic virtual reality simulator, the LAP-X, for training basic laparoscopic skills. Minim Invasive Ther Allied Technol 23(5):287–293. https://doi.org/10.3109/13645706.2014.903853 CrossRefPubMed

24.

Xiao D, Jakimowicz JJ, Albayrak A, Buzink SN, Botden SM, Goossens RH (2014) Face, content, and construct validity of a novel portable ergonomic simulator for basic laparoscopic skills. J Surg Educ 71(1):65–72. https://doi.org/10.1016/j.jsurg.2013.05.003 CrossRefPubMed

25.

Hennessey IA, Hewett P (2013) Construct, concurrent, and content validity of the eoSim laparoscopic simulator. J Laparoendosc Adv Surg Tech A 23(10):855–860. https://doi.org/10.1089/lap.2013.0229 CrossRefPubMed

26.

Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186(3):1019–1024. https://doi.org/10.1016/j.juro.2011.04.064 CrossRefPubMed

27.

Gavazzi A, Bahsoun AN, Van Haute W, Ahmed K, Elhage O, Jaye P, Khan MS, Dasgupta P (2011) Face, content and construct validity of a virtual reality simulator for robotic surgery (SEP Robot). Ann R Coll Surg Engl 93(2):152–156. https://doi.org/10.1308/003588411x12851639108358 CrossRefPubMedPubMedCentral

28.

Martin JA, Regehr G, Reznick R, MacRae H, Murnaghan J, Hutchison C, Brown M (1997) Objective structured assessment of technical skill (OSATS) for surgical residents. Br J Surg 84(2):273–278CrossRefPubMed

29.

Hart SG, Staveland LE (1988) Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. In: Hancock PA, Meshkati N (eds) Advances in psychology, vol 52. North-Holland, pp 139–183. https://doi.org/10.1016/S0166-4115(08)62386-9

30.

Hart SG (2006) NASA-Task Load Index (NASA-TLX); 20 years later. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 50 (9):904–908. https://doi.org/10.1177/154193120605000909

31.

Anvari M (2007) Remote telepresence surgery: the Canadian experience. Surg Endosc 21(4):537–541. https://doi.org/10.1007/s00464-006-9040-8 CrossRefPubMed

32.

Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244(2):310–314. https://doi.org/10.1097/01.sla.0000218094.92650.44 CrossRefPubMedPubMedCentral

33.

Chikwe J, de Souza AC, Pepper JR (2004) No time to train the surgeons. BMJ 328(7437):418–419. https://doi.org/10.1136/bmj.328.7437.418 CrossRefPubMedPubMedCentral

34.

Guller U, Hervey S, Purves H, Muhlbaier LH, Peterson ED, Eubanks S, Pietrobon R (2004) Laparoscopic versus open appendectomy: outcomes comparison based on a large administrative database. Ann Surg 239(1):43–52. https://doi.org/10.1097/01.sla.0000103071.35986.c1 CrossRefPubMedPubMedCentral

35.

Larsen CR, Soerensen JL, Grantcharov TP, Dalsgaard T, Schouenborg L, Ottosen C, Schroeder TV, Ottesen BS (2009) Effect of virtual reality training on laparoscopic surgery: randomised controlled trial. BMJ 338:b1802. https://doi.org/10.1136/bmj.b1802 CrossRefPubMedPubMedCentral

36.

Sirimanna P, Gladman MA (2017) Development of a proficiency-based virtual reality simulation training curriculum for laparoscopic appendicectomy. ANZ J Surg 87(10):760–766. https://doi.org/10.1111/ans.14135 CrossRefPubMed

37.

Stefanidis D, Scerbo MW, Montero PN, Acker CE, Smith WD (2012) Simulator training to automaticity leads to improved skill transfer compared with traditional proficiency-based training: a randomized controlled trial. Ann Surg 255(1):30–37. https://doi.org/10.1097/SLA.0b013e318220ef31 CrossRefPubMed

38.

Yurko YY, Scerbo MW, Prabhu AS, Acker CE, Stefanidis D (2010) Higher mental workload is associated with poorer laparoscopic performance as measured by the NASA-TLX tool. Simul Healthc 5(5):267–271. https://doi.org/10.1097/SIH.0b013e3181e3f329 CrossRefPubMed

39.

Seymour NE, Gallagher AG, Roman SA, O'Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236(4):458–463; discussion 463-454. https://doi.org/10.1097/01.sla.0000028969.51489.b4 CrossRefPubMedPubMedCentral

40.

Calatayud D, Arora S, Aggarwal R, Kruglikova I, Schulze S, Funch-Jensen P, Grantcharov T (2010) Warm-up in a virtual reality environment improves performance in the operating room. Ann Surg 251(6):1181–1185. https://doi.org/10.1097/SLA.0b013e3181deb630 CrossRefPubMed

Title: Validation of a virtual reality laparoscopic appendicectomy simulator: a novel process using cognitive task analysis
Authors: Sandeep Krishan Nayar
Liam Musto
Roland Fernandes
Rasiah Bharathan
Publication date: 01-08-2019
Publisher: Springer London
Published in: Irish Journal of Medical Science (1971 -) / Issue 3/2019
Print ISSN: 0021-1265
Electronic ISSN: 1863-4362
DOI: https://doi.org/10.1007/s11845-018-1931-x

Live Webinar | 27-06-2024 | 18:00 (CEST)

Keynote webinar | Spotlight on medication adherence

Reserve your place

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

WHO estimates that half of all patients worldwide are non-adherent to their prescribed medication. The consequences of poor adherence can be catastrophic, on both the individual and population level.

Join our expert panel to discover why you need to understand the drivers of non-adherence in your patients, and how you can optimize medication adherence in your clinics to drastically improve patient outcomes.

Prof. Kevin Dolgin

Prof. Florian Limbourg

Prof. Anoop Chauhan

Developed by: Springer Medicine

Obesity Clinical Trial Summary

At a glance: The STEP trials

A round-up of the STEP phase 3 clinical trials evaluating semaglutide for weight loss in people with overweight or obesity.

Developed by: Springer Medicine

Highlights from the ACC 2024 Congress

Year in Review: Pediatric cardiology

Pediatric Cardiology Video

Watch Dr. Anne Marie Valente present the last year's highlights in pediatric and congenital heart disease in the official ACC.24 Year in Review session.

Year in Review: Pulmonary vascular disease

Cardiopulmonary Comorbidity Video

The last year's highlights in pulmonary vascular disease are presented by Dr. Jane Leopold in this official video from ACC.24.

Year in Review: Valvular heart disease

Valvular Heart Disease Video

Watch Prof. William Zoghbi present the last year's highlights in valvular heart disease from the official ACC.24 Year in Review session.

Year in Review: Heart failure and cardiomyopathies

Heart Failure Video

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.

ACC 2024 Congress Coverage

Year in Review: Heart failure and cardiomyopathies

Heart Failure Video

Watch this official video from ACC.24. Dr. Biykem Bozkurt discusses last year's major advances in heart failure and cardiomyopathies.

Watch now

Semaglutide benefits people with type 2 diabetes and obesity-related heart failure

16-04-2024 Type 2 Diabetes News

Incentivised to exercise

11-04-2024 Lifestyle Modifications News

New intervention for STEMI-related cardiogenic shock

10-04-2024 Myocardial Infarction News

» View more highlights on the ACC 2024 congress hub page

Image Credits

Illustration of figure on mountain summit/© Orapun / Stock.adobe.com, STEP AAG HeroTeaserCollection image/© Tarek / Generated with AI / Stock.adobe.com, ACC 2024 Pediatric and Congenital Heart Disease: Year in Review/© 2024 American College of Cardiology, ACC 2024 Pulmonary Vascular Disease: Year in Review/© 2024 American College of Cardiology, ACC 2024 Valvular Heart Disease: Year in Review/© 2024 American College of Cardiology, ACC 2024 HF and Cardiomyopathies: Year in Review/© 2024 American College of Cardiology, Woman out walking/© Seventyfour / stock.adobe.com (symbolic image with model), Woman checking smartwatch /© saltdium / stock.adobe.com (symbolic image with model), Cardiac catheterization/© Damian / stock.adobe.com

At a glance: The STEP trials

Springer Medicine

Abstract

Background

Aims

Methods

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 3/2019

Introduction of an academic internship in Ireland: views of undergraduate medical students

Dietary patterns were not associated with age-related macular degeneration: a cross-sectional analysis in the Irish Nun Eye Study

Appropriate use of elective coronary angiography in patients with suspected stable coronary artery disease

Burning mouth syndrome—a diagnostic dilemma

Limax Nd:YAG laser–assisted thoracoscopic resection of pulmonary metastases; a single centre’s initial experience

Management of type 1 diabetes in primary schools in Ireland: a cross-sectional survey

Live: Thursday 27th June 2024, 18:00-19:30 (CEST)

Highlights from the ACC 2024 Congress

ACC 2024 Congress Coverage