Skip to main content
Top
Published in: Knee Surgery, Sports Traumatology, Arthroscopy 6/2016

01-06-2016 | Experimental Study

Validation of the PASSPORT V2 training environment for arthroscopic skills

Authors: J. J. Stunt, G. M. M. J. Kerkhoffs, T. Horeman, C. N. van Dijk, G. J. M. Tuijthof

Published in: Knee Surgery, Sports Traumatology, Arthroscopy | Issue 6/2016

Login to get access

Abstract

Purpose

Virtual reality simulators used in the education of orthopaedic residents often lack realistic haptic feedback. To solve this, the (Practice Arthroscopic Surgical Skills for Perfect Operative Real-life Treatment) PASSPORT simulator was developed, which was subjected to fundamental changes: improved realism and user interface. The purpose was to demonstrate its face and construct validity.

Methods

Thirty-one participants were divided into three groups having different levels of arthroscopic experience. Participants answered questions regarding general information and the outer appearance of the simulator for face validity. Construct validity was assessed with one standardized navigation task, which was timed. Face validity, educational value and user-friendliness were determined with two representative exercises and by asking participants to fill out the questionnaire. A value of 7 or greater was considered sufficient.

Results

Construct validity was demonstrated between experts and novices. Median task time for the fifth trial was 55 s (range 17–139 s) for the novices, 33 s (range 17–59 s) for the intermediates, and 26 s (range 14–52 s) for the experts. Median task times of three trials were not significantly different between the novices and intermediates, and none of the trials between intermediates and experts. Face validity, educational value and user-friendliness were perceived as sufficient (median >7). The presence of realistic tactile feedback was considered the biggest asset of the simulator.

Conclusion

Proper preparation for arthroscopic operations will increase the quality of real-life surgery and patients’ safety. The PASSPORT simulator can assist in achieving this, as it showed construct and face validity, and its physical nature offered adequate haptic feedback during training. This indicates that PASSPORT has potential to evolve as a valuable training modality.
Literature
1.
go back to reference Anastakis DJ, Regehr G, Reznick RK, Cusimano M, Murnaghan J, Brown M, Hutchison C (1999) Assessment of technical skills transfer from the bench training model to the human model. Am J Surg 177:167–170CrossRefPubMed Anastakis DJ, Regehr G, Reznick RK, Cusimano M, Murnaghan J, Brown M, Hutchison C (1999) Assessment of technical skills transfer from the bench training model to the human model. Am J Surg 177:167–170CrossRefPubMed
2.
go back to reference Brehmer M, Swartz R (2005) Training on bench models improves dexterity in ureteroscopy. Eur Urol 48:458–463CrossRefPubMed Brehmer M, Swartz R (2005) Training on bench models improves dexterity in ureteroscopy. Eur Urol 48:458–463CrossRefPubMed
3.
go back to reference Brehmer M, Tolley D (2002) Validation of a bench model for endoscopic surgery in the upper urinary tract. Eur Urol 42:175–179CrossRefPubMed Brehmer M, Tolley D (2002) Validation of a bench model for endoscopic surgery in the upper urinary tract. Eur Urol 42:175–179CrossRefPubMed
4.
go back to reference Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177:28–32CrossRefPubMed Bridges M, Diamond DL (1999) The financial impact of teaching surgical residents in the operating room. Am J Surg 177:28–32CrossRefPubMed
5.
go back to reference Cannon WD, Eckhoff DG, Garrett WE Jr, Hunter RE, Sweeney HJ (2006) Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. Clin Orthop Relat Res 442:21–29CrossRefPubMed Cannon WD, Eckhoff DG, Garrett WE Jr, Hunter RE, Sweeney HJ (2006) Report of a group developing a virtual reality simulator for arthroscopic surgery of the knee joint. Clin Orthop Relat Res 442:21–29CrossRefPubMed
6.
go back to reference Escoto A, Trejos AL, Naish MD, Patel RV, Lebel ME (2012) Force sensing-based simulator for arthroscopic skills assessment in orthopaedic knee surgery. Stud Health Technol Inform 173:129–135PubMed Escoto A, Trejos AL, Naish MD, Patel RV, Lebel ME (2012) Force sensing-based simulator for arthroscopic skills assessment in orthopaedic knee surgery. Stud Health Technol Inform 173:129–135PubMed
7.
go back to reference Gomoll AH, O’Toole RV, Czarnecki J, Warner JJ (2007) Surgical experience correlates with performance on a virtual reality simulator for shoulder arthroscopy. Am J Sports Med 35:883–888CrossRefPubMed Gomoll AH, O’Toole RV, Czarnecki J, Warner JJ (2007) Surgical experience correlates with performance on a virtual reality simulator for shoulder arthroscopy. Am J Sports Med 35:883–888CrossRefPubMed
8.
go back to reference Gomoll AH, Pappas G, Forsythe B, Warner JJ (2008) Individual skill progression on a virtual reality simulator for shoulder arthroscopy: a 3-year follow-up study. Am J Sports Med 36:1139–1142CrossRefPubMed Gomoll AH, Pappas G, Forsythe B, Warner JJ (2008) Individual skill progression on a virtual reality simulator for shoulder arthroscopy: a 3-year follow-up study. Am J Sports Med 36:1139–1142CrossRefPubMed
9.
go back to reference Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150CrossRefPubMed Grantcharov TP, Kristiansen VB, Bendix J, Bardram L, Rosenberg J, Funch-Jensen P (2004) Randomized clinical trial of virtual reality simulation for laparoscopic skills training. Br J Surg 91:146–150CrossRefPubMed
10.
go back to reference Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70 Holm S (1979) A simple sequentially rejective multiple test procedure. Scand J Stat 6:65–70
11.
go back to reference Horeman T, Rodrigues SP, Jansen FW, Dankelman J, van den Dobbelsteen JJ (2010) Force measurement platform for training and assessment of laparoscopic skills. Surg Endosc 24:3102–3108CrossRefPubMedPubMedCentral Horeman T, Rodrigues SP, Jansen FW, Dankelman J, van den Dobbelsteen JJ (2010) Force measurement platform for training and assessment of laparoscopic skills. Surg Endosc 24:3102–3108CrossRefPubMedPubMedCentral
12.
go back to reference Howells NR, Gill HS, Carr AJ, Price AJ, Rees JL (2008) Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg Br 90:494–499CrossRefPubMed Howells NR, Gill HS, Carr AJ, Price AJ, Rees JL (2008) Transferring simulated arthroscopic skills to the operating theatre: a randomised blinded study. J Bone Joint Surg Br 90:494–499CrossRefPubMed
13.
go back to reference Jacomides L, Ogan K, Cadeddu JA, Pearle MS (2004) Use of a virtual reality simulator for ureteroscopy training. J Urol 171:320–323CrossRefPubMed Jacomides L, Ogan K, Cadeddu JA, Pearle MS (2004) Use of a virtual reality simulator for ureteroscopy training. J Urol 171:320–323CrossRefPubMed
14.
go back to reference Knoll T, Trojan L, Haecker A, Alken P, Michel MS (2005) Validation of computer-based training in ureterorenoscopy. BJU Int 95:1276–1279CrossRefPubMed Knoll T, Trojan L, Haecker A, Alken P, Michel MS (2005) Validation of computer-based training in ureterorenoscopy. BJU Int 95:1276–1279CrossRefPubMed
15.
go back to reference Leong JJ, Leff DR, Das A, Aggarwal R, Reilly P, Atkinson HD, Emery RJ, Darzi AW (2008) Validation of orthopaedic bench models for trauma surgery. J Bone Joint Surg Br 90:958–965CrossRefPubMed Leong JJ, Leff DR, Das A, Aggarwal R, Reilly P, Atkinson HD, Emery RJ, Darzi AW (2008) Validation of orthopaedic bench models for trauma surgery. J Bone Joint Surg Br 90:958–965CrossRefPubMed
16.
go back to reference Reznek M, Harter P, Krummel T (2002) Virtual reality and simulation: training the future emergency physician. Acad Emerg Med 9:78–87CrossRefPubMed Reznek M, Harter P, Krummel T (2002) Virtual reality and simulation: training the future emergency physician. Acad Emerg Med 9:78–87CrossRefPubMed
17.
go back to reference Matsumoto ED, Hamstra SJ, Radomski SB, Cusimano MD (2001) A novel approach to endourological training: training at the Surgical Skills Center. J Urol 166:1261–1266CrossRefPubMed Matsumoto ED, Hamstra SJ, Radomski SB, Cusimano MD (2001) A novel approach to endourological training: training at the Surgical Skills Center. J Urol 166:1261–1266CrossRefPubMed
18.
go back to reference Matsumoto ED, Pace KT, D’A Honey RJ (2006) Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol 13:896–901CrossRefPubMed Matsumoto ED, Pace KT, D’A Honey RJ (2006) Virtual reality ureteroscopy simulator as a valid tool for assessing endourological skills. Int J Urol 13:896–901CrossRefPubMed
19.
go back to reference McCarthy AD, Moody L, Waterworth AR, Bickerstaff DR (2006) Passive haptics in a knee arthroscopy simulator: is it valid for core skills training? Clin Orthop Relat Res 442:13–20CrossRefPubMed McCarthy AD, Moody L, Waterworth AR, Bickerstaff DR (2006) Passive haptics in a knee arthroscopy simulator: is it valid for core skills training? Clin Orthop Relat Res 442:13–20CrossRefPubMed
20.
go back to reference Michelson JD (2006) Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am 88:1405–1411CrossRefPubMed Michelson JD (2006) Simulation in orthopaedic education: an overview of theory and practice. J Bone Joint Surg Am 88:1405–1411CrossRefPubMed
21.
go back to reference Modi CS, Morris G, Mukherjee R (2010) Computer-simulation training for knee and shoulder arthroscopic surgery. Arthroscopy 26:832–840CrossRefPubMed Modi CS, Morris G, Mukherjee R (2010) Computer-simulation training for knee and shoulder arthroscopic surgery. Arthroscopy 26:832–840CrossRefPubMed
22.
go back to reference Moody L, Waterworth A, McCarthy AD, Harley P, Smallwood R (2008) The feasibility of a mixed reality surgical training environment. Virtual Real 12:77–86CrossRef Moody L, Waterworth A, McCarthy AD, Harley P, Smallwood R (2008) The feasibility of a mixed reality surgical training environment. Virtual Real 12:77–86CrossRef
23.
go back to reference Muller W, Bockholt U (1998) The virtual reality arthroscopy training simulator. Stud Health Technol Inform 50:13–19PubMed Muller W, Bockholt U (1998) The virtual reality arthroscopy training simulator. Stud Health Technol Inform 50:13–19PubMed
24.
go back to reference Naik VN, Matsumoto ED, Houston PL, Hamstra SJ, Yeung RY, Mallon JS, Martire TM (2001) Fiberoptic orotracheal intubation on anesthetized patients: do manipulation skills learned on a simple model transfer into the operating room? Anesthesiology 95:343–348CrossRefPubMed Naik VN, Matsumoto ED, Houston PL, Hamstra SJ, Yeung RY, Mallon JS, Martire TM (2001) Fiberoptic orotracheal intubation on anesthetized patients: do manipulation skills learned on a simple model transfer into the operating room? Anesthesiology 95:343–348CrossRefPubMed
25.
go back to reference O’Neill PJ, Cosgarea AJ, Freedman JA, Queale WS, McFarland EG (2002) Arthroscopic proficiency: a survey of orthopaedic sports medicine fellowship directors and orthopaedic surgery department chairs. Arthroscopy 18:795–800CrossRefPubMed O’Neill PJ, Cosgarea AJ, Freedman JA, Queale WS, McFarland EG (2002) Arthroscopic proficiency: a survey of orthopaedic sports medicine fellowship directors and orthopaedic surgery department chairs. Arthroscopy 18:795–800CrossRefPubMed
26.
go back to reference Ogan K, Jacomides L, Shulman MJ, Roehrborn CG, Cadeddu JA, Pearle MS (2004) Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver. J Urol 172:667–671CrossRefPubMed Ogan K, Jacomides L, Shulman MJ, Roehrborn CG, Cadeddu JA, Pearle MS (2004) Virtual ureteroscopy predicts ureteroscopic proficiency of medical students on a cadaver. J Urol 172:667–671CrossRefPubMed
28.
go back to reference Oostema JA, Abdel MP, Gould JC (2008) Time-efficient laparoscopic skills assessment using an augmented-reality simulator. Surg Endosc 22:2621–2624CrossRefPubMed Oostema JA, Abdel MP, Gould JC (2008) Time-efficient laparoscopic skills assessment using an augmented-reality simulator. Surg Endosc 22:2621–2624CrossRefPubMed
29.
go back to reference Pedowitz RA, Esch J, Snyder S (2002) Evaluation of a virtual reality simulator for arthroscopy skills development. Arthroscopy 18:E29CrossRefPubMed Pedowitz RA, Esch J, Snyder S (2002) Evaluation of a virtual reality simulator for arthroscopy skills development. Arthroscopy 18:E29CrossRefPubMed
30.
go back to reference Safir O, Dubrowski A, Mirsky L, Lin C, Backstein D, Carnahan A (2008) What skills should simulation training in arthroscopy teach residents? Int J Comput Assist Radiol Surg 3:433–437CrossRef Safir O, Dubrowski A, Mirsky L, Lin C, Backstein D, Carnahan A (2008) What skills should simulation training in arthroscopy teach residents? Int J Comput Assist Radiol Surg 3:433–437CrossRef
31.
go back to reference Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463CrossRefPubMedPubMedCentral Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463CrossRefPubMedPubMedCentral
32.
go back to reference Slade Shantz JA, Leiter JR, Gottschalk T, MacDonald PB (2014) The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education. Knee Surg Sports Traumatol Arthrosc 22:33–40CrossRefPubMed Slade Shantz JA, Leiter JR, Gottschalk T, MacDonald PB (2014) The internal validity of arthroscopic simulators and their effectiveness in arthroscopic education. Knee Surg Sports Traumatol Arthrosc 22:33–40CrossRefPubMed
33.
go back to reference Srivastava S, Youngblood PL, Rawn C, Hariri S, Heinrichs WL, Ladd AL (2004) Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg 13:196–205CrossRefPubMed Srivastava S, Youngblood PL, Rawn C, Hariri S, Heinrichs WL, Ladd AL (2004) Initial evaluation of a shoulder arthroscopy simulator: establishing construct validity. J Shoulder Elbow Surg 13:196–205CrossRefPubMed
34.
go back to reference Stunt JJ, Wulms PHLM, Kerkhoffs GM, Sierevelt IN, Schafroth MU, Tuijthof GJM (2013) Variation in joint stressing magnitudes during knee arthroscopy. Knee Surg Sports Traumatol Arthrosc 22(7):1529–1535 Stunt JJ, Wulms PHLM, Kerkhoffs GM, Sierevelt IN, Schafroth MU, Tuijthof GJM (2013) Variation in joint stressing magnitudes during knee arthroscopy. Knee Surg Sports Traumatol Arthrosc 22(7):1529–1535
35.
go back to reference Torkington J, Smith SG, Rees BI, Darzi A (2000) The role of simulation in surgical training. Ann R Coll Surg Engl 82:88–94PubMedPubMedCentral Torkington J, Smith SG, Rees BI, Darzi A (2000) The role of simulation in surgical training. Ann R Coll Surg Engl 82:88–94PubMedPubMedCentral
36.
go back to reference Tuijthof GJM, Horeman T (2011) Training facility, surgical instruments and artificial knee with an upper limb and a lower limb for simulation and training of arthroscopic surgical techniques. Patent NL2006846 Tuijthof GJM, Horeman T (2011) Training facility, surgical instruments and artificial knee with an upper limb and a lower limb for simulation and training of arthroscopic surgical techniques. Patent NL2006846
37.
go back to reference Tuijthof GJ, van Sterkenburg MN, Sierevelt IN, van Oldenrijk J, van Dijk CN, Kerkhoffs GM (2010) First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 18:218–224CrossRefPubMed Tuijthof GJ, van Sterkenburg MN, Sierevelt IN, van Oldenrijk J, van Dijk CN, Kerkhoffs GM (2010) First validation of the PASSPORT training environment for arthroscopic skills. Knee Surg Sports Traumatol Arthrosc 18:218–224CrossRefPubMed
38.
go back to reference Tuijthof GJ, Visser P, Sierevelt IN, van Dijk CN, Kerkhoffs GM (2011) Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin Orthop Relat Res 469:1701–1708CrossRefPubMedPubMedCentral Tuijthof GJ, Visser P, Sierevelt IN, van Dijk CN, Kerkhoffs GM (2011) Does perception of usefulness of arthroscopic simulators differ with levels of experience? Clin Orthop Relat Res 469:1701–1708CrossRefPubMedPubMedCentral
39.
go back to reference van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987CrossRefPubMed van Hove PD, Tuijthof GJ, Verdaasdonk EG, Stassen LP, Dankelman J (2010) Objective assessment of technical surgical skills. Br J Surg 97:972–987CrossRefPubMed
40.
go back to reference Verdaasdonk EG, Stassen LP, Monteny LJ, Dankelman J (2006) Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO. Surg Endosc 20:511–518CrossRefPubMed Verdaasdonk EG, Stassen LP, Monteny LJ, Dankelman J (2006) Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO. Surg Endosc 20:511–518CrossRefPubMed
41.
go back to reference Verdaasdonk EG, Stassen LP, Schijven MP, Dankelman J (2007) Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Surg Endosc 21:1406–1412CrossRefPubMed Verdaasdonk EG, Stassen LP, Schijven MP, Dankelman J (2007) Construct validity and assessment of the learning curve for the SIMENDO endoscopic simulator. Surg Endosc 21:1406–1412CrossRefPubMed
42.
go back to reference Verdaasdonk EG, Stassen LP, van Wijk RP, Dankelman J (2007) The influence of different training schedules on the learning of psychomotor skills for endoscopic surgery. Surg Endosc 21:214–219CrossRefPubMed Verdaasdonk EG, Stassen LP, van Wijk RP, Dankelman J (2007) The influence of different training schedules on the learning of psychomotor skills for endoscopic surgery. Surg Endosc 21:214–219CrossRefPubMed
43.
go back to reference Watterson JD, Beiko DT, Kuan JK, Denstedt JD (2002) Randomized prospective blinded study validating acquisition of ureteroscopy skills using computer based virtual reality endourological simulator. J Urol 168:1928–1932CrossRefPubMed Watterson JD, Beiko DT, Kuan JK, Denstedt JD (2002) Randomized prospective blinded study validating acquisition of ureteroscopy skills using computer based virtual reality endourological simulator. J Urol 168:1928–1932CrossRefPubMed
44.
go back to reference White MA, Dehaan AP, Stephens DD, Maes AA, Maatman TJ (2010) Validation of a high fidelity adult ureteroscopy and renoscopy simulator. J Urol 183:673–677CrossRefPubMed White MA, Dehaan AP, Stephens DD, Maes AA, Maatman TJ (2010) Validation of a high fidelity adult ureteroscopy and renoscopy simulator. J Urol 183:673–677CrossRefPubMed
45.
go back to reference Zivanovic A, Dibble E, Davies B, Moody L, Waterworth A (2003) Engineering requirements for a haptic simulator for knee arthroscopy training. Stud Health Technol Inform 94:413–418PubMed Zivanovic A, Dibble E, Davies B, Moody L, Waterworth A (2003) Engineering requirements for a haptic simulator for knee arthroscopy training. Stud Health Technol Inform 94:413–418PubMed
Metadata
Title
Validation of the PASSPORT V2 training environment for arthroscopic skills
Authors
J. J. Stunt
G. M. M. J. Kerkhoffs
T. Horeman
C. N. van Dijk
G. J. M. Tuijthof
Publication date
01-06-2016
Publisher
Springer Berlin Heidelberg
Published in
Knee Surgery, Sports Traumatology, Arthroscopy / Issue 6/2016
Print ISSN: 0942-2056
Electronic ISSN: 1433-7347
DOI
https://doi.org/10.1007/s00167-014-3213-0

Other articles of this Issue 6/2016

Knee Surgery, Sports Traumatology, Arthroscopy 6/2016 Go to the issue