Skip to main content
Top
Published in: Surgical Endoscopy 10/2013

01-10-2013

Characterizing the learning curve of the VBLaST-PT© (Virtual Basic Laparoscopic Skill Trainer)

Authors: Likun Zhang, Ganesh Sankaranarayanan, Venkata Sreekanth Arikatla, Woojin Ahn, Cristol Grosdemouge, Jesse M. Rideout, Scott K. Epstein, Suvranu De, Steven D. Schwaitzberg, Daniel B. Jones, Caroline G. L. Cao

Published in: Surgical Endoscopy | Issue 10/2013

Login to get access

Abstract

Background

Mastering laparoscopic surgical skills requires considerable time and effort. The Virtual Basic Laparoscopic Skill Trainer (VBLaST-PT©) is being developed as a computerized version of the peg transfer task of the Fundamentals of Laparoscopic Surgery (FLS) system using virtual reality technology. We assessed the learning curve of trainees on the VBLaST-PT© using the cumulative summation (CUSUM) method and compared them with those on the FLS to establish convergent validity for the VBLaST-PT©.

Methods

Eighteen medical students from were assigned randomly to one of three groups: control, VBLaST-training, and FLS-training. The VBLaST and the FLS groups performed a total of 150 trials of the peg-transfer task over a 3-week period, 5 days a week. Their CUSUM scores were computed based on predefined performance criteria (junior, intermediate, and senior levels).

Results

Of the six subjects in the VBLaST-training group, five achieved at least the “junior” level, three achieved the “intermediate” level, and one achieved the “senior” level of performance criterion by the end of the 150 trials. In comparison, for the FLS group, three students achieved the “senior” criterion and all six students achieved the “intermediate” and “junior” criteria by the 150th trials. Both the VBLaST-PT© and the FLS systems showed significant skill improvement and retention, albeit with system specificity as measured by transfer of learning in the retention test: The VBLaST-trained group performed better on the VBLaST-PT© than on FLS (p = 0.003), whereas the FLS-trained group performed better on the FLS than on VBLaST-PT© (p = 0.002).

Conclusions

We characterized the learning curve for a virtual peg transfer task on the VBLaST-PT© and compared it with the FLS using CUSUM analysis. Subjects in both training groups showed significant improvement in skill performance, but the transfer of training between systems was not significant.
Literature
2.
go back to reference Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30(7):617–620PubMedCrossRef Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30(7):617–620PubMedCrossRef
3.
go back to reference Adams JA (1987) Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. Psychol Bull 101(1):41–74CrossRef Adams JA (1987) Historical review and appraisal of research on the learning, retention, and transfer of human motor skills. Psychol Bull 101(1):41–74CrossRef
4.
go back to reference Powers TW, Murayama KM, Toyama M, Murphy S, Denham EW 3rd, Derossis AM et al (2002) Housestaff performance is improved by participation in a laparoscopic skills curriculum. Am J Surg 184(6):626–629 discussion 629–630PubMedCrossRef Powers TW, Murayama KM, Toyama M, Murphy S, Denham EW 3rd, Derossis AM et al (2002) Housestaff performance is improved by participation in a laparoscopic skills curriculum. Am J Surg 184(6):626–629 discussion 629–630PubMedCrossRef
5.
go back to reference Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967PubMedCrossRef Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967PubMedCrossRef
6.
go back to reference Fried GM (2008) FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg 12(2):210–212PubMedCrossRef Fried GM (2008) FLS assessment of competency using simulated laparoscopic tasks. J Gastrointest Surg 12(2):210–212PubMedCrossRef
7.
go back to reference Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B et al (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135(1):21–27PubMedCrossRef Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B et al (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135(1):21–27PubMedCrossRef
8.
go back to reference Sankaranarayanan G, Lin H, Arikatla VS, Mulcare M, Zhang L, Derevianko A et al (2010) Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer. J Laparoendosc Adv Surg Tech A 20(2):153–157PubMedCrossRef Sankaranarayanan G, Lin H, Arikatla VS, Mulcare M, Zhang L, Derevianko A et al (2010) Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer. J Laparoendosc Adv Surg Tech A 20(2):153–157PubMedCrossRef
9.
go back to reference Biau DJ, Resche-Rigon M, Godiris-Petit G, Nizard RS, Porcher R (2007) Quality control of surgical and interventional procedures: a review of the CUSUM. Qual Saf Health Care 16(3):203–207PubMedCrossRef Biau DJ, Resche-Rigon M, Godiris-Petit G, Nizard RS, Porcher R (2007) Quality control of surgical and interventional procedures: a review of the CUSUM. Qual Saf Health Care 16(3):203–207PubMedCrossRef
10.
go back to reference Williams SM, Parry BR, Schlup MM (1992) Quality control: an application of the cusum. BMJ 304(6838):1359–1361PubMedCrossRef Williams SM, Parry BR, Schlup MM (1992) Quality control: an application of the cusum. BMJ 304(6838):1359–1361PubMedCrossRef
11.
go back to reference Zhang L, Grosdemouge C, Arikatla VS, Ahn W, Sankaranarayanan G, De S et al (2012) The added value of virtual reality technology and force feedback for surgical training simulators. Work 41:2288–2292PubMed Zhang L, Grosdemouge C, Arikatla VS, Ahn W, Sankaranarayanan G, De S et al (2012) The added value of virtual reality technology and force feedback for surgical training simulators. Work 41:2288–2292PubMed
12.
go back to reference Fraser SA, Feldman LS, Stanbridge D, Fried GM (2005) Characterizing the learning curve for a basic laparoscopic drill. Surg Endosc 19(12):1572–1578PubMedCrossRef Fraser SA, Feldman LS, Stanbridge D, Fried GM (2005) Characterizing the learning curve for a basic laparoscopic drill. Surg Endosc 19(12):1572–1578PubMedCrossRef
13.
go back to reference Magill RA (2007) Motor learning and control: concepts and applications. McGraw-Hill, Boston Magill RA (2007) Motor learning and control: concepts and applications. McGraw-Hill, Boston
14.
go back to reference Cook JA, Ramsay CR, Fayers P (2007) Using the literature to quantify the learning curve: a case study. Int J Technol Assess Health Care 23(2):255–260PubMedCrossRef Cook JA, Ramsay CR, Fayers P (2007) Using the literature to quantify the learning curve: a case study. Int J Technol Assess Health Care 23(2):255–260PubMedCrossRef
15.
go back to reference Rosser JC, Rosser LE, Savalgi RS (1997) Skill acquisition and assessment for laparoscopic surgery. Arch Surg 132(2):200–204PubMedCrossRef Rosser JC, Rosser LE, Savalgi RS (1997) Skill acquisition and assessment for laparoscopic surgery. Arch Surg 132(2):200–204PubMedCrossRef
16.
go back to reference Shapiro SJ, Paz-Partlow M, Daykhovsky L, Gordon LA (1996) The use of a modular skills center for the maintenance of laparoscopic skills. Surg Endosc 10(8):816–819PubMedCrossRef Shapiro SJ, Paz-Partlow M, Daykhovsky L, Gordon LA (1996) The use of a modular skills center for the maintenance of laparoscopic skills. Surg Endosc 10(8):816–819PubMedCrossRef
17.
go back to reference Melvin WS, Johnson JA, Ellison EC (1996) Laparoscopic skills enhancement. Am J Surg 172(4):377–379PubMedCrossRef Melvin WS, Johnson JA, Ellison EC (1996) Laparoscopic skills enhancement. Am J Surg 172(4):377–379PubMedCrossRef
18.
go back to reference McCarter FD, Luchette FA, Molloy M, Hurst JM, Davis K, Johannigman JA et al (2000) Institutional and individual learning curves for focused abdominal ultrasound for trauma. Ann Surg 231(5):689–700PubMedCrossRef McCarter FD, Luchette FA, Molloy M, Hurst JM, Davis K, Johannigman JA et al (2000) Institutional and individual learning curves for focused abdominal ultrasound for trauma. Ann Surg 231(5):689–700PubMedCrossRef
19.
go back to reference Schlup MMT, Williams SM, Barbezat GO (1997) ERCP: a review of technical competency and workload in a small unit. Gastrointest Endosc 46(1):48–52PubMedCrossRef Schlup MMT, Williams SM, Barbezat GO (1997) ERCP: a review of technical competency and workload in a small unit. Gastrointest Endosc 46(1):48–52PubMedCrossRef
20.
go back to reference Van Rij AM, McDonald JR, Pettigrew RA, Putterill MJ, Reddy CK, Wright JJ (1995) Cusum as an aid to early assessment of the surgical trainee. Br J Surg 82(11):1500–1503PubMedCrossRef Van Rij AM, McDonald JR, Pettigrew RA, Putterill MJ, Reddy CK, Wright JJ (1995) Cusum as an aid to early assessment of the surgical trainee. Br J Surg 82(11):1500–1503PubMedCrossRef
21.
go back to reference Li JCM, Lo AWI, Hon SSF, Ng SSM, Lee JFY, Leung KL (2012) Institution learning curve of laparoscopic colectomy—a multi-dimensional analysis. Int J Colorectal Dis 27(4):527–533PubMedCrossRef Li JCM, Lo AWI, Hon SSF, Ng SSM, Lee JFY, Leung KL (2012) Institution learning curve of laparoscopic colectomy—a multi-dimensional analysis. Int J Colorectal Dis 27(4):527–533PubMedCrossRef
22.
go back to reference Pendlimari R, Holubar SD, Dozois EJ, Larson DW, Pemberton JH, Cima RR (2012) Technical proficiency in hand-assisted laparoscopic colon and rectal surgery: determining how many cases are required to achieve mastery. Arch Surg 147(4):317–322PubMedCrossRef Pendlimari R, Holubar SD, Dozois EJ, Larson DW, Pemberton JH, Cima RR (2012) Technical proficiency in hand-assisted laparoscopic colon and rectal surgery: determining how many cases are required to achieve mastery. Arch Surg 147(4):317–322PubMedCrossRef
23.
go back to reference Bartlett A, Parry B (2001) Cusum analysis of trends in operative selection and conversion rates for laparoscopic cholecystectomy. ANZ J Surg 71(8):453–456PubMedCrossRef Bartlett A, Parry B (2001) Cusum analysis of trends in operative selection and conversion rates for laparoscopic cholecystectomy. ANZ J Surg 71(8):453–456PubMedCrossRef
24.
go back to reference Fraser SA, Bergman S, Garzon J (2012) Laparoscopic splenectomy: learning curve comparison between benign and malignant disease. Surg Innov 19(1):27–32PubMedCrossRef Fraser SA, Bergman S, Garzon J (2012) Laparoscopic splenectomy: learning curve comparison between benign and malignant disease. Surg Innov 19(1):27–32PubMedCrossRef
25.
go back to reference Jaffer U, Cameron AEP (2008) Laparoscopic appendectomy: a junior trainee’s learning curve. JSLS 12(3):288–291PubMed Jaffer U, Cameron AEP (2008) Laparoscopic appendectomy: a junior trainee’s learning curve. JSLS 12(3):288–291PubMed
26.
go back to reference Kye B-H, Kim J-G, Cho H-M, Kim H-J, Suh Y-J, Chun C-S (2011) Learning curves in laparoscopic right-sided colon cancer surgery: a comparison of first-generation colorectal surgeon to advance laparoscopically trained surgeon. J Laparoendosc Adv Surg Tech A 21(9):789–796PubMedCrossRef Kye B-H, Kim J-G, Cho H-M, Kim H-J, Suh Y-J, Chun C-S (2011) Learning curves in laparoscopic right-sided colon cancer surgery: a comparison of first-generation colorectal surgeon to advance laparoscopically trained surgeon. J Laparoendosc Adv Surg Tech A 21(9):789–796PubMedCrossRef
27.
go back to reference Okrainec A, Ferri LE, Feldman LS, Fried GM (2011) Defining the learning curve in laparoscopic paraesophageal hernia repair: a CUSUM analysis. Surg Endosc 25(4):1083–1087PubMedCrossRef Okrainec A, Ferri LE, Feldman LS, Fried GM (2011) Defining the learning curve in laparoscopic paraesophageal hernia repair: a CUSUM analysis. Surg Endosc 25(4):1083–1087PubMedCrossRef
28.
go back to reference Son G-M, Kim J-G, Lee J-C, Suh Y-J, Cho H-M, Lee Y-S et al (2010) Multidimensional analysis of the learning curve for laparoscopic rectal cancer surgery. J Laparoendosc Adv Surg Tech A 20(7):609–617PubMedCrossRef Son G-M, Kim J-G, Lee J-C, Suh Y-J, Cho H-M, Lee Y-S et al (2010) Multidimensional analysis of the learning curve for laparoscopic rectal cancer surgery. J Laparoendosc Adv Surg Tech A 20(7):609–617PubMedCrossRef
29.
go back to reference Murzi M, Cerillo AG, Bevilacqua S, Gilmanov D, Farneti P, Glauber M (2012) Traversing the learning curve in minimally invasive heart valve surgery: a cumulative analysis of an individual surgeon’s experience with a right minithoracotomy approach for aortic valve replacement. Eur J Cardiothorac Surg 41(6):1242–1246PubMedCrossRef Murzi M, Cerillo AG, Bevilacqua S, Gilmanov D, Farneti P, Glauber M (2012) Traversing the learning curve in minimally invasive heart valve surgery: a cumulative analysis of an individual surgeon’s experience with a right minithoracotomy approach for aortic valve replacement. Eur J Cardiothorac Surg 41(6):1242–1246PubMedCrossRef
30.
go back to reference Bokhari MB, Patel CB, Ramos-Valadez DI, Ragupathi M, Haas EM (2011) Learning curve for robotic-assisted laparoscopic colorectal surgery. Surg Endosc 25(3):855–860PubMedCrossRef Bokhari MB, Patel CB, Ramos-Valadez DI, Ragupathi M, Haas EM (2011) Learning curve for robotic-assisted laparoscopic colorectal surgery. Surg Endosc 25(3):855–860PubMedCrossRef
31.
go back to reference Buchs NC, Fo Pugin, Bucher P, Hagen ME, Chassot G, Koutny-Fong P et al (2012) Learning curve for robot-assisted Roux-en-Y gastric bypass. Surg Endosc 26(4):1116–1121PubMedCrossRef Buchs NC, Fo Pugin, Bucher P, Hagen ME, Chassot G, Koutny-Fong P et al (2012) Learning curve for robot-assisted Roux-en-Y gastric bypass. Surg Endosc 26(4):1116–1121PubMedCrossRef
32.
go back to reference Novotny T, Dvorak M, Staffa R (2011) The learning curve of robot-assisted laparoscopic aortofemoral bypass grafting for aortoiliac occlusive disease. J Vasc Surg 53(2):414–420PubMedCrossRef Novotny T, Dvorak M, Staffa R (2011) The learning curve of robot-assisted laparoscopic aortofemoral bypass grafting for aortoiliac occlusive disease. J Vasc Surg 53(2):414–420PubMedCrossRef
33.
go back to reference Calsina L, Clara A, Vidal-Barraquer F (2011) The use of the CUSUM chart method for surveillance of learning effects and quality of care in endovascular procedures. Eur J Vasc Endovasc Surg 41(5):679–684PubMedCrossRef Calsina L, Clara A, Vidal-Barraquer F (2011) The use of the CUSUM chart method for surveillance of learning effects and quality of care in endovascular procedures. Eur J Vasc Endovasc Surg 41(5):679–684PubMedCrossRef
34.
go back to reference Naik VN, Devito I, Halpern SH (2003) Cusum analysis is a useful tool to assess resident proficiency at insertion of labour epidurals. Can J Anaesth 50(7):694–698PubMedCrossRef Naik VN, Devito I, Halpern SH (2003) Cusum analysis is a useful tool to assess resident proficiency at insertion of labour epidurals. Can J Anaesth 50(7):694–698PubMedCrossRef
35.
36.
go back to reference Kinsey SE, Giles FJ, Holton J (1989) Cusum plotting of temperature charts for assessing antimicrobial treatment in neutropenic patients. BMJ 299(6702):775–776PubMedCrossRef Kinsey SE, Giles FJ, Holton J (1989) Cusum plotting of temperature charts for assessing antimicrobial treatment in neutropenic patients. BMJ 299(6702):775–776PubMedCrossRef
37.
go back to reference Papanna R, Biau DJ, Mann LK, Johnson A, Moise KJ Jr (2011) Use of the Learning Curve-Cumulative Summation test for quantitative and individualized assessment of competency of a surgical procedure in obstetrics and gynecology: fetoscopic laser ablation as a model. Am J Obstet Gynecol 204(3):218.e1–218.e9. doi:10.1016/j.ajog.2010.10.910 CrossRef Papanna R, Biau DJ, Mann LK, Johnson A, Moise KJ Jr (2011) Use of the Learning Curve-Cumulative Summation test for quantitative and individualized assessment of competency of a surgical procedure in obstetrics and gynecology: fetoscopic laser ablation as a model. Am J Obstet Gynecol 204(3):218.e1–218.e9. doi:10.​1016/​j.​ajog.​2010.​10.​910 CrossRef
38.
go back to reference Lane NE (1987) Skill acquisition rates and patterns: issues and training implications. Springer, New YorkCrossRef Lane NE (1987) Skill acquisition rates and patterns: issues and training implications. Springer, New YorkCrossRef
39.
go back to reference Scott DJ, Young WN, Tesfay ST, Frawley WH, Rege RV, Jones DB (2001) Laparoscopic skills training. Am J Surg 182(2):137–142PubMedCrossRef Scott DJ, Young WN, Tesfay ST, Frawley WH, Rege RV, Jones DB (2001) Laparoscopic skills training. Am J Surg 182(2):137–142PubMedCrossRef
40.
go back to reference Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12(9):1117–1120PubMedCrossRef Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12(9):1117–1120PubMedCrossRef
41.
go back to reference Kolozsvari NO, Kaneva P, Brace C, Chartrand G, Vaillancourt M, Cao J et al (2011) Mastery versus the standard proficiency target for basic laparoscopic skill training: effect on skill transfer and retention. Surg Endosc 25(7):2063–2070PubMedCrossRef Kolozsvari NO, Kaneva P, Brace C, Chartrand G, Vaillancourt M, Cao J et al (2011) Mastery versus the standard proficiency target for basic laparoscopic skill training: effect on skill transfer and retention. Surg Endosc 25(7):2063–2070PubMedCrossRef
42.
go back to reference Feldman LS, Cao J, Andalib A, Fraser S, Fried GM (2009) A method to characterize the learning curve for performance of a fundamental laparoscopic simulator task: defining “learning plateau” and “learning rate.”. Surgery 146(2):381–386PubMedCrossRef Feldman LS, Cao J, Andalib A, Fraser S, Fried GM (2009) A method to characterize the learning curve for performance of a fundamental laparoscopic simulator task: defining “learning plateau” and “learning rate.”. Surgery 146(2):381–386PubMedCrossRef
Metadata
Title
Characterizing the learning curve of the VBLaST-PT© (Virtual Basic Laparoscopic Skill Trainer)
Authors
Likun Zhang
Ganesh Sankaranarayanan
Venkata Sreekanth Arikatla
Woojin Ahn
Cristol Grosdemouge
Jesse M. Rideout
Scott K. Epstein
Suvranu De
Steven D. Schwaitzberg
Daniel B. Jones
Caroline G. L. Cao
Publication date
01-10-2013
Publisher
Springer US
Published in
Surgical Endoscopy / Issue 10/2013
Print ISSN: 0930-2794
Electronic ISSN: 1432-2218
DOI
https://doi.org/10.1007/s00464-013-2932-5

Other articles of this Issue 10/2013

Surgical Endoscopy 10/2013 Go to the issue