Top

Published in:

Open Access 01-12-2017 | Original Article

Face and content validity of the virtual reality simulator ‘ScanTrainer®’

Authors: Amal Alsalamah, Rudi Campo, Vasilios Tanos, Gregoris Grimbizis, Yves Van Belle, Kerenza Hood, Neil Pugh, Nazar Amso

Published in: Gynecological Surgery | Issue 1/2017

Abstract

Background

Ultrasonography is a first-line imaging in the investigation of women’s irregular bleeding and other gynaecological pathologies, e.g. ovarian cysts and early pregnancy problems. However, teaching ultrasound, especially transvaginal scanning, remains a challenge for health professionals. New technology such as simulation may potentially facilitate and expedite the process of learning ultrasound. Simulation may prove to be realistic, very close to real patient scanning experience for the sonographer and objectively able to assist the development of basic skills such as image manipulation, hand-eye coordination and examination technique.

Objective

The aim of this study was to determine the face and content validity of a virtual reality simulator (ScanTrainer®, MedaPhor plc, Cardiff, Wales, UK) as reflective of real transvaginal ultrasound (TVUS) scanning.

Method

A questionnaire with 14 simulator-related statements was distributed to a number of participants with differing levels of sonography experience in order to determine the level of agreement between the use of the simulator in training and real practice.

Results

There were 36 participants: novices (n = 25) and experts (n = 11) who rated the simulator. Median scores of face validity statements between experts and non-experts using a 10-point visual analogue scale (VAS) ratings ranged between 7.5 and 9.0 (p > 0.05) indicated a high level of agreement. Experts’ median scores of content validity statements ranged from 8.4 to 9.0.

Conclusions

The findings confirm that the simulator has the feel and look of real-time scanning with high face validity. Similarly, its tutorial structures and learning steps confirm the content validity.

Available only for authorised users

Weidenbach M, Rázek V, Wild F, Khambadkone S, Berlage T, Janousek J, Marek J (2009) Simulation of congenital heart defects: a novel way of training in echocardiography. Heart 95(8):636–641CrossRefPubMed

Markowitz JE, Hwang JQ, Moore CL (2011) Development and validation of a web-based assessment tool for the extended focused assessment with sonography in trauma examination. J Ultrasound Med 30(3):371–375CrossRefPubMed

Carter FJ, Schijven MP, Aggarwal R, Grantcharov T, Francis NK, Hanna GB, Jakimowicz JJ (2005) Consensus guidelines for validation of virtual reality surgical simulators. Surg Endosc 19:1523–1532CrossRefPubMed

McDougall M, Corica FA, Boker JR, Sala LG, Stoliar G, Borin JF, Chu FT, Clayman RV (2006) Construct validity testing of a laparoscopic surgical simulator. J Am Coll Surg 202(5):779–787CrossRefPubMed

Gilliam AD, Acton ST (2007) Echocardiographic simulation for validation of automated segmentation methods. Image Processing, ICIP 2007. IEEE Int Conf 5:529–532

Wilfong DN, Falsetti DJ, McKinnon JL, Daniel LH, Wan QC (2011) The effects of virtual intravenous and patient simulator training compared to the traditional approach of teaching nurses: a research project on peripheral i.v. catheter insertion. J Infus Nurs 34(1):55–62CrossRefPubMed

Aiello P, D’Elia F, Di Tore S, Sibilio M (2012) A constructivist approach to virtual reality for experiential learning. E-Lear Digital Media 9(3):317–324CrossRef

Wright MC, Segall N, Hobbs G, Phillips-Bute B, Maynard L, Taekman JM (2013) Standardized assessment for evaluation of team skills: validity and feasibility. Soc Simul Healthc 8:292–303CrossRef

Madsen ME, Konge L, Norgaard LN, Tabor A, Ringsted C, Klemmensen A, Ottesen B, Tolsgaard M (2014) Assessment of performance and learning curves on a virtual reality ultrasound simulator. Ultrasound Obstet Gynecol 44(6):693–699CrossRefPubMed

10.

Tolsgaard M, Ringsted C, Dreisler E, Nørgaard LN, Petersen JH, Madsen ME, Freiesleben NL, Sørensen JL, Tabor A (2015) Sustained effect of simulation-based ultrasound training on clinical performance: a randomized trial. Ultrasound Obstet Gynecol 46(3):312–318CrossRefPubMedPubMedCentral

11.

Byrne A, Greaves J (2001) Assessment instruments used during anaesthetic simulation: review of published studies. Br J Anaesth 86(3):445–450CrossRefPubMed

12.

Hung AJ, Zehnder P, Patil MB, Cai J, Ng CK, Aron M, Gill IS, Desai MM (2011) Face, content and construct validity of a novel robotic surgery simulator. J Urol 186(3):1019–1024CrossRefPubMed

13.

Alzahrani T, Haddad R, Alkhayal A, Delisle J, Drudi L, Gotlieb W, Fraser S, Bergman S, Bladou F, Andonian S, Anidjar M (2013) Validation of the da Vinci surgical skill simulator across three surgical disciplines. Can Urol Assoc J 7(7–8):520–529CrossRef

14.

Nicholson W, Patel A, Niazi K, Palmer S, Helmy T, Gallagher A (2006) Face and content validation of virtual reality simulation for carotid angiography. Simul Healthc 1(3):147–150CrossRefPubMed

15.

Schreuder HW, van Dongen KW, Roeleveld SJ, Schijven MP, Broeders IA (2009) Face and construct validity of virtual reality simulation of laparoscopic gynecologic surgery. Am J Obstet Gynecol 200(5):540 e541–540 e548CrossRef

16.

Xiao D, Jakimowicz JJ, Albayrak A, Buzink SN, Botden SM, Goossens RH (2014) Face, content, and construct validity of a novel portable ergonomic simulator for basic laparoscopic skills. J Surg Educ 71(1):65–72CrossRefPubMed

17.

Seixas-Mikelus S, Stegemann AP, Kesavadas T, Srimathveeravalli G, Sathyaseelan G, Chandrasekhar R, Wilding GE, Peabody JO, Guru KA (2011) Content validation of a novel robotic surgical simulator. BJU Int 107(7):1130–1135CrossRefPubMed

18.

Dulan G, Rege RV, Hogg DC, Gilberg-Fisher KK, Tesfay ST, Scott DJ (2012) Content and face validity of a comprehensive robotic skills training program for general surgery, urology, and gynecology. Am J Surg 203(4):535–539CrossRefPubMed

19.

Kenney PA, Wszolek MF, Gould JJ, Lobertino JA, Moinzadeh A (2009) Face, content, and construct validity of dV-trainer, a novel virtual reality simulator for robotic surgery. Urology 73(6):1288–1292CrossRefPubMed

20.

Verdaasdonk EG, Stassen LP, Monteny LJ, Dankelman J (2006) Validation of a new basic virtual reality simulator for training of basic endoscopic skills: the SIMENDO. Surg Endosc 20(3):511–518CrossRefPubMed

21.

Seixas-Mikelus S, Kesavadas T, Srimathveeravalli G, Chandrasekhar R, Wilding GE, Guru KA (2010) Face validation of a novel robotic surgical simulator. Urology 76(2):357–360CrossRefPubMed

22.

Kelly D, Margules AC, Kundavaram CR, Narins H, Gomella LG, Trabulsi EJ, Lallas CD (2012) Face, content, and construct validation of the da Vinci skills simulator. Urology 79(5):1068–1072CrossRefPubMed

23.

Schijven M, Jakimowicz J (2002) Face-, expert, and referent validity of the Xitact LS500 laparoscopy simulator. Surg Endosc 16(12):1764–1770CrossRefPubMed

24.

Sweet R, Kowalewski T, Oppenheimer P, Weghorst S, Satava R (2004) Face, content and construct validity of the University of Washington virtual reality transurethral prostate resection trainer. J Urol 172(5):1953–1957CrossRefPubMed

25.

Maithel S, Sierra R, Korndorffer J, Neumann P, Dawson S, Callery M, Jones D, Scott D (2006) Construct and face validity of MIST-VR, Endotower, and CELTS, are we ready for skills assessment using simulators? Surg Endosc 20:104–112CrossRefPubMed

26.

Aydin A, Ahmed K, Brewin J, Khan MS, Dasgupta P, Aho T (2014) Face and content validation of the prostatic hyperplasia model and holmium laser surgery simulator. J Surg Educ 71(3):339–344CrossRefPubMed

27.

Fisher J, Binenbaum G, Tapino P, Volpe NJ (2006) Development and face and content validity of an eye surgical skills assessment test for ophthalmology residents. Ophthalmology 113(12):2364–2370CrossRefPubMed

28.

Scott DJ, Cendan JC, Pugh CM, Minter RM, Dunnington GL, Kozar RA (2008) The changing face of surgical education: simulation as the new paradigm. J Surg Res 147(2):189–193CrossRefPubMedPubMedCentral

29.

Gould D (2010) Using simulation for interventional radiology training. Br J Radiol 83:546–553CrossRefPubMedPubMedCentral

30.

Vick LR, Vick KD, Borman KR, Salameh JR (2007) Face, content, and construct validities of inanimate intestinal anastomoses simulation. J Surg Educ 64(6):365–368CrossRefPubMed

31.

Gavazzi A, Bahsoun A, Haute W, Ahmed K, Elhage O, Jaye P, Khan M, Dasgupta P (2011) Face, content and construct validity of a virtual reality simulator for robotic surgery (SEP Robot). Ann R Coll Surg Engl 93(2):152–156CrossRefPubMedPubMedCentral

32.

Schreuder HR, Persson JE, Wolswijk RG, Ihse I, Schijven MP, Verheijen RH (2014) Validation of a novel virtual reality simulator for robotic surgery. Sci World J 2014:30CrossRef

33.

Medaphor® Plc, The ScanTrainer (2016) [online] Available at http://www.medaphor.com/scantrainer/ [Accessed 30 June 2016]

34.

Jensen MP, Chen C, Brugger AM (2003) Interpretation of visual analog scale ratings and change scores: a reanalysis of two clinical trials of postoperative pain. J Pain 4(7):407–414CrossRefPubMed

35.

Shanmugan S, Leblanc F, Senagore AJ, Ellis CN, Stein SL, Khan S, Delaney CP, Champagne BJ (2014) Virtual reality simulator training for laparoscopic colectomy: what metrics have construct validity? Dis Colon rectum 57(2):210–214CrossRefPubMed

36.

O'Leary SJ, Hutchins MA, Stevenson DR, Gunn C, Krumpholz A, Kennedy G, Tykocinski M, Dahm M, Pyman B (2008) Validation of a networked virtual reality simulation of temporal bone surgery. Laryngoscope 118(6):1040–1046CrossRefPubMed

37.

de Vries AH, van Genugten HG, Hendrikx AJ, Koldewijn EL, Schout BM, Tjiam IM, van Merriënboer JJ, Muijtjens AM, Wagner C (2016) The Simbla TURBT simulator in urological residency training: from needs analysis to validation. J Endourol 30(5):580–587CrossRefPubMed

38.

Chalasani V, Cool DW, Sherebrin S, Fenster A, Chin J, Izawa JI (2011) Development and validation of a virtual reality transrectal ultrasound guided prostatic biopsy simulator. Can Urol Assoc J 5(1):19–26CrossRefPubMedPubMedCentral

39.

Lin Y, Wang X, Wu F, Chen X, Wang C, Shen G (2014) Development and validation of a surgical training simulator with haptic feedback for learning bone-sawing skill. J Biomed Inform 48:122–129CrossRefPubMed

40.

Chalouhi GE, Bernardi V, Gueneuc A, Houssin I, Stirnemann JJ, Ville Y (2015) Evaluation of trainees’ ability to perform obstetrical ultrasound using simulation: challenges and opportunities. Am J Obstet Gynecol 214(4):525.e1–525.e8CrossRef

41.

Hsi RS, Dunmire B, Cunitz BW, He X, Sorensen MD, Harper JD, Bailey MR, Lendvay TS (2014) Content and face validation of a curriculum for ultrasonic propulsion of calculi in a human renal model. J Endourol 28(4):459–463CrossRefPubMedPubMedCentral

42.

Jaffer U, Singh P, Pandey VA, Aslam M, Standfield NJ (2014) Validation of a novel duplex ultrasound objective structured assessment of technical skills (DUOSATS) for arterial stenosis detection. Heart Lung Vessel 6(2):92–104PubMedPubMedCentral

43.

Shumard KM, Akoma UN, Street LM, Brost BC, Nitsche JF (2015) Development of a novel task trainer for second trimester ultrasound-guided uterine evacuation. Simul Healthc 10(1):49–53CrossRefPubMed

44.

Maul H, Scharf A, Baier P, Wüstemann M, Günter HH, Gebauer G, Sohn C (2004) Ultrasound simulators: experience with the SonoTrainer and comparative review of other training systems. Ultrasound Obstet Gynecol 24(5):581–585CrossRefPubMed

45.

Merz E (2006) Ultrasound simulator—an ideal supplemental tool for mastering the diagnostics of fetal malformations or an illusion? Ultraschall in Med 27(4):321–323CrossRef

46.

Williams CJ, Edie JC, Mulloy B, Flinton DM, Harrison G (2013) Transvaginal ultrasound simulation and its effect on trainee confidence levels: a replacement for initial clinical training? Ultrasound 21(2):50–56CrossRef

47.

Cline BC, Badejo AO, Rivest II, Scanlon JR, Taylor WC, Gerling GJ (2008) Human performance metrics for a virtual reality simulator to train chest tube insertion. IEEE Systems Inf Eng Des Symp:168–173 doi:10.1109/SIEDS.2008.4559705

48.

Stefanidis D, Korndorffer JR, Markley S, Sierra R, Heniford BT, Scott DJ (2007) Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 205(2):307–313CrossRefPubMed

49.

White MA, Dehaan AP, Stephens DD, Maes AA, Maatman TJ (2010) Validation of a high fidelity adult ureteroscopy and renoscopy simulator. J Urol 183(2):673–677CrossRefPubMed

50.

Bright E, Vine S, Wilson MR, Masters RS, McGrath JS (2012) Face validity, construct validity and training benefits of a virtual reality turp simulator. Int J Surg 10(3):163–166CrossRefPubMed

51.

Shetty S, Panait L, Baranoski J, Dudrick SJ, Bell RL, Roberts KE, Duffy AJ (2012) Construct and face validity of a virtual reality-based camera navigation curriculum. J Surg Res 177(2):191–195CrossRefPubMed

52.

Campo R, Puga M, Meier Furst R, Wattiez A, De Wilde RL (2014) Excellence needs training “Certified programme in endoscopic surgery”. Facts Views Vis Obgyn 6(4):240–244PubMedPubMedCentral

53.

Campo R, Wattiez A, Tanos V, Di Spiezio SA, Grimbizis G, Wallwiener D, Brucker S, Puga M, Molinas R, O’Donovan P, Deprest J, Van Belle Y, Lissens A, Herrmann A, Tahir M, Benedetto C, Siebert I, Rabischong B, De Wilde RL (2016) Gynaecological endoscopic surgical education and assessment. A diploma programme in gynaecological endoscopic surgery. Gynecol Surg 13:133–137CrossRefPubMedPubMedCentral

Title: Face and content validity of the virtual reality simulator ‘ScanTrainer®’
Authors: Amal Alsalamah
Rudi Campo
Vasilios Tanos
Gregoris Grimbizis
Yves Van Belle
Kerenza Hood
Neil Pugh
Nazar Amso
Publication date: 01-12-2017
Publisher: Springer Berlin Heidelberg
Published in: Gynecological Surgery / Issue 1/2017
Print ISSN: 1613-2076
Electronic ISSN: 1613-2084
DOI: https://doi.org/10.1186/s10397-017-1020-6

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Face and content validity of the virtual reality simulator ‘ScanTrainer®’

Abstract

Background

Objective

Method

Results

Conclusions

At a glance: The ONWARDS insulin icodec trials

Springer Medicine

Abstract

Background

Objective

Method

Results

Conclusions

Please log in to get access to this content

Other articles of this Issue 1/2017

Effects of salpingectomy during abdominal hysterectomy on ovarian reserve: a randomized controlled trial

Dominant hand, non-dominant hand, or both? The effect of pre-training in hand-eye coordination upon the learning curve of laparoscopic intra-corporeal knot tying

Treating symptomatic uterine fibroids with myomectomy: current practice and views of UK consultants

Essure® present controversies and 5 years’ learned lessons: a retrospective study with short- and long-term follow-up

Pregnancy following laparoscopic hysteropexy—a case series

Oophoropexy for ovarian torsion: a new easier technique