The Fundamentals of Laparoscopic Surgery (FLS) trainer box is now established as a standard for evaluating minimally invasive surgical skills. A particularly simple task in this trainer box is the peg transfer task which is aimed at testing the surgeon’s bimanual dexterity, hand–eye coordination, speed, and precision. The Virtual Basic Laparoscopic Skill Trainer (VBLaST©) is a virtual version of the FLS tasks which allows automatic scoring and real-time, subjective quantification of performance without the need of a human proctor. In this article we report validation studies of the VBLaST© peg transfer (VBLaST-PT©) simulator.
Thirty-five subjects with medical background were divided into two groups: experts (PGY 4–5, fellows, and practicing surgeons) and novices (PGY 1–3). The subjects were asked to perform the peg transfer task on both the FLS trainer box and the VBLaST-PT© simulator; their performance was evaluated based on established metrics of error and time. A new length of trajectory (LOT) metric has also been introduced for offline analysis. A questionnaire was used to rate the realism of the virtual system on a 5-point Likert scale.
Preliminary face validation of the VBLaST-PT© with 34 subjects rated on a 5-point Likert scale questionnaire revealed high scores for all aspects of simulation, with 3.53 being the lowest mean score across all questions. A two-tailed Mann–Whitney test performed on the total scores showed significant (p = 0.001) difference between the groups. A similar test performed on the task time (p = 0.002) and the LOT (p = 0.004) separately showed statistically significant differences between the experts and the novices (p < 0.05). The experts appear to be traversing shorter overall trajectories in less time than the novices.
VBLaST-PT© showed both face and construct validity and has promise as a substitute for the FLS for training peg transfer skills.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Price includes VAT for USA
Dawson SL, Kaufman JA (1998) The imperative for medical simulation. Proc IEEE 86(3):479–483
Derossis AM, Fried GM, Abrahamowicz M, Sigman HH, Barkun JS, Meakins JL (1998) Development of a model for training and evaluation of laparoscopic skills. Am J Surg 175(6):482–487
Dauster B, Steinberg AP, Vassiliou MC, Bergman S, Stanbridge DD, Feldman LS, Fried GM (2005) Validity of the MISTELS simulator for laparoscopy training in urology. J Endourol 19(5):541–545
McCluney A, Vassiliou M, Kaneva P, Cao J, Stanbridge D, Feldman L, Fried G (2007) FLS simulator performance predicts intraoperative laparoscopic skill. Surg Endosc 21(11):1991–1995
Liu A, Tendick F, Cleary K, Kaufmann C (2003) A survey of surgical simulation: applications, technology, and education. Presence Teleoper Virtual Environ 12:599–614
Satava RM (2007) Historical review of surgical simulation—a personal perspective. World J Surg 32(2):141–148
Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance. Ann Surg 236(4):458–464
Jordan JA, Gallagher AG, McGuigan J, McClure N (2001) Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc 15(10):1080–1084
Fraser SA, Klassen DR, Feldman LS, Ghitulescu GA, Stanbridge D, Fried GM (2003) Evaluating laparoscopic skills: setting the pass/fail score for the MISTELS system. Surg Endosc 17(6):964–967
Zilles CB, Salisbury JK (1995) A constraint-based god-object method for haptic display. IEEE/RSJ Int Conf Intell Robots Syst 3:146–151
Rosser JC, Lynch PJ, Cuddihy L, Gentile DA, Klonsky J, Merrell R (2007) The impact of video games on training surgeons in the twenty first century. Arch Surg 142(2):181–186
Sutherland LM, Middleton PF, Anthony A, Hamdorf J, Cregan P, Scott D, Maddern GJ (2006) Surgical simulation. Ann Surg 243(3):291–300
Zhang A, Hünerbein M, Dai Y, Schlag P, Beller S (2008) Construct validity testing of a laparoscopic surgery simulator (Lap Mentor): evaluation of surgical skill with a virtual laparoscopic training simulator. Surg Endosc 22(6):1440–1444
Epona Medical | LAP-X. Laparoscopy training. Available at http://www.lapx.eu/en/lapx.html. Accessed 13 May 2012
Iwata N, Fujiwara M, Kodera Y, Tanaka C, Ohashi N, Nakayama G, Koike M et al (2011) Construct validity of the LapVR virtual-reality surgical simulator. Surg Endosc 25(2):423–428
Mansour S, Din N, Ratnasingham K, Irukulla S, Vasilikostas G, Reddy M, Wan A (2012) Objective assessment of the core laparoscopic skills course. Minim Invasive Surg 2012:379625
Pitzul KB, Grantcharov TP, Okrainec A (2012) Validation of three virtual reality Fundamentals of Laparoscopic Surgery (FLS) modules. Stud Health Technol Inf 173:349–355
Ritter E, Kindelan T, Michael C, Pimentel E, Bowyer M (2007) Concurrent validity of augmented reality metrics applied to the fundamentals of laparoscopic surgery (FLS). Surg Endosc 21(8):1441–1445
Larsen CR, Grantcharov T, Aggarwal R, Tully A, Sørensen JL, Dalsgaard T, Ottesen B (2006) Objective assessment of gynecologic laparoscopic skills using the LapSimGyn virtual reality simulator. Surg Endosc 20(9):1460–1466
Chmarra MK, Jansen FW, Grimbergen CA, Dankelman J (2008) Retracting and seeking movements during laparoscopic goal-oriented movements. Is the shortest path length optimal? Surg Endosc 22(4):943–949
Verner L, Oleynikov D, Holtmann S, Haider H, Zhukov L (2003) Measurements of the level of surgical expertise using flight path analysis from da Vinci robotic surgical system. Stud Health Technol Inf 94:373–378
Rosen J, MacFarlane M, Richards C, Hannaford B, Sinanan M (1999) Surgeon-tool force/torque signatures—evaluation of surgical skills in minimally invasive surgery. Stud Health Technol Inf 62:290–296
Hwang H, Lim J, Kinnaird C, Nagy A, Panton O, Hodgson A, Qayumi K (2006) Correlating motor performance with surgical error in laparoscopic cholecystectomy. Surg Endosc 20(4):651–655
Kowalewski TM, Rosen J, Chang L, Sinanan MN, Hannaford B (2004) Optimization of a vector quantization codebook for objective evaluation of surgical skill. Stud Health Technol Inf 98:174–179
The authors gratefully acknowledge the support of this study by NIH/NIBIB (Grant No. 5R01EB010037). They also thank Alex Derevianko of Massachusetts General Hospital (MGH) for helping conduct the experiments and Saurabh Dargar of Rensselaer Polytechnic Institute for helping during the hardware design phase.
Venkata S. Arikatla, Dr. Ganesh Sankaranarayanan, Woojin Ahn, Amine Chellali, John Hwabejire, Marc DeMoya, Steven Schwaitzberg, Daniel B. Jones, Suvranu De, and Caroline Cao have no conflicts of interest or financial ties to disclose.
About this article
Cite this article
Arikatla, V.S., Sankaranarayanan, G., Ahn, W. et al. Face and construct validation of a virtual peg transfer simulator. Surg Endosc 27, 1721–1729 (2013). https://doi.org/10.1007/s00464-012-2664-y
- Virtual reality
- Surgical training
- Face validity
- Length of trajectory