Convergent validation and transfer of learning studies of a virtual reality-based pattern cutting simulator
Research has clearly shown the benefits of surgical simulators to train laparoscopic motor skills required for positive patient outcomes. We have developed the Virtual Basic Laparoscopic Skill Trainer (VBLaST) that simulates tasks from the Fundamentals of Laparoscopic Surgery (FLS) curriculum. This study aims to show convergent validity of the VBLaST pattern cutting module via the CUSUM method to quantify learning curves along with motor skill transfer from simulation environments to ex vivo tissue samples.
18 medical students at the University at Buffalo, with no prior laparoscopic surgical skills, were placed into the control, FLS training, or VBLaST training groups. Each training group performed pattern cutting trials for 12 consecutive days on their respective simulation trainers. Following a 2-week break period, the trained students performed three pattern cutting trials on each simulation platform to measure skill retention. All subjects then performed one pattern cutting task on ex vivo cadaveric peritoneal tissue. FLS and VBLaST pattern cutting scores, CUSUM scores, and transfer task completion times were reported.
Results indicate that the FLS and VBLaST trained groups have significantly higher task performance scores than the control group in both the VBLaST and FLS environments (p < 0.05). Learning curve results indicate that three out of seven FLS training subjects and four out of six VBLaST training subjects achieved the “senior” performance level. Furthermore, both the FLS and VBLaST trained groups had significantly lower transfer task completion times on ex vivo peritoneal tissue models (p < 0.05).
We characterized task performance scores for trained VBLaST and FLS subjects via CUSUM analysis of the learning curves and showed evidence that both groups have significant improvements in surgical motor skill. Furthermore, we showed that learned surgical skills in the FLS and VBLaST environments transfer not only to the different simulation environments, but also to ex vivo tissue models.
KeywordsLearning curve Virtual surgical simulation Surgical training Surgical performance metrics Surgical skill transfer Laparoscopy
This work is supported by NIBIB 1R01EB014305, NHLBI 1R01HL119248, and NCI 1R01CA197491 Grants awarded to Suvranu De. The authors would like to thank the medical student subjects and their dedication for this study. The authors would also like to thank the anatomical gift program and the gross anatomy lab at University of Buffalo for their support regarding the ex vivo cadaveric samples.
Compliance with ethical standards
Drs. Arun Nemani, Woojin Ahn, Clairice Cooper, Steven Schwaitzberg, and Suvranu De have no conflict of interest or financial ties to disclose.
- 3.Aggarwal R, Grantcharov T, Moorthy K, Milland T, Papasavas P, Dosis A, Bello F, Darzi A (2007) An evaluation of the feasibility, validity, and reliability of laparoscopic skills assessment in the operating room. Ann Surg 245:992–999. doi: 10.1097/01.sla.0000262780.17950.e5 CrossRefPubMedPubMedCentralGoogle Scholar
- 11.Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27. doi: 10.1016/S0039-6060(03)00156-9 CrossRefPubMedGoogle Scholar
- 17.Zhang L, Sankaranarayanan G, Arikatla VS, Ahn W, Grosdemouge C, Rideout JM, Epstein SK, De S, Schwaitzberg SD, Jones DB, Cao CGL (2013) Characterizing the learning curve of the VBLaST-PT© (Virtual Basic Laparoscopic Skill Trainer). Surg Endosc 27:3603–3615. doi: 10.1007/s00464-013-2932-5 CrossRefPubMedPubMedCentralGoogle Scholar
- 18.Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463. doi: 10.1097/01.SLA.0000028969.51489.B4 CrossRefPubMedPubMedCentralGoogle Scholar
- 22.Sankaranarayanan G, Lin H, Arikatla VS, Mulcare M, Zhang L, Derevianko A, Lim R, Fobert D, Cao C, Schwaitzberg SD, Jones DB, De S (2010) Preliminary face and construct validation study of a virtual basic laparoscopic skill trainer. J Laparoendosc Adv Surg Tech A 20:153–157. doi: 10.1089/lap.2009.0030 CrossRefPubMedPubMedCentralGoogle Scholar
- 29.Kye B-H, Kim J-G, Cho H-M, Kim H-J, Suh Y-J, Chun C-S (2011) Learning curves in laparoscopic right-sided colon cancer surgery: a comparison of first-generation colorectal surgeon to advance laparoscopically trained surgeon. J Laparoendosc Adv Surg Tech 21:789–796. doi: 10.1089/lap.2011.0086 CrossRefGoogle Scholar
- 34.Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of Laparoscopic Surgery simulator training to proficiency improves laparoscopic performance in the operating room—a randomized controlled trial. Am J Surg 199:115–120. doi: 10.1016/j.amjsurg.2009.07.035 CrossRefPubMedGoogle Scholar
- 37.Leff DR, Orihuela-Espina F, Elwell CE, Athanasiou T, Delpy DT, Darzi AW, Yang G-Z (2011) Assessment of the cerebral cortex during motor task behaviours in adults: a systematic review of functional near infrared spectroscopy (fNIRS) studies. Neuroimage 54:2922–2936. doi: 10.1016/j.neuroimage.2010.10.058 CrossRefPubMedGoogle Scholar