Operator experience determines performance in a simulated computer-based brain tumor resection task
- 416 Downloads
Develop measures to differentiate between experienced and inexperienced neurosurgeons in a virtual reality brain surgery simulator environment.
Medical students (\(n=71\)) and neurosurgery residents (\(n=12\)) completed four simulated Glioblastoma multiforme resections. Simulated surgeries took place over four days with intermittent spacing in between (average time between surgeries of 4.77 \(\pm \) 0.73 days). The volume of tumor removed (cc), volume of healthy brain removed (cc), and instrument path length (mm) were recorded. Additionally, surgical effectiveness (% tumor removed divided by % healthy brain removed) and efficiency (% tumor removed divided by instrument movement in mm) were calculated. Performance was compared (1) between groups, and (2) for each participant over time to assess the learning curve. In addition, the effect of real-time instruction (“coaching”) was assessed with a randomly selected group of medical students.
Neurosurgery residents removed less healthy brain, were more effective in removing tumor and sparing healthy brain tissue, required less instrument movement, and were more efficient in removing tumor tissue than medical students. Medical students approached the resident level of performance over serial sessions. Coached medical students showed more conservative surgical behavior, removing both less tumor and less healthy brain. In sum, neurosurgery residents removed more tumor, removed less healthy brain, and required less instrument movement than medical students. Coaching modified medical student performance.
Virtual Reality brain surgery can differentiate operators based on both recent and long-term experience and may be useful in the acquisition and assessment of neurosurgical skills. Coaching alters the learning curve of naïve inexperienced individuals.
KeywordsSimulator Virtual reality Training NeuroTouch Coaching Glioblastoma multiforme tumor
We would like to thank the NRC for logistical support, Steven Philemond for coaching participants in the study, and Dr. Errol Gordon and Dr. E. J. Fernandez for their assistance with experimental design, the medical students and neurosurgery residents of the Icahn School of Medicine at Mount Sinai for their participation in our study, and all those who contributed to the study or manuscript preparation. Zachary Lorsch and Michael Chary are supported by the Medical Scientist Training Program of the Icahn School of Medicine at Mount Sinai (NIH Grant # T32 GM 007280).
Conflict of interest
Terrell Holloway, Zachary Lorsch, Michael Chary, Stanislaw Sobotka, Maximilian Moore, Anthony Costa, and Rolando Del Maestro report no Conflicts of Interest. As stated in the disclosures, Dr. Joshua Bederson, is part of the Neurotouch Consortium advisory board without compensation.
Ethical standard All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.
Informed consent Informed consent was obtained from all individual participants included in the study. The institutional review board (IRB) of Mount Sinai Hospital determined that this study was exempt from IRB review.
Video demonstration of simulated GBM resection using NeuroTouch surgical simulator. Outline of tools used %during virtual GBM resection; suction utilized by the aspirator in right hand (RH) and cauterization utilized by the %bipolar in left hand (LH)
- 4.Choudhury N, Gélinas-Phaneuf N, Delorme S, Del Maestro R (2012) Fundamentals of neurosurgery: virtual reality tasks for training and evaluation of technical skills. World Neurosurg 9–19. doi: 10.1016/j.wneu.2012.08.022
- 7.Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193:774–783. doi: 10.1016/j.amjsurg.2007.01.022 CrossRefPubMedGoogle Scholar
- 12.Gélinas-Phaneuf N, Choudhury N, Al-Habib AR, Cabral A, Nadeau E, Mora V, Pazos V, Debergue P, DiRaddo R, Del Maestro RF (2013) Assessing performance in brain tumor resection using a novel virtual reality simulator. Int J Comput Assist Radiol Surg. doi: 10.1007/s11548-013-0905-8
- 13.Azarnoush H, Alzhrani G, Winkler-Schwartz A, Alotaibi F, Gelinas-Phaneuf N, Pazos V, Choudhury N, Fares J, DiRaddo R, Del Maestro RF (2014) Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection. Int J Comput Assist Radiol Surg. doi: 10.1007/s11548-014-1091-z
- 20.Cole SJ, Mackenzie H, Ha J, Hanna GB, Miskovic D (2014) Randomized controlled trial on the effect of coaching in simulated laparoscopic training. Surg Endosc 28:979–986. doi: 10.1007/s00464-013-3265-0
- 21.Teitelbaum EN, Soper NJ, Santos BF, Rooney DM, Patel P, Nagle AP, Hungness ES (2014) A simulator-based resident curriculum for laparoscopic common bile duct exploration. Surgery 156:880–887, 890–893. doi: 10.1016/j.surg.2014.06.020
- 22.Rosseau G, Bailes J, del Maestro R, Choudhury N, Comas O, Debergue P, De Luca G, Hovdebo J, Jiang D, Laroche D, Neubauer A, Pazos V, Thibault F, DiRaddo R (2013) The development of a virtual simulator for training neurosurgeons to perform and perfect endoscopic endonasal transsphenoidal surgery. Neurosurgery 73(Suppl 1):85–93. doi: 10.1227/NEU.0000000000000112 CrossRefPubMedGoogle Scholar
- 24.Ahlberg G, Enochsson L, Gallagher AG, Hedman L, Hogman C, McClusky DA, Ramel S, Smith CD, Arvidsson D (2007) Proficiency-based virtual reality training significantly reduces the error rate for residents during their first 10 laparoscopic cholecystectomies. Am J Surg 193:797–804. doi: 10.1016/j.amjsurg.2006.06.050 CrossRefPubMedGoogle Scholar
- 28.Schlickum MK, Hedman L, Enochsson L, Kjellin A, Fellander-Tsai L (2009) Systematic video game training in surgical novices improves performance in virtual reality endoscopic surgical simulators: a prospective randomized study. World J Surg 33:2360–2367. doi: 10.1007/s00268-009-0151-y CrossRefPubMedGoogle Scholar