A proficiency-based virtual reality endoscopy curriculum improves performance on the fundamentals of endoscopic surgery examination
- 138 Downloads
The fundamentals of endoscopic surgery (FES) examination is a national test of knowledge and skill in flexible gastrointestinal endoscopy. The skill portion of the examination involves five tasks that assesses the following skills: scope navigation, loop reduction, mucosal inspection, retroflexion, and targeting. This project aimed to assess the efficacy of a proficiency-based virtual reality (VR) curriculum in preparing residents for the FES skills exam.
Experienced (>100 career colonoscopies) and inexperienced endoscopists (<50 career colonoscopies) were recruited to participate. Six VR modules were identified as reflecting the skills tested in the exam. All participants were asked to perform each of the selected modules twice, and median performance was compared between the two groups. Inexperienced endoscopists were subsequently randomized in matched pairs into a repetition (10 repetitions of each task) or proficiency curriculum. After completion of the respective curriculum, FES scores and pass rates were compared to national data and historical institutional control data (endoscopy-rotation training alone).
Five experienced endoscopists and twenty-three inexperienced endoscopists participated. Construct valid metrics were identified for six modules and proficiency benchmarks were set at the median performance of experienced endoscopists. FES scores of inexperienced endoscopists in the proficiency group had significantly higher FES scores (530 ± 86) versus historical control (386.7 ± 92.2, p = 0.0003) and higher pass rate (proficiency: 100%, historical control 61.5%, p = 0.01).
Trainee engagement in a VR curriculum yields superior FES performance compared to an endoscopy rotation alone. Compared to the 2012–2016 national resident pass rate of 80, 100% of trainees in a proficiency-based curriculum passed the FES manual skills examination.
KeywordsProficiency Graduate medical education Clinical competence Fundamentals of endoscopic surgery Task performance and analysis Curriculum
The authors would like to thank Brenessa Lindeman, MD MEHP for her assistance in educational research methodology and Michelle Lynn Sanchez for her administrative support.
This project was funded by a grant from the MGH Executive Committee on Teaching and Education. The FES Committee of the Society of American Gastrointestinal and Endoscopic Surgeons provided reduced cost testing vouchers for the FES manual skills examination for the purposes of this study. Daniel Hashimoto is funded by the National Institutes of Health National Institute of Diabetes and Digestive and Kidney Diseases (NIH NIDDK Grant #: T32DK007754-16A1) and the Massachusetts General Hospital (MGH) Edward D. Churchill Research Fellowship. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.
Compliance with ethical standards
Daniel A. Hashimoto, Emil Petrusa, Roy Phitayakorn, Christina Valle, Brenna Casey, and Denise Gee declare that they have no conflicts of interest or financial ties to disclose.
- 1.ACGME (2008) ACGME program requirements of graduate medical education in surgery. Accreditation Council for Graduate Medical Education, ChicagoGoogle Scholar
- 3.Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C, Korndorffer JR Jr, Ujiki M, Velanovich V, Kochman ML, Tsuda S, Martinez J, Scott DJ, Korus G, Park A, Marks JM (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28:704–711CrossRefPubMedGoogle Scholar
- 6.ABS (2014) Flexible endoscopy curriculum for general surgery residents. American Board of Surgery, PhiladelphiaGoogle Scholar
- 7.Hashimoto DA, Sirimanna P, Gomez ED, Beyer-Berjot L, Ericsson KA, Willians NN, Darzi A, Aggarwal R (2015) Deliberate practice enhances the quality of laparoscopic surgical performance in a randomized controlled trial: from arrested development to expert performance. Surg Endosc 29:3154–3162CrossRefPubMedGoogle Scholar
- 10.Rosenthal ME, Ritter EM, Goova MT, Castellvi AO, Tesfay ST, Pimentel EA, Hartzler R, Scott DJ (2010) Proficiency-based Fundamentals of Laparoscopic Surgery skills training results in durable performance improvement and a uniform certification pass rate. Surg Endosc 24:2453–2457CrossRefPubMedGoogle Scholar
- 12.Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, Bini EJ, Bodenheimer H, Cerulli M, Gerdes H, Greenwald D, Gress F, Grosman I, Hawes R, Mullin G, Schnoll-Sussman F, Starpoli A, Stevens P, Tenner S, Villanueva G (2006) Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc 64:361–368CrossRefPubMedGoogle Scholar
- 14.Committee F (2017) FES Test Centers. Society of American Gastrointestinal and Endoscopic SurgeonsGoogle Scholar
- 16.Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW, Lightdale JR, Velanovich V, Swanstrom LL, Mellinger JD, Fried GM (2010) Global Assessment of Gastrointestinal Endoscopic Skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg Endosc 24:1834–1841CrossRefPubMedGoogle Scholar