Surgical Endoscopy

, Volume 32, Issue 3, pp 1397–1404 | Cite as

A proficiency-based virtual reality endoscopy curriculum improves performance on the fundamentals of endoscopic surgery examination

Article

Abstract

Introduction

The fundamentals of endoscopic surgery (FES) examination is a national test of knowledge and skill in flexible gastrointestinal endoscopy. The skill portion of the examination involves five tasks that assesses the following skills: scope navigation, loop reduction, mucosal inspection, retroflexion, and targeting. This project aimed to assess the efficacy of a proficiency-based virtual reality (VR) curriculum in preparing residents for the FES skills exam.

Methods

Experienced (>100 career colonoscopies) and inexperienced endoscopists (<50 career colonoscopies) were recruited to participate. Six VR modules were identified as reflecting the skills tested in the exam. All participants were asked to perform each of the selected modules twice, and median performance was compared between the two groups. Inexperienced endoscopists were subsequently randomized in matched pairs into a repetition (10 repetitions of each task) or proficiency curriculum. After completion of the respective curriculum, FES scores and pass rates were compared to national data and historical institutional control data (endoscopy-rotation training alone).

Results

Five experienced endoscopists and twenty-three inexperienced endoscopists participated. Construct valid metrics were identified for six modules and proficiency benchmarks were set at the median performance of experienced endoscopists. FES scores of inexperienced endoscopists in the proficiency group had significantly higher FES scores (530 ± 86) versus historical control (386.7 ± 92.2, p = 0.0003) and higher pass rate (proficiency: 100%, historical control 61.5%, p = 0.01).

Conclusion

Trainee engagement in a VR curriculum yields superior FES performance compared to an endoscopy rotation alone. Compared to the 2012–2016 national resident pass rate of 80, 100% of trainees in a proficiency-based curriculum passed the FES manual skills examination.

Keywords

Proficiency Graduate medical education Clinical competence Fundamentals of endoscopic surgery Task performance and analysis Curriculum 

Notes

Acknowledgements

The authors would like to thank Brenessa Lindeman, MD MEHP for her assistance in educational research methodology and Michelle Lynn Sanchez for her administrative support.

Funding

This project was funded by a grant from the MGH Executive Committee on Teaching and Education. The FES Committee of the Society of American Gastrointestinal and Endoscopic Surgeons provided reduced cost testing vouchers for the FES manual skills examination for the purposes of this study. Daniel Hashimoto is funded by the National Institutes of Health National Institute of Diabetes and Digestive and Kidney Diseases (NIH NIDDK Grant #: T32DK007754-16A1) and the Massachusetts General Hospital (MGH) Edward D. Churchill Research Fellowship. The content is solely the responsibility of the authors and does not necessarily represent the official views of the NIH.

Compliance with ethical standards

Disclosures

Daniel A. Hashimoto, Emil Petrusa, Roy Phitayakorn, Christina Valle, Brenna Casey, and Denise Gee declare that they have no conflicts of interest or financial ties to disclose.

References

  1. 1.
    ACGME (2008) ACGME program requirements of graduate medical education in surgery. Accreditation Council for Graduate Medical Education, ChicagoGoogle Scholar
  2. 2.
    Aggarwal R, Grantcharov TP, Darzi A (2007) Framework for systematic training and assessment of technical skills. J Am Coll Surg 204:697–705CrossRefPubMedGoogle Scholar
  3. 3.
    Vassiliou MC, Dunkin BJ, Fried GM, Mellinger JD, Trus T, Kaneva P, Lyons C, Korndorffer JR Jr, Ujiki M, Velanovich V, Kochman ML, Tsuda S, Martinez J, Scott DJ, Korus G, Park A, Marks JM (2014) Fundamentals of endoscopic surgery: creation and validation of the hands-on test. Surg Endosc 28:704–711CrossRefPubMedGoogle Scholar
  4. 4.
    Koch AD, Buzink SN, Heemskerk J, Botden SM, Veenendaal R, Jakimowicz JJ, Schoon EJ (2008) Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc 22:158–162CrossRefPubMedGoogle Scholar
  5. 5.
    Phitayakorn R, Marks JM, Reynolds HL, Delaney CP (2009) Expert benchmark for the GI Mentor II. Surg Endosc 23:611–614CrossRefPubMedGoogle Scholar
  6. 6.
    ABS (2014) Flexible endoscopy curriculum for general surgery residents. American Board of Surgery, PhiladelphiaGoogle Scholar
  7. 7.
    Hashimoto DA, Sirimanna P, Gomez ED, Beyer-Berjot L, Ericsson KA, Willians NN, Darzi A, Aggarwal R (2015) Deliberate practice enhances the quality of laparoscopic surgical performance in a randomized controlled trial: from arrested development to expert performance. Surg Endosc 29:3154–3162CrossRefPubMedGoogle Scholar
  8. 8.
    Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112CrossRefPubMedGoogle Scholar
  9. 9.
    Stefanidis D, Acker CE, Greene FL (2010) Performance goals on simulators boost resident motivation and skills laboratory attendance. J Surg Educ 67:66–70CrossRefPubMedGoogle Scholar
  10. 10.
    Rosenthal ME, Ritter EM, Goova MT, Castellvi AO, Tesfay ST, Pimentel EA, Hartzler R, Scott DJ (2010) Proficiency-based Fundamentals of Laparoscopic Surgery skills training results in durable performance improvement and a uniform certification pass rate. Surg Endosc 24:2453–2457CrossRefPubMedGoogle Scholar
  11. 11.
    Sroka G, Feldman LS, Vassiliou MC, Kaneva PA, Fayez R, Fried GM (2010) Fundamentals of laparoscopic surgery simulator training to proficiency improves laparoscopic performance in the operating room-a randomized controlled trial. Am J Surg 199:115–120CrossRefPubMedGoogle Scholar
  12. 12.
    Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, Bini EJ, Bodenheimer H, Cerulli M, Gerdes H, Greenwald D, Gress F, Grosman I, Hawes R, Mullin G, Schnoll-Sussman F, Starpoli A, Stevens P, Tenner S, Villanueva G (2006) Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc 64:361–368CrossRefPubMedGoogle Scholar
  13. 13.
    Crochet P, Aggarwal R, Dubb SS, Ziprin P, Rajaretnam N, Grantcharov T, Ericsson KA, Darzi A (2011) Deliberate practice on a virtual reality laparoscopic simulator enhances the quality of surgical technical skills. Ann Surg 253:1216–1222CrossRefPubMedGoogle Scholar
  14. 14.
    Committee F (2017) FES Test Centers. Society of American Gastrointestinal and Endoscopic SurgeonsGoogle Scholar
  15. 15.
    Mueller CL, Kaneva P, Fried GM, Feldman LS, Vassiliou MC (2014) Colonoscopy performance correlates with scores on the FES manual skills test. Surg Endosc 28:3081–3085CrossRefPubMedGoogle Scholar
  16. 16.
    Vassiliou MC, Kaneva PA, Poulose BK, Dunkin BJ, Marks JM, Sadik R, Sroka G, Anvari M, Thaler K, Adrales GL, Hazey JW, Lightdale JR, Velanovich V, Swanstrom LL, Mellinger JD, Fried GM (2010) Global Assessment of Gastrointestinal Endoscopic Skills (GAGES): a valid measurement tool for technical skills in flexible endoscopy. Surg Endosc 24:1834–1841CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2017

Authors and Affiliations

  • Daniel A. Hashimoto
    • 1
  • Emil Petrusa
    • 1
    • 3
  • Roy Phitayakorn
    • 1
  • Christina Valle
    • 1
    • 3
  • Brenna Casey
    • 2
  • Denise Gee
    • 1
    • 4
  1. 1.Department of SurgeryMassachusetts General HospitalBostonUSA
  2. 2.Division of Gastroenterology, Department of MedicineMassachusetts General HospitalBostonUSA
  3. 3.Learning LaboratoryMassachusetts General HospitalBostonUSA
  4. 4.Department of SurgeryMassachusetts General HospitalBostonUSA

Personalised recommendations