Skip to main content
SpringerLink
Log in
Book cover

Serious Games and Edutainment Applications pp 187–202Cite as

VR Surgery: Interactive Virtual Reality Application for Training Oral and Maxillofacial Surgeons using Oculus Rift and Leap Motion

  • Chapter
  • First Online:

Abstract

VR Surgery is an immersive virtual reality operating room experience for trainee surgeons in oral and maxillofacial surgery maxillofacial surgery. Using a combination of Oculus Rift head-mounted display, Leap Motion tracking devices, high-resolution stereoscopic 3D videos and 360-degree videos, this application allows a trainee to virtually participate in a surgical procedure and interact with the patient’s anatomy. VR Surgery is highly useful for surgical trainees as a visualisation aid and for senior surgeons as a practice-based learning tool. This chapter discusses the need for reforms in the existing surgical training methods and a brief review on simulation, serious games and virtual reality in surgical training. Following this, the principles of design and development of VR Surgery are presented.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   189.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   249.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • AAMC: Physician shortages to worsen without increases in residency training. Available at: https://www.aamc.org/download/150584/data/physician_shortages_factsheet.pdf (2010). Accessed 18 Apr 2016

  • Aggarwal, R., et al.: The simulated operating theatre: Comprehensive training for surgical teams. Qual. Saf. Health Care. 13(suppl 1), i27–i32 (2004)

    Article  MathSciNet  Google Scholar 

  • ASIT: Cost of surgical training. Retrieved April 18, 2016, from http://www.asit.org/news/costofsurgicaltraining (2015)

  • Bogner, M.S.E.: Human Error in Medicine. Lawrence Erlbaum Associates, Inc, Hillsdale (1994)

    Google Scholar 

  • Bridges, M., Diamond, D.L.: The financial impact of teaching surgical residents in the operating room. (0002–9610 (Print))

    Google Scholar 

  • Carson, E.: Digital cadavers: How virtual reality and augmented reality can change anatomy class. Available at: http://www.techrepublic.com/article/digital-cadavers-how-virtual-reality-and-augmented-reality-can-change-anatomy-class/ (2015). Accessed 17 April 2016

  • Clark, R.E., et al.: The use of cognitive task analysis to improve instructional descriptions of procedures. J. Surg. Res. 173(1), e37–e42 (2012)

    Article  Google Scholar 

  • de Wit-Zuurendonk, L.D., Oei, S.G.: Serious gaming in women’s health care. BJOG: An Int. J. Obstet. Gynaecol. 118(s3), 17–21 (2011)

    Article  Google Scholar 

  • Dedy, N.J., et al.: Structured training to improve nontechnical performance of junior surgical residents in the operating room: A randomized controlled trial. Ann. Surg. 263(1), 43–49 (2016)

    Article  Google Scholar 

  • Evgeniou, E., Loizou, P.: Simulation-based surgical education – Evgeniou – 2012 – ANZ journal of surgery – Wiley online library. ANZ. J. Surg. 83(9), 619–623 (2012)

    Article  Google Scholar 

  • Fletcher, G., et al.: Rating non-technical skills: developing a behavioural marker system for use in anaesthesia. Cogn. Tech. Work. 6(3), 165–171 (2004)

    Article  Google Scholar 

  • Geoffrion, R., et al.: Validating a self-confidence scale for surgical trainees. J. Obstet. Gynaecol. Can. 35(4), 355–361 (2013)

    Article  Google Scholar 

  • Go Pro, H.: 360Heros® announces release of time saving file manager 360CamMan™ software (2014)

    Google Scholar 

  • Google: Google cardboard (2015)

    Google Scholar 

  • Graafland, M., et al.: Systematic review of serious games for medical education and surgical skills training. Br. J. Surg. 99(10), 1322–1330 (2012)

    Article  Google Scholar 

  • Gurusamy, K., et al.: Systematic review of randomized controlled trials on the effectiveness of virtual reality training for laparoscopic surgery. Br. J. Surg. 95(9), 1088–1097 (2008)

    Article  Google Scholar 

  • Hartle, A., et al.: Can doctors be trained in a 48 hour working week? 2015 (2014)

    Google Scholar 

  • HTC (2015) HTC Vive hardware. Available at: https://www.vive.com/us/product/ Accessed 25 Jan 2017

  • Hull, L., et al.: The impact of nontechnical skills on technical performance in surgery: A systematic review. J. Am. Coll. Surg. 214(2), 214–230 (2012)

    Article  Google Scholar 

  • Huynh-Thu, Q., et al.: The importance of visual attention in improving the 3D-TV viewing experience: Overview and new perspectives. IEEE Trans. Broadcast. 57(2), 421–431 (2011)

    Article  Google Scholar 

  • Issenberg, B.S., et al.: Simulation technology for health care professional skills training and assessment. JAMA. 282(9), 861–866 (1999)

    Article  Google Scholar 

  • Issenberg, B.S., et al.: Features and uses of high-fidelity medical simulations that lead to effective learning: A BEME systematic review*. Med. Teach. 27(1), 10–28 (2005)

    Article  Google Scholar 

  • Jackson, C., Gibbin, K.: Per ardua … ‘Training tomorrow’s surgeons using inter alia lessons from aviation. J. R. Soc. Med. 99(11), 554–558 (2006)

    Article  Google Scholar 

  • Kapralos, B., et al.: An overview of virtual simulation and serious gaming for surgical education and training. Springer Science + Business Media (2014)

    Google Scholar 

  • Kerr, B., O’Leary, J.P.: The training of the surgeon: Dr. Halsted’s greatest legacy. Am. Surg. 65(11), 1101–1102 (1999)

    Google Scholar 

  • Kneebone, R.L.: Practice, rehearsal, and performance. JAMA. 302(12), (2009)

    Google Scholar 

  • Kneebone, R., et al.: Simulation and clinical practice: strengthening the relationship. Med. Educ. 38(10), 1095–1102 (2004)

    Article  Google Scholar 

  • Kolb, D.A., et al.: Experiential learning theory: Previous research and new directions. Perspect. Think Learn Cogn. Style. 1, 227–247 (2001)

    Google Scholar 

  • Kolor: Autopano video – practical synchronization – Autopano. Available at: http://www.kolor.com/wiki-en/action/view/Autopano_Video_-_Practical_synchronization?action=view&title=Autopano_Video_-_Practical_synchronization#MOTION_SYNCHRONIZATION (2015). Accessed 12 April 2016

  • Lave, J., Wenger, E.: Situated Learning: Legitimate Peripheral Participation. Cambridge University Press, Cambridge (1991)

    Book  Google Scholar 

  • Leap, M.: Leap Motion controller (2015)

    Google Scholar 

  • Leap Motion: VR best practices guidelines. Available at: https://developer.leapmotion.com/assets/Leap%20Motion%20VR%20Best%20Practices%20Guidelines.pdf (2015). Accessed 17 April 2016

  • Li, P.: Cognitive task analysis. OCLC Syst. Serv.: Int. Digit. Libr. Perspect. 21(3), 252–256 (2005)

    Article  Google Scholar 

  • Luker, K.R., et al.: The use of a cognitive task analysis–based multimedia program to teach surgical decision making in flexor tendon repair. Am. J. Surg. 195(1), 11–15 (2008)

    Article  Google Scholar 

  • Lyon, P.: A model of teaching and learning in the operating theatre. Med. Educ. 38(12), 1278–1287 (2004)

    Article  Google Scholar 

  • Meara, J.G., et al.: Global surgery 2030: Evidence and solutions for achieving health, welfare, and economic development. Lancet. 386(9993), 569–624 (2015)

    Article  Google Scholar 

  • Michael, D.R., Chen, S.L.: Serious Games: Games That Educate, Train, and Inform. Muska & Lipman/Premier-Trade, New York (2005)

    Google Scholar 

  • Miller, E.R.: Creating 360 degree videos for surgical education. Available at: http://www.medicalrealities.com/creating-360-video-content-for-surgical-education/ (2015). Accessed 12 April 2016

  • Miloro, M., et al.: Peterson’s Principles of Oral and Maxillofacial Surgery, vol. 1. PMPH-USA, Shelton (2004)

    Google Scholar 

  • Moorthy, K., et al.: Surgical crisis management skills training and assessment: A stimulation-based approach to enhancing operating room performance. Ann. Surg. 244(1), 139 (2006)

    Article  Google Scholar 

  • Orzech, N., et al.: A comparison of 2 ex vivo training curricula for advanced laparoscopic skills: a randomized controlled trial. Ann. Surg. 255(5), 833–839 (2012)

    Article  Google Scholar 

  • Paige, J.T., et al.: High-fidelity, simulation-based, interdisciplinary operating room team training at the point of care. Surgery. 145(2), 138–146 (2009)

    Article  Google Scholar 

  • Pallace, N.: BioCommunications association. Available at: http://www.bca.org/resources/tips/surgical_photography_tips.html (2014). Accessed 12 April 2016

  • Patel, A.D., et al.: Learning curves and reliability measures for virtual reality simulation in the performance assessment of carotid angiography. J. Am. Coll. Cardiol. 47(9), 1796–1802 (2006)

    Article  Google Scholar 

  • Quinn, B.: UK cancer surgery to be live-streamed via virtual reality technology. Available at: http://www.theguardian.com/society/2016/mar/25/uk-cancer-surgery-live-streamed-virtual-reality (2016). Accessed 6 April 2016

  • Reid, W.M.: Teaching and learning in operating theatres. Available at:http://www.faculty.londondeanery.ac.uk/e-learning/explore-further/teaching_and_learning_in_\break operating_theatres.pdf (2007). Accessed 16 April 2016

    Google Scholar 

  • Reznick, R.K.: Teaching and testing technical skills. Am. J. Surg. 165(3), 358–361 (1993)

    Article  Google Scholar 

  • Roberts, N.K., et al.: Capturing the teachable moment: A grounded theory study of verbal teaching interactions in the operating room. Surgery. 151(5), 643–650 (2012)

    Article  Google Scholar 

  • Rodriguez-Paz, J., et al.: Beyond “see one, do one, teach one”: toward a different training paradigm. Qual. Saf. Health Care. 18(1), 63–68 (2009)

    Google Scholar 

  • Rousseau, R.: Virtual surgery gets real. Available at: https://medium.com/@Goetz/virtual-surgery-gets-real-221beeac65ea#.o2lwpyixa (2014). Accessed 17 April 2016

  • Royal College of Surgeons: Taskforce report on the impact of the European Working Time Directive — The Royal College of Surgeons of England 2015 (2014)

    Google Scholar 

  • Samsung: Samsung Gear VR 2015 (2015)

    Google Scholar 

  • Sarker, S., Patel, B.: Simulation and surgical training. Int. J. Clin. Pract. 61(12), 2120–2125 (2007)

    Article  Google Scholar 

  • Satava, R.M., et al.: Surgical competence and surgical proficiency: Definitions, taxonomy, and metrics. J. Am. Coll. Surg. 196(6), 933–937 (2003)

    Article  Google Scholar 

  • Serjeant, J.: The NHS technology lag cannot go on (2016)

    Google Scholar 

  • Sturm, L.P., et al.: A systematic review of skills transfer after surgical simulation training. Ann. Surg. 248(2), 166–179 (2008)

    Article  Google Scholar 

  • Surgery, T.: Home | touch surgery surgical simulator | the virtual surgery App (2015)

    Google Scholar 

  • Sutherland, L.M., et al.: Surgical simulation. Ann. Surg. 243(3), 291–300 (2006)

    Article  Google Scholar 

  • Te, Z.: Oculus Rift vs. Morpheus vs. Vive VR. 2015 (2015)

    Google Scholar 

  • Torkington, J., et al.: The role of simulation in surgical training. Ann. R. Coll. Surg. Engl. 82(2), 88 (2000)

    Google Scholar 

  • Vinden, C., et al.: Teaching Surgery Takes Time: the impact of surgical education on time in the operating room. Can. J. Surg. 59(2), 87–92 (2016)

    Article  Google Scholar 

  • Vitish-Sharma, P., et al.: Acquisition of fundamental laparoscopic skills: Is a box really as good as a virtual reality trainer? Int. J. Surg. 9(8), 659–661 (2011)

    Article  Google Scholar 

  • Vozenilek, J., et al.: See one, do one, teach one: advanced technology in medical education. Acad. Emerg. Med. 11(11), 1149–1154 (2004)

    Article  Google Scholar 

  • Vr, O.: Oculus-ready PCs (2016)

    Google Scholar 

  • Wagner, O., et al.: Three-dimensional vision enhances task performance independently of the surgical method. Surg. Endosc. 26(10), 2961–2968 (2012)

    Article  Google Scholar 

  • Wingfield, L.R., et al.: Cognitive task analysis: Bringing olymbic athlete style training to surgical education. Surg. Innov. 2015. 22(4), 406–417 (2014)

    Google Scholar 

  • Yule, S., et al.: Non-technical skills for surgeons in the operating room: A review of the literature. Surgery. 139(2), 140–149 (2006)

    Article  Google Scholar 

Download references

Acknowledgements

We would like to thank Mr. Edward Miller, a virtual reality consultant from Business Tours UK, who helped in capturing the 360-degree videos at Glasgow Dental Hospital for the VR Surgery project.

Author information

Authors and Affiliations

  1. School of Art, Design and Architecture, University of Huddersfield, Huddersfield, UK

    Yeshwanth Pulijala & Minhua Ma

  2. Glasgow Dental School, University of Glasgow, Glasgow, Scotland, UK

    Ashraf Ayoub

Authors
  1. Yeshwanth Pulijala
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Minhua Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ashraf Ayoub
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yeshwanth Pulijala .

Editor information

Editors and Affiliations

  1. School of Art, Design and Architecture, University of Huddersfield, Huddersfield, United Kingdom

    Minhua Ma

  2. College of Science and Technology, Nottingham Trent University, Nottingham, United Kingdom

    Andreas Oikonomou

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Pulijala, Y., Ma, M., Ayoub, A. (2017). VR Surgery: Interactive Virtual Reality Application for Training Oral and Maxillofacial Surgeons using Oculus Rift and Leap Motion. In: Ma, M., Oikonomou, A. (eds) Serious Games and Edutainment Applications . Springer, Cham. https://doi.org/10.1007/978-3-319-51645-5_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-51645-5_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-51643-1

  • Online ISBN: 978-3-319-51645-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation