An Augmented Reality Interface for Endoscopic Ear Surgery

  • Nozomu MatsumotoEmail author
  • Byunghyun Cho
  • Makoto Hashizume
  • Takashi Nakagawa


We herein introduce our recent research on an image-guided surgery (IGS) interface for otological procedures. We designed the IGS screen to show selected information that is considered to be most important for the surgeon. Since the “importance” of this information changes during a surgical procedure, the information on the screen is selected and updated during an operation. As a result, surgeons found that essential information was highlighted because the system minimized the overall amount of information within the surgeon’s view. Research on IGS interfaces is a relatively new field of study, and current technology tends to aim at delivering as much information to the surgeon as possible. Future studies on IGS interfaces should progress toward selecting the information that is important at different time-points within an operation, and toward the effective delivery of relevant information to the surgeon.


Image-guided surgery Augmented reality TEES Endoscope 


  1. 1.
    Dalgorf DM, Sacks R, Wormald PJ, et al. Image-guided surgery influences perioperative morbidity from endoscopic sinus surgery: a systematic review and meta-analysis. Otolaryngol Head Neck Surg. 2013;149(1):17–29.CrossRefGoogle Scholar
  2. 2.
    Fried MP, Parikh SR, Sadoughi B. Image-guidance for endoscopic sinus surgery. Laryngoscope. 2008;118(7):1287–92.CrossRefGoogle Scholar
  3. 3.
    Black D, Hansen C, Nabavi A, Kikinis R, Hahn H. A survey of auditory display in image-guided interventions. Int J Comput Assist Radiol Surg. 2017;12(10):1665–76.CrossRefGoogle Scholar
  4. 4.
    Cho B, Oka M, Matsumoto N, et al. Warning navigation system using real-time safe region monitoring for otologic surgery. Int J Comput Assist Radiol Surg. 2013;8(3):395–405.CrossRefGoogle Scholar
  5. 5.
    Sahyouni R, Moshtaghi O, Tran DK, et al. Assessment of Google glass as an adjunct in neurological surgery. Surg Neurol Int. 2017;8:68.CrossRefGoogle Scholar
  6. 6.
    Yoon JW, Chen RE, ReFaey K, et al. Technical feasibility and safety of image-guided parieto-occipital ventricular catheter placement with the assistance of a wearable head-up display. Int J Med Robot. 2017;13:4.Google Scholar
  7. 7.
    Bernhardt S, Nicolau SA, Soler L, Doignon C. The status of augmented reality in laparoscopic surgery as of 2016. Med Image Anal. 2017;37:66–90.CrossRefGoogle Scholar
  8. 8.
    Citardi MJ, Agbetoba A, Bigcas JL, Luong A. Augmented reality for endoscopic sinus surgery with surgical navigation: a cadaver study. Int Forum Allergy Rhinol. 2016;6(5):523–8.CrossRefGoogle Scholar
  9. 9.
    Matsumoto N, Oka M, Cho B, et al. Cochlear implantation assisted by noninvasive image guidance. Otol Neurotol. 2012;33(8):1333–8.CrossRefGoogle Scholar
  10. 10.
    Lee S, Cho B, Matsumoto N, Hashizume M, Hong J, editors. Augmented reality system with a simple interface for endoscopic ear surgery. In: Proceedings of IEEE EMBS; 2017.Google Scholar
  11. 11.
    Citardi MJ, Yao W, Luong A. Next-generation surgical navigation systems in sinus and skull base surgery. Otolaryngol Clin N Am. 2017;50(3):617–32.CrossRefGoogle Scholar
  12. 12.
    Li L, Yang J, Chu Y, et al. A novel augmented reality navigation system for endoscopic sinus and skull base surgery: a feasibility study. PLoS One. 2016;11(1):e0146996.CrossRefGoogle Scholar
  13. 13.
    Zeng B, Meng F, Ding H, Wang G. A surgical robot with augmented reality visualization for stereoelectroencephalography electrode implantation. Int J Comput Assist Radiol Surg. 2017;12(8):1355–68.CrossRefGoogle Scholar
  14. 14.
    Zhou C, Zhu M, Shi Y, et al. Robot-assisted surgery for mandibular angle split osteotomy using augmented reality: preliminary results on clinical animal experiment. Aesthet Plast Surg. 2017;41(5):1228–36.CrossRefGoogle Scholar
  15. 15.
    Luz M, Manzey D, Modemann S, Strauss G. Less is sometimes more: a comparison of distance-control and navigated-control concepts of image-guided navigation support for surgeons. Ergonomics. 2015;58(3):383–93.CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • Nozomu Matsumoto
    • 1
    Email author
  • Byunghyun Cho
    • 2
  • Makoto Hashizume
    • 2
  • Takashi Nakagawa
    • 1
  1. 1.Department of OtorhinolaryngologyGraduate School of Medical Sciences, Kyushu UniversityFukuokaJapan
  2. 2.Department of Advanced Medical Initiatives, Faculty of Medical SciencesKyushu UniversityFukuokaJapan

Personalised recommendations