A Study of Guidance Method for AR Laparoscopic Surgery Navigation System

  • Katsuhiko OnishiEmail author
  • Yohei Miki
  • Keishi Okuda
  • Masanao Koeda
  • Hiroshi Noborio
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10289)


Laparoscopic surgery is becoming popular as a minimally invasive operation. It is widely used as a technique for various kinds of surgical operation. In this surgery, a surgeon uses an endoscopic camera, which is limited view volume, and forceps into the patient body. It has been needed to support system such as navigation system.

Therefore, we are studying about the AR laparoscopic surgery navigation system support the surgeon to find these organs by using semi-automatic registration method to make an overlay video image of virtual organs and real organs. In this paper, we focus on the guidance method by using the endoscopic view image and the endoscopic position. We introduce our study about registration method of the position and orientation of the endoscope camera. Our method tracks the tools position and orientation by using markers. Then, it uses the camera reference frame based on this position and orientation for generating the overlay image of virtual organs and real organs. The result of using our method can be showed a potential for efficient guidance method of AR surgical navigation system.


Laparoscopic surgery Marker tracking Surgical navigation Augmented reality 



This work was supported by JSPS KAKENHI Grant Number JP15K00291.


  1. 1.
    Qian, K., Bai, J., Yang, X., Pan, J., Zhang, J.: Virtual reality based laparoscopic surgery simulation. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 69–78 (2015).
  2. 2.
    Coles, T.R., Meglan, D., John, N.W.: The role of haptics in medical training simulators: A survey of the state of the art. IEEE Trans. Haptics 4(1), 51–66 (2011). CrossRefGoogle Scholar
  3. 3.
    Kalavakonda, N., Chandra, S., Thondiyath, A.: Development of virtual reality based robotic surgical trainer for patient-specific deformable anatomy. In: Proceedings of the 2015 Conference on Advances in Robotics - AIR 2015, pp. 1–5 (2015).
  4. 4.
    Delingette, H., Ayache, N.: Hepatic surgery simulation. Commun. ACM 48(2), 31–36 (2005). CrossRefGoogle Scholar
  5. 5.
    Nicolau, S.A., Goffin, L., Soler, L.: A low cost and accurate guidance system for laparoscopic surgery. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology - VRST 2005, pp. 124–133 (2005).
  6. 6.
    Desai, J.P., Tholey, G., Kennedy, C.W.: Haptic feedback system for robot-assisted surgery. In: PerMIS 2007 - Workshop on Performance Metrics for Intelligent Systems, pp. 188–195 (2007).
  7. 7.
    Hughes-Hallett, A., Mayer, E.K., Marcus, H.J., Cundy, T.P., Pratt, P.J., Darzi, A.W., Vale, J.A.: Augmented reality partial nephrectomy: Examining the current status and future perspectives. Urology 83(2), 266–273 (2014). CrossRefGoogle Scholar
  8. 8.
    Su, L.M., Vagvolgyi, B.P., Agarwal, R., Reiley, C.E., Taylor, R.H., Hager, G.D.: Augmented reality during robot-assisted laparoscopic partial nephrectomy toward real-time 3D-CT to stereoscopic video registration. Urology 73(4), 896–900 (2009). CrossRefGoogle Scholar
  9. 9.
    Intuitive Surgical - Products:
  10. 10.
    Koeda, M., et al.: Depth camera calibration and knife tip position estimation for liver surgery support system. In: Stephanidis, C. (ed.) HCI 2015. CCIS, vol. 528, pp. 496–502. Springer, Cham (2015). doi: 10.1007/978-3-319-21380-4_84 CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Katsuhiko Onishi
    • 1
    Email author
  • Yohei Miki
    • 1
  • Keishi Okuda
    • 1
  • Masanao Koeda
    • 1
  • Hiroshi Noborio
    • 1
  1. 1.Osaka Electro-Communication UniversityShijonawateJapan

Personalised recommendations