A Study of Guidance Method for AR Laparoscopic Surgery Navigation System
Laparoscopic surgery is becoming popular as a minimally invasive operation. It is widely used as a technique for various kinds of surgical operation. In this surgery, a surgeon uses an endoscopic camera, which is limited view volume, and forceps into the patient body. It has been needed to support system such as navigation system.
Therefore, we are studying about the AR laparoscopic surgery navigation system support the surgeon to find these organs by using semi-automatic registration method to make an overlay video image of virtual organs and real organs. In this paper, we focus on the guidance method by using the endoscopic view image and the endoscopic position. We introduce our study about registration method of the position and orientation of the endoscope camera. Our method tracks the tools position and orientation by using markers. Then, it uses the camera reference frame based on this position and orientation for generating the overlay image of virtual organs and real organs. The result of using our method can be showed a potential for efficient guidance method of AR surgical navigation system.
KeywordsLaparoscopic surgery Marker tracking Surgical navigation Augmented reality
This work was supported by JSPS KAKENHI Grant Number JP15K00291.
- 1.Qian, K., Bai, J., Yang, X., Pan, J., Zhang, J.: Virtual reality based laparoscopic surgery simulation. In: Proceedings of the 21st ACM Symposium on Virtual Reality Software and Technology, pp. 69–78 (2015). http://doi.org/10.1145/2821592.2821599
- 3.Kalavakonda, N., Chandra, S., Thondiyath, A.: Development of virtual reality based robotic surgical trainer for patient-specific deformable anatomy. In: Proceedings of the 2015 Conference on Advances in Robotics - AIR 2015, pp. 1–5 (2015). http://doi.org/10.1145/2783449.2783465
- 5.Nicolau, S.A., Goffin, L., Soler, L.: A low cost and accurate guidance system for laparoscopic surgery. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology - VRST 2005, pp. 124–133 (2005). http://doi.org/10.1145/1101616.1101642
- 6.Desai, J.P., Tholey, G., Kennedy, C.W.: Haptic feedback system for robot-assisted surgery. In: PerMIS 2007 - Workshop on Performance Metrics for Intelligent Systems, pp. 188–195 (2007). http://doi.org/10.1145/1660877.1660904
- 8.Su, L.M., Vagvolgyi, B.P., Agarwal, R., Reiley, C.E., Taylor, R.H., Hager, G.D.: Augmented reality during robot-assisted laparoscopic partial nephrectomy toward real-time 3D-CT to stereoscopic video registration. Urology 73(4), 896–900 (2009). http://doi.org/10.1016/j.urology.2008.11.040 CrossRefGoogle Scholar
- 9.Intuitive Surgical - Products: http://www.intuitivesurgical.com/products/