Abstract
Pointing in the endoscopic view of a surgical robot is a natural and efficient way for instructors to communicate with trainees in robot-assisted minimally invasive surgery. However, pointing in a stereo-endoscopic view can be limited by problems such as video delay, double vision, arm fatigue, and reachability of the pointer controls. We address these problems by hardware-based overlaying the stereo-endoscopic view with a one-eyed cursor, which can be comfortably controlled by a wireless, gyroscopic air mouse. The proposed system was positively evaluated by five experienced instructors in four full-day training units in robot-assisted minimally invasive surgery on anaesthetised pigs.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ali, M.R., Loggins, J.P., Fuller, W.D., Miller, B.E., Hasser, C.J., Yellowlees, P., Vidovszky, T.J., Rasmussen, J.J., Pierce, J.: 3-D telestration: a teaching tool for robotic surgery. J. Laparoendosc. Adv. Surg. Tech. 18(1), 107–112 (2008)
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001). http://dx.org/10.1109/38.963459
Buchs, N., Pugin, F., Volont, F., Morel, P.: Learning tools andsimulation in robotic surgery: state of the art. World J. Surg. 37(12), 2812–2819 (2013). http://dx.org/10.1007/s00268-013-2065-y
Hasser, C.J., Larkin, D.Q., Miller, B., Zhang, G.G., Nowlin, W.C.: Medical robotic system providing three-dimensional telestration. US Patent 2007/0167702 A1 (2007)
Ontario, H.Q., Secretariat, M.A.: Robotic-assisted minimally invasive surgery for gynecologic and urologic oncology: an evidence-based analysis. Ont. Health Technol. Assess. Ser. 2010 10, 1–118 (2010). Health Quality Ontario
Hincapié-Ramos, J.D., Guo, X., Moghadasian, P., Irani, P.: Consumed endurance: a metric to quantify arm fatigue of mid-air interactions. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, pp. 1063–1072. ACM (2014)
Kibsgaard, M., Kraus, M.: Real-time augmented reality for robotic-assisted surgery. In: Proceedings of the 3rd Aalborg University Workshop on Robotics 2014 (2015, accepted for publication)
Lamprecht, B., Nowlin, W., Stern, J.: Stereo telestration for robotic surgery. US Patent 7,907,166 B2 (2011)
Ng, A., Lepinski, J., Wigdor, D., Sanders, S., Dietz, P.: Designing for low-latency direct-touch input. In: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST 2012, pp. 453–464 (2012)
Schemali, L., Eisemann, E.: Design and evaluation of mouse cursors in a stereoscopic desktop environment. In: 2014 IEEE Symposium on 3D User Interfaces (3DUI), pp. 67–70. IEEE (2014)
Shenai, M.B., Dillavou, M., Shum, C., Ross, D., Tubbs, R.S., Shih, A., Guthrie, B.L.: Virtual interactive presence and augmented reality (VIPAR) for remote surgical assistance. Neurosurgery 68, ons200–ons207 (2011)
Teather, R.J., Stuerzlinger, W.: Pointing at 3D target projections with one-eyed and stereo cursors. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, NY, USA, pp. 159–168. ACM, New York (2013). http://doi.acm.org/10.1145/2470654.2470677
Volonté, F., Buchs, N.C., Pugin, F., Spaltenstein, J., Schiltz, B., Jung, M., Hagen, M., Ratib, O., Morel, P.: Augmented reality to the rescue of the minimally invasive surgeon. The usefulness of the interposition of stereoscopic images in the da vinci robotic console. Int. J. Med. Robot. Comput. Assist. Surg. 9(3), e34–e38 (2013)
Ware, C., Lowther, K.: Selection using a one-eyed cursor in a fish tank VR environment. ACM Trans. Comput.-Hum. Interact. 4(4), 309–322 (1997). http://doi.acm.org/10.1145/267135.267136
Zhao, W., Wu, C., Hirvonen, D., Hasser, C.J., Miller, B.E., Mohr, C.J., Zhao, T., Di Maio, S., Hoffman, B.D.: Efficient 3-D telestration for local and remote robotic proctoring. US Patent 2015/0025392 A1 (2015)
Acknowledgments
The authors would like to thank the participating instructors and trainees of the relevant MIUC courses at Aalborg University Hospital; in particular, chief surgeon Johan Poulsen and registered nurse first assistant in robotic surgery Jane Petersson.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Kibsgaard, M., Kraus, M. (2016). Pointing with a One-Eyed Cursor for Supervised Training in Minimally Invasive Robotic Surgery. In: Luo, X., Reichl, T., Reiter, A., Mariottini, GL. (eds) Computer-Assisted and Robotic Endoscopy. CARE 2015. Lecture Notes in Computer Science(), vol 9515. Springer, Cham. https://doi.org/10.1007/978-3-319-29965-5_2
Download citation
DOI: https://doi.org/10.1007/978-3-319-29965-5_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-29964-8
Online ISBN: 978-3-319-29965-5
eBook Packages: Computer ScienceComputer Science (R0)