Abstract
Neurosurgery is one of the key areas for computer-assisted navigation. By providing an intuitive visualization and feedback to the operator, augmented reality has the potential to provide improved clinical workflows and patient outcomes. In this work, a mobile augmented reality system for surgical neuronavigation is presented, allowing for a direct projection of anatomical information on both planar and non-planar surfaces. The system consists of a tracked mobile laser projector, integrated within a navigation system, providing registered patient surface and image data. Using this setup, image data can be corrected for distortions and displayed accurately on the body surface in relation to the patient. We present the overall system with an efficient distortion correction, and evaluate the accuracy with a series of experiments for point and surface projection errors, as well as the general clinical applicability. The system is demonstrated for the projection of craniotomy incision lines and general image data directly onto the surface of a human skull model, where an average error of 1.04 mm shows a sufficient accuracy with respect to the clinical application.
This work was partially supported by Brainlab AG, Feldkirchen. Experiments were performed using commercial and development equipment provided as such.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Besharati Tabrizi, L., Mahvash, M.: Augmented reality-guided neurosurgery: accuracy and intraoperative application of an image projection technique. J. Neurosurg. 123(1), 206–211 (2015)
Edgcumbe, P., Pratt, P., Yang, G.-Z., Nguan, C., Rohling, R.: Pico lantern: a pick-up projector for augmented reality in laparoscopic surgery. In: Golland, P., Hata, N., Barillot, C., Hornegger, J., Howe, R. (eds.) MICCAI 2014, Part I. LNCS, vol. 8673, pp. 432–439. Springer, Heidelberg (2014)
Glossop, N., Wedlake, C., Moore, J., Peters, T., Wang, Z.: Laser projection augmented reality system for computer assisted surgery. In: Ellis, R.E., Peters, T.M. (eds.) MICCAI 2003. LNCS, vol. 2879, pp. 239–246. Springer, Heidelberg (2003)
Hartley, R., Zisserman, A.: Multiple View Geometry, 2nd edn. Cambridge University Press, New York (2010)
Helm, P.A., Teichman, R., Hartmann, S.L., Simon, D.: Spinal navigation and imaging: history, trends, and future. IEEE Trans. Med. Imaging 34(8), 1738–1746 (2015)
Hoppe, H., Duber, S., Raczkowsky, J., Wrn, H.: Intraoperative visualization of surgical planning data using video projectors. In: Medicine Meets Virtual Reality 2001: Outer Space, Inner Space, Virtual Space, p. 206. IOS Press (2001)
Jiang, L., Zhang, S., Yang, J., Zhuang, X., Zhang, L., Gu, L.: A robust automated markerless registration framework for neurosurgery navigation. Int. J. Med. Robot. Comput. Assist. Surg. 11(4), 436–447 (2015)
Leong-Hoï, A., Serio, B., Twardowski, P., Montgomery, P.: Three-dimensional surface reconstruction by combining a pico-digital projector for structured light illumination and an imaging system with high magnification and high depth of field. In: SPIE Photonics Europe, p. 913219. International Society for Optics and Photonics (2014)
Mahvash, M., Tabrizi, L.B.: A novel augmented reality system of image projection for image-guided neurosurgery. Acta Neurochir. 155(5), 943–947 (2013)
Mezger, U., Jendrewski, C., Bartels, M.: Navigation in surgery. Langenbeck’s Arch. Surg. 398(4), 501–514 (2013)
Moreno, D., Taubin, G.: Simple, accurate, and robust projector-camera calibration. In: 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 464–471. IEEE (2012)
Orghidan, R., Salvi, J., Gordan, M., Florea, C., Batlle, J.: Structured light self-calibration with vanishing points. Mach. Vis. Appl. 25(2), 489–500 (2014)
Park, H., Lee, M.-H., Kim, S.-J., Park, J.-I.: Surface-independent direct-projected augmented reality. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, vol. 3852, pp. 892–901. Springer, Heidelberg (2006)
Shi, C., Becker, B.C., Riviere, C.N.: Inexpensive monocular pico-projector-based augmented reality display for surgical microscope. In: 2012 25th International Symposium on Computer-Based Medical Systems (CBMS), pp. 1–6. IEEE (2012)
Wang, D., Ma, D., Wong, M.L., Wáng, Y.X.J.: Recent advances in surgical planning & navigation for tumor biopsy and resection. Quant. Imaging Med. Surg. 5(5), 640 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Hennersperger, C., Manus, J., Navab, N. (2016). Mobile Laserprojection in Computer Assisted Neurosurgery. In: Zheng, G., Liao, H., Jannin, P., Cattin, P., Lee, SL. (eds) Medical Imaging and Augmented Reality. MIAR 2016. Lecture Notes in Computer Science(), vol 9805. Springer, Cham. https://doi.org/10.1007/978-3-319-43775-0_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-43775-0_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43774-3
Online ISBN: 978-3-319-43775-0
eBook Packages: Computer ScienceComputer Science (R0)