Letter to the Editor on “Augmented Reality Based Navigation for Computer Assisted Hip Resurfacing: A Proof of Concept Study”

  • Fabrizio CutoloEmail author

To the Editor,

I read with great interest the article “Augmented Reality Based Navigation for Computer Assisted Hip Resurfacing: A Proof of Concept Study”.19 In the paper, the authors propose an augmented reality (AR) based surgical navigation system for hip resurfacing. The ambition of the work is to conceive a solution that can overcome the limits of traditional image-guided surgery (IGS) systems thanks to the advantages offered by a commercial optical see-through (OST) AR visor (i.e., Microsoft Hololens31). Thereby, I would like to open a productive discussion concerning some of the technical and human-factor flaws that still hinder the adoption of OST head-mounted displays (HMDs) in IGS.

First and foremost, the authors should be complemented for their pioneering procedure, which combines a markerless image-to-anatomy registration, yielded by depth sensing technology and robotic assistance, with an ergonomic AR visualization.

The emerging of modern medical imaging technologies...



This work was funded by the HORIZON2020 Project VOSTARS, Project ID: 731974. Call: ICT-29-2016—Photonics KET 2016.

Conflict of interest

The author does not have any financial or personal conflict of interest with regard to this study.


  1. 1.
    Benton, S. A. Selected Papers on Three-Dimensional Displays. SPIE Optical Engineering Press, 2001.Google Scholar
  2. 2.
    Cutolo, F., M. Carbone, P. D. Parchi, V. Ferrari, M. Lisanti, and M. Ferrari. Application of a new wearable augmented reality video see-through display to aid percutaneous procedures in spine surgery. Augment Real Virtual Real Comput Graphics 9769(Pt II):43–54, 2016.Google Scholar
  3. 3.
    Cutolo, F., U. Fontana, and V. Ferrari. Perspective preserving solution for quasi-orthoscopic video see-through HMDs. Technologies 6:9, 2018.CrossRefGoogle Scholar
  4. 4.
    Cutolo, F., C. Freschi, S. Mascioli, P. Parchi, M. Ferrari, and V. Ferrari. Robust and accurate algorithm for wearable stereoscopic augmented reality with three indistinguishable markers. Electronics 5:59, 2016.CrossRefGoogle Scholar
  5. 5.
    Cutolo, F. Augmented reality in image-guided surgery. In: Encyclopedia of Computer Graphics and Games, edited by N. Lee. Cham: Springer, 2018, pp. 1–11.Google Scholar
  6. 6.
    Cutolo F., P. D. Parchi, and V. Ferrari. Video see through AR head-mounted display for medical procedures. In: 2014 IEEE International Symposium on Mixed and Augmented Reality (Ismar)Science and Technology, 2014, pp. 393–396.Google Scholar
  7. 7.
    Cutolo F., U. Fontana, M. Carbone, R. D’Amato, and V. Ferrari. Hybrid Video/Optical See-Through HMD. In: Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (Ismar-Adjunct), 2017, pp. 52–57.Google Scholar
  8. 8.
    Eckert, M., J. S. Volmerg, and C. M. Friedrich. Augmented reality in medicine: systematic and bibliographic review. JMIR Mhealth Uhealth 7:e10967, 2019.CrossRefGoogle Scholar
  9. 9.
    Fida, B., F. Cutolo, G. di Franco, M. Ferrari, and V. Ferrari. Augmented reality in open surgery. Updates Surg. 70:389–400, 2018.CrossRefGoogle Scholar
  10. 10.
    Fontana U., F. Cutolo, N. Cattari, and V. Ferrari. Closed—loop calibration for optical see-through near eye display with infinity focus. In: 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2018, pp. 51–56.Google Scholar
  11. 11.
    Grubert, J., Y. Itoh, K. Moser, and J. E. Swan. A survey of calibration methods for optical see-through head-mounted displays. IEEE Trans. Vis. Comput. Graphics 24:2649–2662, 2018.CrossRefGoogle Scholar
  12. 12.
    Helin, K., T. Kuula, C. Vizzi, J. Karjalainen, and A. Vovk. User experience of augmented reality system for astronaut’s manual work support. Front. Robot. Al 5:106, 2018.CrossRefGoogle Scholar
  13. 13.
    Holliman, N. S., N. A. Dodgson, G. E. Favalora, and L. Pockett. Three-dimensional displays: a review and applications analysis. IEEE Trans. Broadcast. 57:362–371, 2011.CrossRefGoogle Scholar
  14. 14.
    Hua, H. Enabling focus cues in head-mounted displays. Proc. IEEE 105:805–824, 2017.CrossRefGoogle Scholar
  15. 15.
    Kersten-Oertel, M., P. Jannin, and D. L. Collins. The state of the art of visualization in mixed reality image guided surgery. Comput. Med. Imaging Graphics 37:98–112, 2013.CrossRefGoogle Scholar
  16. 16.
    Lanman, D., and D. Luebke. Near-eye light field displays. ACM Trans. Graphics 32:220, 2013.CrossRefGoogle Scholar
  17. 17.
    Liao, H., N. Hata, S. Nakajima, M. Iwahara, I. Sakuma, and T. Dohi. Surgical navigation by autostereoscopic image overlay of integral videography. IEEE Trans. Inf. Technol. Biomed. 8:114–121, 2004.CrossRefGoogle Scholar
  18. 18.
    Liao, H., S. Nakajima, M. Iwahara, E. Kobayashi, I. Sakuma, N. Yahagi, and T. Dohi. Intra-operative real-time 3-D information display system based on integral videography. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2001, edited by W. Niessen, and M. Viergever. Berlin: Springer, 2001, pp. 392–400.CrossRefGoogle Scholar
  19. 19.
    Liu, H., E. Auvinet, J. Giles, and F. R. Y. Baena. Augmented reality based navigation for computer assisted hip resurfacing: a proof of concept study. Ann. Biomed. Eng. 46:1595–1605, 2018.CrossRefGoogle Scholar
  20. 20.
    Meola, A., F. Cutolo, M. Carbone, F. Cagnazzo, M. Ferrari, and V. Ferrari. Augmented reality in neurosurgery: a systematic review. Neurosurg. Rev. 40:537–548, 2017.CrossRefGoogle Scholar
  21. 21.
    Oshima K., K. R. Moser, D. C. Rompapas, J. E. Swan, S. Ikeda, G. Yamamoto, T. Taketomi, C. Sandor, and H. Kato. SharpView: improved clarity of defocussed content on optical see-through head-mounted displays. In: 2016 IEEE Virtual Reality Conference (Vr), 2016, pp. 253–254.Google Scholar
  22. 22.
    Peters, T. M. Image-guided surgery: from X-rays to virtual reality. Comput. Methods Biomech. Biomed. Eng. 4:27–57, 2000.CrossRefGoogle Scholar
  23. 23.
    Peters, T. M. Image-guidance for surgical procedures. Phys. Med. Biol. 51:R505–540, 2006.CrossRefGoogle Scholar
  24. 24.
    Qian, L., A. Barthel, A. Johnson, G. Osgood, P. Kazanzides, N. Navab, and B. Fuerst. Comparison of optical see-through head-mounted displays for surgical interventions with object-anchored 2D-display. Int. J. Comput. Assist. Radiol. Surg. 12:901–910, 2017.CrossRefGoogle Scholar
  25. 25.
    Rolland, J. P., and H. Fuchs. Optical versus video see-through mead-mounted displays in medical visualization. Presence Teleoperators Virtual Environ 9:287–309, 2000.CrossRefGoogle Scholar
  26. 26.
    Rolland J. P. and O. Cakmakci. The past, present, and future of head-mounted display designs. In: Proceedings of SPIE 5638, Optical Design and Testing II, 2005, pp. 368–377.Google Scholar
  27. 27.
    Shi, L., F. C. Huang, W. Lopes, W. Matusik, and D. Luebke. Near-eye light field holographic rendering with spherical waves for wide field of view interactive 3D computer graphics. ACM Trans. Graphics 36:1–17, 2017.CrossRefGoogle Scholar
  28. 28.
    Sielhorst, T., M. Feuerstein, and N. Navab. Advanced medical displays: a literature review of augmented reality. J. Display Technol. 4:451–467, 2008.CrossRefGoogle Scholar
  29. 29.
  30. 30.
  31. 31.
    ©Microsoft Hololens, 2017,

Copyright information

© Biomedical Engineering Society 2019

Authors and Affiliations

  1. 1.Department of Information EngineeringUniversity of PisaPisaItaly
  2. 2.EndoCAS Center, Department of Translational Research and New Technologies in Medicine and SurgeryUniversity of PisaPisaItaly

Personalised recommendations