A Microsoft HoloLens Mixed Reality Surgical Simulator for Patient-Specific Hip Arthroplasty Training

  • Giuseppe Turini
  • Sara CondinoEmail author
  • Paolo Domenico Parchi
  • Rosanna Maria Viglialoro
  • Nicola Piolanti
  • Marco Gesi
  • Mauro Ferrari
  • Vincenzo Ferrari
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10851)


Surgical simulation can offer novice surgeons an opportunity to practice skills outside the operating theatre in a safe controlled environment. According to literature evidence, nowadays there are very few training simulators available for Hip Arthroplasty (HA).

In a previous study we have presented a physical simulator based on a lower torso phantom including a patient-specific hemi-pelvis replica embedded in a soft synthetic foam. This work explores the use of Microsoft HoloLens technology to enrich the physical patient-specific simulation with the implementation of wearable mixed reality functionalities. Our HA multimodal simulator based on mixed reality using the HoloLens is described by illustrating the overall system, and by summarizing the main phases of the design and development.

Finally, we present a preliminary qualitative study with seven subjects (5 medical students, and 2 orthopedic surgeons) showing encouraging results that suggest the suitability of the HoloLens for the proposed application. However, further studies need to be conducted to perform a quantitative test of the registration accuracy of the virtual content, and to confirm qualitative results in a larger cohort of subjects.


Surgical simulation Augmented reality Microsoft HoloLens Hip arthroplasty 



The research leading to these results has been partially supported by the European Project VOSTARS (H2020 Call ICT-29-2016 G.A. 731974) and by the SThARS project, funded by the Italian Ministry of Health and Regione Toscana through the call “RicercaFinalizzata2011–2012”.


  1. 1.
    Wolf, B.R., Lu, X., Li, Y., Callaghan, J.J., Cram, P.: Adverse outcomes in hip arthroplasty: long-term trends. J. Bone Joint Surg. Am. 94, e103 (2012)CrossRefGoogle Scholar
  2. 2.
    Hasegawa, Y., Amano, T.: Surgical skills training for primary total hip arthroplasty. Nagoya J. Med. Sci. 77, 51–57 (2015)Google Scholar
  3. 3.
    de Steiger, R.N., Lorimer, M., Solomon, M.: What is the learning curve for the anterior approach for total hip arthroplasty? Clin. Orthop. Relat. Res. 473, 3860–3866 (2015)CrossRefGoogle Scholar
  4. 4.
    Carbone, M., Condino, S., Mattei, L., Forte, P., Ferrari, V., Mosca, F.: Anthropomorphic ultrasound elastography phantoms - characterization of silicone materials to build breast elastography phantoms. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 492–494. IEEE Engineering in Medicine and Biology Society (2012)Google Scholar
  5. 5.
    Nysaether, J.B., Dorph, E., Rafoss, I., Steen, P.A.: Manikins with human-like chest properties–a new tool for chest compression research. IEEE Trans. Bio-Med. Eng. 55, 2643–2650 (2008)CrossRefGoogle Scholar
  6. 6.
    Sparks, J.L., Vavalle, N.A., Kasting, K.E., Long, B., Tanaka, M.L., Sanger, P.A., Schnell, K., Conner-Kerr, T.A.: Use of silicone materials to simulate tissue biomechanics as related to deep tissue injury. Adv. Skin Wound Care 28, 59–68 (2015)CrossRefGoogle Scholar
  7. 7.
    Botden, S.M., Jakimowicz, J.J.: What is going on in augmented reality simulation in laparoscopic surgery? Surg. Endosc. 23, 1693–1700 (2009)CrossRefGoogle Scholar
  8. 8.
    Carbone, M., Condino, S., Ferrari, V., Ferrari, M., Mosca, F.: Surgical simulators integrating virtual and physical anatomies. In: CEUR Workshop Proceedings, pp. 13–18 (2011)Google Scholar
  9. 9.
    Condino, S., Carbone, M., Ferrari, V., Faggioni, L., Peri, A., Ferrari, M., Mosca, F.: How to build patient-specific synthetic abdominal anatomies. An innovative approach from physical toward hybrid surgical simulators. Int. J. Med. Robot. Comp. 7, 202–213 (2011)CrossRefGoogle Scholar
  10. 10.
    Viglialoro, R.M., Condino, S., Gesi, M., Ferrari, M., Ferrari, V.: Augmented reality simulator for laparoscopic cholecystectomy training. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2014. LNCS, vol. 8853, pp. 428–433. Springer, Cham (2014). Scholar
  11. 11.
    Ferrari, V., Viglialoro, R.M., Nicoli, P., Cutolo, F., Condino, S., Carbone, M., Siesto, M., Ferrari, M.: Augmented reality visualization of deformable tubular structures for surgical simulation. Int. J. Med. Robot. + Comput. Assist. Surg. MRCAS 12, 231–240 (2015)CrossRefGoogle Scholar
  12. 12.
    Viglialoro, R., Condino, S., Freschi, C., Cutolo, F., Gesi, M., Ferrari, M., Ferrari, V.: AR visualization of “synthetic Calot’s triangle” for training in cholecystectomy. In: 12th IASTED International Conference on Biomedical Engineering, BioMed 2016 (2016)Google Scholar
  13. 13.
    Vaughan, N., Dubey, V.N., Wainwright, T.W., Middleton, R.G.: A review of virtual reality based training simulators for orthopaedic surgery. Med. Eng. Phys. 38, 59–71 (2016)CrossRefGoogle Scholar
  14. 14.
    Sato, Y., Sasama, T., Sugano, N., Nakahodo, K., Nishii, T., Ozono, K., Yonenobu, K., Ochi, T., Tamura, S.: Intraoperative simulation and planning using a combined acetabular and femoral (CAF) navigation system for total hip replacement. In: Delp, S.L., DiGoia, A.M., Jaramaz, B. (eds.) MICCAI 2000. LNCS, vol. 1935, pp. 1114–1125. Springer, Heidelberg (2000). Scholar
  15. 15.
    Parchi, P., Condino, S., Carbone, M., Gesi, M., Ferrari, V., Ferrari, M., Lisanti, M.: Total hip replacement simulators with virtual planning and physical replica for surgical training and reharsal. In: Proceedings of the 12th IASTED International Conference on Biomedical Engineering, BioMed 2016, pp. 97–101 (2016)Google Scholar
  16. 16.
    Tepper, O.M., Rudy, H.L., Lefkowitz, A., Weimer, K.A., Marks, S.M., Stern, C.S., Garfein, E.S.: Mixed reality with HoloLens: where virtual reality meets augmented reality in the operating room. Plast. Reconstr. Surg. 140, 1066–1070 (2017)CrossRefGoogle Scholar
  17. 17.
    Hanna, M.G., Ahmed, I., Nine, J., Prajapati, S., Pantanowitz, L.: Augmented Reality Technology Using Microsoft HoloLens in Anatomic Pathology. Archives of Pathology & Laboratory Medicine (2018)Google Scholar
  18. 18.
    Nicholson, D. (ed.): AHFE 2017. AISC, vol. 593. Springer, Cham (2018). Scholar
  19. 19.
    Rolland, J.P., Fuchs, H.: Optical versus video see-through mead-mounted displays in medical visualization. Presence Teleoperators Virtual Environ. 9, 287–309 (2000)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Giuseppe Turini
    • 1
    • 2
  • Sara Condino
    • 2
    • 3
    Email author
  • Paolo Domenico Parchi
    • 2
    • 4
  • Rosanna Maria Viglialoro
    • 2
  • Nicola Piolanti
    • 4
  • Marco Gesi
    • 5
    • 6
  • Mauro Ferrari
    • 2
  • Vincenzo Ferrari
    • 2
    • 3
  1. 1.Computer Science DepartmentKettering UniversityFlintUSA
  2. 2.EndoCAS Center, Department of Translational Research and of New Surgical and Medical TechnologiesUniversity of PisaPisaItaly
  3. 3.Department of Information EngineeringUniversity of PisaPisaItaly
  4. 4.1st Orthopaedic and Traumatology Division, Department of Translational Research and of New Surgical and Medical TechnologiesUniversity of PisaPisaItaly
  5. 5.Department of Translational Research and of New Surgical and Medical TechnologiesUniversity of PisaPisaItaly
  6. 6.Center for Rehabilitative Medicine “Sport and Anatomy”University of PisaPisaItaly

Personalised recommendations