Skip to main content

Augmented Visualization and Touchless Interaction with Virtual Organs

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNBI,volume 10814))

Abstract

The actual trend in surgery is the transition from open procedures to minimally invasive interventions and revolutionary changes in computer-aided surgery have been obtained thanks to the introduction of the augmented reality technology that can support the doctor during the surgery. A realistic three-dimensional visualization of the patient’s organs can be obtained by means of specific algorithms of segmentation and classification of medical images and advanced modalities of touchless interaction and innovative gesture-control devices permit surgeon to have a natural and simple way of fruition of the patient’s data preserving the surgical environment from the danger of contamination.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Maad, S.: Augmented reality. In: The Horizon of Virtual and Augmented Reality: The Reality of the Global Digital Age. Intech, January 2010. ISBN 978-953-7619-69-5

    Google Scholar 

  2. De Paolis, L.T., Aloisio, G.: Augmented reality in minimally invasive surgery. In: Mukhopadhyay, S.C., Lay-Ekuakille, A. (eds.) Advances in Biomedical Sensing, Measurements. LNEE, vol. 55. Instrumentation and Systems. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-05167-8_17

    Chapter  Google Scholar 

  3. Samset, E., Schmalstieg, D., Vander Sloten, J., Freudenthal, A., Declerck, J., Casciaro, S., Rideng, Ø., Gersak, B.: Augmented reality in surgical procedures. In: SPIE Human Vision and Electronic Imaging XIII (2008)

    Google Scholar 

  4. Bichlmeier, C., Wimmer, F., Michael, H.S., Nassir, N.: Contextual anatomic mimesis: hybrid in-situ visualization method for improving multi-sensory depth perception in medical augmented reality. In: Proceedings of Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR 2007), Nara, Japan, pp. 129–138 (2007)

    Google Scholar 

  5. Nicolau, S.A., Pennec, X., Soler, L., Buy, X., Gangi, A., Ayache, N., Marescaux, J.: An augmented reality system for liver thermal ablation: design and evaluation on clinical cases. Med. Image Anal. 13(3), 494–506 (2009). Elsevier

    Article  Google Scholar 

  6. De Mauro, A., Mazars, J., Manco, L., Mataj, T., Fernandez, A.H., Cortes, C., De Paolis, L.T.: Intraoperative navigation system for image guided surgery. In: 6th International Conference on Complex, Intelligent, and Software Intensive Systems, pp. 486–490 (2012)

    Google Scholar 

  7. De Paolis, L.T., Pulimeno, M., Aloisio, G.: An augmented reality application for minimally invasive surgery. In: Katashev, A., Dekhtyar, Y., Spigulis, J. (eds.) 14th Nordic-Baltic Conference on Biomedical Engineering and Medical Physics. IFMBE, vol. 20, pp. 489–492. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69367-3_131

    Chapter  Google Scholar 

  8. Ricciardi, F., Copelli, C., De Paolis, L.T.: A pre-operative planning module for an augmented reality application in maxillo-facial surgery. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2015. LNCS, vol. 9254, pp. 244–254. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-22888-4_18

    Chapter  Google Scholar 

  9. De Paolis, L.T., Ricciardi, F., Dragoni, A.F., Aloisio, G.: An augmented reality application for the radio frequency ablation of the liver tumors. In: Murgante, B., Gervasi, O., Iglesias, A., Taniar, D., Apduhan, B.O. (eds.) ICCSA 2011. LNCS, vol. 6785, pp. 572–581. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-21898-9_47

    Chapter  Google Scholar 

  10. Abe, Y., Sato, S., Kato, K., Hyakumachi, T., Yanagibashi, Y., Ito, M., Abumi, K.: A novel 3D guidance system using augmented reality for percutaneous vertebroplasty. J. Neurosurg. Spine 19, 492–501 (2013)

    Article  Google Scholar 

  11. Baker, D.K., Fryberger, C.T., Ponce, B.A.: The emergence of augmented reality in orthopaedic surgery and education. Orthop. J. Harvard Med. School 16, 8–16 (2015)

    Google Scholar 

  12. Houts, P.S., Doak, C.C., Doak, L.G., Loscalzo, M.J.: The role of pictures in improving health communication: a review of research on attention, comprehension, recall, and adherence. Patient Educ. Counsel 61, 173–190 (2006)

    Article  Google Scholar 

  13. König, T.S.: Usability issues in 3D medical visualization. Ph.D thesis, Technische Universitat Wien, Wien (2001)

    Google Scholar 

  14. Livatino, S., De Paolis, L.T., D’Agostino, M., Zocco, A., Agrimi, A., De Santis, A., Bruno, L.V., Lapresa, M.: Stereoscopic visualization and 3-D technologies in medical endoscopic teleoperation. IEEE Trans. Ind. Electron. 62(1), 525–535 (2015)

    Article  Google Scholar 

  15. De Paolis, L.T., De Mauro, A., Raczkowsky, J., Aloisio, G.: Virtual model of the human brain for neurosurgical simulation. Stud. Health Technol. Inform. 150, 811–815 (2009)

    Google Scholar 

  16. Yoo, T.S.: Insight into Images. A K Peters, Natick (2004)

    Book  Google Scholar 

  17. Garber, L.: Gestural technology: moving interfaces in a new direction [technology news]. Computer 46, 22–25 (2013)

    Article  Google Scholar 

  18. Joslin, C., El-Sawah, A., Chen, Q., Georganas, N.: Dynamic gesture recognition. In: Proceedings of the IEEE Instrumentation and Measurement Technology Conference, Ottawa, ON, Canada, 16–19 May 2005, vol. 3, pp. 1706–1711 (2005)

    Google Scholar 

  19. Bellarbi, A., Benbelkacem, S., Zenati-Henda, N., Belhocine, M.: Hand gesture interaction using color-based method for tabletop interfaces. In: Proceedings of the 7th International Symposium on Intelligent Signal Processing (WISP), Floriana, Malta, 19–21 September 2011, pp. 1–6 (2011)

    Google Scholar 

  20. Fiala, M.: ARTag, a fiducial marker system using digital techniques. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, San Diego, CA, USA, 20–25 June 2005, vol. 2, pp. 590–596 (2005)

    Google Scholar 

  21. Invitto, S., Faggiano, C., Sammarco, S., De Luca, V., De Paolis, L.T.: Haptic, virtual interaction and motor imagery: entertainment tools and psychophysiological testing. Sensors 16, 394 (2016)

    Article  Google Scholar 

  22. Nintendo Wii System. http://wii.com

  23. The leap motion controller. http://www.leapmotion.com

  24. Sony PlayStation. http://www.playstation.com

  25. Microsoft Kinect. http://support.xbox.com/en-US/browse/xbox-one/kinect

  26. Myo Armband. http://www.myo.com

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lucio Tommaso De Paolis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

De Paolis, L.T. (2018). Augmented Visualization and Touchless Interaction with Virtual Organs. In: Rojas, I., Ortuño, F. (eds) Bioinformatics and Biomedical Engineering. IWBBIO 2018. Lecture Notes in Computer Science(), vol 10814. Springer, Cham. https://doi.org/10.1007/978-3-319-78759-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-78759-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-78758-9

  • Online ISBN: 978-3-319-78759-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics