Skip to main content

Towards the Development of a Quasi-Orthoscopic Hybrid Video/Optical See-Through HMD for Manual Tasks

  • Conference paper
  • First Online:
Augmented Reality, Virtual Reality, and Computer Graphics (AVR 2019)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11614))

  • 2057 Accesses

Abstract

Augmented Reality (AR) based on head-mounted displays (HMDs) represent the most ergonomic and efficient solution for aiding complex manual tasks performed under direct vision and it is considered an enabling technology of the fourth industrial revolution (Industry 4.0). This work intends to give a harmonized and consistent overview of the workflow carried out so far in the framework of the European Project VOSTARS towards the development of a novel AR HMD specifically designed to aiding complex manual tasks within arm’s reach. First results and future developments are being presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ong, S.K., Yuan, M.L., Nee, A.Y.C.: Augmented reality applications in manufacturing: a survey. Int. J. Prod. Res. 46, 2707–2742 (2008)

    Article  Google Scholar 

  2. Henderson, S., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17, 1355–1368 (2011)

    Article  Google Scholar 

  3. Nee, A.Y.C., Ong, S.K., Chryssolouris, G., Mourtzis, D.: Augmented reality applications in design and manufacturing. CIRP Ann.-Manuf. Technol. 61, 657–679 (2012)

    Article  Google Scholar 

  4. Wang, X., Ong, S.K., Nee, A.Y.C.: A comprehensive survey of augmented reality assembly research. Adv. Manuf. 4, 1–22 (2016)

    Article  Google Scholar 

  5. Bower, M., Howe, C., McCredie, N., Robinson, A., Grover, D.: Augmented reality in education - cases, places, and potentials. In: IEEE Annual International Conference (2013)

    Google Scholar 

  6. Radu, I.: Augmented reality in education: a meta-review and cross-media analysis. Pers. Ubiquit. Comput. 18, 1533–1543 (2014)

    Article  Google Scholar 

  7. Bacca, J., Baldiris, S., Fabregat, R., Graf, S.: Kinshuk: augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17, 133–149 (2014)

    Google Scholar 

  8. Qu, M., et al.: Precise positioning of an intraoral distractor using augmented reality in patients with hemifacial microsomia. J. Cranio Maxill. Surg. 43, 106–112 (2015)

    Article  Google Scholar 

  9. Voinea, A., Moldoveanu, A., Moldoveanu, F.: Efficient learning technique in medical education based on virtual and augmented reality. In: ICERI Proceedings, pp. 8757–8764 (2016)

    Google Scholar 

  10. Meola, A., Cutolo, F., Carbone, M., Cagnazzo, F., Ferrari, M., Ferrari, V.: Augmented reality in neurosurgery: a systematic review. Neurosurg. Rev. 40, 537–548 (2017)

    Article  Google Scholar 

  11. Kersten-Oertel, M., Jannin, P., Collins, D.L.: The state of the art of visualization in mixed reality image guided surgery. Comput. Med. Imaging Graph. 37, 98–112 (2013)

    Article  Google Scholar 

  12. Fida, B., Cutolo, F., di Franco, G., Ferrari, M., Ferrari, V.: Augmented reality in open surgery. Updates Surg. 70, 389–400 (2018)

    Article  Google Scholar 

  13. Eckert, M., Volmerg, J.S., Friedrich, C.M.: Augmented reality in medicine: systematic and bibliographic review. JMIR mHealth uHealth 7, e10967 (2019)

    Article  Google Scholar 

  14. Ferreira Reis, A., Wirth, G.J., Iselin, C.E.: Augmented reality in urology: present and future. Rev. Med. Suisse 14, 2154–2157 (2018)

    Google Scholar 

  15. Yoon, J.W., et al.: Augmented reality for the surgeon: Systematic review. Int. J. Med. Robot. Comput. Assist. Surg. MRCAS 14, e1914 (2018)

    Article  Google Scholar 

  16. Dunn, J., Yeo, E., Moghaddampour, P., Chau, B., Humbert, S.: Virtual and augmented reality in the treatment of phantom limb pain: a literature review. Neurorehabilitation 40, 595–601 (2017)

    Article  Google Scholar 

  17. Cutolo, F., et al.: A new head-mounted display-based augmented reality system in neurosurgical oncology: a study on phantom. Comput. Assist. Surg. 22, 39–53 (2017)

    Article  Google Scholar 

  18. Cutolo, F., Freschi, C., Mascioli, S., Parchi, P., Ferrari, M., Ferrari, V.: Robust and accurate algorithm for wearable stereoscopic augmented reality with three indistinguishable markers. Electronics 5, 59 (2016)

    Article  Google Scholar 

  19. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21, 34–47 (2001)

    Article  Google Scholar 

  20. Cutolo, F., Badiali, G., Ferrari, V.: Human-PnP: ergonomic AR interaction paradigm for manual placement of rigid bodies. In: Linte, C.A., Yaniv, Z., Fallavollita, P. (eds.) AE-CAI 2015. LNCS, vol. 9365, pp. 50–60. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24601-7_6

    Chapter  Google Scholar 

  21. Cutolo, F., Carbone, M., Parchi, P.D., Ferrari, V., Lisanti, M., Ferrari, M.: Application of a new wearable augmented reality video see-through display to aid percutaneous procedures in spine surgery. In: De Paolis, L.T., Mongelli, A. (eds.) AVR 2016. LNCS, vol. 9769, pp. 43–54. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-40651-0_4

    Chapter  Google Scholar 

  22. http://www.vostars.eu/

  23. Cutolo, F., Fontana, U., Carbone, M., D’Amato, R., Ferrari, V.: Hybrid video/optical see-through HMD. In: Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality (Ismar-Adjunct), pp. 52–57 (2017)

    Google Scholar 

  24. Cutolo, F., Fontana, U., Ferrari, V.: Perspective preserving solution for quasi-orthoscopic video see-through HMDs. Technologies 6, 9 (2018)

    Article  Google Scholar 

  25. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2003)

    Google Scholar 

  26. Tomioka, M., Ikeda, S., Sato, K.: Approximated user-perspective rendering in tablet-based augmented reality. In: International Symposium on Mixed and Augmented Reality, pp. 21–28 (2013)

    Google Scholar 

  27. Fontana, U., Cutolo, F., Cattari, N., Ferrari, V.: Closed – loop calibration for optical see-through near eye display with infinity focus. In: Adjunct Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality (2018)

    Google Scholar 

Download references

Acknowledgments

Funded BY THE HORIZON2020 Project VOSTARS, Project ID: 731974. Call: ICT-29-2016 - Photonics KET 2016.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fabrizio Cutolo .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Cutolo, F., Cattari, N., Fontana, U., Ferrari, V. (2019). Towards the Development of a Quasi-Orthoscopic Hybrid Video/Optical See-Through HMD for Manual Tasks. In: De Paolis, L., Bourdot, P. (eds) Augmented Reality, Virtual Reality, and Computer Graphics. AVR 2019. Lecture Notes in Computer Science(), vol 11614. Springer, Cham. https://doi.org/10.1007/978-3-030-25999-0_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-25999-0_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-25998-3

  • Online ISBN: 978-3-030-25999-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics