Abstract
The illusion of the co-existence of virtual objects in the physical world, which is the essence of MR paradigm, is typically made possible by superimposing virtual contents onto the surrounding environment captured through a camera. This works well until the order of the planes to be composited is coherent to their distance from the observer. But, whenever an object of the real world is expected to occlude the virtual contents, the illusion vanishes. What should be seen behind a real object could be visualized over it instead, generating a “cognitive dissonance” that may compromise scene comprehension and, ultimately, the interaction capabilities during the MR experience. This paper describes an approach to handle hand occlusions in MR/AR interaction contexts by means of an optimized stereo matching technique based on the belief propagation algorithm.
Chapter PDF
References
Furmanski, C., Azuma, R., Daily, M.: Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information. In: Proceedings of the International Symposium on Mixed and Augmented Reality (ISMAR 2002), pp. 215–320. IEEE (2002)
Shah, M.M., Arshad, H., Sulaiman, R.: Occlusion in augmented reality. In: Proceedings of the 8th International Conference on Information Science and Digital Content Technology (ICIDT 2012), pp. 372–378. IEEE (2012)
Lee, W., Park, J.: Augmented foam: a tangible augmented reality for product design. In: Proceedings of the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 106–109. IEEE (2005)
Walairacht, S., Yamada, K., Hasegawa, S., Koike, Y., Sato, M.: 4+ 4 fingers manipulating virtual objects in mixed-reality environment. Presence: Teleoperators and Virtual Environments. MIT Press Journal, 134–143 (2002)
Buchmann, V., Violich, S., Billinghurst, M., Cockburn, A.: FingARtips: Gesture Based Direct Manipulation in Augmented Reality. In: Proceedings of the 2nd International Conference on Computer Graphics and Interactive Techniques (GRAPHITE 2004), pp. 212–221. ACM (2004)
Fischer, J., Bartz, D., Straßer, W.: Occlusion handling for medical augmented reality using a volumetric phantom model. In: Proceedings of the ACM symposium on Virtual reality software and technology (2004), pp. 174–177. ACM (2004)
Corbett-Davies, S., Dunser, A., Green, R., Clark, A.: An Advanced Interaction Framework for Augmented Reality Based Exposure Treatment. In: IEEE Virtual Reality (VR 2013), pp. 19–22. IEEE (2013)
Gordon, G., Billinghurst, M., Bell, M., Woodfill, J., Kowalik, B., Erendi, A., Tilander, J.: The use of dense stereo range data in augmented reality. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality (2002), p. 14–23. IEEE Computer Society (2002)
Seo, D.W., Lee, J.Y.: Direct hand touchable interactions in augmented reality environments for natural and intuitive user experiences. Expert Systems with Applications 40(9), 3784–3793 (2013)
Kanade, T., Okutomi, M.: A stereo matching algorithm with an adaptive window: Theory and experiment. IEEE Transactions on Pattern Analysis and Machine Intelligence, 920–932 (1994)
Medioni, G., Nevatia, R.: Segment-based stereo matching. In: Computer Vision, Graphics, and Image Processing, pp. 2–18 (1985)
Yang, Q., Wang, L., Yang, R., Wang, S., Liao, M.: NisterD.: Real-time global stereo matching using hierarchical belief propagation, in: The British Machine Vision Conference, pp. 989–998 (2006)
Humenberger, M., Zinner, C., Weber, M., Kubinger, W., Vincze, M.: A fast stereo matching algorithm suitable for embedded real-time systems. Computer Vision and Image Understanding 114(11), 1180–1202 (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Abate, A.F., Narducci, F., Ricciardi, S. (2014). An Image Based Approach to Hand Occlusions in Mixed Reality Environments. In: Shumaker, R., Lackey, S. (eds) Virtual, Augmented and Mixed Reality. Designing and Developing Virtual and Augmented Environments. VAMR 2014. Lecture Notes in Computer Science, vol 8525. Springer, Cham. https://doi.org/10.1007/978-3-319-07458-0_30
Download citation
DOI: https://doi.org/10.1007/978-3-319-07458-0_30
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07457-3
Online ISBN: 978-3-319-07458-0
eBook Packages: Computer ScienceComputer Science (R0)