Abstract
Interactive virtual environments are often focused on visual representation. This study introduces embodied and eyes-free interaction with audio-haptic navigation environment (AHNE) in a 3-dimensional space. AHNE is based on an optical tracking algorithm that makes use of Microsoft-Kinect and virtual objects are presented by dynamic audio-tactile cues. Users are allowed to grab and move the targets, enabled by a sensor located in a glove. To evaluate AHNE with users, an experiment was conducted. Users’ comments indicated that sound cues elicited physical and visual experiences. Our findings suggest that AHNE could be a novel and fun interface to everyday resources in the environment such as a home audio system in the living room or a shopping list by fridge.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21 (2001)
Braun, V., Clarke, V.: Using Thematic Analysis in Psychology. Qualitative Research in Psychology 3(2), 77–101 (2006)
Dourish, P.: Where the Action is: the Foundations of Embodied Interaction. MIT Press, Cambridge (2004)
Fallman, D.: In romance with the materials of mobile interaction: a phenomenological approach to the design of mobile information technology. Doctoral thesis. Umeå University, Sweden: Larsson & Co:s Tryckeri (2003)
Holmes, N.P., Calvert, G.A., Spence, C.: Multimodal Integration. In: Binder, M.D., Hirokawa, N., Windhorst, U. (eds.) Encyclopedia of Neuroscience. Springer (2008)
Hunt, A., Hermann, T.: The Importance of Interaction in Sonification. In: Proc. of International Conference on Auditory Display, ICAD (2004)
Kildal, J.: 3D-Press: Haptic Illusion of Compliance when Pressing on a Rigid Surface. In: Proc. of ICMI 2010. ACM (2010)
Lai, C.-H., Niinimaki, M., Tahiroğlu, K., Kildal, J., Ahmaniemi, T.: Perceived Physicality in Audio-Enhanced Force Input. In: Proc. of ICMI 2011. ACM (2011)
Niinimäki, M., Tahiroğlu, K.: AHNE: A Novel Interface for Spatial Interaction. In: Proc. of CHI 2012 Extended Abstracts on Human Factors in Computing System. ACM (2012)
Pick, H.L., Warren, D.H., Hay, J.C.: Sensory conflict in judgments of spatial direction. Perception & Psychophysics 6(4), 203–205 (1969)
Pusch, A., Martin, O., Coquillart, S.: HEMP-hand-displacement-based pseudo-haptics: A study of a force field application and a behavioural analysis. Int. J. Hum.-Comput. Stud. 67(3), 256–268 (2009)
Härmä, A., Jakka, J., Tikander, M., Karjalainen, M., Lokki, T., Hiipakka, J., Lorho, G.: Augmented reality audio for mobile and wearable appliances. J. Audio Eng. Soc. 52(6), 618–639 (2004)
Rohs, M., Schöning, J., Raubal, M., Essl, G., Kruger, A.: Map navigation with mobile devices: virtual versus physical movement with and without visual context. In: Proc. of ICMI 2007. ACM (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Tahiroğlu, K., Kildal, J., Ahmaniemi, T., Overstall, S., Wikström, V. (2012). Embodied Interactions with Audio-Tactile Virtual Objects in AHNE. In: Magnusson, C., Szymczak, D., Brewster, S. (eds) Haptic and Audio Interaction Design. HAID 2012. Lecture Notes in Computer Science, vol 7468. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-32796-4_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-32796-4_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-32795-7
Online ISBN: 978-3-642-32796-4
eBook Packages: Computer ScienceComputer Science (R0)