Abstract
In this paper, we describe an opportunistic model for human-environment interaction. Such model is conceived to adapt the expressivity of a small lexicon of gestures through the use of generic functional gestures lowering the cognitive load on the user and reducing the system complexity. An interactive entity is modeled as a finite-state machine. A functional gesture is defined as the semantic meaning of an event that triggers a state transition and not as the movement to be performed. An interaction scenario has been designed in order to evaluate the features of the proposed model and to investigate how its application can enhance a post-WIMP human-environment interaction.
Chapter PDF
Similar content being viewed by others
References
Carrino, S., Mugellini, E., Abou Khaled, O., Ingold, R.: ARAMIS: Toward a Hybrid Approach for Human-Environment Interaction. In: Jacko, J.A. (ed.) Human-Computer Interaction, Part III, HCII 2011. LNCS, vol. 6763, pp. 165–174. Springer, Heidelberg (2011)
Wachs, J.P., Kölsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Communications of the ACM 54, 60 (2011)
Quek, F., McNeill, D., Bryll, R., Duncan, S., Ma, X.-F., Kirbas, C., McCullough, K.E., Ansari, R.: Multimodal human discourse: gesture and speech. ACM Transactions on Computer-Human Interaction 9(3), 171–193 (2002)
Karam, M., Schraefel, M.C.: A taxonomy of gestures in human computer interactions (2005)
Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindlbauer, D., Ion, A., Zhao, S., Tzu, J., Valino, K.: Understanding Mid-Air Hand Gestures.: A Study of Human Preferences in Usage of Gesture Types for HCI, Microsoft Research Technical Report (2012)
Baudel, T., Beaudouin-Lafon, C.: Remote Control of Objects using FreeHand Gestures. Communications of the ACM 36(7), 28–35 (1993)
Kjeldsen, R., Hartman, J.: Design Issues for Vision- based Computer Interaction Systems. In: Proc. of the Workshop on Perceptual User Interfaces, Orlando, Florida, USA (2001)
Abe, K., Saito, H., Ozawa, S.: Virtual 3-D Interface System via Hand Motion Recognition from Two Cameras. IEEE Trans. Systems, Man and Cybernetics, Part A 32(4), 536–540 (2002)
Stern, H.I., Wachs, J.P., Edan, Y.: Optimal Hand Gesture Vocabulary Design Using Psycho-Physiological and Technical Factors. In: 7th International Conference on Automatic Face and Gesture Recognition (FGR 2006), pp. 257–262 (2006)
Kettebekov, S., Sharma, R.: Toward natural gesture/speech control of a large display. Engineering for Human-Computer Interaction 2254, 221–234 (2001)
Bub, D.N., Masson, M.E.J., Cree, G.S.: Evocation of functional and volumetric gestural knowledge by objects and words. Cognition 106(1), 27–58 (2008)
Akers, D.L.: Observation-based design methods for gestural user interfaces. In: CHI 2007 Extended Abstracts on Human Factors in Computing Systems - CHI 2007, pp. 1625–1628. ACM (2007)
Prekopcsák, Z., Halácsy, P., Gáspár-Papanek, C.: Design and development of an everyday hand gesture interface. In: Proceedings of the 10th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI 2008, p. 479 (2008)
Nielsen, M., Moeslund, T., Storring, M., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Proc. 5th Int. Workshop on Gesture and Sign Language based HCI, Genova, Italy (2003)
Sommaruga, L., Formilli, T., Rizzo, N.: DomoML - an Integrating Devices Framework for Ambient Intelligence Solutions. In: Proceedings of the 6th International Workshop on Enhanced Web Service Technologies - WEWST 2011, pp. 9–15 (2011)
Norman, D.A.: Living with complexity. MIT Press (2010)
Miller, G.A.: The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information. The Psychological Review 63, 81–97 (1956), www.musanim.com/miller1956
Neßelrath, R., Lu, C., Schulz, C.H., Frey, J., Alexandersson, J.: A Gesture Based System for Context-Sensitive Interaction with Smart Homes. In: Ambient Assisted Living, 4. AAL-Kongress, pp. 209–219. Springer (2011)
Cheverst, K., Davies, N., Dix, A., Rodden, T.: Exploiting Context in HCI Design for Mobile Systems. In: First Workshop on Human Computer Interaction for Mobile Devices, pp. 1900–1901 (1998)
Perroud, D., Angelini, L., Khaled, O.A., Mugellini, E.: Context-Based Generation of Multimodal Feedbacks for Natural Interaction in Smart Environments. In: The Second International Conference on Ambient Computing, Applications, Services and Technologies (AMBIENT 2012), Barcelona, Spain, September 23-28 (2012)
Bau, O., Mackay, W.E.: OctoPocus. In: The 21st Annual ACM Symposium on User Interface Software and Technology - UIST 2008, p. 37. ACM Press, New York (2008)
Greenberg, S., Marquardt, N., Ballendat, T., Diaz-Marino, R., Wang, M.: Proxemic interactions. Interactions 18(1), 42 (2011)
Carrino, S., Péclat, A., Mugellini, E., Abou Khaled, O., Ingold, R.: Humans and Smart Environments: A Novel Multimodal Interaction Approach. In: Proceedings of the 13th International Conference on Multimodal Interfaces - ICMI 2011, p. 105 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Carrino, S., Caon, M., Abou Khaled, O., Ingold, R., Mugellini, E. (2013). Functional Gestures for Human-Environment Interaction. In: Kurosu, M. (eds) Human-Computer Interaction. Interaction Modalities and Techniques. HCI 2013. Lecture Notes in Computer Science, vol 8007. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-39330-3_18
Download citation
DOI: https://doi.org/10.1007/978-3-642-39330-3_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-39329-7
Online ISBN: 978-3-642-39330-3
eBook Packages: Computer ScienceComputer Science (R0)