Gestures in Human-Computer Interaction – Just Another Modality?
The traditional framework in human-computer studies is based on a simple input-output model of interaction. In many cases, however, splitting interaction into input and output is not necessarily appropriate. Gestures work as a good example of a modality which is difficult or inappropriate to be conceptualised within the traditional input-output paradigm. In the search for a more appropriate interaction paradigm, gestures, as modality, have potential in working as a meta-modality, in terms of which all other modalities could be analysed. This paper proposes the use of gestures and gestural metaphors in a central role in interaction design, and presents a case study as an illustration of the point.
Keywordsgesture metaphor human-computer interaction
Unable to display preview. Download preview PDF.
- 3.Card, S.K., Moran, T.P., Newell, A.: The psychology of human-computer interaction. Lawrence Erlbaum Associates, Hillsdale (1983)Google Scholar
- 4.Pirhonen, A., Brewster, S.: Metaphors and imitation. In: Workshop proceedings at PC-HCI 2001, Patras, Greece, December 7-9, pp. 27–32 (2001)Google Scholar
- 5.Pirhonen, A., Brewster, S., Holguin, C.: Gestural and audio metaphors as a means of control for mobile devices. In: Proceedings of CHI 2002, Minneapolis, Minnesota, April 20-25, pp. 291–298 (2002)Google Scholar
- 6.Pirhonen, A.: What do learning curves tell us about learnability? In: Vetere, F., Johnston, L., Kushinsky, R. (eds.) Proceedings of the HF2002 Human Factors Conference, Design for the whole person - integrating physical, cognitive and social aspects, November 25-27. Swinburne University of Technology (CD-ROM –format), Melbourne (2002)Google Scholar
- 7.Pirhonen, A.: From metaphors to simulations to idioms: Supporting the conceptualisation process. In: Markopoulos, P., Eggen, B., Aarts, E., Crowley, J.L. (eds.) EUSAI 2004. LNCS, vol. 3295, pp. 279–290. Springer, Heidelberg (2004)Google Scholar
- 8.Lakoff, G., Johnson, M.: Metaphors we live by. The University of Chicago Press, Chicago (1980)Google Scholar
- 10.Godøy, R.I.: Gestural-Sonorous Objects: Embodied Extensions of Schaeffer’s Conceptual Apparatus. Organised Sound 11(2) (2006)Google Scholar
- 11.Bernsen, N.O.: A toolbox of output modalities: Representing output information in multimodal interfaces. Esprit Basic Research Action 7040: The Amodeus Project, document TM/WP21 (1995)Google Scholar
- 12.Bernsen, N.O.: A taxonomy of input modalities. Esprit Basic Research Action 7040: The Amodeus Project, document TM/WP22 (1995)Google Scholar