Skip to main content

Gestures in Human-Computer Interaction – Just Another Modality?

  • Conference paper
Gesture in Embodied Communication and Human-Computer Interaction (GW 2009)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5934))

Included in the following conference series:

Abstract

The traditional framework in human-computer studies is based on a simple input-output model of interaction. In many cases, however, splitting interaction into input and output is not necessarily appropriate. Gestures work as a good example of a modality which is difficult or inappropriate to be conceptualised within the traditional input-output paradigm. In the search for a more appropriate interaction paradigm, gestures, as modality, have potential in working as a meta-modality, in terms of which all other modalities could be analysed. This paper proposes the use of gestures and gestural metaphors in a central role in interaction design, and presents a case study as an illustration of the point.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Broadbent, D.E.: Perception and communication. Pergamon, London (1958)

    Book  Google Scholar 

  2. Horrey, W.J., Wickens, C.D.: Examining the impact of cell phone conversations on driving using meta-analytic techniques. Human Factors 48(1), 196–205 (2006)

    Article  Google Scholar 

  3. Card, S.K., Moran, T.P., Newell, A.: The psychology of human-computer interaction. Lawrence Erlbaum Associates, Hillsdale (1983)

    Google Scholar 

  4. Pirhonen, A., Brewster, S.: Metaphors and imitation. In: Workshop proceedings at PC-HCI 2001, Patras, Greece, December 7-9, pp. 27–32 (2001)

    Google Scholar 

  5. Pirhonen, A., Brewster, S., Holguin, C.: Gestural and audio metaphors as a means of control for mobile devices. In: Proceedings of CHI 2002, Minneapolis, Minnesota, April 20-25, pp. 291–298 (2002)

    Google Scholar 

  6. Pirhonen, A.: What do learning curves tell us about learnability? In: Vetere, F., Johnston, L., Kushinsky, R. (eds.) Proceedings of the HF2002 Human Factors Conference, Design for the whole person - integrating physical, cognitive and social aspects, November 25-27. Swinburne University of Technology (CD-ROM –format), Melbourne (2002)

    Google Scholar 

  7. Pirhonen, A.: From metaphors to simulations to idioms: Supporting the conceptualisation process. In: Markopoulos, P., Eggen, B., Aarts, E., Crowley, J.L. (eds.) EUSAI 2004. LNCS, vol. 3295, pp. 279–290. Springer, Heidelberg (2004)

    Google Scholar 

  8. Lakoff, G., Johnson, M.: Metaphors we live by. The University of Chicago Press, Chicago (1980)

    Google Scholar 

  9. Gallese, V., Lakoff, G.: The brain’s concepts: the role of the sensory-motor system in reason and language. Cogn. Neuropsychol. 22(2005), 455–479 (2005)

    Article  Google Scholar 

  10. Godøy, R.I.: Gestural-Sonorous Objects: Embodied Extensions of Schaeffer’s Conceptual Apparatus. Organised Sound 11(2) (2006)

    Google Scholar 

  11. Bernsen, N.O.: A toolbox of output modalities: Representing output information in multimodal interfaces. Esprit Basic Research Action 7040: The Amodeus Project, document TM/WP21 (1995)

    Google Scholar 

  12. Bernsen, N.O.: A taxonomy of input modalities. Esprit Basic Research Action 7040: The Amodeus Project, document TM/WP22 (1995)

    Google Scholar 

  13. Blattner, M., Sumikawa, D., Greenberg, R.: Earcons and icons: Their structure and common design principles. Human-Computer Interaction 4(1), 11–44 (1989)

    Article  Google Scholar 

  14. Brewster, S., Brown, L.: Non-visual information display using tactons. In: CHI 2004 extended abstracts on Human factors in computing systems, pp. 787–788. ACM, New York (2004)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pirhonen, A. (2010). Gestures in Human-Computer Interaction – Just Another Modality?. In: Kopp, S., Wachsmuth, I. (eds) Gesture in Embodied Communication and Human-Computer Interaction. GW 2009. Lecture Notes in Computer Science(), vol 5934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-12553-9_25

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-12553-9_25

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-12552-2

  • Online ISBN: 978-3-642-12553-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics