Encyclopedia of Database Systems

2018 Edition
| Editors: Ling Liu, M. Tamer Özsu

Multimodal Interfaces

  • Monica Sebillo
  • Giuliana Vitiello
  • Maria De Marsico
Reference work entry
DOI: https://doi.org/10.1007/978-1-4614-8265-9_880

Definition

Multimodal interfaces are characterized by the (possibly simultaneous) use of multiple human sensory modalities and can support combined input/output modes.

The term multimodal recurs across several domains. Since its first use in the field of interface design, its affinity and derivation from the terms “mode” and “modality” were discussed. According to Merriam-Webster, one of the meanings for mode is “a possible, customary, or preferred way of doing something,” whereas modality can be “one of the main avenues of sensation (as vision).” In multimodal interfaces, the former influences the way information is conveyed, the latter refers to the exploited communication channel. Both express peculiar aspects of a multimodal system, which is expected to provide users with flexibility and natural interaction.

Early multimodal interfaces simply combined display, keyboard, and mouse with voice (speech recognition/synthesis). Later, pen-based input, hand gestures, eye gaze, haptic...

This is a preview of subscription content, log in to check access.

Recommended Reading

  1. 1.
    Blattner MM, Dannenberg RB. CHI’90 Workshop on multimedia and multimodal interface design. SIGCHI Bull. 1990;22(2):54–8.CrossRefGoogle Scholar
  2. 2.
    Bolt RA. Put that there: voice and gesture at the graphics interface. ACM Comput Graph. 1980;14(3):262–70.CrossRefGoogle Scholar
  3. 3.
    Cohen PR, Johnston M, McGee DR, Oviatt SL, Pittman J, Smith I, Chen L, Clow J. QuickSet: multimodal interaction for distributed applications. In: Proceedings of the 5th ACM International Conference on Multimedia; 1997. p. 31–40.Google Scholar
  4. 4.
    European Telecommunications Standards Institute. Human Factors (HF); Multimodal interaction, communication and navigation guidelines ETSI EG 202 191 V1.1.1 (2003–08).Google Scholar
  5. 5.
    Jaimes A, Sebe N. Multimodal human-computer interaction: a survey. Comput Vis Image Underst. 2007;108(1–2):116–34.CrossRefGoogle Scholar
  6. 6.
    Norman D. The design of everyday things. New York: Doubleday; 1988.Google Scholar
  7. 7.
    Oviatt S. Ten myths of multimodal interaction. Commun ACM. 1999;42(11):74–81.CrossRefGoogle Scholar
  8. 8.
    Oviatt S. Multimodal interfaces. In: Jacko J, Sears A, editors. The human-computer interaction handbook: fundamentals, evolving technologies, and emerging applications. Mahwah: Lawrence Erlbaum; 2003.Google Scholar
  9. 9.
    Reeves LM, Lai J, Larson JA, Oviatt S, Balaji TS, Buisine S, Collings P, Cohen P, Kraal B, Martin JC, McTear M, Raman TV, Stanney KM, Su H, Wang QY. Guidelines formultimodal user interface design. Commun ACM. 2004;47(1):57–9.CrossRefGoogle Scholar
  10. 10.
    Yuen PC, Tang YY, Wang PSP, editors. Multimodal interface for human-machine communication. River Edge: World Scientific; 2002.zbMATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Monica Sebillo
    • 1
  • Giuliana Vitiello
    • 1
  • Maria De Marsico
    • 2
  1. 1.University of SalernoSalernoItaly
  2. 2.Sapienza University of RomeRomeItaly

Section editors and affiliations

  • Tiziana Catarci
    • 1
  1. 1.Dept. di Ingegneria Informatica, Automatica e GestionaleUniversita di RomaRomaItaly