© 2008

Multimodal User Interfaces

From Signals to Interaction

  • Dimitrios Tzovaras


  • First book combining Signal Processing and Human-Computer-Interaction.

  • Multidisciplinary area involving several fields, including signal processing, human-machine interaction, computer science and cognitive science.


Part of the Signals and Commmunication Technologies book series (SCT)

Table of contents

  1. Front Matter
    Pages i-x
  2. Pages 1-4
  3. Niels Ole Bernsen
    Pages 5-29
  4. Jean-Philippe Thiran, Torsten Butz, A. Murat Tekalp
    Pages 31-59
  5. Jean Vanderdonckt, Gaëlle Calvary, Joëlle Coutaz, Adrian Stanciulescu
    Pages 61-84
  6. Mihai Gurban, Veronica Vilaplana, Jean-Philippe Thiran, Ferran Marques
    Pages 85-117
  7. R. Cowie, E. Douglas-Cowie, K. Karpouzis, G. Caridakis, M. Wallace, S. Kollias
    Pages 119-153
  8. Alexey Karpov, Sebastien Carbini, Andrey Ronzhin, Jean Emmanuel Viallet
    Pages 155-184
  9. Fabio Paternò, Carmen Santoro
    Pages 185-199
  10. Laurence Nigay, Jullien Bouchet, David Juras, Benoit Mansoux, Michael Ortega, Marcos Serrano et al.
    Pages 201-218
  11. Oya Aran, Thomas Burger, Lale Akarun, Alice Caplier
    Pages 219-250
  12. Savvas Argyropoulos, Konstantinos Moustakas
    Pages 251-270
  13. Daniela G. Trevisan, Vincent Nicolas, Benoit Macq, Luciana P. Nedel
    Pages 271-280
  14. Pablo Lamata, Carlos Alberola, Francisco Sánchez-Margallo, Miguel Ángel Florido, Enrique J. Gómez
    Pages 281-290
  15. Back Matter
    Pages 291-315

About this book


Where multimodal signal processing meets multimodal human computer interaction...

Signal Processing (SP) and Human-Computer Interaction (HCI), two very popular scientific areas, are brought together to provide solutions to a series of great challenges in the field of multimodal interfaces. Focus is on multimodal interfaces that respond efficiently to speech, gestures, vision, haptics and direct brain connections taking advantage of recent developments in both HCI and SP.

The book presents a common theoretical framework for fusion and fission of multimodal information using the most advanced signal processing algorithms constrained by HCI rules, described in detail and integrated in the context of a common distributed software platform for easy and efficient development and usability assessment of multimodal tools. The book also demonstrates the use of the multimodal framework for the development of a set of applications in the areas of edutainment, interfaces for disabled people and interfaces for medical applications.


Haptik Interaction Interface Segment User Interfaces digital signal processing haptics human-computer interaction (HCI) image processing image registration information multimedia segmentation signal processing user interface

Editors and affiliations

  • Dimitrios Tzovaras
    • 1
  1. 1.Centre for Research and Technology HellasInformatics and Telematics Institute Thermi-ThessalonikiGreece

Bibliographic information

Industry Sectors
IT & Software
Oil, Gas & Geosciences