Skip to main content
  • Book
  • © 2006

SmartKom: Foundations of Multimodal Dialogue Systems

  • Provides a detailed description of the salient characteristics of SmartKom:
  • Seamless integration and mutual disambiguation of multimodal input and output on semantic and pragmatic levels
  • Situated understanding of possibly imprecise, ambiguous, or incomplete multimodal input
  • Context-sensitive interpretation of dialog interaction on the basis of dynamic discourse and context models
  • Adaptive generation of coordinated, cohesive, and coherent multimodal presentations
  • Semi- or fully automatic completion of user-delegated tasks through the integration of information services
  • Intuitive personification of the system through a presentation agent
  • Includes supplementary material: sn.pub/extras

Part of the book series: Cognitive Technologies (COGTECH)

Buy it now

Buying options

eBook USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access

This is a preview of subscription content, log in via an institution to check for access.

Table of contents (38 chapters)

  1. Multimodal Dialogue Processing

    1. Overlay: The Basic Operation for Discourse Processing

      • Jan Alexandersson, Tilman Becker, Norbert Pfleger
      Pages 255-267
    2. In Context: Integrating Domain- and Situation-Specific Knowledge

      • Robert Porzel, Iryna Gurevych, Rainer Malaka
      Pages 269-284
    3. Intention Recognition

      • Jürgen te Vrugt, Thomas Portele
      Pages 285-299
    4. Emotion Analysis and Emotion-Handling Subdialogues

      • Michael Streit, Anton Batliner, Thomas Portele
      Pages 317-332
  2. Multimodal Output Generation

    1. Front Matter

      Pages 347-347
    2. Realizing Complex User Wishes with a Function Planning Module

      • Sunna Torge, Christian Hying
      Pages 349-362
    3. Intelligent Integration of External Data and Services into SmartKom

      • Hidir Aras, Vasu Chandrasekhara, Sven Krüger, Rainer Malaka, Robert Porzel
      Pages 363-378
    4. Multimodal Fission and Media Design

      • Peter Poller, Valentin Tschernomas
      Pages 379-400
    5. Multimodal Speech Synthesis

      • Antje Schweitzer, Norbert Braunschweiler, Grzegorz Dogil, Tanja Klankert, Bernd Möbius, Gregor Möhler et al.
      Pages 411-435
  3. Scenarios and Applications

    1. Front Matter

      Pages 437-437
    2. SmartKom-English: From Robust Recognition to Felicitous Interaction

      • David Gelbart, John Bryant, Andreas Stolcke, Robert Porzel, Manja Baudis, Nelson Morgan
      Pages 453-470
    3. SmartKom-Public

      • Axel Horndasch, Horst Rapp, Hans Röttger
      Pages 471-492
    4. SmartKom-Home: The Interface to Home Entertainment

      • Thomas Portele, Silke Goronzy, Martin Emele, Andreas Kellner, Sunna Torge, Jürgen te Vrugt
      Pages 493-503
    5. SmartKom-Mobile: Intelligent Interaction with a Mobile System

      • Rainer Malaka, Jochen Häußler, Hidir Aras, Matthias Merdes, Dennis Pfisterer, Matthias Jöst et al.
      Pages 505-522
    6. SmartKom-Mobile Car: User Interaction with Mobile Services in a Car Environment

      • André Berton, Dirk Bühler, Wolfgang Minker
      Pages 523-537
  4. Data Collection and Evaluation

    1. Front Matter

      Pages 539-539

Reviews

From the reviews:

"The book is organized into six parts, each of which contains several chapters. … This book should be useful for many types of readers. Those who want to get a sense of the state of the art of multimodal communication … will find it invaluable. Students who have had a good grounding in artificial intelligence or natural language processing should read the book to get an overview of how the techniques from these fields can be integrated into a comprehensive system." (J. P. E. Hodgson, ACM Computing Reviews, Vol. 49 (4), April, 2008)

Editors and Affiliations

  • German Research Center for AI, DFKI GmbH, Saarbrücken, Germany

    Wolfgang Wahlster

About the editor

Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster is the Director and CEO of the German Research Center for Artificial Intelligence (DFKI GmbH) and a Professor of Computer Science at the Universität des Saarlandes, Saarbrücken. In 2000, he was coopted as a Professor of Computational Linguistics at the same university. In addition, he is the Head of the Intelligent User Interfaces Lab at DFKI.

He was the Scientific Director of the Verbmobil consortium on spontaneous speech translation (1993-2000), the SmartKom consortium on multimodal dialog systems (1999-2003), and the SmartWeb consortium on mobile multimodal access to semantic web services (2004-2008).

He has authored more than 150 technical papers and 6 books on language technology and intelligent user interfaces, and edited many books, among them the Springer titles "Verbmobil: Foundations of Speech-to-Speech Translation", "SmartKom: Foundations of Multimodal Dialogue Systems", and "SemProM: Foundations of Semantic Product Memories for the Internet of Things". His research includes multimodal and perceptive user interfaces, user modeling, embodied conversational agents, smart navigation systems, semantic web services, and resource-adaptive cognitive technologies.

He was awarded the Deutscher Zukunftspreis (German Future Award) in 2001 and he received the Federal Cross of Merit, First Class, the Officer's Cross of the Order of Merit of the Federal Republic of Germany in 2006.

He is the Chief Academic Advisor for Information and Communication Technologies (ICT) in the Research Union of the German Government, he is a member or chair of many key international scientific advisory and governance boards, including the National Institute of Informatics (NII) of Japan, the jury for the European ICT Prize of the European Commission, the SingaporeAgency for Science, Technology and Research, the SAP Next Business & Technology Advisory Board, the Center for Advanced Security Research in Darmstadt, the Intel Visual Computing Institute, the Fondazione Bruno Kessler, and the Future Internet Public-Private Partnership of the European Commission.

He is a member of many academies, including the German Academy of Sciences and Literature, Mainz, the Royal Swedish Academy of Sciences, Stockholm, the German Academy of Natural Scientists Leopoldina, Acatech, the Council for Engineering Sciences of the Union of German Academies of Science and Humanities, and the Berlin-Brandenburg Academy of Sciences and Humanities.

He has chaired and given invited talks at the key international conferences in computational linguistics and artificial intelligence, he is a board member of the key AI journals, and he is a Fellow of the Association for the Advancement of Artificial Intelligence (AAAI), the European Coordinating Committee for Artificial Intelligence (ECCAI), and the Gesellschaft für Informatik (GI).

Bibliographic Information

Buy it now

Buying options

eBook USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Other ways to access