Multimodal Signals: Cognitive and Algorithmic Issues

COST Action 2102 and euCognition International School Vietri sul Mare, Italy, April 21-26, 2008 Revised Selected and Invited Papers

  • Anna Esposito
  • Amir Hussain
  • Maria Marinaro
  • Raffaele Martone
Conference proceedings

Part of the Lecture Notes in Computer Science book series (LNCS, volume 5398)

Also part of the Lecture Notes in Artificial Intelligence book sub series (LNAI, volume 5398)

Table of contents

  1. Front Matter
  2. Interactive and Unsupervised Multimodal Systems

    1. Gérard Chollet, Anna Esposito, Annie Gentes, Patrick Horain, Walid Karam, Zhenbo Li et al.
      Pages 1-23
    2. Maria Koutsombogera, Harris Papageorgiou
      Pages 40-46
    3. Dirk Heylen, Mannes Poel, Anton Nijholt
      Pages 60-66
    4. Mark ter Maat, Dirk Heylen
      Pages 67-74
    5. Marcos Faundez-Zanuy
      Pages 94-103
    6. Josef Chaloupka, Jan Nouza, Jindrich Zdansky, Petr Cerva, Jan Silovsky, Martin Kroul
      Pages 104-111
    7. Goranka Zoric, Karlo Smid, Igor S. Pandzic
      Pages 112-120
    8. Alina E. Lascu, Alexandru V. Georgescu
      Pages 130-136
    9. René Hempel, Patrick Westfeld
      Pages 137-144
  3. Verbal and Nonverbal Communication Signals

    1. Maciej Karpinski
      Pages 164-169
    2. Isabella Poggi
      Pages 170-186
    3. Uli Sauerland, Mathias Schenner
      Pages 197-207
    4. Friedrich Neubarth, Christian Kranzler
      Pages 208-215
    5. Michael Pucher, Gudrun Schuchmann, Peter Fröhlich
      Pages 216-222
    6. Štefan Beňuš, Milan Rusko
      Pages 223-231
    7. Anna Přibilová, Jiří Přibil
      Pages 232-241
    8. Michal Mirilovič, Jozef Juhár, Anton Čižmár
      Pages 242-247
    9. Ammar Mahdhaoui, Mohamed Chetouani, Cong Zong, Raquel Sofia Cassel, Catherine Saint-Georges, Marie-Christine Laznik et al.
      Pages 248-255
    10. Peter J. Murphy, Anne-Maria Laukkanen
      Pages 264-270
    11. Carl Vogel, Jerom F. Janssen
      Pages 271-287
    12. Antonio Verduzco-Mendoza, Emilio Arch-Tirado, Carlos A. Reyes García, Jaime Leybón Ibarra, Juan Licona Bonilla
      Pages 320-327
    13. Matthias Wimmer, Christoph Mayer, Bernd Radig
      Pages 328-339
    14. Marco Grassi, Marcos Faundez-Zanuy, Francesco Piazza
      Pages 340-346
  4. Back Matter

About these proceedings


This book constitutes the thoroughly refereed post-conference
proceedings of the COST Action 2102 and euCognition supported international school on Multimodal Signals: "Cognitive and Algorithmic Issues" held in Vietri sul Mare, Italy, in April 2008.

The 34 revised full papers presented were carefully reviewed and selected from participants’ contributions and invited lectures given at the workshop. The volume is organized in two parts; the first on Interactive and Unsupervised Multimodal Systems contains 14 papers. The papers deal with the theoretical and computational issue of defining algorithms, programming languages, and determinist models to recognize
and synthesize multimodal signals. These are facial and vocal
expressions of emotions, tones of voice, gestures, eye contact, spatial arrangements, patterns of touch, expressive movements, writing patterns, and cultural differences, in anticipation of the implementation of intelligent avatars and interactive dialogue systems that could be exploited to improve user access to future telecommunication services. The second part of the volume, on Verbal and Nonverbal Communication Signals, presents 20 original studies devoted to the modeling of timing synchronisation between speech production, gestures, facial and head movements in human communicative expressions and on their mutual contribution for an effective communication.


algorithms animation systems architecture audiovisual processing avatar cognition communication computer-assisted surgery conversation analysis dialects emotion recognition gesture modeling programming language speech processing

Editors and affiliations

  • Anna Esposito
    • 1
  • Amir Hussain
    • 2
  • Maria Marinaro
    • 3
  • Raffaele Martone
    • 4
  1. 1.Department of PsychologySecond University of Naples, and IIASSVietri sul Mare (SA)Italy
  2. 2.Department of Computing Science & MathematicsUniversity of StirlingStirlingScotland, UK
  3. 3.Dipartimento di Fisica “E.R. Caianiello”Università degli Studi di Salerno, Italy and IIASSBaronissi (SA)Italy
  4. 4.Dip. di Ingegneria dell’ InformazioneSeconda Università di NapoliAversa (CE)Italy

Bibliographic information

  • DOI
  • Copyright Information Springer-Verlag Berlin Heidelberg 2009
  • Publisher Name Springer, Berlin, Heidelberg
  • eBook Packages Computer Science Computer Science (R0)
  • Print ISBN 978-3-642-00524-4
  • Online ISBN 978-3-642-00525-1
  • Series Print ISSN 0302-9743
  • Series Online ISSN 1611-3349
  • Buy this book on publisher's site
Industry Sectors
Materials & Steel
Chemical Manufacturing
Finance, Business & Banking
IT & Software
Consumer Packaged Goods