Multimedia Interaction and Intelligent User Interfaces

Principles, Methods and Applications

  • Ling Shao
  • Caifeng Shan
  • Jiebo Luo
  • Minoru Etoh

Part of the Advances in Pattern Recognition book series (ACVPR)

Table of contents

  1. Front Matter
    Pages I-X
  2. Hayley Hung, Gerald Friedland, Chuohao Yeo
    Pages 25-59
  3. Gianpaolo D’Amico, Alberto Del Bimbo, Fabrizio Dini, Lea Landucci, Nicola Torpei
    Pages 85-106
  4. Caifeng Shan
    Pages 107-128
  5. Jun Yang, Hong Lu, Zhigang Liu, Péter Pál Boda
    Pages 185-213
  6. Wim Fikkert, Paul van der Vet, Anton Nijholt
    Pages 215-242
  7. Dan Tretter, Jerry Liu, Xuemei Zhang, Yuli Gao, Brian Atkins, Hui Chao et al.
    Pages 271-300
  8. Back Matter
    Pages 301-302

About this book


Consumer electronics (CE) devices, providing multimedia entertainment and enabling communication, have become ubiquitous in daily life. An important challenge for the modern CE industry is the design of user interfaces for CE products that enable natural interactions that are convenient, intuitive and fun. As many CE products are supplied with microphones and cameras, the exploitation of both audio and visual information for interactive multimedia is a growing field of research.

Collecting together contributions from an international selection of experts, including leading researchers in industry, this unique text presents the latest advances in applications of multimedia interaction and user interfaces for consumer electronics. Covering issues of both multimedia content analysis and human-machine interaction, the book examines a wide range of techniques from computer vision, machine learning, audio and speech processing, communications, artificial intelligence and media technology.

Topics and features:

  • Introduces novel computationally efficient algorithms to extract semantically meaningful audio-visual events
  • Investigates modality allocation in intelligent multimodal presentation systems, taking into account the cognitive impacts of modality on human information processing
  • Provides an overview on gesture control technologies for CE
  • Presents systems for natural human-computer interaction, virtual content insertion, and human action retrieval
  • Examines techniques for 3D face pose estimation, physical activity recognition, and video summary quality evaluation
  • Describes features that characterize the new generation of CE and examines how web services can be integrated for improved user experience

This book is an essential resource for researchers and practitioners from both academia and industry working in areas of multimedia analysis, human-computer interaction and interactive user interfaces. Graduate students studying computer vision, pattern recognition and multimedia will also find it a beneficial and a useful reference.

Dr. Ling Shao is a Senior Lecturer in the Department of Electronic and Electrical Engineering at the University of Sheffield, UK. Dr. Caifeng Shan is a Senior Scientist with Philips Research, Eindhoven, The Netherlands. Dr. Jiebo Luo is a Senior Principal Scientist with Kodak Research Laboratories in Rochester, NY, USA. Dr. Minoru Etoh is Managing Director of the Service & Solution Development Department of NTT DOCOMO, Yokosuka, Japan.


Audio Processing Computer Vision Consumer Electronics Context-Awareness Design Human-Computer Interaction Multimedia User Experience User Experience (UX) User Interface human-computer interaction (HCI) multimodal interaction

Editors and affiliations

  • Ling Shao
    • 1
  • Caifeng Shan
    • 2
  • Jiebo Luo
    • 3
  • Minoru Etoh
    • 4
  1. 1., Dept Electronic & Electrical EngineeringUniversity of SheffieldSheffieldUnited Kingdom
  2. 2.Philips ResearchEindhovenNetherlands
  3. 3.Kodak Research LaboratoriesRochesterUSA
  4. 4., Service & Solution Development DeptNTT DoCoMo, Inc.YokosukaJapan

Bibliographic information

Industry Sectors
IT & Software