Abstract
Multimodal interfaces offer its users the possibility of interacting with computers, in a transparent, natural way, by means of various modalities. Fusion engines are key components in multimodal systems, responsible for combining information from different sources and extract a semantic meaning from them. This fusion process allows many modalities to be effectively used at once and therefore allowing a natural communication between user and machine. Elderly users, whom can possess several accessibility issues, can benefit greatly from this kind of interaction. By developing fusion engines that are capable of adapting, taking into account the characteristics of these users, it is possible to make multimodal systems cope with the needs of impaired users.
Chapter PDF
Similar content being viewed by others
References
Dumas, B., Lalanne, D., Oviatt, S.: Multimodal interfaces: A survey of principles, models and frameworks. Human Machine Interaction 5440(2), 3–26 (2009)
Oviatt, S.L.: Multimodal interactive maps: Designing for human performance. Human-Computer Interaction 12(1), 93–129 (1997)
Sanderson, C., Paliwal, K.K.: Information fusion and person verification using speech & face information. Research Paper IDIAP-RR 02-33Â 1(33) (2002)
Poh, N., Bourlai, T., Kittler, J.: Multimodal information fusion. In: Multimodal Signal Processing Theory and Applications for Human Computer Interaction, p. 153. Academic Press, London (2010)
Lalanne, D., Nigay, L., Palanque, P., Robinson, P., Vanderdonckt, J.: Fusion engines for multimodal input: a survey. In: Proceedings of the 2009 International Conference on Multimodal Interfaces, pp. 153–160. ACM, New York (2009)
Lawson, L., Al-Akkad, A.-A., Vanderdonckt, J., Macq, B.: An open source workbench for prototyping multimodal interactions based on off-the-shelf hetero-geneous components. In: Proceedings of the 1st ACM SIGCHI Symposium on Engineering Interactive Computing Systems EICS 2009, p. 245. ACM Press, New York (2009)
Dumas, B., Ingold, R., Lalanne, D.: Benchmarking fusion engines of multimodal interactive systems. In: Proceedings of the 2009 International Conference on Multi-modal Interfaces ICMIMLMI 2009, pp. 169–176. ACM Press, New York (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Feiteira, P., Duarte, C. (2011). Adaptive Multimodal Fusion. In: Stephanidis, C. (eds) Universal Access in Human-Computer Interaction. Design for All and eInclusion. UAHCI 2011. Lecture Notes in Computer Science, vol 6765. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21672-5_41
Download citation
DOI: https://doi.org/10.1007/978-3-642-21672-5_41
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21671-8
Online ISBN: 978-3-642-21672-5
eBook Packages: Computer ScienceComputer Science (R0)