Abstract
Humans interact with each other by utilizing the five basic senses as input modalities, whereas sounds, gestures, facial expressions etc. are utilized as output modalities. Multimodal interaction is also used between humans and their surrounding environment, although enhanced with further senses such as equilibrioception and the sense of balance. Computer interfaces that are considered as a different environment that human can interact with, lack of input and output amalgamation in order to provide a close to natural interaction. Multimodal human-computer interaction has sought to provide alternative means of communication with an application, which will be more natural than the traditional “windows, icons, menus, pointer” (WIMP) style. Despite the great amount of devices in existence, most applications make use of a very limited set of modalities, most notably speech and touch. This paper describes a multimodal framework enabling deployment of a vast variety of modalities, tailored appropriately for use in blended learning environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Oviatt, S.: Ten myths of multimodal interaction. Commun. ACM 42(11), 74–81 (1999)
Oviatt, S.: Advances in robust multimodal interface design. IEEE Comput. Graph. Appl. 23(5), 62–68 (2003)
Oviatt, S., Cohen, P., Wu, L., Vergo, J., Duncan, L., Suhm, B., Bers, J., Holzman, T., Winograd, T., Landay, J., Larson, J., Ferro, D.: Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions. Hum. Comput. Interact. 15(4), 263–322 (2000)
Garofolo, J.: Overcoming barriers to progress in multimodal fusion research. In: Multimedia Information Extraction: Papers from the 2008 AAAI Fall Symposium Arlington, Virginia, pp. 3–4. The AAAI Press (2008)
Thevenin, D., Coutaz, J.: Plasticity of user interfaces: framework and research agenda. In: Proceedings of INTERACT, vol. 99 (1999)
Elouali, N., Rouillard, J., Pallec, X.L., Tarby, J.-C.: Multimodal interaction: a survey from model driven engineering and mobile perspectives. J. Multimodal User Interfaces 7(4), 351–370 (2013)
Bellik, Y., Teil, D.: Définitions Terminologiques pour la communication multimodale. In: presented at the Proceedings of Interface Hommemachine (IHM) (1992)
Nigay, L., Coutaz, J.: Multifeature systems: the CARE properties and their impact on software design. In: Multimedia Interfaces: Research and Applications, Chap. 9 (1997)
Oviatt, S.: Advances in robust multimodal interface design. IEEE Comput. Graph. Appl. 23(5), 62–68 (2003)
Friesen, N.: Report: Blended Learning (2012)
Bonk, C.J., Graham, C.R. (eds.): Handbook of Blended Learning: Global Perspectives, Local Designs. Pfeiffer Publishing, San Francisco, Chap. 1.1, Blended learning systems: Definition, current trends, and future directions (2005)
Singh, H., Reed, C.: A white paper: achieving success with blended learning. Centra softw. 1, 1–11 (2001)
Garrison, D.R., Kanuka, H.: Blended learning: uncovering its transformative potential in higher education. Internet High. Educ. 7(2), 95–105 (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Vidakis, N., Konstantinos, K., Triantafyllidis, G. (2017). A Multimodal Interaction Framework for Blended Learning. In: Brooks, A., Brooks, E. (eds) Interactivity, Game Creation, Design, Learning, and Innovation. ArtsIT DLI 2016 2016. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 196. Springer, Cham. https://doi.org/10.1007/978-3-319-55834-9_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-55834-9_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-55833-2
Online ISBN: 978-3-319-55834-9
eBook Packages: Computer ScienceComputer Science (R0)