Abstract
This paper analyses the knowledge and software engineering aspects of educational applications that provide affective bi-modal human-computer interaction. For this purpose, a system that provides affective interaction based on evidence from two different modes has been developed. More specifically, the system’s inferences about students’ emotions are based on user input evidence from the keyboard and the microphone. Evidence from these two modes is combined by a user modelling component that incorporates user stereotypes as well as a multi criteria decision making theory. The mechanism that integrates the inferences from the two modes has been based on the results of two empirical studies that were conducted in the context of knowledge engineering of the system. The evaluation of the developed system showed significant improvements in the recognition of the emotional states of users.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Hudlicka, E.: To feel or not to feel: The role of affect in human-computer interaction. International Journal of Human-Computer Studies, 1–32 (2003)
Goleman, D.: Emotional Intelligence. Bantam Books, New York (1995)
Picard, R.W., Klein, J.: Computers that recognise and respond to user emotion: theoretical and practical implications. Interacting with Computers 14, 141–169 (2002)
Picard, R.W.: Affective Computing: Challenges. Int. Journal of Human-Computer Studies 59(1-2), 55–64 (2003)
Oviatt, S.: User-modeling and evaluation of multimodal interfaces. Proceedings of the IEEE. Institute of Electrical and Electronics Engineers, 1457–1468 (2003)
Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human-cumputer interaction. Proceedings of the IEEE, Institute of Electrical and Electronics Engineers 91, 1370–1390 (2003)
Fishburn, P.C.: Additive Utilities with Incomplete Product Set: Applications to Priorities and Assignments, Operations Research (1967)
Hwang, C.L., Yoon, K.: Multiple Attribute Decision Making: Methods and Applications. Lecture Notes in Economics and Mathematical Systems, vol. 186. Springer, Heidelberg (1981)
Rich, E.: Users are individuals: individualizing user models. International Journal of Man-Machine Studies 18, 199–214 (1983)
Kay, J.: Stereotypes, student models and scrutability. In: Gauthier, G., Frasson, C., VanLehn, K. (eds.) ITS 2000. LNCS, vol. 1839, pp. 19–30. Springer, Heidelberg (2000)
Kobsa, A., Koenemann, J., Pohl, W.: Personalized hypermedia presentation techniques for improving on-line customer relationships. The Knowledge Engineering Review 16, 111–115 (2001)
Elfenbein, H.A., Ambady, N.: When Familiarity Breeds Accuracy. Cultural Exposure and Facial Emotion Recognition. Journal of Personality and Social Psychology 85(2), 276–290 (2003)
Moriyama, T., Ozawa, S.: Measurement of Human Vocal Emotion Using Fuzzy Control. Systems and Computers in Japan 32(4) (2001)
Moriyama, T., Saito, H., Ozawa, S.: Evaluation of the Relation between Emotional Con-cepts and Emotional Parameters in Speech. Systems and Computers in Japan 32(3) (2001)
Stathopoulou, I.O., Tsihrintzis, G.A.: Detection and Expression Classification System for Face Images (FADECS). In: IEEE Workshop on Signal Processing Systems, Athens, Greece (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alepis, E., Virvou, M., Kabassi, K. (2008). Knowledge Engineering Aspects of Affective Bi-Modal Educational Applications. In: Filipe, J., Obaidat, M.S. (eds) E-business and Telecommunications. ICETE 2007. Communications in Computer and Information Science, vol 23. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88653-2_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-88653-2_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88652-5
Online ISBN: 978-3-540-88653-2
eBook Packages: Computer ScienceComputer Science (R0)