Abstract
Towards building an affective educational system we explore the human-computer interaction that is based on two modalities, namely the computer’s keyboard and the computer’s microphone. The resulting system is affective by having the ability to recognize human emotional signals, as well as by being able to generate emotions for pedagogical educational reasons. Both for the recognition and for the generation of emotions within the educational environment we have incorporated two sophisticated theories that are used as mechanisms for human-machine emotional interaction. The first mechanism emerges from a well known decision making theory, while the second mechanism uses quite recent findings in the area of cognitive psychology. In our research, we have investigated the recognition of emotions from the above mentioned modalities with respect to six basic emotional states, namely happiness, sadness, surprise, anger and disgust as well as the emotion-less state which we refer to as neutral. The purpose of the incorporation of the supplementary emotional interaction between users and computers was to assist the educational processes in e-learning applications and also to support the instructors’ work during their authoring duties.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Pantic, M., Rothkrantz, L.J.M.: Toward an affect-sensitive multimodal human-cumputer interaction. In: Proceedings of the IEEE, Institute of Electrical and Electronics Engineers, vol. 91, pp. 1370–1390 (2003)
Jascanu, N., Jascanu, V., Bumbaru, S.: Toward emotional e-commerce: The customer agent. In: Lovrek, I., Howlett, R.J., Jain, L.C. (eds.) KES 2008, Part I. LNCS (LNAI), vol. 5177, pp. 202–209. Springer, Heidelberg (2008)
Bernhardt, D., Robinson, P.: Interactive control of music using emotional body expressions. In: Proceedings on Conference on Human Factors in Computing Systems, pp. 3117–3122 (2008)
Lane, H.C. Intelligent Tutoring Systems: Prospects for Guided Practice and Efficient Learning. In: Whitepaper for the Army’s Science of Learning Workshop, Hampton, VA (2006)
Brusilovsky, P.: Adaptive and Intelligent Technologies for Web-based Education. In: Rollinger, C., Peylo, C. (eds.) Künstliche Intelligenz, vol. 4, pp. 19–25 (1999); Special Issue on Intelligent Systems and Teleteaching
Johnson, W.L., Rickel, J., Lester, J.: Animated Educational Agents: Face-to-Face Interaction in Interactive Learning Environments. International Journal of Artificial Intelligence in Education 11, 47–78 (2000)
Lester, J., Converse, S., Kahler, S., Barlow, S., Stone, B., Bhogal, R.: The Persona Effect: affective impact of animated educational agents. In: Pemberton, S. (ed.) Proceedings of Conference Human Factors in Computing Systems, CHI 1997, pp. 359–366. ACM Press, New York (1997)
Virvou, M., Alepis, E.: Mobile educational features in authoring tools for personalised tutoring. Computers & Education 44(1), 53–68 (2005)
Leon, E., Clarke, G., Gallaghan, V., Sepulveda, F.: A user-independent real-time emotion recognition system for software agents in domestic environments. Engineering Applications of Artificial Intelligence 20(3), 337–345 (2007)
Goleman, D.: Emotional Intelligence. Bantam Books, New York (1995)
Picard, R.W.: Affective Computing: Challenges. Int. Journal of Human-Computer Studies 59(1-2), 55–64 (2003)
Alepis, E., Virvou, M., Kabassi, K.: Knowledge Engineering for Affective Bi-modal Human-Computer Interaction. In: SIGMAP (2007)
Ortony, A., Clore, G., Collins, A.: The cognitive structure of emotions. Cambridge University Press, Cambridge (1990)
Alepis, E., Virvou, M.: Emotional Intelligence: Constructing user stereotypes for affective bi- modal interaction. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds.) KES 2006. LNCS (LNAI), vol. 4251, pp. 435–442. Springer, Heidelberg (2006)
Fishburn, P.C.: Additive Utilities with Incomplete Product Set: Applications to Priorities and Assignments. Operations Research (1967)
Hwang, C.L., Yoon, K.: Multiple Attribute Decision Making: Methods and Applications. Lecture Notes in Economics and Mathematical Systems, vol. 186. Springer, Berlin (1981)
Stathopoulou, I.O., Tsihrintzis, G.A.: Detection and Expression Classification System for Face Images (FADECS). In: IEEE Workshop on Signal Processing Systems, Athens, Greece (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Alepis, E., Virvou, M., Kabassi, K. (2011). Emotion Based User Interaction in Multimedia Educational Applications. In: Cordeiro, J., Ranchordas, A., Shishkov, B. (eds) Software and Data Technologies. ICSOFT 2009. Communications in Computer and Information Science, vol 50. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20116-5_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-20116-5_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20115-8
Online ISBN: 978-3-642-20116-5
eBook Packages: Computer ScienceComputer Science (R0)