Abstract
We investigate how positive, neutral and negative feedback responses from an Intelligent Tutoring System (ITS) influences learners’ affect and physiology. AutoTutor, an ITS with conversational dialogues, was used by learners (n=16) while their physiological signals (heart signal, facial muscle signal and skin conductivity) were recorded. Learners were asked to self-report the cognitive-affective states they experienced during their interactions with AutoTutor via a retrospective judgment protocol immediately after the tutorial session. Statistical analysis (Chi-square) indicated that tutor feedback and learner affect were related. The results revealed that after receiving positive feedback from AutoTutor, learners mostly experienced ‘delight’ while surprise was experienced after negative feedback. We also classified physiological signals based on the tutor’s feedback (Negative vs. Non-Negative) with a support vector machine (SVM) classifier. The classification accuracy, ranged from 42% to 84%, and was above the baseline for 10 learners.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lepper, M., Henderlong, J.: Turning ‘play’ into ‘work’ and ‘work’ into ‘play’: 25 years of research on intrinsic versus extrinsic motivation. In: Intrinsic and extrinsic motivation: The search for optimal motivation and performance, pp. 257–307 (2000)
Linnenbrink, E., Pintrich, P.: The role of motivational beliefs in conceptual change. Practice 115, 135 (2002)
Kort, B., Reilly, R., Picard, R.: An affective model of interplay between emotions and learning. In: Reengineering educational pedagogy-building a learning companion, pp. 43–48 (2001)
Craig, S., Graesser, A., Sullins, J., Gholson, B.: Affect and learning: an exploratory look into the role of affect in learning with AutoTutor. Journal of Educational Media 29 (2004)
Picard, R.: Affective Computing. The MIT Press, Cambridge (1997)
D’Mello, S., Graesser, A., Picard, R.: Toward an affect-sensitive AutoTutor. IEEE Intelligent Systems 22, 53–61 (2007)
Ekman, P., Levenson, R., Friesen, W.: Autonomic nervous system activity distinguishes among emotions. Science 221, 1208–1210 (1983)
D’Mello, S., Craig, S., Witherspoon, A., Mcdaniel, B., Graesser, A.: Automatic detection of learner’s affect from conversational cues. User Modeling and User-Adapted Interaction 18, 45–80 (2008)
Burleson, W., Picard, R.: Affective agents: Sustaining motivation to learn through failure and a state of stuck. Citeseer (2004)
Csikszentmihalyi, M.: Flow: The psychology of optimal experience, New York (1990)
Graesser, A., McDaniel, B., Chipman, P., Witherspoon, A., D’Mello, S., Gholson, B.: Detection of emotions during learning with AutoTutor. In: Proceedings of the 28 th Annual Meetings of the Cognitive Science Society, pp. 285–290 (2006)
Klein, J., Moon, Y., Picard, R.: This computer responds to user frustration: Theory, design, and results. Interacting with computers 14, 119–140 (2002)
Prendinger, H., Ishizuka, M.: The Empathic Companion: A Character-Based Interface That Addresses Users’ Affective States. Applied Artificial Intelligence 19, 267–286 (2005)
Picard, R.W., Vyzas, E., Healey, J.: Toward machine emotional intelligence: analysis of affective physiological state. IEEE transactions on Pattern Analysis and Machine Intelligence 23, 1175–1191 (2001)
Cowie, R., Douglas-Cowie, E., Tsapatsoulis, N., Votsis, G., Kollias, S., Fellenz, W., Taylor, J.: Emotion recognition in human-computer interaction. IEEE Signal Processing Magazine 18, 32–80 (2001)
Polzin, T.: Detecting Verbal and Non-verbal cues in the communication of emotion. Unpublished Doctoral Dissertation, School of Computer Science, Carnegie Mellon University (2000)
Yacoob, Y., Davis, L.: Recognizing human facial expressions from long image sequences using optical flow (1996)
Picard, R., Vyzas, E., Healey, J.: Toward machine emotional intelligence: Analysis of affective physiological state. IEEE transactions on Pattern Analysis and Machine Intelligence, 1175–1191 (2001)
Barrett, L.: Are Emotions Natural Kinds? vol. 1 58 (2006)
Christie, I.C.: Multivariate discrimination of emotion-specific autonomic nervous system activity (2002)
Fredrickson, B.L., Mancuso, R.A., Branigan, C., Tugade, M.M.: The undoing effect of positive emotions. Motivation and Emotion 24, 237–258 (2000)
Levenson, R.W., Ekman, P., Friesen, W.V.: Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology 27, 363–384 (1990)
Conati, C., Chabbal, R., Maclaren, H.: A study on using biometric sensors for monitoring user emotions in educational games. In: Workshop on Assessing and Adapting to User Attitudes and Affect: Why, When and How (2003)
Arroyo, I., Cooper, D., Burleson, W., Woolf, B., Muldner, K., Christopherson, R.: Emotion Sensors go to School (2009)
Narciss, S.: Motivational Effects of the Informativeness of Feedback (1999)
Graesser, A., Chipman, P., Haynes, B., Olney, A.: AutoTutor: An intelligent tutoring system with mixed-initiative dialogue. IEEE Transactions on Education 48, 612–618 (2005)
D’Mello, S., Picard, R., Graesser, A.: Toward an Affect-Sensitive AutoTutor. IEEE Intelligent Systems 22, 53–61 (2007)
Witten, I.H., Frank, E.: Data Mining: Practical Machine Learning Tools and Techniques, 2nd edn. Morgan Kaufmann Series in Data Management Systems. Morgan Kaufmann, San Francisco (2005)
Platt, J.: Machines using Sequential Minimal Optimization. In: Schoelkopf, B., Burges, C., Smola, A. (eds.) Advances in Kernel Methods - Support Vector Learning (1998)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, New York (2001)
Calvo, R.A., Brown, I., Scheding, S.: Effect of Experimental Factors on the Recognition of Affective Mental States Through Physiological Measures. In: Nicholson, A., Li, X. (eds.) AI 2009. LNCS, vol. 5866. Springer, Heidelberg (2009)
Lang, P.J., Greenwald, M., Bradley, M.M., Hamm, A.O.: Looking at pictures: Evaluative, facial, visceral, and behavioral responses, vol. 30, pp. 261–274 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Aghaei Pour, P., Hussain, M.S., AlZoubi, O., D’Mello, S., Calvo, R.A. (2010). The Impact of System Feedback on Learners’ Affective and Physiological States. In: Aleven, V., Kay, J., Mostow, J. (eds) Intelligent Tutoring Systems. ITS 2010. Lecture Notes in Computer Science, vol 6094. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13388-6_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-13388-6_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13387-9
Online ISBN: 978-3-642-13388-6
eBook Packages: Computer ScienceComputer Science (R0)