Abstract
We describe the work on infusion of emotion into limited-task autonomous spoken conversational agents (SCAs) situated in the domestic environment, using a Need-inspired task-independent Emotion model (NEMO). In order to demonstrate the generation of affect through the use of the model, we describe the work of integrating it with a natural-language mixed-initiative HiFi-control SCA. NEMO and the host system communicates externally, removing the need for the Dialog Manager to be modified as done in most existing dialog systems, in order to be adaptive. We also summarize the work on automatic affect prediction, namely frustration and contentment from dialog features, a non-conventional source, in the attempt of moving towards a more user-centric approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bailey, J.E., Pearson, S.W.: Development of a tool for measuring and analyzing computer user satisfaction. Management Science 24, 530–545 (1983)
Barra-Chicote, R., Yamagishi, J., King, S., Montero, J.M., Macias-Guarasa, J.: Analysis of statistical parametric and unit selection speech synthesis systems applied to emotional speech. Speech Commun. 52(5), 394–404 (2010)
Callejas, Z., López-Cózar, R.: On the Use of Kappa Coefficients to Measure the Reliability of the Annotation of Non-acted Emotions. In: André, E., Dybkjær, L., Minker, W., Neumann, H., Pieraccini, R., Weber, M. (eds.) PIT 2008. LNCS (LNAI), vol. 5078, pp. 221–232. Springer, Heidelberg (2008)
D’Mello, S.K., Craig, S.D., Witherspoon, A., McDaniel, B., Graesser, A.: Automatic detection of learner’s affect from conversational cues. User Model User-Adap. Inter. 18, 45–80 (2008)
Doll, W.J., Torkzadeh, G.: The measurement of end-user computing satisfaction. MIS Quarterly 12, 259–274 (1988)
Ekman, P., Friesen, W.: The Facial Action Coding System: A technique for the measurement of facial movement. Consulting Psychologists Press (1978)
Fernández-Martínez, F., Bläzquez, J., Ferreiros, J., Barra-Chicote, R., Macias-Guarasa, J., Lucas-Cuesta, J.M.: Evaluation of a spoken dialog system for controlling a hifi audio system. In: Proceedings of the IEEE Workshop on Spoken Language Technology, Goa, India (2008)
Fernández-Martínez, F., Ferreiros, J., Lucas-Cuesta, J.M., Echeverry, J.D., San-Segundo, R., Córdoba, R.: Flexible, robust and dynamic dialogue modeling with a speech dialogue interface for controlling a hi-fi audio system. In: Proceedings of the IEEE Workshop on Database and Expert Systems Applications (DEXA 2010). Springer, Bilbao (2010)
Fernández-Martínez, F., Lucas-Cuesta, J.M., Chicote, R.B., Ferreiros, J., Macías-Guarasa, J.: HIFI-AV: An audio-visual corpus for spoken language human-machine dialogue research in Spanish. In: Proceedings of the Seventh Conference on International Language Resources and Evaluation (LREC 2010), European Language Resources Association (ELRA), Valletta, Malta (May 2010)
Gelbrich, K.: Beyond just being dissatisfied: How angry and helpless customers react to failures when using self-service technologies. Schmalenbach Business Review 61, 40–59 (2009)
Kernbach, S., Schutte, N.S.: The impact of service provider emotional intelligence on customer satisfaction. Journal of Services Marketing 19(7), 438–444 (2005)
Locke, E.A.: The nature and causes of job satisfaction. Consulting Psychologists Press, Palo Alto (1976)
Lutfi, S., Barra-Chicote, R., Lucas-Cuesta, J., Montero, J.: Nemo: Need-inspired emotional expressions within a task-independent framework. In: Proc.of Brain Inspired Cognitive Systems (BICS), Madrid, Spain (July 2010)
Sanz-Moreno, C., Lutfi, S., Barra-Chicote, R., Lucas-Cuesta, J., Montero, J.: Desarrollo de un asistente domótico emocional inteligente. In: XIX Jornadas Telecom I+D, Madrid, Spain (November 2009)
Witten, I.H., Frank, E.: Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann, San Francisco (2005)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lutfi, S.L., Fernández-Martínez, F., Casanova-García, A., López-Ludeña, V., Montero, J.M. (2012). I Feel You: Towards Affect-Sensitive Domotic Spoken Conversational Agents. In: Bravo, J., Hervás, R., Rodríguez, M. (eds) Ambient Assisted Living and Home Care. IWAAL 2012. Lecture Notes in Computer Science, vol 7657. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35395-6_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-35395-6_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35394-9
Online ISBN: 978-3-642-35395-6
eBook Packages: Computer ScienceComputer Science (R0)