Abstract
We discuss here the need to define what we call an agent conversational language, a language for Embodied Conversational Agents (ECA) to have conversations with a human. We propose a set of Expressive Multimodal Conversation Acts (EMCA), which is based on the Expressive Speech Acts that we introduced in a previous work, enriched with the multimodal expression of the emotions linked to these acts. We have then implemented these EMCA for SAIBA-compliant ECA, and specifically for Greta. We were able to use Greta in experiments aimed at assessing the benefits of our language in terms of perceived sincerity and believability of an ECA using it to interact with a human user.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bunt, H.: The dit++ taxonomy for functional dialogue markup. In: Proc. of AMAAS 2009 Workshop ”Towards a Standard Markup Language for Embodied Dialogue Acts” (2009)
Core, M.G., Allen, J.F.: Coding dialogs with the DAMSL annotation scheme. In: Proc. of the Working Notes of the AAAI Fall Symposium on Communicative Action in Humans and Machines, Cambridge, MA (1997)
Gebhard, P., Kipp, M., Klesen, M., Rist, T.: Adding the emotional dimension to scripting character dialogues. In: Rist, T., Aylett, R.S., Ballin, D., Rickel, J. (eds.) IVA 2003. LNCS (LNAI), vol. 2792, pp. 48–56. Springer, Heidelberg (2003)
Gong, L.: How social is social responses to computers? the function of the degree of anthropomorphism in computer representations. Comput. Hum. Behav. 24, 1494–1509 (2008)
Guiraud, N., Longin, D., Lorini, E., Pesty, S., Riviere, J.: The face of emotions: a logical formalization of expressive speech acts. In: Proc. of AAMAS 2011 (2011)
Lee, J., Marsella, S.: Nonverbal behavior generator for embodied conversational agents. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 243–255. Springer, Heidelberg (2006)
Lorini, E., Schwarzentruber, F.: A logic for reasoning about counterfactual emotions. Artificial Intelligence 175(3-4), 814–847 (2011)
Mancini, M., Pelachaud, C.: The fml-apml language. In: Proc. of the Workshop on FML at AAMAS 2008 (2008)
McRorie, M., Sneddon, I., de Sevin, E., Bevacqua, E., Pelachaud, C.: A model of personality and emotional traits. In: Ruttkay, Z., Kipp, M., Nijholt, A., Vilhjálmsson, H.H. (eds.) IVA 2009. LNCS, vol. 5773, pp. 27–33. Springer, Heidelberg (2009)
Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., Carolis, B.D.: Greta: A believable embodied conversational agent. In: Multimodal Communication in Virtual Environments, pp. 27–45 (2005)
Searle, J.R.: Speech acts: an essay in the philosophy of language. Cambridge University Press, London (1969)
Vilhjálmsson, H.H., Cantelmo, N., Cassell, J., Chafai, N.E., Kipp, M., Kopp, S., Mancini, M., Marsella, S.C., Marshall, A.N., Pelachaud, C., Ruttkay, Z., Thórisson, K.R., van Welbergen, H., van der Werf, R.J.: The behavior markup language: Recent developments and challenges. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 99–111. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Riviere, J. et al. (2011). Expressive Multimodal Conversational Acts for SAIBA Agents. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds) Intelligent Virtual Agents. IVA 2011. Lecture Notes in Computer Science(), vol 6895. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23974-8_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-23974-8_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23973-1
Online ISBN: 978-3-642-23974-8
eBook Packages: Computer ScienceComputer Science (R0)