Abstract
In SAIBA-compliant agent systems, the Function Markup Language (FML) is used to describe the agent’s communicative functions that are transformed into utterances accompanied with appropriate non-verbal behaviours. In the context of the ARIA Framework, we propose a template-based approach, grounded in the DIT++ taxonomy, as an interface between the dialogue manager (DM) and the non-verbal behaviour generation (NVBG) components of this framework. Our approach enhances our current FML-APML implementation of FML with the capability of receiving on-the-fly generated natural language and socio-emotional parameters (e.g. emotional stance) for transforming the agent’s intents in believable verbal and non-verbal behaviours in an adaptive manner.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
References
Aylett, M.P., Pidcock, C.J.: The cerevoice characterful speech synthesiser SDK. In: Pelachaud, C., Martin, J.-C., André, E., Chollet, G., Karpouzis, K., Pelé, D. (eds.) IVA 2007. LNCS (LNAI), vol. 4722, pp. 413–414. Springer, Heidelberg (2007). doi:10.1007/978-3-540-74997-4_65
Bruijnes, M.: Believable suspect agents: response and interpersonal style selection for an artificial suspect. Ph.D. thesis, University of Twente (2016). sIKS dissertation no. 2016–39
Bunt, H., Alexandersson, J., Choe, J.W., Fang, A.C., Hasida, K., Petukhova, V., Popescu-Belis, A., Traum, D.R.: Iso 24617–2: A semantically-based standard for dialogue annotation. In: LREC, pp. 430–437 (2012)
Cafaro, A., Vilhjálmsson, H.H., Bickmore, T., Heylen, D., Pelachaud, C.: Representing communicative functions in saiba with a unified function markup language. In: Bickmore, T., Marsella, S., Sidner, C. (eds.) IVA 2014. LNCS (LNAI), vol. 8637, pp. 81–94. Springer, Cham (2014). doi:10.1007/978-3-319-09767-1_11
Goldberg, L.R.: An alternative “description of personality”: the big-five factor structure. Journal of Personality and Social Psychology 59(6), 1216–1229 (1990)
Keizer, S., Bunt, H., Petukhova, V.: Multidimensional dialogue management. In: van den Bosch, A., Bouma, G. (eds.) Interactive Multi-modal Question-Answering, pp. 57–86. Springer (2011)
Kopp, S., Krenn, B., Marsella, S., Marshall, A.N., Pelachaud, C., Pirker, H., Thórisson, K.R., Vilhjálmsson, H.: Towards a common framework for multimodal generation: the behavior markup language. In: Gratch, J., Young, M., Aylett, R., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 205–217. Springer, Heidelberg (2006). doi:10.1007/11821830_17
Larsson, S., Traum, D.R.: Information state and dialogue management in the TRINDI Dialogue Move Engine Toolkit. Natural Language Engineering 6(3&4), 323–340 (2000)
Leuski, A., Traum, D.: NPCEditor: Creating Virtual Human Dialogue Using Information Retrieval Techniques. AI Magazine 32(2), 42–56 (2011)
Lison, P.: Structured probabilistic modelling for dialogue management. Ph.D. thesis, University of Oslo (2013)
ter Maat, M., Heylen, D.: Flipper: an information state component for spoken dialogue systems. In: Vilhjálmsson, H.H., Kopp, S., Marsella, S., Thórisson, K.R. (eds.) IVA 2011. LNCS (LNAI), vol. 6895, pp. 470–472. Springer, Heidelberg (2011). doi:10.1007/978-3-642-23974-8_67
Mairesse, F., Walker, M.: PERSONAGE: personality generation for dialogue. In: Proceedings of the 45th Annual Meeting of the Association of Computational Linguistics, vol. 45, pp. 496–503. Association for Computational Linguistics (2007)
Mancini, M., Pelachaud, C.: The FML-APML language. In: Why Conversational Agents do what they do. Workshop on Functional Representations for Generating Conversational Agents Behavior at AAMAS (2008)
Morbini, F., DeVault, D., Sagae, K., Gerten, J., Nazarian, A., Traum, D.: FLoReS: a forward looking, reward seeking, dialogue manager. In: Natural Interaction with Robots, Knowbots and Smartphones, pp. 313–325. Springer (2014)
Ochs, M., Sabouret, N., Corruble, V.: Simulation of the dynamics of nonplayer characters’ emotions and social relations in games. IEEE Transactions on Computational Intelligence and AI in Games 1(4), 281–297 (2009)
Poggi, I.: Mind, hands, face and body: A goal and belief view of multimodal communication. Weidler Buchverlag Berlin (2007)
Rich, C., Sidner, C.L.: Using Collaborative Discourse Theory to Partially Automate Dialogue Tree Authoring. In: Nakano, Y., Neff, M., Paiva, A., Walker, M. (eds.) IVA 2012. LNCS (LNAI), vol. 7502, pp. 327–340. Springer, Heidelberg (2012). doi:10.1007/978-3-642-33197-8_34
Wagner, J., Lingenfelser, F., Baur, T., Damian, I., Kistler, F., André, E.: The social signal interpretation (SSI) framework: multimodal signal processing and recognition in real-time. In: Proceedings of the 21st ACM International Conference on Multimedia, pp. 831–834 (2013)
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Cafaro, A., Bruijnes, M., van Waterschoot, J., Pelachaud, C., Theune, M., Heylen, D. (2017). Selecting and Expressing Communicative Functions in a SAIBA-Compliant Agent Framework. In: Beskow, J., Peters, C., Castellano, G., O'Sullivan, C., Leite, I., Kopp, S. (eds) Intelligent Virtual Agents. IVA 2017. Lecture Notes in Computer Science(), vol 10498. Springer, Cham. https://doi.org/10.1007/978-3-319-67401-8_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-67401-8_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-67400-1
Online ISBN: 978-3-319-67401-8
eBook Packages: Computer ScienceComputer Science (R0)