Abstract
In Social Robotics, being able to interact with users in a natural way is a key feature. To achieve this, we need to model dialogues that allow the robot to complete its tasks and to adapt to unforeseen changes in the conversation. We present an approach where these dialogues are modelled as a combination of basic interaction units, called Communicative Acts or CAs. With this, our system aims to provide all the necessary tools so each of the robot’s applications can tailor their own dialogues in a simplier way. These applications make the decisions that need task-related information and request the activation of the CAs in order to create complex dialogues. The CAs handle decisions that require communication-related information (e.g. giving the user some information, or asking a question). They also manage some of the problems that can appear in any interaction, like not being able to understand the other peer, or not getting an answer to a question. A case study associated to a cognitive stimulation exercise is presented in this paper to validate our system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Alonso-Martin, F., Castro-González, Á., Gorostiza, J.F., Salichs, M.A.: Multidomain voice activity detection during human-robot interaction. In: Herrmann, G., Pearson, M.J., Lenz, A., Bremner, P., Spiers, A., Leonards, U. (eds.) ICSR 2013. LNCS, vol. 8239, pp. 64–73. Springer, Cham (2013). https://doi.org/10.1007/978-3-319-02675-6_7
Alonso Martín, F., Castro-González, A., Fernandez de Gorostiza Luengo, F.J., Salichs, M.A.: Augmented robotics dialog system for enhancing human-robot interaction. Sensors (Basel, Switzerland) 15, 15799–15829 (2015)
Asoh, H., Matsui, T., Fry, J., Asano, F., Hayamizu, S.: A spoken dialog system for a mobile office robot. In: Proceedings of Eurospeech, Budapest, pp. 1139–1142 (1999)
Bohus, D., Rudnicky, A.I.: The RavenClaw dialog management framework: architecture and systems. Comput. Speech Lang. 23(3), 332–361 (2009)
Castro-González, Á., Malfaz, M., Salichs, M.A.: Learning the selection of actions for an autonomous social robot by reinforcement learning based on motivations. Int. J. Soc. Robot. 3(4), 427–441 (2011). https://doi.org/10.1007/s12369-011-0113-z
Fodor, P.: Dialog management for decision processes. In: Proceedings of the 3rd Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics, Poznan, Poland, pp. 1–4 (2007)
Lemon, O., Bracy, A., Gruenstein, A., Peters, S.: The WITAS multi-modal dialogue system I. In: Proceedings of INTERSPEECH, pp. 1559–1562 (2001)
Nguyen, A., Wobcke, W.: An agent-based approach to dialogue management in personal assistants. In: Proceedings of International Conference on Intelligent User Interfaces (IUI) (2005)
Niklasson, A.: Dialogue systems using web-based language tools. Master’s thesis in Computing Science, Umea University, Sweden (2017)
Salichs, E., Castro-González, Á., Malfaz, M., Salichs, M.A.: Mini: a social assistive robot for people with mild cognitive impairment. New Friends, 31–32 (2016). ISBN 978-84-945603-9-2
Souvignier, B., Kellner, A., Rueber, B., Schramm, H., Seide, F.: The thoughtful elephant: strategies for spoken dialog systems. IEEE Trans. Speech Audio Process. 8(1), 51–62 (2000)
Spiliotopoulos, D., Androutsopoulos, I., Spyropoulos, D.C.: Human-robot interaction based on spoken natural language dialogue. In: Proceedings of European Workshop on Service and Humanoid Robots, Santorini (2001)
Acknowledgment
The research leading to these results has received funding from the projects: Development of social robots to help seniors with cognitive impairment (ROBSEN), funded by the Ministerio de Economia y Competitividad; and RoboCity2030-III-CM, funded by Comunidad de Madrid and cofunded by Structural Funds of the EU.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Fernández-Rodicio, E., Castro-González, Á., Castillo, J.C., Alonso-Martin, F., Salichs, M.A. (2018). Composable Multimodal Dialogues Based on Communicative Acts. In: Ge, S., et al. Social Robotics. ICSR 2018. Lecture Notes in Computer Science(), vol 11357. Springer, Cham. https://doi.org/10.1007/978-3-030-05204-1_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-05204-1_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05203-4
Online ISBN: 978-3-030-05204-1
eBook Packages: Computer ScienceComputer Science (R0)