Abstract
This paper presents a model of contextual awareness implemented for a social communicative robot Leolani. Our model starts from the assumption that robots and humans need to establish a common ground about the world they share. This is not trivial as robots make many errors and start with little knowledge. As such, the context in which communication takes place can both help and complicate the interaction: if the context is interpreted correctly it helps in disambiguating the signals, but if it is interpreted wrongly it may distort interpretation. We defined the surrounding world as a spatial context, the communication as a discourse context and the interaction as a social context, which are all three interconnected and have an impact on each other. We model the result of the interpretations as symbolic knowledge (RDF) in a triple store to reason over the result, detect conflicts, uncertainty and gaps. We explain how our model tries to combine the contexts and the signal interpretation and we mention future directions of research to improve this complex process.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
Resource Description Framework.
- 2.
In the future, we plan to use properties of objects (both perceived and communicated) to help to further separate different instances, e.g. green chair or my chair is close by me.
References
Amos, B., Ludwiczuk, B., Satyanarayanan, M.: Openface: a general-purpose face recognition library with mobile applications. Technical report, CMU-CS-16-118, CMU School of Computer Science (2016)
Project authors, T.W.: Webrtc. In: Online publication (2011). https://webrtc.org/
Byron, D.: Understanding referring expressions in situated language: some challenges for real-world agents. In: Proceedings of the First International Workshop on Language Understanding and Agents for the Real World, pp. 80–87. Citeseer (2003)
Clark, H.H., Marshall, C.R.: Definite reference and mutual knowledge. In: Psycholinguistics: Critical Concepts in Psychology, vol. 414 (2002)
Fokkens, A., Vossen, P., Rospocher, M., Hoekstra, R., van Hage, W.: Grasp: grounded representation and source perspective. In: Proceedings of KnowRSH, RANLP-2017 workshop, Varna, Bulgaria (2017)
Frege, G.: Über sinn und bedeutung. Reclam, Philipp (2019)
Google: Cloud speech-to-text - speech recognition. In: Online publication (2018). https://cloud.google.com/speech-to-text/
Grice, H.P.: Logic and conversation. 1975, pp. 41–58 (1975)
Kelleher, J.D., Dobnik, S.: Referring to the recently seen: reference and perceptual memory in situated dialog (2019)
Kelleher, J.D., Dobnik, S.: Referring to the recently seen: reference and perceptual memory in situated dialog. arXiv preprint arXiv:1903.09866 (2019)
Kolbe, N., Zaslavsky, A., Kubler, S., Robert, J., Le Traon, Y.: Enriching a situation awareness framework for IoT with knowledge base and reasoning components. In: Brézillon, P., Turner, R., Penco, C. (eds.) CONTEXT 2017. LNCS (LNAI), vol. 10257, pp. 41–54. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-57837-8_4
Leslie, A.: Pretense and representation: The origins of “theory of mind”. Psychol. Rev. 94(4), 412 (1987)
Masolo, C., Borgo, S., Gangemi, A., Guarino, N., Oltramari, A.: Wonderweb deliverable d17. Comput. Sci. Prepr. Arch. 2002(11), 74–110 (2002)
Mavridis, N.: A review of verbal and non-verbal human-robot interactive communication. Robot. Auton. Syst. 63, 22–35 (2015)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in Neural Information Processing Systems, pp. 3111–3119 (2013)
Pennington, J., Socher, R., Manning, C.: Glove: global vectors for word representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1532–1543 (2014)
Szegedy, C., et al.: Going deeper with convolutions. In: Computer Vision and Pattern Recognition (CVPR) (2015). http://arxiv.org/abs/1409.4842
Vossen, P., Baez, S., Bajc̆etić, L., Bas̆ić, S., Kraaijeveld, B.: A communicative robot to learn about us and the world. In: Proceedings of Dialogue-2019, Moscow (2019)
Vossen, P., Baez, S., Bajc̆etić, L., Kraaijeveld, B.: Leolani: a reference machine with a theory of mind for social communication. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds.) TSD 2018. LNCS (LNAI), vol. 11107, pp. 15–25. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00794-2_2
Acknowledgement
This project was funded through the NWO-Spinoza funds awarded to Piek Vossen and by the VU University of Amsterdam. We specifically thanks Selene Kolman and Bob van Graft for their support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Vossen, P., Bajčetić, L., Baez, S., Bašić, S., Kraaijeveld, B. (2019). Modelling Context Awareness for a Situated Semantic Agent. In: Bella, G., Bouquet, P. (eds) Modeling and Using Context. CONTEXT 2019. Lecture Notes in Computer Science(), vol 11939. Springer, Cham. https://doi.org/10.1007/978-3-030-34974-5_20
Download citation
DOI: https://doi.org/10.1007/978-3-030-34974-5_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-34973-8
Online ISBN: 978-3-030-34974-5
eBook Packages: Computer ScienceComputer Science (R0)