Abstract
Robot software tend to be complex due to management of sensors and actuators in real time facing uncertainty and noise and the more complex tasks to realize in different situations like the human robot multimodal interaction task. This implies a large amount of events to exchange and to process. Robotics intelligent Architecture must be well-conceived to reduce this complexity. Information must be well organized and meaning of situation must be quickly extracted to take decision. Meaning of the situation and situation refinement require the development of a description of the current relationships among entities and events in the environment context. Extraction of meaning and ontological storage of events are very important for interpretation. Human Robot Interaction involves three main parts: awareness and acquisition context, interpretation context and execution context. They define scenarios of multimodal interaction to realize the precondition part called fusion, and the post condition part called fission. In the aim to solve the above problem, we have designed a new architecture using semantic agents and services. We propose in this chapter, simple and efficient components to any multimodal interaction architecture requirements and universal, compliant and generic architecture using a common knowledge representation language. Our framework is designed for high level data fusion, fission and components management. We don’t focus on hardware parts, sensors and actuators. Semantic knowledge is expressed in domain ontologies that permit to extract the situational meaning about any entities in the environment, monitor and adapt the architecture if necessary. In this objective, we apply a narrative knowledge representation language to the memory of agents in a distributed network. We also present the structure and extension of the network for agents to act in ubiquitous environments.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allan R.J.: Survey of Agent Based Modeling and Simulation Tools. Technical Report. STFC (2008-2009), http://epubs.cclrc.ac.uk/work-details?w=50398 , http://epubs.cclrc.ac.uk/bitstream/3637/ABMS.pdf
Benta, K.-L., Hoszu, A., Vacariu, L., Cret, O.: Agent Based Smart House Platform with Affective Control. In: EATIS 2009, Prague, CZ, June 3-5, Art. 18. ACM, New York (2009) ISBN:987-1-60558-398-3
Erik, B., Ivan, K., John, S., Kokar, M.M., Subrata, D., Powell, G.M., Orkill, D.D., Ruspini, E.H.: Issues and Challenges in Situation Assessment (Level 2 Fusion). Journal Of Advances In Information Fusion 1(2), 122–139 (2006)
Silvia, C., Amy, L.: A review of Past and Future Trends in Perceptual Anchoring. In: Fritze, P. (ed.) Tools in Artificial Intelligence. I-Tech Education and Publishing, Vienna (2008)
Guarino, N.: Formal ontology, conceptual analysis and knowledge representation. Human-Computer Studies 43(5/6), 625–640 (1995)
Manuel, G., Alois, K.: MultiML - A General Purpose Representation Language for Multimodal Human Utterances. In: ICMI 2008, Chania, Crete, Greece (2008)
Michael, J.: Building Multimodal Applications with EMMA. In: ICMI-MLMI 2009, Cambridge, MA, USA, November 2-4, pp. 47–54. ACM, New York (2009) ISBN: 978-1-60558-772-1/09/11
Michael, J., Paolo, B., Burnett Daniel, C., Jerry, C., Dahl Deborah, A., Gerry, M., Dave, R.: EMMA: Extensible MultiModal Annotation markup language. W3C Recommendation (February 2009)
Kranstedt, A., Kopp, S., Wachsmuth, I.: Murml: A multimodal utterance representation markup language for conversational agents. In: Proceedings of the AAMAS, Workshop on Embodied Conversational Agents - Let’s Specify and Evaluate them!, Bologna, Italy, July 16 (2002)
Jun-young, K., Young, Y.J., Shinn Richard, H.: An Intelligent Robot Architecture based on Robot Mark-up Languages. In: Proceedings of IEEE International Conference in Engineering of Intelligent Systems, pp. 1–6 (2006)
Frédéric, L.: Physical, semantic and pragmatics levels for multimodal fusion and fission. In: Seventh International Workshop on Computational Semantic (IWCS 2007), Tilburg, The Netherlands, pp. 346–350 (2007)
Frédéric, L., Denis A., Ricci A., Romary L.: Multimodal meaning representation for generic dialogue systems architectures. In: Proceedings on Language Resources and Evaluation (LREC 2004), pp. 521–524 (2004)
Macal Charles, M., North Michael, J.: Tutorial on agent-based modeling and simulation part 2: How to model with agents. In: Perrone, L.F., Wieland, F.P., Liu, J., Lawson, B.G., Nicol, D.M., Fujimoto, R.M. (eds.) Proceedings of the 2006 Winter Simulation Conference, Monterey, CA, USA, December 3, pp. 73–83 (2006)
Marvin, M.: Matter, Mind and Models. In: Proceedings of IFIP Congress, May 1965, pp. 45–49. Spartan Books, Washington D.C (1965); Reprinted in Semantic Information Processing
Leo, O.: Ontologies for semantically Interoperable Systems. In: Proceedings of the twelfth International Conference on Information and Knowledge Management, New Orleans. LA, USA, pp. 366–369. ACM Press, New York (2003) ISBN: 1-58113-723-0
Ross, Q.: Semantic memory. Ph.D. thesis, Carnegie Intstitute of Technology (1966); In: Minsky, M. (ed.) Semantic Information Processing, pp. 227–270. MIT Press, Cambridge (1968)
Mark, S., Jason, B.: Combinatory Categorial Grammar. In: Borsley, R., Borjars, K. (eds.) Non-Transformational Syntax. Blackwell, Malden (2005)
Subercaze, J., Maret, P.: SAM: Semantic Agent Model for SWRL rule-based agents. In: Proceedings of the International Conference on Agents and Artificial Intelligence, Valencia, Spain. Agents, vol. 2, pp. 244–248. INSTICC Press (2010) ISBN 978-989-674-022-1
Piero, Z.G.: Representation and Processing of Complex Events. In: Association for the Advancement of Artificial Intelligence AAAI Spring Symposium (2009a)
Piero, Z.G.: Representation and Management of Narrative Information: Theorical Principles and Implementation. In: Jain, L., Wu, X. (eds.) vol. 1, pp. 978–971. Springer, Heidelberg (2009b) ISBN:978-1.84800-078-0_1
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Dourlens, S., Ramdane-Chérif, A. (2011). Semantic Architecture for Human Robot Interaction. In: Elçi, A., Koné, M.T., Orgun, M.A. (eds) Semantic Agent Systems. Studies in Computational Intelligence, vol 344. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-18308-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-642-18308-9_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-18307-2
Online ISBN: 978-3-642-18308-9
eBook Packages: EngineeringEngineering (R0)