Skip to main content

Toward Alignment with a Virtual Human - Achieving Joint Attention

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 5243))

Abstract

Alignment forms the basis of successful communication. It can be seen as the most efficient means for action coordination of cooperating agents, covering adaptation processes operating without an explicit exchange of information states. One critical condition of alignment consists of joint attention. We present work on equipping a virtual human with the capability of reaching joint attention with its human interlocutor. On the one hand, mechanisms to detect the human’s focus of attention are employed. On the other hand, basic cognitive as well as intentional processes underlying the phenomenon of joint attention are incorporated in our agent’s cognitive architecture. In this context, a dynamic working memory and a partner model accounting for theory of mind and intentionality are crucial constituents.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   89.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Pickering, M.J., Garrod, S.: Alignment as the basis for successful communication. Research on Language and Computation 4(2), 203–228 (2006)

    Article  Google Scholar 

  2. Deak, G.O., Fasel, I., Movellan, J.: The emergence of shared attention: Using robots to test developmental theories. In: Proc. of the First Intl. Workshop on Epigenetic Robotics. Lund University Cognitive Studies, vol. 85, pp. 95–104 (2001)

    Google Scholar 

  3. Tomasello, M., Carpenter, M., Call, J., Behne, T., Moll, H.: Understanding and sharing intentions: The origins of cultural cognition. Behavioral and Brain Sciences 28, 675–691 (2005)

    Google Scholar 

  4. Leßmann, N., Kopp, S., Wachsmuth, I.: Situated interaction with a virtual human - perception, action, and cognition. In: Rickheit, G., Wachsmuth, I. (eds.) Situated Communication, pp. 287–323. Mouton de Gruyter, Berlin (2006)

    Google Scholar 

  5. Brinck, I.: The objects of attention. In: Proc. of ESPP 2003, Torino, pp. 1–4 (2003)

    Google Scholar 

  6. Cohen, J., Aston-Jones, G., Gilzenrat, M.: A systems-level perspective on attention and cognitive control. In: Posner, M. (ed.) Cognitive Neuroscience of Attention, pp. 71–90. Guilford Publications, New York (2004)

    Google Scholar 

  7. Posner, M., Petersen, S.: The attention system of the human brain. Annu. Rev. Neurosci. 13, 25–42 (1990)

    Article  Google Scholar 

  8. Nuku, P., Bekkering, H.: Joint attention: Inferring what others perceive (and don’t perceive). Conscious and Cognition 17(1), 339–349 (2008)

    Article  Google Scholar 

  9. Hobson, R.P.: What puts the jointness into joint attention? In: Eilan, N., Hoerl, C., McCormack, T., Roessler, J. (eds.) Joint attention: communication and other minds, pp. 185–204. Oxford University Press, Oxford (2005)

    Google Scholar 

  10. Courtney, S.M.: Attention and cognitive control as emergent properties of information representation in working memory. Cognitive, Affective & Behavioral Neuroscience 4(4), 501–516 (2004)

    Article  Google Scholar 

  11. Cowan, N.: An embedded-processes model of working memory. In: Miyake, A., Shah, P. (eds.) Models of Working Memory, Mechanisms of Active Maintenance and Executive Control, pp. 62–102. Cambridge University Press, Cambridge (1999)

    Google Scholar 

  12. Oberauer, K.: Access to information in working memory: Exploring the focus of attention. J. of Exp. Psych.: Learning, Memory, and Cognition 28, 411–421 (2002)

    Article  Google Scholar 

  13. Baron-Cohen, S.: The eye-direction detector (edd) and the shared attention mechanism (sam): two cases for evolutionary psychology. In: Moore, C., Dunham, P. (eds.) Joint Attention: Its origins and role in development, pp. 41–61. L. Erlbaum, Mahwah (1994)

    Google Scholar 

  14. Tomasello, M.: Joint attention as social cognition. In: Moore, C., Dunham, P. (eds.) Joint Attention: Its origin and role in development, pp. 103–128. L. Erlbaum, Mahwah (1995)

    Google Scholar 

  15. Kim, Y., Hill, R.W., Traum, D.R.: Controlling the focus of perceptual attention in embodied conversational agents. In: Proceedings AAMAS, pp. 1097–1098 (2005)

    Google Scholar 

  16. Gu, E., Badler, N.I.: Visual attention and eye gaze during multiparty conversations with distractions. In: Gratch, J., Young, M., Aylett, R.S., Ballin, D., Olivier, P. (eds.) IVA 2006. LNCS (LNAI), vol. 4133, pp. 193–204. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  17. Nagai, Y., Hosoda, K., Morita, A., Asada., M.: A constructive model for the development of joint attention. ConnectionScience 15(4), 211–229 (2003)

    Article  Google Scholar 

  18. Doniec, M., Sun, G., Scassellati, B.: Active learning of joint attention. In: IEEE/RSJ International Conference on Humanoid Robotics (2006)

    Google Scholar 

  19. Ogasawara, Y., Okamoto, M., Nakano, Y., Nishida, T.: Establishing natural communication environment between a human and a listener robot. In: AISB Symposium on Conversational Informatics, pp. 42–51 (2005)

    Google Scholar 

  20. Breazeal, C., Brooks, A., Gray, J., Hoffman, G., Kidd, C., Lee, H., Lieberman, J., Lockerd, A., Chilongo, D.: Tutelage and collaboration for humanoid robots. International Journal of Humanoid Robots 1(2), 315–348 (2004)

    Article  Google Scholar 

  21. Kaplan, F., Hafner, V.: The challenges of joint attention. Interaction Studies 7(2), 135–169 (2006)

    Article  Google Scholar 

  22. Rao, A., Georgeff, M.: Modeling rational behavior within a BDI-architecture. In: Proc. Intl. Conf. on Principles of Knowledge Repr. and Planning, pp. 473–484 (1991)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Andreas R. Dengel Karsten Berns Thomas M. Breuel Frank Bomarius Thomas R. Roth-Berghofer

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Pfeiffer-Leßmann, N., Wachsmuth, I. (2008). Toward Alignment with a Virtual Human - Achieving Joint Attention. In: Dengel, A.R., Berns, K., Breuel, T.M., Bomarius, F., Roth-Berghofer, T.R. (eds) KI 2008: Advances in Artificial Intelligence. KI 2008. Lecture Notes in Computer Science(), vol 5243. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-85845-4_36

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-85845-4_36

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-85844-7

  • Online ISBN: 978-3-540-85845-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics