Skip to main content

Imitation and Mechanisms of Joint Attention: A Developmental Structure for Building Social Skills on a Humanoid Robot

  • Conference paper
  • First Online:
Computation for Metaphors, Analogy, and Agents (CMAA 1998)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1562))

Abstract

Adults are extremely adept at recognizing social cues, such as eye direction or pointing gestures, that establish the basis of joint attention. These skills serve as the developmental basis for more complex forms of metaphor and analogy by allowing an infant to ground shared experiences and by assisting in the development of more complex communication skills. In this chapter, we review some of the evidence for the developmental course of these joint attention skills from developmental psychology, from disorders of social development such as autism, and from the evolutionary development of these social skills. We also describe an on-going research program aimed at testing existing models of joint attention development by building a human-like robot which communicates naturally with humans using joint attention.

Our group has constructed an upper-torso humanoid robot, called Cog, in part to investigate how to build intelligent robotic systems by following a developmental progression of skills similar to that observed in human development. Just as a child learns social skills and conventions through interactions with its parents, our robot will learn to interact with people using natural social communication. We further consider the critical role that imitation plays in bootstrapping a system from simple visual behaviors to more complex social skills. We will present data from a face and eye finding system that serves as the basis of this developmental chain, and an example of how this system can imitate the head movements of an individual.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baron-Cohen, S. (1995), Mindblindness, MIT Press.

    Google Scholar 

  2. Brooks, R.& Stein, L.A. (1994), ‘Building Brains for Bodies’, Autonomous Robots 1:1, 7–25.

    Article  Google Scholar 

  3. Brooks, R.A., Ferrell, C., Irie, R., Kemp, C. C., Marjanovic, M., Scassellati, B. & Williamson, M. (1998), Alternative Essences of Intelligence, in ‘Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98)’, AAAI Press.

    Google Scholar 

  4. Burghardt, G.M. & Greene, H.W. (1990), ‘Predator Simulation and Duration of Death Feigning in Neonate Hognose Snakes’, Animal Behaviour 36(6), 1842–1843.

    Article  Google Scholar 

  5. Butterworth, G. (1991), The Ontogeny and Phylogeny of Joint Visual Attention, in A. Whiten, ed., ‘Natural Theories of Mind’, Blackwell.

    Google Scholar 

  6. Cheney, D.L. & Seyfarth, R.M. (1990), How Monkeys See the World, University of Chicago Press.

    Google Scholar 

  7. Cohen, D. J. & Volkmar, F. R., eds (1997), Handbook of Autism and Pervasive Developmental Disorders, second edn, John Wiley & Sons, Inc.

    Google Scholar 

  8. Dautenhahn, K. (1994), Trying to Imitate — A Step Towards Releasing Robots from Social Isolation, in ‘Proc. From Perception to Action Conference (Lausanne, Switzerland, Sept 7–9, 1994)’, IEEE Computer Society Press, pp. 290–301.

    Google Scholar 

  9. Dautenhahn, K. (1997), ‘could be you — the phenomenological dimension of social Understanding’, Cybernetics and Systems 25(8), 417–453.

    Article  Google Scholar 

  10. Dennett, D.C. (1991), Consciousness Explained, Little, Brown, & Company.

    Google Scholar 

  11. Diamond, A. (1990), Developmental Time Course in Human Infants and Infant Monkeys, and the Neural Bases, of Inhibitory Control in Reaching, in ‘Development and Neural Bases of Higher Cognitive Functions’, Vol. 608, New York Academy of Sciences, pp. 637–676.

    Google Scholar 

  12. DSM (1994), ‘Diagnostic and Statistical Manual of Mental Disorders’, American Psychiatric Association, Washington DC.

    Google Scholar 

  13. Frith, U. (1990), Autism: Explaining the Enigma, Basil Blackwell.

    Google Scholar 

  14. Hauser, M.D. (1996), Evolution of Communication, MIT Press.

    Google Scholar 

  15. Hayes, G.& Demiris, J. (1994), A Robot Controller Using Learning by Imitation, in A. Borkowski & J. L. Crowley, eds, ‘Proc. 2nd International Symposium on Intelligent Robotic Systems’, Grenoble, France: LIFTA-IMAG, pp. 198–204.

    Google Scholar 

  16. Hobson, R.P. (1993), Autism and the Development of Mind, Erlbaum.

    Google Scholar 

  17. ICD (1993), ‘The ICD-10 Classification of Mental and Behavioral Disorders: Diagnostic Criteria for Research’, World Health Organization (WHO), Geneva.

    Google Scholar 

  18. Jordan, M.I. & Rumelhart, D.E. (1992), ‘Forward Models: supervised learning with a distal teacher’, Cognitive Science 16, 307–354.

    Article  Google Scholar 

  19. Karmiloff-Smith, A., Klima, E., Bellugi, U., Grant, J. & Baron-Cohen, S. (1995), ‘Is there a social module? Language, face processing, and theory of mind in individuals with Williams Syndrome’, Journal of Cognitive Neuroscience 7:2, 196–208.

    Article  Google Scholar 

  20. Marjanović, M., Scassellati, B.& Williamson, M. (1996), Self-Taught Visually-Guided Pointing for a Humanoid Robot, in ‘From Animals to Animats 4: Proceedings of the Fourth International Conference on Simulation of Adaptive Behavior (SAB-96)’, Bradford Books, pp. 35–44.

    Google Scholar 

  21. Moore, C. & Dunham, P. J., eds (1995), Joint Attention: Its Origins and Role in Development, Erlbaum.

    Google Scholar 

  22. Povinelli D.J. & Preuss, T.M. (1995), ‘Theory of Mind: evolutionary history of a cognitive specialization’, Trends in Neuroscience.

    Google Scholar 

  23. Pratt, G.A. & Williamson, M.M. (1995), Series Elastic Actuators, in ‘Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-95)’, Vol. 1, Pittsburg, PA, pp. 399–406.

    Article  Google Scholar 

  24. Premack, D. (1988), “Does the chimpanzee have a theory of mind?” revisited, in R. Byrne & A. Whiten, eds, ‘Machiavellian Intelligence: Social Expertise and the Evolution of Intellect in Monkeys, Apes, and Humans.’, Oxford University Press.

    Google Scholar 

  25. Ristau, C.A. (1991), Before Mindreading: Attention, Purposes and Deception in Birds?, in A. Whiten, ed., ‘Natural Theories of Mind’, Blackwell.

    Google Scholar 

  26. H., Baluja, S. & Kanade, T. (1995), Human Face Detection in Visual Scenes, Technical Report CMU-CS-95-158, Carnegie Mellon University.

    Google Scholar 

  27. Scaife, M. (1976), ‘The response to eye-like shapes by birds. II. The importance of staring, pairedness, and shape.’, Animal Behavior 24, 200–206.

    Article  Google Scholar 

  28. Scaife, M.& Bruner, J. (1975), ‘The capacity for joint visual attention in the infant.’, Nature 253, 265–266.

    Article  Google Scholar 

  29. Scassellati, B. (1996), Mechanisms of Shared Attention for a Humanoid Robot, in ‘Embodied Cognition and Action: Papers from the 1996 AAAI Fall Symposium’, AAAI Press.

    Google Scholar 

  30. Scassellati, B. (1998a), A Binocular, Foveated Active Vision System, Technical Report 1628, MIT Artificial Intelligence Lab Memo.

    Google Scholar 

  31. Scassellati, B. (1998b), Finding Eyes and Faces with a Foveated Vision System, in ‘Proceedings of the Fifteenth National Conference on Artificial Intelligence (AAAI-98)’, AAAI Press.

    Google Scholar 

  32. Sinha, P. (1994), ‘Object Recognition via Image Invariants: A Case Study’, Investigative Ophthalmology and Visual Science 35, 1735–1740.

    Google Scholar 

  33. Sinha, P. (1996), Perceiving and recognizing three-dimensional forms, PhD thesis, Massachusetts Institute of Technology.

    Google Scholar 

  34. Sung, K.-K.& Poggio, T. (1994), Example-based Learning for View-based Human Face Detection, Technical Report 1521, MIT Artificial Intelligence Lab Memo.

    Google Scholar 

  35. Thelen, E.& Smith, L. (1994), A Dynamic Systems Approach to the Development of Cognition and Action, MIT Press, Cambridge,MA.

    Google Scholar 

  36. Whiten, A., ed. (1991), Natural Theories of Mind, Blackwell.

    Google Scholar 

  37. Wood, D., Bruner, J.S. & Ross, G. (1976), ‘The role of tutoring in problem-solving’, Journal of Child Psychology and Psychiatry 17, 89–100.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1999 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Scassellati, B. (1999). Imitation and Mechanisms of Joint Attention: A Developmental Structure for Building Social Skills on a Humanoid Robot. In: Nehaniv, C.L. (eds) Computation for Metaphors, Analogy, and Agents. CMAA 1998. Lecture Notes in Computer Science(), vol 1562. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-48834-0_11

Download citation

  • DOI: https://doi.org/10.1007/3-540-48834-0_11

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-65959-4

  • Online ISBN: 978-3-540-48834-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics