Affective Human-Robotic Interaction

  • Christian Jones
  • Andrew Deeming
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4868)


Entertainment robots are becoming commonplace in the home. Users are less fearful of interacting with robotic systems however these interactions are often limited to performing pre-recording sequences of actions. The next generation of consumer-level entertainment robots should offer more natural interfacing and more engaging interaction. This paper reports on the development and evaluation of a consumer-level robotic dog with acoustic emotion recognition capabilities. The dog can recognise the emotional state of it’s owner from affective cues in the owner’s speech and respond with appropriate actions. The evaluation study shows that users can recognise the new robotic dog to be emotionally intelligent and report that this makes the dog appear more ‘alive’.


Entertainment Robots Sony AIBO Affective computing Acoustic emotion recognition Human-Robotic interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Digilog, Voice Analysis Insurance, Banking Fraud Internal Audit,
  2. 2.
    Jones, C.M., Jonsson, I.-M.: Detecting Emotions in Conversations Between Driver and In-car Information Systems. In: Proceedings of the International Conference on Affective Computing and Intelligent Interaction, Beijing, China (2005)Google Scholar
  3. 3.
    MIT Media Lab: Affective Computing Group,
  4. 4.
    Fernandez, R., Picard, R.W.: Modeling Driver’s Speech under Stress. Speech Communication 40, 145–159 (2003)zbMATHCrossRefGoogle Scholar
  5. 5.
    Jones, C.M., Jonsson, I.-M.: Automatic Recognition of Affective Cues in the Speech of Car Drivers to Allow Appropriate Responses. In: Proceedings of OZCHI Canberra, Australia (2005)Google Scholar
  6. 6.
    Kaiser, S., Wehrle, T., Edwards, P.: Multi-Modal Emotion Measurement in an Interactive Computer Game: A Pilot-Study. In: Frijda, N.H. (ed.) Proc Conf International Society of Research on Emotions, pp. 275–279. ISRE Publications, Storrs (1994)Google Scholar
  7. 7.
    Jones, C.M., Sutherland, J.: Creating an Emotionally Reactive Computer Game Responding to Affective Cues in Speech. In: Proceedings of British HCI Group Annual Conference, Edinburgh, UK (2005)Google Scholar
  8. 8. Mindstorms,
  9. 9.
  10. 10.
    Sony AIBO Europe, Sony Entertainment,
  11. 11.
    Roux, J.: Pursuit Ability of a Robotic Pet, MSc Dissertation. Heriot-Watt University (2005)Google Scholar
  12. 12.
    Sony Corporation: AIBO SDE Official web site, Open R Development Platform for AIBO robots,
  13. 13.
    Carnegie Mellon University: Tekkotsu: Homepage, Open Source Development Environment for Sony’s AIBO,
  14. 14.
    Baillie J-C/ENSTA/URBI/Goasti, S.A.S.: URBI – Universal Real-Time Behavior Interface, Robot Control Using the URBI Scripting Language,
  15. 15.
    AiboPet: AiboHack Main Page - AiboPet and other ’Pets, Information Regarding Programming in AIBO R-Code Scripting Language Including R-Code Tool YART (Yet Another RCode Tool),
  16. 16.
    Friedman, B., Kahn, P.H., Hagman, J.: Hardware Companions?: What On-line AIBO Discussion Forums Reveal About the Human-Robotic Relationship. In: Proc. SIGCHI Conference on Human Factors in Computing Systems, Florida, USA, pp. 273–280 (2003)Google Scholar
  17. 17.
    Kahn, P.H., Friedman, B., Freier, N.G., Perez-Granados, D.R.: Robotic Pets in the Lives of Preschool Children. In: CHI 2004 Extended Abstracts on Human Factors in Computing Systems, Vienna, Austria, pp. 1449–1452 (2004)Google Scholar
  18. 18.
    Kahn, P.H., Friedman, B., Melson, G.F., Beck, A.M., Roberts, T., Garrett, E.: Robots as Dogs?: Children’s Interactions with the Robotic Dog AIBO and a Live Australian Shepherd. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1649–1652 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Christian Jones
    • 1
  • Andrew Deeming
    • 2
  1. 1.University of the Sunshine CoastQueenslandAustralia
  2. 2.Heriot-Watt UniversityEdinburghUnited Kingdom

Personalised recommendations