Skip to main content
SpringerLink
Log in

FaceBots: Steps towards enhanced long-term human-robot interaction by utilizing and publishing online social information

  • Research Article
  • Published:
Paladyn

Abstract

The overarching goal of the FaceBots project is to support the achievement of sustainable long-term human-robot relationships through the creation of robots with face recognition and natural language capabilities, which exploit and publish online information, and especially social information available on Facebook, and which achieve two significant novelties. The underlying experimental hypothesis is that such relationships can be significantly enhanced if the human and the robot are gradually creating a pool of episodic memories that they can co-refer to (“shared memories”), and if they are both embedded in a social web of other humans and robots they mutually know (“shared friends”). We present a description of system architecture, as well as important concrete results regarding face recognition and transferability of training, with training and testing sets coming from either one or a combination of two sources: an onboard camera which can provide sequences of images, as well as facebook-derived photos. Furthermore, early interaction-related results are presented, and evaluation methodologies as well as interesting extensions are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. N. Mitsunaga, T. Miyashita, H. Ishiguro, K. Kogure, and N. Hagita, Robovie-IV: A Communication Robot Interacting with People Daily in an Office, In Proceedings of IROS 2006, p. 5066–5072.

  2. C.D. Kidd, C. Breazeal, Robots at home: Understanding longterm human-robot interaction, In proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 22–26 Sept. 2008, pp 3230–3235.

  3. J. Sung, H.I. Christensen, and R.E. Grinter, Robots in the Wild: Understanding Long-Term Use. In Proceedings of the 4th ACM/IEEE international conference on Human robot interaction (HRI’ 09). San Jose, USA, 2009.

  4. C. Breazeal, Emotion and sociable humanoid robots, International Journal of Human-Computer Studies, Volume 59,Issues 1–2, Applications of Affective Computing in Human-Computer Interaction, July 2003, Pages 119–155, ISSN 1071-5819, DOI: 10.1016/S1071-5819(03)00018-1.

    Article  Google Scholar 

  5. A.G. Brooks, J. Gray, G. Hoffman, A. Lockerd, H. Lee, and C. Breazeal, Robot’s play: interactive games with sociable machines. Computer Entertainment. 2,3 (Jul. 2004), 10–10.

    Article  Google Scholar 

  6. M.A. Salichs, R. Barber, A.M. Khamis, M. Malfaz, J.F. Gorostiza, R. Pacheco; R. Rivas, A. Corrales, E. Delgado. Maggie: A Robotic Platform for Human-Robot Social Interaction. IEEE International Conference on Robotics, Automation and Mechatronics (RAM 2006). Bangkok. Thailand. Jun, 2006.

  7. H. Ishiguro, T. Ono, M. Imai, T. Maeda, T. Kanda, R. Nakatsu, Robovie: an interactive humanoid robot. Industrial Robot: An International Journal, Volume 28, Number 6, 2001, pp. 498–504(7)

    Article  Google Scholar 

  8. H. Okuno, K. Nakadai, and H. Kitano, Social Interaction of Humanoid RobotBased on Audio-Visual Tracking, In Proceedings of the International Conference on Industrial, Engineering & Other Applications of Applied Intelligent Systems IEA/AIE 2002, p.140–173.

  9. N. Mavridis, Grounded Situation Models for Situated Conversational Assistants, PhD thesis, Massachusetts Institute of Technology, available online at MIT DSpace Collections Archive at http://hdl.handle.net/1721.1/38523 and at http://www.drnikolaos-mavridis.com

  10. M. Bennewitz, F. Faber, J. Dominik, M. Schreiber, and S. Behnke, Multimodal Conversation between a Humanoid Robot and Multiple Persons. In Proc. MCHI ws at AAAI05.

  11. T. Kanda, T. Hirano, D. Eaton, H. Ishiguro, Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial. In Human-Computer Interaction, 19(1–2):61–84.

  12. T. Kanda, R. Sato, N. Saiwaki, and H. Ishiguro, A Two-Month Field Trial in an Elementary School for Long-Term Human-Robot Interaction, IEEE Transactions on Robotics, 23,5 (2007), pp. 962–971

    Article  Google Scholar 

  13. L. Ahn, R. Liu, M. Blum, Peekaboom: A Game for Locating Objects in Images. In ACM Conference on Human Factors in Computing Systems CHI 2006. p. 55–64.

  14. European Union RoboEarth project website, available online at: http://www.roboearth.org

  15. Pioneer 3 / PeopleBot Human-Robot Interaction Robot Operations Manual, ActivMedia Robotics, 44 Concord St., Peterborough NH, 03458

  16. Point Grey Research, Inc., Vancouver, Canada, provider of pan-tilt-zoom camera motorization base units, web site available online at: http://www.ptgrey.com

  17. Directed Perception, Inc., 890C Cowan Road, Burlingame, CA 94010, provider of BumbleBee stereo cameras, web site available online at: http://www.dperception.com

  18. The Internet Communications Engine, ZeroC Inc., web site available online at: http://www.zeroc.com/ice.html

  19. P. Viola and M. Jones. Robust real-time object detection. International Journal of Computer Vision, 57(2):137–154, 2004.

    Article  Google Scholar 

  20. D. Bolme, R. Beveridge, M. Teixeira and B. Draper (2003) The CSU Face Identification Evaluation System: Its Purpose, Features and Structure, International Conference on Vision Systems, pp 304–311, Graz, Austria, April 1–3.

  21. A.V. Nefian and M.H. Hayes, Hidden markov models for face detection and recognition, in Proceedings of the International Conference on Image Processing, 1998.

  22. W. Walker, P. Lamere, P. Kwok, B. Raj, R. Singh, E. Gouvea, P. Wolf, and J. Woelfel. Sphinx-4: A flexible open source framework for speech recognition. Technical Report TR-2004-139, Sun Microsystems Laboratories, 2004.

  23. ActivMedia Robotics, Aria library reference manual, Technical Report (1.1.10), 2002.

  24. N. Mavridis, and D. Hanson, The IbnSina Center: An Augmented Reality Theater with Intelligent Robotic and Virtual Characters, in Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication Ro-MAN 2009, Toyama, Japan.

  25. N. Mavridis, A. Dhaheri, L. Dhaheri, M. Khanji, N. Darmaki, Transforming IbnSina into an Advanced Multilingual Interactive Android Robot, in Proceedings of the IEEE GCC Conference, 2011.

  26. N. Mavridis, E. Machado, et al., Real-time Teleoperation of an Industrial Robotic Arm Through Human Arm Movement Imitation, in Proceedings of the International Symposium on Robotics and Intelligent Sensors (IRIS), 2010, Nagoya, Japan.

  27. C. Christoforou, N. Mavridis, et al., Android tele-operation through Brain-Computer Interfacing: A real-world demo with non-expert users, in Proceedings of the International Symposium on Robotics and Intelligent Sensors (IRIS), 2010, Nagoya, Japan.

  28. N. Mavridis, W. Kazmi, and P. Toulis, Friends with Faces: How Social Networks Can Enhance Face Recognition and Vice Versa, in Book “Computational Social Networks Analysis: Trends, Tools and Research Advances”, Springer Verlag, 2009.

  29. Touchgraph Limited Liability Company, web site available online at: http://www.touchgraph.com/

  30. N. Mavridis, “Robot Friends: Artificial Agents entering Human Social Networks”, in Book “The Networked Self: Identity, Community and Culture on Social Network Sites”, Routledge, New York, 2010.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Interactive Robots and Media Lab, United Arab Emirates University, 17551, Al Ain, UAE

    Nikolaos Mavridis, Michael Petychakis, Alexandros Tsamakos, Panos Toulis, Shervin Emami, Wajahat Kazmi, Chandan Datta, Chiraz BenAbdelkader & Andry Tanoto

Authors
  1. Nikolaos Mavridis
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michael Petychakis
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alexandros Tsamakos
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Panos Toulis
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Shervin Emami
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Wajahat Kazmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Chandan Datta
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Chiraz BenAbdelkader
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Andry Tanoto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Nikolaos Mavridis.

About this article

Cite this article

Mavridis, N., Petychakis, M., Tsamakos, A. et al. FaceBots: Steps towards enhanced long-term human-robot interaction by utilizing and publishing online social information. Paladyn 1, 169–178 (2010). https://doi.org/10.2478/s13230-011-0003-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.2478/s13230-011-0003-y

Keywords

Search

Navigation