Abstract
In this study, we experimentally examined whether changes in the facial expressions of teleoperated androids can affect and regulate their operators’ emotion, based on the facial feedback theory of emotion and the phenomenon of body ownership transfer to the robot. Twenty-six Japanese participants conversed with an experimenter through a robot in a situation where the participants were induced to feel anger, and during the conversation, the android’s facial expression was changed according to a pre-programmed scheme. The results showed that facial feedback from the android did occur. Moreover, a comparison of the results of two groups of participants, one of which operated the robot and the second did not, showed that this facial feedback from the android robot occurred only when the participants operated the robot, and that when an operator could effectively operate the robot, his/her emotional states were more affected by the facial expression change of the robot.
This chapter is a modified version of a previously published paper [1], edited to be comprehensive and fit with the context of this book.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
This experiment was approved by the ethical committee of Advanced Telecommunications Research International Institute (No. 12-506-1).
- 2.
We used the same effect scale for the pre-experiment questionnaire. However, the results of the pre-experiment questionnaire were not used in this study.
- 3.
In this study, we used only the post-session results for analysis.
References
Nishio, Shuichi, Koichi Taura, Hidenobu Sumioka, and Hiroshi Ishiguro. 2013. Teleoperated android robot as emotion regulation media. International Journal of Social Robotics 5 (4): 563–573.
Gross, James J. 2002. Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology 39: 281–291.
Botherel, V., and V. Maffiolo. 2006. Regulation of emotional attitudes for a better interaction: Field study in call centres. In Proceedings of the 20th international symposium of human factors in telecommunication, Mar 2006.
Derks, Daantje, Agneta H. Fischer, and E.R. Arjan. 2008. Bos. The role of emotion in computer-mediated communication: A review. Computers in Human Behavior 24 (3): 766–785.
Nico, H. 1986. Frijda. New York, USA: The emotions. Cambridge University Press.
Lewis, Jeannette M. Haviland-Jones, and Lisa Feldman Barrett (eds.). 2008. Handbook of emotions. New York, USA: Guilford Press.
Scherer, Klaus R., and Paul Ekman (eds.). 1984. Approaches to emotion. New Jersey, USA: Lawrence Erlbaum Associates.
Calvo, Rafael A., and Sidney D’Mello. 2010. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE transactions on affective computing 1 (1): 18–37.
Gross, James J. 1998. The emerging field of emotion regulation: An integrative review. Review of General Psychology 2 (3): 271–299.
Harris, Christine R. 2001. Cardiovascular responses of embarrassment and effects of emotional suppression in a social setting. Journal of Personality and Social Psychology 81 (5): 886–897.
Nakanishi, Hideyuki. 2004. Freewalk: A social interaction platform for group behaviour in a virtual space. International Journal of Human-Computer Studies 60 (4): 421–454.
Zeng, Zhihong, Maja Pantic, Glenn I. Roisman, and Thomas S. Huang. 2007. A survey of affect recognition methods: Audio, visual and spontaneous expressions. In Proceedings of the 9th international conference on multimodal interfaces, 126–133.
Kleinke, C., T. Peterson, and T. Rutledge. 1998. Effects of self-generated facial expressions on mood. Journal of Personality and Social Psychology 74: 272–279.
MacIntosh, D. 1996. Facial feedbck hypotheses: Evidence, implications, and directions. Motivation and Emotion 20: 121–147.
Soussignan, R. 2002. Duchenne smile, emotional experience, and autonomic reactivity : A test of the facial feedback hypothesis. Emotion 2: 52–74.
Strack, F., L. Martin, and S. Stepper. 1988. Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. Journal of Personality and Social Psychology 54: 768–77.
Izard, Carrol E. 1990. Facial expressions and the regulation of emotions. Journal of Personality and Social Psychology 58 (3): 487–498.
Nishio, S., Hiroshi Ishiguro, and Norihiro Hagita. 2007. Geminoid: Teleoperated android of an existing person. In Humanoid robots: New developments, ed. Armando Carlos de Pina Filho, 343–352. Vienna, Austria: I-Tech Education and Publishing.
Nishio, Shuichi, Tetsuya Watanabe, Kohei Ogawa, and Hiroshi Ishiguro. 2012. Body ownership transfer to teleoperated android robot. In International conference on social robotics (ICSR 2012), 398–407, Oct 2012, Chengdu, China.
Botvinick, Matthew. 1998. Rubber hands ’feel’ touch that eyes see. Nature 391 (6669): 756.
Averill, James R. 1983. Studies on anger and aggression: Implications for theories of emotion. American Psychologist 38 (11): 1145–1160.
Ishi, C.T., C. Liu, H. Ishiguro, and N. Hagita. 2012. Evaluation of a formant-based speech-driven lip motion generation. In 13th Annual conference of the international speech communication association (Interspeech 2012), P1a.04, Portland, Oregon, Sept 2012.
Ogawa, Tokihiro, Rie Monchi, Mami Kikuya, and Naoto Suzuki. 2000. Development of the general affect scales (in Japanese). The Japanese Journal of Psychology 71 (3): 241–246.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Nishio, S., Taura, K., Sumioka, H., Ishiguro, H. (2018). Regulating Emotion with Body Ownership Transfer. In: Ishiguro, H., Dalla Libera, F. (eds) Geminoid Studies. Springer, Singapore. https://doi.org/10.1007/978-981-10-8702-8_22
Download citation
DOI: https://doi.org/10.1007/978-981-10-8702-8_22
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-8701-1
Online ISBN: 978-981-10-8702-8
eBook Packages: EngineeringEngineering (R0)