A Video Communication System with a Virtual Pupil CG Superimposed on the Partner’s Pupil
Pupil response plays an important role in expression of talker’s affect. Focusing on the pupil response in human voice communication, we analyzed the pupil response in embodied interaction, and demonstrated that the speaker’s pupil was clearly dilated during the burst-pause of utterance. In addition, it was confirmed that the pupil response is effective for enhancing affective conveyance by using the developed system in which an interactive CG character generates the pupil response based on the burst-pause of utterance. In this study, we develop a video communication system with a virtual pupil CG superimposed on the partner’s pupil for enhancing affective conveyance. This system generates a virtual pupil response in synchronization of the talker’s utterance. The effectiveness of the system is demonstrated by means of sensory evaluations of 12 pairs of subjects in video communication.
KeywordsHuman interaction Nonverbal communication Affective conveyance Line-of-sight Pupil response
This work was supported by JSPS KAKENHI Grant Numbers JP16K01560, JP26280077.
- 4.Sejima, Y., Watanabe, T., Jindai, M.: Speech-driven embodied entrainment character system with pupillary response. Bull. JSME Mech. Eng. J. 3(4), 832–837 (2016). Paper No. 15-00314Google Scholar
- 7.Vertgaal, R., Veer, V.G., Vons, H.: Effects of gaze on multiparty mediated communication. In: Proceedings of Graphic Interface 2000, pp. 95–102 (2000)Google Scholar
- 8.Maeda, R., Egawa, S., Sejima, Y., Sato, Y., Watanabe, T.: Development of a video chat system superimposing a pupil CG synchronized with utterance on the partner’s pupil. In: Proceedings of 23rd International Symposium on Artificial Life and Robotics (AROB2018), pp. 236–239 (2018)Google Scholar
- 9.Johnson & Johnson Co, Ltd.: The “golden ratio of pupil” of white eyes and black eyes is “1: 2: 1” (2014). http://acuvue.jnj.co.jp/corp/press/pdf/p0138.pdf. Accessed 8 Feb 2018. (in Japanese)
- 10.Oyama, S., Imai, S., Wake, T.: Handbook of Sense and Perception Psychology, p. 895. Sei Shin Shobo, Tokyo (1994). (in Japanese)Google Scholar
- 11.Kawatani, H., Kashiwazaki, H., Takai Y., Takai, N.: Feature evaluation by moe-factor of ANIME character image and its application. In: IEICE Technical Report of Image Engineering, vol. 34, no. 6, pp. 113–118 (2010). (in Japanese)Google Scholar