Using FaceReader to Evaluate Consumer Emotions toward Personification in Animals

  • Chia-yin Yu
  • Chih-hsiang Ko
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 739)


Products reinforcing consumer’s positive emotions can encourage purchasing behavior. The following emotional effects also can influence consumers’ recognition and feelings. Besides structured oral responses, physiological signals useable for understanding consumer emotions. In design field, personifications in animals is commonly used in package design, advertising, commercial activities or any other relevant fields. It is important for designers to understand consumer emotions and the reasons behind, for building emotional communication between customer and product, and create consumer demands. In this paper, an emotion recognition experiment conducted to understand 112 participants’ emotional reactions toward realistic drawings and personifications. FaceReader, a software program that can automatically analyze facial expressions, adopted to recognize participants’ emotions. Meanwhile, we collected participants’ self-reports to compare with those aroused emotions from viewing sample images. The results showed (1) participants showed significant emotional differences in neutral, happiness, sadness and disgust toward realistic drawings and personifications. (2) Participants had higher positive evaluations on personification design. (3) The facial expressions of personification design could affect participants’ emotions. (4) Realistic drawings could inspire more associated ideas from participants. In addition, we generalized limitations and precautions in using FaceReader under the experimental condition as follows. (1) When participants viewed static images, the statistical values of negative emotions could be low. (2) FaceReader could recognize neutral facial expression as sadness. This research has demonstrated practical implications of personification in animals. This approach provides a preferable basis for researchers and designers in relevant fields of design practice and marketing.


personification emotion facial expression recognition FaceReader 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Schachter, S. & Singer, J. E.: Cognitive, social, and physiological determinants of emotional state Psychological Review, 69, 379-399. (1962).Google Scholar
  2. 2.
    Fridlund, A. J.: Human facial expression: An evolutionary view. London: Academic Press. (2014).Google Scholar
  3. 3.
    Ekman, P.: Emotions revealed- Recognizing faces and feelings to improve communication and emotional life. New York: Times Books. (2003).Google Scholar
  4. 4.
    Mahrabian, A.: Silent messages. Belmont, CA: Wadsworth. (1981).Google Scholar
  5. 5.
    Pollak, S. D., Messner, M., Kistler, D. J. & Cohn, J. F.: Development of perceptual expertise in emotion recognition. Cognition, 110(2), 242-247. (2009).Google Scholar
  6. 6.
    Rinn, W. E.: The neuropsychology of facial expression: A review of the neurological and psychological mechanisms for producing facial expressions. Psychological Bulletin, 95(1), 52-77. (1984).Google Scholar
  7. 7.
    Ekman, P., Friesen, W. V.: Facial action coding system: A technique for the measurement of facial movement. Palo Alto, CA: Consulting Psychologists Press. (1978).Google Scholar
  8. 8.
    Pos, O. Green-Armytage, P.: Facial expression, colours and basic emotions. Colour: design & creativity, 1(1), 2, 1-20. (2007).Google Scholar
  9. 9.
    Lajevardi, S. M., Wu, H. R.: Facial expression recognition in perceptual color space. IEEE transactions on image processing, 21(8), 3721-3733. (2012).Google Scholar
  10. 10.
    Pantic, M., Patras, I.: Dynamics of facial expression: Recognition of facial actions and their temporal segments from face profile image sequences. IEEE Transactions on Systems, Man and Cybernetics: Part B, 36(2), 433-449. (2006).Google Scholar
  11. 11.
    Zhan, Y., Zhou, G.: Facial expression recognition based on hybrid features and fusing discrete HMM. Paper presented at the Virtual Reality, HCII 2007, (LNCS 4563) Berlin/ Heidelberg, Germany. (2007).Google Scholar
  12. 12.
    Lau, B. T.: Portable real time needs expression for people with communication disabilities. Paper presented at the Proceedings of Communication in Computer and Information Science: Intelligent Interactive Assistance and Mobile Multimedia Computing, Berlin/ Heidelberg, Germany. (2009).Google Scholar
  13. 13.
    Loijens, L., Krips, O.: FaceReader methodology. Wageningen, Nederland: Noldus Information Technology. (2013).Google Scholar
  14. 14.
    Zaman, B., Shrimpton-Smith, T.: The FaceReader: Measuring instant fun of use. Paper presented at the Nordic Conference on Human-Computer Interaction 2006, Olso, Norway. (2006).Google Scholar
  15. 15.
    Yu, C. Y., Ko, C. H.: Applying FaceReader to Recognize Consumer Emotions in Graphic Styles. Procedia CIRP, 60, 104-109. (2017).Google Scholar
  16. 16.
    Cohen, A. S., Morrison, S. C., Callaway, D. A.: Computerized facial analysis for understanding constricted/blunted affect: Initial feasibility, reliability, and validity data. Schizophrenia Research, 148, 111-116. (2013).Google Scholar
  17. 17.
    Danner, L., Haindl, S., Joechl, M., Duerrschmid, K.: Facial expressions and autonomous nervous system responses elicited by tasting different juices. Food Research International, 64, 81-90. (2014).Google Scholar
  18. 18.
    Ricoeur, P.: The Rule of Metaphor: Multi-disciplinary Studies of the Creation of Meaning in Language (R. Czerny, Trans.). Toronto: University of Toronto Press. (1977).Google Scholar
  19. 19.
    Aggarwal, P., McGill, A. L.: Is That Car Smiling at Me? Schema Congruity as a Basis for Evaluating Anthropomorphized Products. Journal of Consumer Research, 34(4), 468-479. (2007).Google Scholar
  20. 20.
    Beiman, N.: Creating story and characters for animated features and shorts. New York: Elsevier. (2007).Google Scholar
  21. 21.
    Dunn, S. W., Barban, A. M.: Advertising: its role in modern marketing (6 ed.). Fort Worth: Dryden Press. (1986).Google Scholar
  22. 22.
    Norris, J. S.: Advertising (4 ed.). New Jersey: Prentice Hall. (1990).Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.Department of Applied ArtsFu Jen Catholic UniversityNew TaipeiTaiwan
  2. 2.Department of DesignNational Taiwan University of Science and TechnologyTaipeiTaiwan

Personalised recommendations