Abstract
As a basic human quality, trustworthiness plays an important role in social communications. In this paper, we proposed a novel concept to predict people’s trustworthiness at first sight using facial traits. Firstly, personality-toward traits were designed from psychology, including permanent traits and transient traits. Then, a mixture of feature descriptors consisting of Histogram of Gradients (HOG), Local Binary Patterns (LBP) and geometrical descriptions were adopted to describe personality traits. Finally, we trained the personality traits by LibSVM to determine trustworthiness of a person using portrait. Experiments demonstrated the effectiveness of our method by improving the precision by 33.60%, recall by 20.33% and F1-measure by 25.63% when determining whether a person is trustworthy or not comparing to a baseline method. Feature contribution analysis was applied to deeply unveil the correspondence between features and personality. Demonstration showed visual patterns in portrait collages of trustworthy people that further proved effectiveness of our method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bar, M., Neta, M., Linz, H.: Very first impressions. Emotion 6(2), 269 (2006)
Brownlow, S., Zebrowitz, L.A.: Facial appearance, gender, and credibility in television commercials. Journal of Nonverbal Behavior 14(1), 51–60 (1990)
Olivola, C.Y., Todorov, A.: Elected in 100 milliseconds: Appearance-based trait inferences and voting. Journal of Nonverbal Behavior 34(2), 83–110 (2010)
Asteriadis, S., Nikolaidis, N., Pitas, I.: Facial feature detection using distance vector fields. Pattern Recognition 42(7), 1388–1398 (2009)
Jeng, S.H., Liao, H.Y.M., Han, C.C., Chern, M.Y., Liu, Y.T.: Facial feature detection using geometrical face model: an efficient approach. Pattern Recognition 31(3), 273–282 (1998)
Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing 27(6), 803–816 (2009)
Albiol, A., Monzo, D., Martin, A., Sastre, J., Albiol, A.: Face recognition using HOG–EBGM. Pattern Recognition Letters 29(10), 1537–1543 (2008)
Gritti, T., Shan, C., Jeanne, V., Braspenning, R.: Local features based facial expression recognition with face registration errors. In: 8th IEEE International Conference on Automatic Face & Gesture Recognition, FG 2008, pp. 1–8. IEEE (September 2008)
Tian, Y.L., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(2), 97–115 (2001)
Hoque, M.E., McDuff, D.J., Picard, R.W.: Exploring temporal patterns in classifying frustrated and delighted smiles. IEEE Transactions on Affective Computing 3(3), 323–334 (2012)
Fitzgerald Steele, J., Evans, D.C., Green, R.K.: Is Your Profile Picture Worth 1000 Words? Photo Characteristics Associated with Personality Impression Agreement. Landscape 2, 139 (2009)
Cristani, M., Vinciarelli, A., Segalin, C., Perina, A.: Unveiling the multimedia unconscious: Implicit cognitive processes and multimedia content analysis. In: Proceedings of the 21st ACM International Conference on Multimedia, pp. 213–222. ACM (October 2013)
Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. Journal of Personality and Social Psychology 17(2), 124 (1971)
Ekman, P., Friesen, W.V.: Facial action coding system (1977)
Wei, Y.: Research on facial expression recognition and synthesis. Master Thesis, Department of Computer Science and Technology, Nanjing (2009)
Nie, J., Cui, P., Yan, Y., Huang, L., Li, Z., Wei, Z.: How your portrait impresses people? Inferring personality impressions from portrait contents. In: Proceedings of the ACM inter-national conference on Multimedia (to be published, 2014)
Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2(3), 27 (2011)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Yan, Y., Nie, J., Huang, L., Li, Z., Cao, Q., Wei, Z. (2015). Is Your First Impression Reliable? Trustworthy Analysis Using Facial Traits in Portraits. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds) MultiMedia Modeling. MMM 2015. Lecture Notes in Computer Science, vol 8936. Springer, Cham. https://doi.org/10.1007/978-3-319-14442-9_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-14442-9_13
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14441-2
Online ISBN: 978-3-319-14442-9
eBook Packages: Computer ScienceComputer Science (R0)