Abstract
This paper presents a study on personal aesthetics, a recent soft biometrics application where the goal is to recognize people by considering the images they like. Here we propose a multi-level approach, where each level is intended as a low-dimensional space where the images preferred by a user can be projected, and similar images are mapped nearby, namely a Counting Grid. Multiple levels are generated by adopting Counting Grids at different resolutions, corresponding to analyze images at different grains. Each level is then associated to an exemplar Support Vector Machine, which separates the images of an individual from the rest of the users. Putting together multiple levels gives a battery of classifiers whose performances are very good: on a dataset of 200 users, and 40 K images, using 5 preferred images as biometric template gives 97 % of probability of guessing the correct user; as for the verification capability, the equal error rate is 0.11. The approach has also been tested with diverse comparative methods and different features, showing that color image properties are crucial to encode the personal aesthetics, and that high-level information (as the objects within the images) could be very effective, but current methods are not robust enough to catch it.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Lovato, P., Perina, A., Sebe, N., Zandonà, O., Montagnini, A., Bicego, M., Cristani, M.: Tell me what you like and i’ll tell you what you are: Discriminating visual preferences on flickr data. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012, Part I. LNCS, vol. 7724, pp. 45–56. Springer, Heidelberg (2013)
Dantcheva, A., Velardo, C., D’angelo, A., Dugelay, J.L.: Bag of soft biometrics for person identification. Multimed. Tools Appl. 51, 739–777 (2011)
Yampolskiy, R.V., Govindaraju, V.: Behavioural biometrics: a survey and classification. Int. J. Biometrics 1, 81–113 (2008)
Pusara, M., Brodley, C.E.: User re-authentication via mouse movements. In: Proceedings of ACM workshop on Visualization and data mining for computer security, pp. 1–8 (2004)
Rybnik, M., Tabedzki, M., Saeed, K.: A keystroke dynamics based system for user identification. In: 7th Computer Information Systems and Industrial Management Applications, CISIM 2008, pp. 225–230. IEEE (2008)
Roffo, G., Segalin, C., Vinciarelli, A., Murino, V., Cristani, M.: Reading between the turns: Statistical modeling for identity recognition and verification in chats. In: 10th IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS, pp. 99–104 (2013)
Olejnik, L., Castelluccia, C., Janc, A., et al.: Why johnny can’t browse in peace: On the uniqueness of web browsing history patterns. In: 5th Workshop on Hot Topics in Privacy Enhancing Technologies (HotPETs) (2012)
Jin, X., Wang, C., Luo, J., Yu, X., Han, J.: Likeminer: a system for mining the power of ‘like’ in social media networks. In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 753–756 (2011)
Joshi, D., Datta, R., Fedorovskaya, E., Luong, Q.T., Wang, J., Li, J., Luo, J.: Aesthetics and emotions in images. IEEE Sig. Process. Mag. 28, 94–115 (2011)
Furnham, A., Walker, J.: The influence of personality traits, previous experience of art, and demographic variables on artistic preference. Personality Individ. Differ. 31, 997–1017 (2001)
Perina, A., Jojic, N.: Image analysis by counting on a grid. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1985–1992 (2011)
Lovato, P., Bicego, M., Segalin, C., Perina, A., Sebe, N., Cristani, M.: Faved! biometrics: Tell me which image you like and i’ll tell you who you are. IEEE Trans. Inf. Forensics Secur. 9, 364–374 (2014)
Segalin, C., Perina, A., Cristani, M.: Biometrics on visual preferences: A “Pump and Distill” regression approach. In: IEEE International Conference on Image Processing (ICIP) (2014)
Machajdik, J., Hanbury, A.: Affective image classification using features inspired by psychology and art theory. In: International Conference on Multimedia, pp. 83–92. ACM (2010)
Felzenszwalb, P., Girshick, R., McAllester, D., Ramanan, D.: Object detection with discriminatively trained part-based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1627–1645 (2010)
Datta, R., Joshi, D., Li, J., Wang, J.Z.: Studying aesthetics in photographic images using a computational approach. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 288–301. Springer, Heidelberg (2006)
Valdez, P., Mehrabian, A.: Effects of color on emotions. J. Exp. Psychol. Gen. 123, 394 (1994)
Mardia, K., Jupp, P.: Directional Statistics. Wiley, Chichester (2009)
Comaniciu, D., Meer, P.: Mean shift: A robust approach toward feature space analysis. IEEE TPAMI 24, 603–619 (2002)
Georgescu, C.: Synergism in low level vision. In: International Conference on Pattern Recognition, pp. 150–155 (2002)
Tamura, H., Mori, S., Yamawaki, T.: Texture features corresponding to visual perception. IEEE Trans. Syst. Man Cybern. 8, 460–473 (1978)
Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: IEEE Conference on CVPR, pp. 511–518 (2001)
Moon, H., Phillips, P.J.: Computational and performance aspects of PCA-based face-recognition algorithms. Perception-London 30, 303–322 (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Segalin, C., Perina, A., Cristani, M. (2015). Recognizing People by Their Personal Aesthetics: A Statistical Multi-level Approach. In: Cremers, D., Reid, I., Saito, H., Yang, MH. (eds) Computer Vision -- ACCV 2014. ACCV 2014. Lecture Notes in Computer Science(), vol 9005. Springer, Cham. https://doi.org/10.1007/978-3-319-16811-1_33
Download citation
DOI: https://doi.org/10.1007/978-3-319-16811-1_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16810-4
Online ISBN: 978-3-319-16811-1
eBook Packages: Computer ScienceComputer Science (R0)