Skip to main content

Comparative Analysis of Benchmark Datasets for Face Recognition Algorithms Verification

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 7594))

Abstract

The paper presents a problem of recognition of facial portraits in the aspect of benchmark database quality. The aim of the work presented here was to analyse the potential of datasets published over the Internet and the predicted applicability of such data for the task of face recognition performance verification. We gathered 41 datasets created and published by various academic and commercial bodies. In the paper we focus on both pure data characteristics, including the number of images, their spatial resolution, quality, content and usability, as well as more high-level properties, e.g. face orientation, expression, background, lighting, and attributes like hats, glasses and beards. We have chosen several datasets on which we performed more detailed experiments related to face recognition. We employed several database preparation algorithms (cross-validation based on different schemes) to make the results as much objective as possible. Here, Principal Component Analysis was employed, as a standard tool for dimensionality reduction. The classification was performed using simple Euclidean metrics. Performed experiments showed a true potential of selected databases.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Gross, R.: Face Database. In: Li, S., Jain, A. (eds.) Handbook of Face Recognition, p. 395. Springer (2005)

    Google Scholar 

  2. Turk, M., Pentland, A.: Eigenfaces for Recognition. Journal of Cognitive Neurosicence 3(1), 71–86 (1991)

    Article  Google Scholar 

  3. Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face recognition by independent component analysis. IEEE Trans. on Neural Networks 13(6), 1450–1464 (2002)

    Article  Google Scholar 

  4. Swets, D., Weng, J.: Using Discriminant Eigenfeatures for Image Retrieval. IEEE Trans. on Pattern Analysis and Machine Intelligence 18(8), 831–836 (1996)

    Article  Google Scholar 

  5. Hancock, P.: Psychological Image Collection at Stirling, PICS (2011), http://pics.psych.stir.ac.uk/2D_face_sets.htm

  6. Thomaz, C.E., Giraldi, G.A.: A new ranking method for Principal Components Analysis and its application to face image analysis. Image and Vision Comp. 28(6), 902–913 (2010)

    Article  Google Scholar 

  7. Solina, F., Peer, P., Batagelj, B., Juvan, S., Kovac, J.: Color-based face detection in the ”15 seconds of fame” art installation. In: Mirage 2003, Conference on Computer Vision / Computer Graphics Collaboration for Model-based Imaging, Rendering, image Analysis and Graphical special Effects, INRIA Rocquencourt, France, Wilfried Philips, Rocquencourt, INRIA, pp. 38–47 (2003)

    Google Scholar 

  8. Huang, G.B., Ramesh, M., Berg, T., Learned-Miller, E.: Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. University of Massachusetts, Amherst, Tech. Rep. 07-49 (2007)

    Google Scholar 

  9. Jain, V., Mukherjee, A.: The Indian Face Database (2002), http://vis-www.cs.umass.edu/~vidit/IndianFaceDatabase

  10. Phillips, P., Wechsler, H., Huang, J., Rauss, P.: The FERET database and evaluation procedure for face recognition algorithms. Image and Vision Comp. 16/5, 295–306 (1999)

    Google Scholar 

  11. Sim, T., Baker, S., Bsat, M.: The CMU Pose, Illumination, and Expression Database. IEEE TPAMI 25(12) (2003)

    Google Scholar 

  12. BioID-Technology Research. The BioID Face Database. (2001), http://www.bioid.com/downloads/software/bioid-face-database.html

  13. Milborrow, S., Morkel, J., Nicolls, F.: The MUCT Landmarked Face Database, Pattern Recognition Association of South Africa (2010), http://www.milbo.org/muct

  14. Nordstrøm, M.M., Larsen, M., Sierakowski, J., Stegmann, M.B.: The IMM Face Database - An Annotated Dataset of 240 Face Images, Informatics and Mathematical Modelling, Technical University of Denmark, DTU (2004), http://www2.imm.dtu.dk/pubdb/p.php?3160

  15. Spacek, L.: Collection of facial Images. Computer Vision Science Research Projects, University of Essex, Department of Computer Science, Essex (2008), http://cswww.essex.ac.uk/mv/allfaces

  16. AT&T Laboratories Cambridge. Database of Faces (1994), http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html

  17. Weyrauch, B., Huang, J., Heisele, B., Blanz, V.: Component-based Face Recognition with 3D Morphable Models. In: First IEEE Workshop on Face Processing in Video, Washington, D.C. (2004)

    Google Scholar 

  18. Weber, M.: Frontal face dataset. California Institute of Technology (1999), http://www.vision.caltech.edu/html-files/archive.html

  19. Georgia Tech Face Database (2011), http://ftp.ee.gatech.edu/pub/users/hayes/facedb/

  20. Gourier, N., Hall, D., Crowley, J.L.: Estimating Face Orientation from Robust Detection of Salient Facial Features Proceedings of Pointing. In: ICPR, International Workshop on Visual Observation of Deictic Gestures, Cambridge, UK (2004)

    Google Scholar 

  21. Minear, M., Park, D.C.: A lifespan database of adult facial stimuli. Behavior Research Methods, Instruments, & Computers 36, 630–633 (2004)

    Article  Google Scholar 

  22. Tarr, M.J.: Face-Place, Center for the Neural Basis of Cognition, Carnegie Mellon University (2008), http://www.tarrlab.org/

  23. Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding Facial Expressions with Gabor Wavelets Proceedings. In: Third IEEE Internat. Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE Comp. Society, Nara Japan (1998)

    Chapter  Google Scholar 

  24. Graham, D.B., Allinson, N.M.: Characterizing Virtual Eigensignatures for General Purpose Face Recognition. In: Wechsler, H., Phillips, P.J., Bruce, V., Fogelman-Soulie, F., Huang, T.S. (eds.) Face Recognition: From Theory to Applications, NATO ASI Series F, Computer and Systems Sciences, vol. 163, pp. 446–456 (1998)

    Google Scholar 

  25. Messer, K., Matas, J., Kittler, J., Luettin, J., Maitre, G.: Xm2vtsdb: The extended m2vts database. In: Second Inter. Conf. of Audio and Video-based Biometric Person Authentication (1999)

    Google Scholar 

  26. The BANCA Database (2004), http://www.ee.surrey.ac.uk/CVSSP/banca/

  27. Kasiński, A., Florek, A., Schmidt, A.: The PUT Face Database. Image Processing & Communications 13(3-4), 59–64 (2008)

    Google Scholar 

  28. Martinez, A.M., Benavente, R.: The AR Face Database. CVC Tech. Rep. #24 (1998)

    Google Scholar 

  29. Bellhumer, P.N., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE TPAMI, Special Issue on Face Recognition 17(7), 711–720 (1997)

    Google Scholar 

  30. Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose. IEEE Trans. Pattern Anal. Mach. Intelligence 23(6), 643–660 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Forczmański, P., Furman, M. (2012). Comparative Analysis of Benchmark Datasets for Face Recognition Algorithms Verification. In: Bolc, L., Tadeusiewicz, R., Chmielewski, L.J., Wojciechowski, K. (eds) Computer Vision and Graphics. ICCVG 2012. Lecture Notes in Computer Science, vol 7594. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33564-8_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-33564-8_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-33563-1

  • Online ISBN: 978-3-642-33564-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics