Parts-Based Face Verification Using Local Frequency Bands

  • Christopher McCool
  • Sébastien Marcel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5558)


In this paper we extend the Parts-Based approach of face verification by performing a frequency-based decomposition. The Parts-Based approach divides the face into a set of blocks which are then considered to be separate observations, this is a spatial decomposition of the face. This paper extends the Parts-Based approach by also dividing the face in the frequency domain and treating each frequency response from an observation separately. This can be expressed as forming a set of sub-images where each sub-image represents the response to a different frequency of, for instance, the Discrete Cosine Transform. Each of these sub-images is treated separately by a Gaussian Mixture Model (GMM) based classifier. The classifiers from each sub-image are then combined using weighted summation with the weights being derived using linear logistic regression. It is shown on the BANCA database that this method improves the performance of the system from an Average Half Total Error Rate of 24.38% to 15.17% when compared to a GMM Parts-Based approach on Protocol P.


Feature Vector Discrete Cosine Transform Gaussian Mixture Model Local Binary Pattern Feature Extraction Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Zhao, W., Chellappa, R., Phillips, P., Rosenfeld, A.: Face recognition: A literature survey. ACM Computing Surveys 35(4), 399–459 (2003)Google Scholar
  2. 2.
    Bledsoe, W.W.: The model method in facial recognition. Technical report for Panoramic Research Inc. (1966)Google Scholar
  3. 3.
    Turk, M., Pentland, A.: Eigenfaces for recognition. Journal of Cognitive Neuroscience 3(1), 71–86 (1991)Google Scholar
  4. 4.
    Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs. fisherfaces: Recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)Google Scholar
  5. 5.
    Samaria, F., Fallside, F.: Face identification and feature extraction using hidden markov models. Image Processing: Theory and Applications, 295–298 (1993)Google Scholar
  6. 6.
    Sanderson, C., Paliwal, K.K.: Fast feature extraction method for robust face verification. Electronic Letters 38(25), 1648–1650 (2002)Google Scholar
  7. 7.
    Samaria, F., Young, S.: Hmm-based architecture for face identification. Image and Vision Computing 12(8), 537–543 (1994)Google Scholar
  8. 8.
    Nefian, A., Hayes III, M.H.: Hidden markov models for face recognition. In: Proceedings of the 1998 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 5, pp. 2721–2724 (1998)Google Scholar
  9. 9.
    Cardinaux, F., Sanderson, C., Marcel, S.: Comparison of mlp and gmm classifiers for face verification on xm2vts. In: International Conference on Audio- and Video-based Biometric Person Authentication, pp. 1058–1059 (2003)Google Scholar
  10. 10.
    Lucey, S., Chen, T.: A gmm parts based face representation for improved verification through relevance adaptation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 855–861 (2004)Google Scholar
  11. 11.
    Heisele, B., Ho, P., Wu, J., Poggio, T.: Face recognition: component-based versus global approaches. In: Computer Vision and Image Understanding, vol. 91, pp. 6–21 (2003)Google Scholar
  12. 12.
    Pennebaker, W.B., Mitchell, J.L.: JPEG still image data compression standard. Van Nostrand Reinhold, New York (1993)Google Scholar
  13. 13.
    Doddington, G., Przybocki, M., Martin, A., Reynolds, D.: The NIST speaker recognition evaluation — overview, methodology, systems, results, perspective. Speech Communication 31(2-3), 225–254 (2000)Google Scholar
  14. 14.
    Reynolds, D.: Comparison of background normalization methods for text-independent speaker verification. In: Proc. European Conference on Speech Communication and Technology (Eurospeech), vol. 2, pp. 963–966 (1997)Google Scholar
  15. 15.
    Lee, C., Gauvain, J.: Bayesian adaptive learning and MAP estimation of HMM, pp. 83–107. Kluwer Academic Publishers, Boston (1996)Google Scholar
  16. 16.
    Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Transactions on Pattern Analysis and Machine Intelligence 20, 226–239 (1998)Google Scholar
  17. 17.
    Brummer, N.: Tools for fusion and calibration of automatic speaker detection systems (2005),
  18. 18.
    Bailly-Bailliere, E., Bengio, S., Bimbo, F., Hamouz, M., Kittler, J., Mariethoz, J., Matas, J., Messer, K., Popovici, V., Poree, F., Ruiz, B., Thiran, J.P.: The banca database and evaluation protocol. LNCS, pp. 625–638. Springer, Heidelberg (2003)Google Scholar
  19. 19.
    Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)Google Scholar
  20. 20.
    Heusch, G., Rodriguez, Y., Marcel, S.: Local binary patterns as an image preprocessing for face authentication. In: International Conference on Automatic Face and Gesture Recognition, pp. 9–14 (2006)Google Scholar
  21. 21.
    Fröba, B., Ernst, A.: Face detection with the modified census transform. In: IEEE Conference on Automatic Face and Gesture Recognition, pp. 91–96 (2004)Google Scholar
  22. 22.
    Heusch, G., Marcel, S.: Face authentication with Salient Local Features and Static Bayesian network. In: IEEE / IAPR Intl. Conf. On Biometrics (ICB) (2007) IDIAP-RR 07-04Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Christopher McCool
    • 1
  • Sébastien Marcel
    • 1
  1. 1.Centre du ParcIdiap Research InstituteMartignySwitzerland

Personalised recommendations