A Discriminant Analysis Method for Face Recognition in Heteroscedastic Distributions

  • Zhen Lei
  • Shengcai Liao
  • Dong Yi
  • Rui Qin
  • Stan Z. Li
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5558)


Linear discriminant analysis (LDA) is a popular method in pattern recognition and is equivalent to Bayesian method when the sample distributions of different classes are obey to the Gaussian with the same covariance matrix. However, in real world, the distribution of data is usually far more complex and the assumption of Gaussian density with the same covariance is seldom to be met which greatly affects the performance of LDA. In this paper, we propose an effective and efficient two step LDA, called LSR-LDA, to alleviate the affection of irregular distribution to improve the result of LDA. First, the samples are normalized so that the variances of variables in each class are consistent, and a pre-transformation matrix from the original data to the normalized one is learned using least squares regression (LSR); second, conventional LDA is conducted on the normalized data to find the most discriminant projective directions. The final projection matrix is obtained by multiply the pre-transformation matrix and the projective directions of LDA. Experimental results on FERET and FRGC ver 2.0 face databases show the proposed LSR-LDA method improves the recognition accuracy over the conventional LDA by using the LSR step.


Least squares regression (LSR) discriminant analysis face recognition 


  1. 1.
    Belhumeur, P., Hespanha, J., Kriegman, D.: Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 711–720 (1997)Google Scholar
  2. 2.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley and Sons, Chichester (2001)Google Scholar
  3. 3.
    Loog, M., Duin, R.P.: Linear dimensionality reduction via a heteroscedastic extension of lda: The chernoff criterion. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(6), 732–739 (2004)Google Scholar
  4. 4.
    Das, K., Nenadic, Z.: Approximate information discriminant analysis: A computationally simple heteroscedastic feature extraction technique. Pattern Recognition 41(5), 1548–1557 (2008)Google Scholar
  5. 5.
    Hsieh, P.F., Wang, D.S., Hsu, C.W.: A linear feature extraction for multiclass classification problems based on class mean and covariance discriminant information. IEEE Transactions on Pattern Analysis and Machine Intelligence 28(2), 223–235 (2006)Google Scholar
  6. 6.
    Kumar, N., Andreou, A.G.: Heteroscedastic discriminant analysis and reduced rank hmms for improved speech recognition. Speech Commun. 26(4), 283–297 (1998)Google Scholar
  7. 7.
    An, G., Ruan, Q.: Novel mathematical model for enhanced fisher’s linear discriminant and its application to face recognition. In: Proceedings of International Conference on Pattern Recognition, pp. 524–527 (2006)Google Scholar
  8. 8.
    Yu, H., Yang, J.: A direct lda algorithm for high-dimensional data with application to face recognition. Pattern Recognition 34(10), 2067–2070 (2001)Google Scholar
  9. 9.
    Chen, L., Liao, H., Ko, M., Lin, J., Yu, G.: A new lda-based face recognition system which can solve the small sample size problem. Pattern Recognition 33(10), 1713–1726 (2000)Google Scholar
  10. 10.
    Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, Heidelberg (2001)Google Scholar
  11. 11.
    Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(10), 1090–1104 (2000)Google Scholar
  12. 12.
    Phillips, P.J., Flynn, P.J., Scruggs, W.T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J., Min, J., Worek, W.J.: Overview of the face recognition grand challenge. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 947–954 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Zhen Lei
    • 1
  • Shengcai Liao
    • 1
  • Dong Yi
    • 1
  • Rui Qin
    • 1
  • Stan Z. Li
    • 1
  1. 1.Center for Biometrics and Security Research, Institute of AutomationChinese Academy of SciencesBeijingChina

Personalised recommendations