Regularized Complete Linear Discriminant Analysis for Small Sample Size Problems

  • Wuyi Yang
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 304)


In small sample size (SSS) problems, the number of available training samples is smaller than the dimensionality of the sample space. Since linear discriminant analysis (LDA) requires the within-class scatter matrix to be non-sigular, LDA cannot be directly applied to SSS problems. In this paper, regularized complete linear discriminant analysis (RCLDA) is proposed to solve SSS problems. RCLDA uses two regularized criterion to derive “regular” discriminant vectors in the range space of the within-class scatter matrix and “irregular” discriminant vectors in the null space of the within-class scatter matrix. Extensive experiments on the SSS problem of face recognition are carried out to evaluate the proposed algorithm in terms of classification accuracy and demonstrate the effectiveness of the proposed algorithm.


Complete linear discriminant analysis regularization small sample size problems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, New York (1990)zbMATHGoogle Scholar
  2. 2.
    Chen, L.F., Liao, H.Y.M., Lin, J.C., Kao, M.D., Yu, G.J.: A New LDA-Based Face Recognition System which Can Solve the Small Sample Size Problem. Pattern Recognition 33(10), 1713–1726 (2000)CrossRefGoogle Scholar
  3. 3.
    Yu, H., Yang, J.: A Direct LDA Algorithm for High-Dimensional Data-With Application to Face Recognition. Pattern Recognition 34(10), 2067–2070 (2001)zbMATHCrossRefGoogle Scholar
  4. 4.
    Yang, J., Yang, J.Y.: Why Can LDA Be Performed in PCA Transformed Space? Pattern Recognition 36(2), 563–566 (2003)CrossRefGoogle Scholar
  5. 5.
    Yang, J., Frangi, A.F., Yang, J.Y., Zhang, D., Jin, Z.: KPCA plus LDA: A Complete Kernel Fisher Discriminant Framework for Feature Extraction and Recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 27(2), 230–244 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Wuyi Yang
    • 1
  1. 1.Key Laboratory of Underwater Acoustic Communication and Marine Information Technology of the Minister of EducationXiamen UniversityXiamenChina

Personalised recommendations