Abstract
When applied to high-dimensional classification task such as face recognition, linear discriminant analysis (LDA) can extract two kinds of discriminant vectors, those in the null space (irregular) and those in the range space (regular) of the within-class scatter matrix. Recently, regularization techniques, which alleviate the over-fitting to the training set, have been used to further improve the recognition performance of LDA. Most current regularization techniques, however, are pre-processing approaches and can’t be used to regularize irregular discriminant vectors. This paper proposes a post-processing method, 2D-Gaussian filtering, for regularizing both regular and irregular discriminant vectors. This method can also be combined with other regularization techniques. We present two LDA methods, regularization of subspace LDA (RSLD) and regularization of complete Fisher discriminant framework (RCFD) and test them on the FERET face database. Post-processing is shown to improve the recognition accuracy in face recognition.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: a literature survey. ACM Computing Surveys 35, 399–458 (2003)
Swets, D.L., Weng, J.: Using discriminant Eigenfeatures for image retrieval. IEEE Trans. Pattern Analysis and Machine Intelligence 18, 831–836 (1996)
Belhumeour, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces versus Fisherfaces: recognition using class specific linear projection. IEEE Trans. Pattern Analysis and Machine Intelligence 19, 711–720 (1997)
Torkkola, K.: Linear discriminant analysis in document classification. In: Proc. IEEE ICDM Workshop Text Mining (2001)
Baeka, J., Kimb, M.: Face recognition using partial least squares components. Pattern Recognition 37, 1303–1306 (2004)
Chien, J.T., Wu, C.C.: Discriminant waveletfaces and nearest feature classifiers for face recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 24, 1644–1649 (2002)
Chen, L.F., Mark Liao, H.Y., Ko, M.T., Lin, J.C., Yu, G.J.: A new LDA-based face recognition system which can solve the small sample size problem. Pattern Recognition 33, 1713–1726 (2000)
Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recognition 34, 2067–2070 (2001)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Face recognition using LDA-based algorithms. IEEE Trans. Neural Networks 14, 195–200 (2003)
Yang, J., Zhang, D., Yang, J.Y.: A generalized K-L expansion method which can deal with Small Smaple Size and high-dimensional problems. Pattern Analysis and Applications 6, 47–54 (2003)
Cevikalp, H., Neamtu, M., Wilkes, M., Barkana, A.: Discriminative common vectors for face recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 27, 4–13 (2005)
Yang, J., Yang, J.Y.: Why can LDA be performed in PCA transformed space. Pattern Recognition 36, 563–566 (2003)
Yang, J., Frangi, A.F., Yang, J.Y., Zhang, D., Jin, Z.: KPCA plus LDA: a complete Kernel Fisher discriminant framework for feature extraction and recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 27, 230–244 (2005)
Zhao, W., Chellappa, R., Krishnaswamy, A.: Discriminant analysis of principal components for face recognition. In: Proc. Int’l Conf. Automatic Face and Gesture Recognition, pp. 336–341 (1998)
Bensmail, H., Celeux, G.: Regularized Gaussian discriminant analysis through eigenvalue decomposition. Journal of the American Statistics Association 91, 1743–1748 (1996)
Liu, C., Wechsler, H.: Enhanced Fisher linear discriminant models for face recognition. In: Proc. 14th Int’l Conf. Pattern Recognition, vol. 2, pp. 1368–1372 (1998)
Wang, X., Tang, X.: A unified framework for subspace face recognition. IEEE Trans. Pattern Analysis and Machine Intelligence 26, 1222–1228 (2004)
Dai, D.Q., Yuen, P.C.: Regularized discriminant analysis and its application to face recognition. Pattern Recognition 36, 845–847 (2003)
Chen, W.S., Yuen, P.C., Huang, J., Dai, D.Q.: Kernel machine-based one-parameter regularized Fisher Discriminant method for face recognition. IEEE Trans. Systems, Man, and Cybernetics-B 35, 659–669 (2005)
Pima, I., Aladjem, M.: Regularized discriminant analysis for face recognition. Pattern Recognition 37, 1945–1948 (2004)
Hoffbeck, J.P., Landgrebe, D.A.: Covariance matrix estimation and classification with limited training data. IEEE Trans. Pattern Analysis and Machine Intelligence 18, 763–767 (1996)
Thomaz, C.E., Gillies, D.F., Feitosa, R.Q.: A new covariance estimate for Bayesian classifier in biometrics recognition. IEEE Trans. Circuits and Systems for Video Technology 14, 214–223 (2004)
Pratt, W.K.: Digital Image Processing, 2nd edn. Wiley, New York (1991)
Yang, J., Yang, J.Y., Zhang, D.: What’s wrong with Fisher criterion. Pattern recognition 35, 2665–2668 (2002)
Xu, Y., Yang, J.Y., Jin, Z.: Theory analysis on FSLDA and ULDA. Pattern recognition 36, 3031–3033 (2003)
Jin, Z., Yang, J.Y., Hu, Z.S., Lou, Z.: Face recognition based on the uncorrelated discriminant transform. Pattern recognition 34, 1405–1416 (2001)
Philips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Analysis and Machine Intelligence 22, 1090–1104 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zuo, W., Wang, K., Zhang, D., Yang, J. (2005). Regularization of LDA for Face Recognition: A Post-processing Approach. In: Zhao, W., Gong, S., Tang, X. (eds) Analysis and Modelling of Faces and Gestures. AMFG 2005. Lecture Notes in Computer Science, vol 3723. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11564386_29
Download citation
DOI: https://doi.org/10.1007/11564386_29
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29229-6
Online ISBN: 978-3-540-32074-6
eBook Packages: Computer ScienceComputer Science (R0)