Abstract
Four different localized representation methods and two manifold learning procedures are compared in terms of recognition accuracy for several face processing tasks. The techniques under investigation are: a) Non-negative Matrix Factorization (NMF); b) Local Non-negative Matrix Factorization (LNMF); c) Independent Components Analysis (ICA); d) NMF with sparse constraints (NMFsc); e) Locality Preserving Projections (Laplacianfaces); and f) Orthogonal Projection Reduction by Affinity (OPRA). A systematic comparative analysis is conducted in terms of distance metric used, number of selected features, and sources of variability on AR, Yale, and Olivetti face databases. Results indicate that the relative performance ranking of the methods is highly task dependent, and varies significantly upon the distance metric used.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
IEEE Spectrum 41, p. 13 (2004)
Brunelli, R., Poggio, T.: Face Recognition: Features versus Templates. IEEE Trans. Pattern Anal. Machine Intell. 15, 1042–1052 (1993)
Turk, M., Pentland, A.P.: Eigenfaces for recognition. J. of Cognitive Neuroscience 3, 71–86 (1991)
Wiskott, L., Fellous, J.-M., Kruger, N., von der Malsburg, C.: Face Recognition by Elastic Bunch Graph Matching. IEEE Trans. Pattern Anal. Machine Intell. 17, 775–779 (1997)
Edwards, G.J., Taylor, C.J., Cootes, T.: Face recognition using the active appearance model. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 581–595. Springer, Heidelberg (1998)
Penev, P., Atick, J.: Local feature analysis: A general statistical theory for object representation. Network: Computation in Neural Systems 7, 477–500 (1996)
Kong, S.G., Heo, J., Abidi, B.R., Paik, J., Abidi, M.A.: Recent advances in visual and infrared face recognition—a review. Computer Vision Image Understansding 97, 103–135 (2005)
Zhao, W., Chellappa, R., Rosenfeld, A., Phillips, P.J.: Face Recognition: A Literature Survey. ACM Computing Surveys, 399–458 (2003)
Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Face recognition using kernel direct discriminant analysis algorithms. IEEE Trans. Neural Networks 14, 117–126 (2003)
Yang, M.-H.: Kernel Eigenfaces vs. Kernel Fisherfaces: Face Recognition Using Kernel Methods. In: IEEE Int. Conf. Automatic Face and Gesture Recognition, pp. 215–220. IEEE Press, Washington (2002)
Yang, J., Frangi, A.F., Yang, J.-Y., Zhang, D., Jin, Z.: KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition. IEEE Trans. Pattern Anal. Machine Intell. 27, 230–244 (2005)
Yang, J., Gao, X., Zhang, D., Yang, J.: Kernel ICA: An alternative formulation and its application to face recognition. Pattern Recognition 38, 1784–1787 (2005)
Heisele, B., Ho, P., Wu, J., Poggio, T.: Face recognition: component-based versus global approaches. Computer Vision and Image Understanding 91, 6–21 (2003)
Lucey, S., Chen, T.: A GMM parts based face representation for improved verification through relevance adaptation. In: Int. Conf. Computer Vision Pattern Recognition, pp. 855–861. IEEE Computer Society, Washington (2004)
He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.J.: Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Machine Intell. 27, 328–340 (2005)
Zhang, J., Li, S.Z., Wang, J.: Manifold Learning and Applications in Recognition. In: Tan, Y.P., Yap, K.H., Wang, L. (eds.) Intelligent Multimedia Processing with Soft Computing. Springer, Heidelberg (2004)
Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401, 788–791 (1999)
Wild, S.: Seeding Non-Negative Matrix Factorizations with the Spherical K-Means Clustering. Master Thesis, University of Colorado (2002)
Li, S.Z., Hou, X.W., Zhang, H.J.: Learning spatially localized, parts-based representation. In: IEEE Int. Conf. CVPR, pp. 1–6. IEEE Press, Washington (2001)
Barlow, H.B.: Unsupervised Learning. Neural Computation 1, 295–311 (1989)
Bartlett, M.S., Movellan, J.R., Sejnowski, T.J.: Face Recognition by Independent Component Analysis. IEEE Trans. Neural Networks 13, 1450–1464 (2002)
Bell, A.J., Sejnowski, T.J.: An information-maximization approach to blind separation and blind deconvolution. Neural Computation 7, 1129–1159 (1995)
Draper, B.A., Baek, K., Bartlett, M.S., Beveridge, J.R.: Recognizing faces with PCA and ICA. Computer Vision and Image Understanding 91, 115–137 (2003)
Hyvarinen, A.: Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Networks 10, 626–634 (1999)
Hoyer, P.O.: Non-negative matrix factorization with sparseness constraints. Journal of Machine Learning Research 5, 1457–1469 (2004)
Kramer, M.A.: Nonlinear principal components analysis using autoassociative neural networks. AIChE Journal 32, 233–243 (1991)
Ge, X., Iwata, S.: Learning the parts of objects by auto-association. Neural Networks 15, 285–295 (2002)
Donoho, D., Stodden, V.: When does non-negative matrix factorization give a correct decomposition into parts? In: NIPS, vol. 16. MIT Press, Cambridge (2004)
Guillamet, D., Vitria, J.: Evaluation of distance metrics for recognition based on non-negative matrix factorization. Pattern Recognition Lett. 4, 1599–1605 (2003)
Tipping, M.: Deriving cluster analytic distance functions, from Gaussian mixture models. In: 9th Int. Conf. on ANN, pp. 815–820 (1999)
Liu, W., Zheng, N.: Non-negative matrix factorization based methods for object recognition. Pattern Recognition Lett. 25, 893–897 (2004)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290, 2319–2323 (2000)
Roweis, S., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)
Belkin, M., Niyogi, P.: Laplacian eigenmaps for dimensionality reduction and data representation. Neural Computation 15, 1373–1396 (2003)
Bengio, Y., Paiement, J.F., Vincent, P., Delalleau, O., Le Roux, N., Ouimet, M.: Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering. Neural Computation 16, 2197–2219 (2004)
He, X., Yan, S., Hu, Y., Niyogi, P.: Face recognition using Laplacianfaces. IEEE Trans. Pattern Anal. Machine Intell. 27, 328–340 (2005)
Kokiopoulou, E., Saad, Y.: Orthogonal neighborhood preserving projections: a projection-based dimensionality reduction technique. IEEE Trans. Pattern Anal. Machine Intell. 29, 2143–2156 (2007)
Guillamet, D., Vitrià, J.: Classifying Faces with Non-negative Matrix Factorization. In: 5th Catalan Conf. for Artificial Intell, pp. 24–31. IEEE Press, Washington (2002)
Chen, L.-F., Mark Liao, H.-Y., Lin, J.-C., Han, C.-C.: Why recognition in a statistics-based face recognition system should be based on the pure face portion: a probabilistic decision-based proof. Pattern Recognition 34, 1393–1403 (2001)
Chien, J.-T., Wu, C.-C.: Discriminant waveletfaces and nearest feature classifiers for face recognition. IEEE Trans. Pattern Anal. Machine Intell. 24, 1644–1649 (2002)
Moghaddam, B., Pentland, A.P.: Probabilistic visual learning for object representation. IEEE Trans. Pattern Anal. Machine Intell. 19, 696–710 (1997)
Rudra, A.: Informative Features in Vision and Learning. Ph.D. thesis, New York University (2002)
Phillips, P.J., Bowyer, K.W.: Empirical Evaluation Techniques in Computer Vision. Wiley-IEEE Press, Chichester (1998)
Eggert, J., Wersing, H., Koerner, E.: Transformation-invariant representation and NMF. In: IJCNN 2004, pp. 2535–2540. IEEE Press, Washington (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Ciocoiu, I.B. (2009). Localized versus Locality Preserving Representation Methods in Face Recognition Tasks. In: Teodorescu, HN., Watada, J., Jain, L.C. (eds) Intelligent Systems and Technologies. Studies in Computational Intelligence, vol 217. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01885-5_5
Download citation
DOI: https://doi.org/10.1007/978-3-642-01885-5_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01884-8
Online ISBN: 978-3-642-01885-5
eBook Packages: EngineeringEngineering (R0)