Advertisement

Neural Processing Letters

, Volume 40, Issue 3, pp 211–226 | Cite as

Adaptive Graph Embedding Discriminant Projections

  • Jun Shi
  • Zhiguo Jiang
  • Hao Feng
Article

Abstract

Graph embedding based learning method plays an increasingly significant role on dimensionality reduction (DR). However, the selection to neighbor parameters of graph is intractable. In this paper, we present a novel DR method called adaptive graph embedding discriminant projections (AGEDP). Compared with most existing DR methods based on graph embedding, such as marginal Fisher analysis which usually predefines the intraclass and interclass neighbor parameters, AGEDP applies all the homogeneous samples for constructing the intrinsic graph, and simultaneously selects heterogeneous samples within the neighborhood generated by the farthest homogeneous sample for constructing the penalty graph. Therefore, AGEDP not only greatly enhances the intraclass compactness and interclass separability, but also adaptively performs neighbor parameter selection which considers the fact that local manifold structure of each sample is generally different. Experiments on AR and COIL-20 datasets demonstrate the effectiveness of the proposed method for face recognition and object categorization, and especially under the interference of occlusion, noise and poses, it is superior to other graph embedding based methods with three different classifiers: nearest neighbor classifier, sparse representation classifier and linear regression classifier.

Keywords

Graph embedding Dimensionality reduction Neighbor parameter selection Discriminant projection Face recognition Object categorization 

Notes

Acknowledgments

This work was supported by the National Natural Science Foundation of China (Nos. 61071137, 61071138, 61027004), and the 973 Program of China (Project No. 2010CB327900). The authors would like to thank the anonymous reviewers for their valuable comments and suggestions to improve the quality of this paper.

References

  1. 1.
    Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRefGoogle Scholar
  2. 2.
    Belhumeur PN, Hepanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRefGoogle Scholar
  3. 3.
    Tenenbaum JB, deSilva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290:2319–2323CrossRefGoogle Scholar
  4. 4.
    Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290:2323–2326CrossRefGoogle Scholar
  5. 5.
    Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality Reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATHGoogle Scholar
  6. 6.
    He X, Niyogi P (2003) Locality preserving projections. In: Advances in neural information processing system (NIPS) 16:100–115Google Scholar
  7. 7.
    Yan S, Xu D, Zhang B, Zhang H, Yang Q, Lin S (2007) Graph embedding and extension: a general framework for dimensionality reduction. IEEE Trans Pattern Anal Mach Intell 29(1):40–51CrossRefGoogle Scholar
  8. 8.
    Yang J, Zhang D, Yang JY, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):650–664CrossRefGoogle Scholar
  9. 9.
    Zhang ZY, Zha HY (2004) Principal manifolds and nonlinear dimensionality reduction by local tangent space alignment. SIAM J Sci Comput 26(1):313–338CrossRefMATHMathSciNetGoogle Scholar
  10. 10.
    Sun SL (2013) Tangent space intrinsic manifold regularization for data representation. In: Proceedings of the 1st IEEE China summit and international conference on signal and information processing: 179–183Google Scholar
  11. 11.
    He X, Cai D, Yan S, Zhang H (2005) Neighborhood preserving embedding. IEEE international conference on computer vision (ICCV): 1208–1213Google Scholar
  12. 12.
    Sugiyama M (2007) Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis. J Mach Learn Res 8:1027–1061MATHGoogle Scholar
  13. 13.
    Lu G, Lin Z, Jin Z (2010) Face recognition using discriminant locality preserving projections based on maximum margin criterion. Pattern Recognit 43(10):3572–3579CrossRefMATHGoogle Scholar
  14. 14.
    Wang J, Hua J (2011) Supervised discriminant projection with its application to face recognition. Neural Process Lett 34:1–12CrossRefMATHGoogle Scholar
  15. 15.
    Yang B, Chen S (2010) Sample-dependent graph construction with application to dimensionality reduction. Neurocomputing 74:301–314CrossRefGoogle Scholar
  16. 16.
    Huang P, Tang Z, Chen C, Cheng X (2011) Nearest-neighbor classifier motivated marginal discriminant projections for face recognition. Front Comput Sci China 5(4):419–428CrossRefMATHMathSciNetGoogle Scholar
  17. 17.
    Belkin M, Niyogi P (2002) Laplacian eigenmaps and spectral techniques for embedding and clustering. Advances in neural information processing systems 14Google Scholar
  18. 18.
    Nene SA, Nayar SK, Murase H (1996) Columbia object image library (COIL-20). Technical, Report CUCS-005-96Google Scholar
  19. 19.
    Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRefGoogle Scholar
  20. 20.
    Naseem I, Togneri R, Bennamoun M (2010) Linear regression for face recognition. IEEE Trans Pattern Anal Mach Intell 32(11):2106–2112CrossRefGoogle Scholar
  21. 21.
    Conover WJ (1999) Practical nonparametric statistics. Wiley, New YorkGoogle Scholar
  22. 22.
    Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview Fisher discriminant analysis. NIPS Workshop Learning from Multiple SourcesGoogle Scholar
  23. 23.
    Chen QN, Sun SL (2009) Hierarchical multi-view Fisher discriminant analysis. Lecture notes in computer science, vol 5864. Springer, Berlin, pp 289–298Google Scholar

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  1. 1.Image Processing Center, School of AstronauticsBeijing University of Aeronautics and AstronauticsBeijingChina
  2. 2.Beijing Key Laboratory of Digital MediaBeijingChina

Personalised recommendations