Soft Computing

, Volume 23, Issue 14, pp 5511–5518 | Cite as

Sparse two-dimensional discriminant locality-preserving projection (S2DDLPP) for feature extraction

  • Minghua WanEmail author
  • Guowei Yang
  • Chengli Sun
  • Maoxi Liu
Methodologies and Application


Two-dimensional locality-preserving projection (2DLPP) is an unsupervised method, so it can’t use the discrimination information of the sample in the sparse data; elastic net regression can obtain a sparse results of the feature extraction. So, this paper presents a new method for image feature extraction, namely the sparse two-dimensional discriminant locality-preserving projection (S2DDLPP) based on the 2D discriminant locality-preserving projection (2DDLPP) and elastic net regression. By adding the between-class scatter and discrimination information into the objective function of 2DLPP, S2DDLPP uses elastic net regression to obtain an optimal sparse projection matrix with “minimizing the within-class scatter” and “maximizing the between-class scatter.” Compared with other methods (2DPCA, 2DPCA-L1, 2DLDA, 2DLPP, 2DDLPP, and 2DDLPP-L1), the experimental results on the ORL, Yale, AR and FERET face database show the effectiveness of the proposed algorithm.


Two-dimensional locality preserving projection Elastic net regression Sparsity Feature extraction Discrimination information 



This work is partially supported by National Key R&D Program Grant No. 2017YFC0804002, the National Science Foundation of China under Grant Nos. 61462064, 6177227, 61362031, 61463008, 61403188, 61503195, 61603192, and the China Postdoctoral Science Foundation under Grant No. 2016M600674, the Natural Science Fund of Jiangsu Province under Grants BK20161580, BK20171494 and China’s Aviation Science (No. 20145556011).

Compliance with ethical standards

Conflict of interest

There are no conflicts of interest.


  1. Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefzbMATHGoogle Scholar
  2. Chao J, Steinbach E (2016) Keypoint encoding for improved feature extraction from compressed video at low bitrates. IEEE Trans Multimedia 18(1):25–39CrossRefGoogle Scholar
  3. Chen BC, Chen CS, Hsu WH (2015) Face recognition and retrieval using cross-age reference coding with cross-age celebrity dataset. IEEE Trans Multimedia 17(6):804–815CrossRefGoogle Scholar
  4. Efron B, Hastie T, Johnstone I et al (2004) Least angle regression. Ann Stat 32(2):407–499MathSciNetCrossRefzbMATHGoogle Scholar
  5. He X, Yan S, Hu Y, Niyogi P, Zhang HJ (2005) Face recognition using Laplacian faces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRefGoogle Scholar
  6. Hu D, Feng G, Zhou Z (2007) Two-dimensional locality preserving projections (2DLPP) with its application to palmprint recognition. Pattern Recognit 40:339–342CrossRefzbMATHGoogle Scholar
  7. Jian M, Jung C (2016) Semi-supervised bi-dictionary learning for image classification with smooth representation-based label propagation. IEEE Trans Multimedia 18(3):458–473CrossRefGoogle Scholar
  8. Kwak N (2008) Principal component analysis based on L1-norm maximization. IEEE Trans Pattern Anal Mach Intell 30(9):1672–1680CrossRefGoogle Scholar
  9. Lai Z, Wong WK, Xu Y et al (2016) Approximate orthogonal sparse embedding for dimensionality reduction. IEEE Trans Neural Netw Learn Syst 27(4):723–735MathSciNetCrossRefGoogle Scholar
  10. Lai Z, Yong X, Jian Y et al (2017) Rotational invariant dimensionality reduction algorithms. IEEE Trans Cybern 47(11):3733–3746CrossRefGoogle Scholar
  11. Lee DD, Seung HS (1999) Learning the parts of objects by nonnegative matrix factorization. Nature 401:788–791CrossRefzbMATHGoogle Scholar
  12. Li X, Pang Y (2010) Deterministic column-based matrix decomposition. IEEE Trans Knowl Data Eng 22(1):145–149MathSciNetCrossRefGoogle Scholar
  13. Li X, Pang Y, Yuan Y (2009) L1-norm-based 2DPCA. IEEE Trans Syst Man Cybern B Cybern 40(4):1170–1175Google Scholar
  14. Lu Y, Lai Z, Xu Y et al (2017) Nonnegative discriminant matrix factorization. IEEE Trans Circuits Syst Video Technol 27(7):1392–1405CrossRefGoogle Scholar
  15. Luo C, Ni B, Yan S, Wang M (2016) Image classification by selective regularized subspace learning. IEEE Trans Multimedia 18(1):40–50CrossRefGoogle Scholar
  16. Ma S, Zhang X, Wang S et al (2017) Entropy of primitive: from sparse representation to visual information evaluation. IEEE Trans Circuits Syst Video Technol 27(2):249–260CrossRefGoogle Scholar
  17. Nie F, Xu D, Tsang WH, Zhang C (2010) Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans Image Process 19(7):1921–1932MathSciNetCrossRefzbMATHGoogle Scholar
  18. Nie F, Yuan J, Huang H (2014) Optimal mean robust principal component analysis. In: Proceedings of the international conference on international conference on machine learning, pp 1062–1070Google Scholar
  19. Nie F, Wang H, Huang H, Ding C (2015) Joint Schatten, p-norm and LP-norm robust matrix completion for missing value recovery. Knowl Inf Syst 42(3):525–544CrossRefGoogle Scholar
  20. Nie F, Zhu W, Li X (2017) Unsupervised large graph embedding. In: Proceedings of 31st AAAI conference on artificial intelligence, San Francisco, CA, pp 2422–2428Google Scholar
  21. Pang Y, Tao D, Yuan Y, Li X (2008) Binary two-dimensional PCA. IEEE Trans Syst Man Cybern B Cybern 38(4):1176–1180CrossRefGoogle Scholar
  22. Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRefGoogle Scholar
  23. Song Y (2009) Orthogonal locality minimizing globality maximizing projections for feature extraction. Opt Eng 48(1):017202–017202-5Google Scholar
  24. Swets D, Weng J (1996) Using discriminant eigenfeatures for image retrieval. IEEE Trans Pattern Anal Mach Intell 18:831–836CrossRefGoogle Scholar
  25. Tang Y, Zhang Z, Zhang Y, Li F (2016) Robust L1-norm matrixed locality preserving projection for discriminative subspace learning. In: Proceedings of international joint conference on neural networks, pp 4199–4204Google Scholar
  26. Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRefGoogle Scholar
  27. Turk M, Pentland A (1991) Eigenfaces for recognition. Cogn Neurosci 3:71–86CrossRefGoogle Scholar
  28. Wagner A, Wright J, Ganesh A et al (2012) Toward a practical face recognition system: robust alignment and illumination by sparse representation. IEEE Trans Pattern Anal Mach Intell 34(2):372–386CrossRefGoogle Scholar
  29. Wan M, Lai Z (2017) Multi-manifold locality graph embedding based on the maximum margin criterion (MLGE/MMC) for face recognition. IEEE Access 5:9823–9830CrossRefGoogle Scholar
  30. Wan M, Lai Z, Shao J, Jin Z (2009) Two-dimensional local graph embedding discriminant analysis (2DLGEDA) with its application to face and palm biometrics. Neurocomputing 73:193–203CrossRefGoogle Scholar
  31. Wan M, Lai Z, Yang G et al (2017) Local graph embedding based on maximum margin criterion via fuzzy set. Fuzzy Sets Syst 318:120–131MathSciNetCrossRefGoogle Scholar
  32. Wang L, Cheng H, Liu Z et al (2014a) A robust elastic net approach for feature learning. J Vis Commun Image Represent 25(2):313–321CrossRefGoogle Scholar
  33. Wang H, Lu X, Hu Z, Zheng W (2014b) Fisher discriminant analysis with L1-norm. IEEE Trans Cybern 44(6):828–842CrossRefGoogle Scholar
  34. Wang Q, Chen F, Gao Q, Gao X, Nie F (2016) On the schatten norm for matrix based subspace learning and classification. Neurocomputing 216:192–199CrossRefGoogle Scholar
  35. Yang J, Zhang D, Frangi AF, Yang J-Y (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137CrossRefGoogle Scholar
  36. Yang J, Zhang D, Xu Y, Yang JY (2005) Two-dimensional discriminant transform for face recognition. Pattern Recognit 38(7):1125–1129CrossRefzbMATHGoogle Scholar
  37. Yu W (2009) Face recognition using two-dimensional discriminant locality preserving projections. Pattern Recognit Lett 30(15):1378–1383CrossRefGoogle Scholar
  38. Zhao HX, Xing HJ, Wang XZ, Chen JF(2011) L1-norm-based 2DLPP. In: Proceedings of Chinese conference on control and decision, pp 1259–1264Google Scholar
  39. Zhi R, Ruan Q (2008) Facial expression recognition based on two-dimensional discriminant locality preserving projections. Neurocomputing 71(7–9):1730–1734CrossRefGoogle Scholar
  40. Zhou Y, Sun S (2017) Manifold partition discriminant analysis. IEEE Trans Cybern 47(4):830–840CrossRefGoogle Scholar
  41. Zou H, Hastie T (2003) Regression shrinkage and selection via the elastic net, with applications to microarrays. J R Stat Soc Ser B 67:301–320CrossRefGoogle Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  • Minghua Wan
    • 1
    • 2
    • 3
    Email author
  • Guowei Yang
    • 1
  • Chengli Sun
    • 4
  • Maoxi Liu
    • 4
  1. 1.School of Information EngineeringNanjing Audit UniversityNanjingPeople’s Republic of China
  2. 2.College of Computer Science and Software EngineeringShenzhen UniversityShenzhenPeople’s Republic of China
  3. 3.Key Laboratory of Trusted Cloud Computing and Big Data AnalysisNanjing Xiaozhuang UniversityNanjingPeople’s Republic of China
  4. 4.Key Laboratory of Jiangxi Province for Image Processing and Pattern RecognitionNanchang Hangkong UniversityNanchangPeople’s Republic of China

Personalised recommendations