Skip to main content

A Flexible Semi-supervised Feature Extraction Method for Image Classification

  • Conference paper
  • First Online:
  • 1378 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9010))

Abstract

This paper proposes a novel discriminant semi-supervised feature extraction for generic classification and recognition tasks. The paper has two main contributions. First, we propose a flexible linear semi-supervised feature extraction method that seeks a non-linear subspace that is close to a linear one. The proposed method is based on a criterion that simultaneously exploits the discrimination information provided by the labeled samples, maintains the graph-based smoothness associated with all samples, regularizes the complexity of the linear transform, and minimizes the discrepancy between the unknown linear regression and the unknown non-linear projection. Second, we provide extensive experiments on four benchmark databases in order to study the performance of the proposed method. These experiments demonstrate much improvement over the state-of-the-art algorithms that are either based on label propagation or semi-supervised graph-based embedding.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://vision.ucsd.edu/~leekc/ExtYaleDatabase/ExtYaleB.html.

  2. 2.

    http://www.itl.nist.gov/iad/humanid/feret/.

  3. 3.

    http://www.facepix.org/.

  4. 4.

    http://www.cs.columbia.edu/CAVE/software/softlib/coil-20.php.

References

  1. Maaten, L., Postma, E., Herik, J.: Dimensionality reduction: a comparative review. Technical report TiCC TR 2009-005, TiCC, Tilburg University (2009)

    Google Scholar 

  2. Saul, L., Weinberger, K., Sha, F., Ham, J., Lee, D.: Spectral methods for dimensionality reduction. In: Chapelle, O., Scholkopf, B., Zien, A. (eds.) Semisupervised Learning, pp. 293–308. MIT Press, Cambridge (2006)

    Google Scholar 

  3. Yan, S., Xu, D., Zhang, B., Zhang, H., Yang, Q., Lin, S.: Graph embedding and extension: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29, 40–51 (2007)

    Article  Google Scholar 

  4. Zhang, T., Tao, D., Li, X., Yang, J.: Patch alignment for dimensionality reduction. IEEE Trans. Knowl. Data Eng. 21, 1299–1313 (2009)

    Article  Google Scholar 

  5. Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning. MIT Press, Cambridge (2006)

    Book  Google Scholar 

  6. Silva, T., Zhao, L.: Network-based stochastic semisupervised learning. IEEE Trans. Neural Netw. Learn. Syst. 23, 451–466 (2012)

    Article  Google Scholar 

  7. Camps-Valls, G., Marsheva, T.B., Zhou, D.: Semi-supervised graph-based hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 45, 3044–3054 (2007)

    Article  Google Scholar 

  8. Huang, H., Li, J., Liu, J.: Enhanced semi-supervised local fisher discriminant analysis for face recognition. Future Gener. Comput. Syst. 28, 244–253 (2012)

    Article  Google Scholar 

  9. Liu, W., He, J., Chang, S.: Large graph construction for scalable semi-supervised learning. In: International Conference on Machine Learning (2010)

    Google Scholar 

  10. Pan, F., Wang, J., Lin, X.: Local margin based semi-supervised discriminant embedding for visual recognition. Neurocomputing 74, 812–819 (2011)

    Article  Google Scholar 

  11. Yang, W., Zhang, S., Liang, W.: A graph based subspace semi-supervised learning framework for dimensionality reduction. In: International Conference on Computer Vision (2008)

    Google Scholar 

  12. Xu, Z., King, I., Lyu, M.R.T., Rong, J.: Discriminative semi-supervised feature selection via manifold regularization. IEEE Trans. Neural Netw. 21, 1033–1047 (2010)

    Article  Google Scholar 

  13. Zhang, T., Ji, R., Liu, W., Tao, D., Hua, G.: Semi-supervised learning with manifold fitted graphs. In: International Joint Conference on Artificial Intelligence (2013)

    Google Scholar 

  14. Liu, W., Tao, D., Liu, J.: Transductive component analysis. In: IEEE International Conference on Data Mining (2008)

    Google Scholar 

  15. Cevikalp, H.: Semi-supervised dimensionality reduction using pairwise equivalence constraints. In: International Conference on Computer Vision Theory and Applications (2009)

    Google Scholar 

  16. Song, Y., Nie, F., Zhang, C., Xiang, S.: A unified framework for semi-supervised dimensionality reduction. Pattern Recogn. 41, 2789–2799 (2008)

    Article  MATH  Google Scholar 

  17. de Sousa, C.A.R., Rezende, S.O., Batista, G.E.A.P.A.: Influence of graph construction on semi-supervised learning. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) ECML PKDD 2013, Part III. LNCS, vol. 8190, pp. 160–175. Springer, Heidelberg (2013)

    Chapter  Google Scholar 

  18. Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using gaussian fields and harmonic functions. In: International Conference on Machine Learning (2003)

    Google Scholar 

  19. Zhou, S., Chellappa, R., Mogghaddam, B.: Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Trans. Image Process. 13, 1473–1490 (2004)

    Article  Google Scholar 

  20. Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7, 2399–2434 (2006)

    MATH  MathSciNet  Google Scholar 

  21. Liu, W., Chang, S.: Robust multi-class transductive learning with graphs. In: Computer Vision and Pattern Recognition (2009)

    Google Scholar 

  22. Nie, F., Xu, D., Tsang, I., Zhang, C.: Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans. Image Process. 19, 1921–1932 (2010)

    Article  MathSciNet  Google Scholar 

  23. Cai, D., He, X., Han, J.: Semi-supervised discriminant analysis. In: IEEE International Conference on Computer Vision (2007)

    Google Scholar 

  24. Chen, H., Chang, H., Liu, T.: Local discriminant embedding and its variants. In: IEEE International Conference on Computer Vision and Pattern Recognition (2005)

    Google Scholar 

  25. Huang, H., Liu, J., Pan, Y.: Semi-supervised marginal fisher analysis for hyperspectral image classification. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences I-3, pp. 377–382 (2012)

    Google Scholar 

  26. Yu, G., Zhang, G., Domeniconi, C., Yu, Z., You, J.: Semi-supervised classification based on random subspace dimensionality reduction. Pattern Recogn. 45, 1119–1135 (2012)

    Article  MATH  Google Scholar 

  27. Xu, Y., Zhang, D., Yang, J., Yang, J.Y.: A two-phase test sample sparse representation method for use with face recognition. IEEE Trans. Circuits Syst. Video Technol. 21, 1255–1262 (2011)

    Article  Google Scholar 

Download references

Acknowledgment

This work was supported by the project EHU13/40.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Fadi Dornaika .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Dornaika, F., El Traboulsi, Y. (2015). A Flexible Semi-supervised Feature Extraction Method for Image Classification. In: Jawahar, C., Shan, S. (eds) Computer Vision - ACCV 2014 Workshops. ACCV 2014. Lecture Notes in Computer Science(), vol 9010. Springer, Cham. https://doi.org/10.1007/978-3-319-16634-6_10

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-16634-6_10

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-16633-9

  • Online ISBN: 978-3-319-16634-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics