Abstract
This paper proposes a novel discriminant semi-supervised feature extraction for generic classification and recognition tasks. The paper has two main contributions. First, we propose a flexible linear semi-supervised feature extraction method that seeks a non-linear subspace that is close to a linear one. The proposed method is based on a criterion that simultaneously exploits the discrimination information provided by the labeled samples, maintains the graph-based smoothness associated with all samples, regularizes the complexity of the linear transform, and minimizes the discrepancy between the unknown linear regression and the unknown non-linear projection. Second, we provide extensive experiments on four benchmark databases in order to study the performance of the proposed method. These experiments demonstrate much improvement over the state-of-the-art algorithms that are either based on label propagation or semi-supervised graph-based embedding.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Maaten, L., Postma, E., Herik, J.: Dimensionality reduction: a comparative review. Technical report TiCC TR 2009-005, TiCC, Tilburg University (2009)
Saul, L., Weinberger, K., Sha, F., Ham, J., Lee, D.: Spectral methods for dimensionality reduction. In: Chapelle, O., Scholkopf, B., Zien, A. (eds.) Semisupervised Learning, pp. 293–308. MIT Press, Cambridge (2006)
Yan, S., Xu, D., Zhang, B., Zhang, H., Yang, Q., Lin, S.: Graph embedding and extension: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29, 40–51 (2007)
Zhang, T., Tao, D., Li, X., Yang, J.: Patch alignment for dimensionality reduction. IEEE Trans. Knowl. Data Eng. 21, 1299–1313 (2009)
Chapelle, O., Scholkopf, B., Zien, A.: Semi-Supervised Learning. MIT Press, Cambridge (2006)
Silva, T., Zhao, L.: Network-based stochastic semisupervised learning. IEEE Trans. Neural Netw. Learn. Syst. 23, 451–466 (2012)
Camps-Valls, G., Marsheva, T.B., Zhou, D.: Semi-supervised graph-based hyperspectral image classification. IEEE Trans. Geosci. Remote Sens. 45, 3044–3054 (2007)
Huang, H., Li, J., Liu, J.: Enhanced semi-supervised local fisher discriminant analysis for face recognition. Future Gener. Comput. Syst. 28, 244–253 (2012)
Liu, W., He, J., Chang, S.: Large graph construction for scalable semi-supervised learning. In: International Conference on Machine Learning (2010)
Pan, F., Wang, J., Lin, X.: Local margin based semi-supervised discriminant embedding for visual recognition. Neurocomputing 74, 812–819 (2011)
Yang, W., Zhang, S., Liang, W.: A graph based subspace semi-supervised learning framework for dimensionality reduction. In: International Conference on Computer Vision (2008)
Xu, Z., King, I., Lyu, M.R.T., Rong, J.: Discriminative semi-supervised feature selection via manifold regularization. IEEE Trans. Neural Netw. 21, 1033–1047 (2010)
Zhang, T., Ji, R., Liu, W., Tao, D., Hua, G.: Semi-supervised learning with manifold fitted graphs. In: International Joint Conference on Artificial Intelligence (2013)
Liu, W., Tao, D., Liu, J.: Transductive component analysis. In: IEEE International Conference on Data Mining (2008)
Cevikalp, H.: Semi-supervised dimensionality reduction using pairwise equivalence constraints. In: International Conference on Computer Vision Theory and Applications (2009)
Song, Y., Nie, F., Zhang, C., Xiang, S.: A unified framework for semi-supervised dimensionality reduction. Pattern Recogn. 41, 2789–2799 (2008)
de Sousa, C.A.R., Rezende, S.O., Batista, G.E.A.P.A.: Influence of graph construction on semi-supervised learning. In: Blockeel, H., Kersting, K., Nijssen, S., Železný, F. (eds.) ECML PKDD 2013, Part III. LNCS, vol. 8190, pp. 160–175. Springer, Heidelberg (2013)
Zhu, X., Ghahramani, Z., Lafferty, J.: Semi-supervised learning using gaussian fields and harmonic functions. In: International Conference on Machine Learning (2003)
Zhou, S., Chellappa, R., Mogghaddam, B.: Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Trans. Image Process. 13, 1473–1490 (2004)
Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: a geometric framework for learning from labeled and unlabeled examples. J. Mach. Learn. Res. 7, 2399–2434 (2006)
Liu, W., Chang, S.: Robust multi-class transductive learning with graphs. In: Computer Vision and Pattern Recognition (2009)
Nie, F., Xu, D., Tsang, I., Zhang, C.: Flexible manifold embedding: a framework for semi-supervised and unsupervised dimension reduction. IEEE Trans. Image Process. 19, 1921–1932 (2010)
Cai, D., He, X., Han, J.: Semi-supervised discriminant analysis. In: IEEE International Conference on Computer Vision (2007)
Chen, H., Chang, H., Liu, T.: Local discriminant embedding and its variants. In: IEEE International Conference on Computer Vision and Pattern Recognition (2005)
Huang, H., Liu, J., Pan, Y.: Semi-supervised marginal fisher analysis for hyperspectral image classification. In: ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences I-3, pp. 377–382 (2012)
Yu, G., Zhang, G., Domeniconi, C., Yu, Z., You, J.: Semi-supervised classification based on random subspace dimensionality reduction. Pattern Recogn. 45, 1119–1135 (2012)
Xu, Y., Zhang, D., Yang, J., Yang, J.Y.: A two-phase test sample sparse representation method for use with face recognition. IEEE Trans. Circuits Syst. Video Technol. 21, 1255–1262 (2011)
Acknowledgment
This work was supported by the project EHU13/40.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Dornaika, F., El Traboulsi, Y. (2015). A Flexible Semi-supervised Feature Extraction Method for Image Classification. In: Jawahar, C., Shan, S. (eds) Computer Vision - ACCV 2014 Workshops. ACCV 2014. Lecture Notes in Computer Science(), vol 9010. Springer, Cham. https://doi.org/10.1007/978-3-319-16634-6_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-16634-6_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16633-9
Online ISBN: 978-3-319-16634-6
eBook Packages: Computer ScienceComputer Science (R0)