Abstract
Graph-based semi-supervised learning (SSL) is one of the most popular topics in the past decades. Most conventional graph-based SSL methods utilize two stage-approach to infer the class labels of the unlabeled data, i.e. it firstly constructs a graph for capturing the geometry of data manifold and then perform SSL for prediction. However, it suffers from three drawbacks: (1) the graph construction and SSL stages are separate. They do not share common information to enhance the performance of classification; (2) the graph construction and SSL should be scalable. However, most methods mainly focus on the improvement of classification accuracy but neglect the computational cost; (3) the graph should also be adaptive and robust to the parameters and datasets. However, this will usually increase computational cost making the efficiency cannot be guaranteed simultaneously. In this paper, we aim to handle the above issues. To achieve adaptiveness of SSL, we adopt a bilinear low-rank model for graph construction, where the coefficient matrix of the low-rank model is calculated through an adaptive and efficient procedure the corresponding constructed graph can capture the global structure of data manifold. Meriting from such a graph, we then propose a unified framework for scalable SSL, where we have involved the graph construction and SSL into a unified optimization problem. As a result, the discriminative information learned by SSL can be provided to improve the discriminative ability of graph construction, while the updated graph can further enhance the classification results of SSL. Simulation indicates that the proposed method can achieve better classification and clustering performance compared with other state-of-the-art graph-based SSL methods.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Belkin, M., Niyogi, P., Sindhwani, V.: Manifold regularization: a geometric framework for learning from labeled and unlabeled samples. J. Mach. Learn. Res. 7, 2399–2434 (2006)
Georghiades, A.S., Belhumeur, P.N., Kriegman, D.J.: From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 643–660 (2001)
He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.: Face recognition using Laplacian faces. IEEE Trans. Pattern Anal. Mach. Intell. 27(3), 328–340 (2005)
Hou, C., Nie, F., Wang, F., Zhang, C., Wu, Y.: Semisupervised learning using negative labels. IEEE Trans. Neural Netw. 22(3), 420–432 (2011)
Lee, K., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 947–963 (2005)
Leibe, B., Schiele, B.: Analyzing appearance and contour based methods for object categorization. In: Proceedings of 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, p. II-409. IEEE (2003)
Liu, W., He, J., Chang, S.F.: Large graph construction for scalable semi-supervised learning. In: Proceedings of the 27th International Conference on Machine Learning (ICML-2010), pp. 679–686 (2010)
Liu, W., Wang, J., Chang, S.F.: Robust and scalable graph-based semisupervised learning. Proc. IEEE 100(9), 2624–2638 (2012)
Nene, S.A., Nayar, S.K., Murase, H.: Columbia object image library (coil-100). Technical report, Technical Report CUCS-005-96, Columbia University (1996)
Nie, F., Xiang, S., Liu, Y., Zhang, C.: A general graph based semi-supervised learning with novel class discovery. Neural Comput. Appl. 19(4), 549–555 (2010)
Nie, F., Xu, D., Li, X., Xiang, S.: Semisupervised dimensionality reduction and classification through virtual label regression. IEEE Trans. Syst. Man Cybern. Part B (Cybern.) 41(3), 675–685 (2011)
Szummer, M., Jaakkola, T.: Patially labeled classification with Markov random walks. In: NIPS (2002)
Wang, F., Zhang, C.: Label propagation through linear neighborhoods. IEEE Trans. Knowl. Data Eng. 20(1), 55–67 (2008)
Wang, J., Wang, F., Zhang, C., Shen, H.C., Quan, L.: Linear neighborhood propagation and its applications. IEEE Trans. Pattern Anal. Mach. Intell. 31(9), 1600–1615 (2009)
Xiang, S., Nie, F., Zhang, C.: Semi-supervised classification via local spline regression. IEEE Trans. Pattern Anal. Mach. Intell. 32(11), 2039–2053 (2010)
Yang, Y., Nie, F., Xu, D., Luo, J., Zhuang, Y., Pan, Y.: A multimedia retrieval framework based on semi-supervised ranking and relevance feedback. IEEE Trans. Pattern Anal. Mach. Intell. 34(4), 723–742 (2012)
Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with local and global consistency. In: NIPS (2004)
Zhu, X., Ghahramani, Z., Lafferty, J.D.: Semi-supervised learning using gaussian fields and harmonic functions. In: ICML (2003)
Acknowledgment
The work is supported by the National Natural Science Foundation of China (61601112). It is also supported by the Fundamental Research Funds for the Central Universities and DHU Distinguished Young Professor Program.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Zhao, M., Zhang, J., Yang, C. (2019). Semi-supervised Learning via Adaptive Low-Rank Graph. In: Zhai, X., Chen, B., Zhu, K. (eds) Machine Learning and Intelligent Communications. MLICOM 2019. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 294. Springer, Cham. https://doi.org/10.1007/978-3-030-32388-2_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-32388-2_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32387-5
Online ISBN: 978-3-030-32388-2
eBook Packages: Computer ScienceComputer Science (R0)