Advertisement

Semi-supervised Classification by Nuclear-Norm Based Transductive Label Propagation

  • Lei Jia
  • Zhao ZhangEmail author
  • Yan Zhang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9949)

Abstract

In this paper, we propose a new transductive label propagation method, Nuclear-norm based Transductive Label Propagation (N-TLP). To encode the neighborhood reconstruction error more accurately and reliably, we use the nuclear norm that has been proved to be more robust to noise and more suitable to model the reconstruction error than both L1-norm or Frobenius norm for characterizing the manifold smoothing degree. During the optimizations, the Nuclear-norm based reconstruction error term is transformed into the Frobenius norm based one for pursuing the solution. To enhance the robustness in the process of encoding the difference between initial labels and predicted ones, we propose to use a weighted L2,1-norm regularization on the label fitness error so that the resulted measurement would be more accurate. Promising results on several benchmark datasets are delivered by our N-TLP compared with several other related methods.

Keywords

Classification Label propagation Nuclear-norm Robustness 

Notes

Acknowledgments

This work is partially supported by the National Natural Science Foundation of China (61402310,61672365, 61373093, 61672364), Major Program of Natural Science Foundation of Jiangsu Higher Education Institutions of China (15KJA520002), Special Funding of China Postdoctoral Science Foundation (2016T90494), Postdoctoral Science Foundation of China (2015M580462), Postdoctoral Science Foundation of Jiangsu Province of China (1501091B), Natural Science Foundation of Jiangsu Province of China (BK20140008 and BK20141195), and the Graduate Student Innovation Project of Jiangsu Province of China (SJZZ16_0236).

References

  1. 1.
    Rohban, M.H., Rabiee, H.R.: Supervised neighborhood graph construction for semi-supervised classification. Pattern Recogn. 45, 1363–1372 (2012)CrossRefzbMATHGoogle Scholar
  2. 2.
    Zhang, F., Yang, J., Qian, J.: Nuclear norm-based 2-DPCA for extracting features from images. Proc. IEEE Trans. Neural Netw. Learn. Syst. 26(10), 2247–2260 (2015)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Blum, A., Chawla, S.: Learning from labeled and unlabeled data using graph mincuts. In: Proceedings of the ICML, pp. 19–26 (2001)Google Scholar
  4. 4.
    Chapelle, O., Weston, J.: Cluster kernels for semi-supervised learning. Adv. Neural Inf. Process. Syst. 15, 15–17 (2003)Google Scholar
  5. 5.
    Hou, C., Nie, F., Li, X.: Joint embedding learning and sparse regression: a framework for unsupervised feature selection. Proc. IEEE Trans. Cybern. 44(6), 793–804 (2013)Google Scholar
  6. 6.
    Wang, F., Zhang, C.: Label propagation through linear neighborhoods. In: ICML, pp. 985–992 (2006)Google Scholar
  7. 7.
    Yang, Y.: L21-norm regularized discriminative feature selection for unsupervised learning. In: Proceedings of the AI, pp. 1589–1594 (2011)Google Scholar
  8. 8.
    Wang, J.: Locally Linear Embedding, pp. 203–220. Springer, Heidelberg (2012)Google Scholar
  9. 9.
    Zhang, C., Wang, S., Li, D.: Prior class dissimilarity based linear neighborhood propagation. Knowl.-Based Syst. 83, 58–65 (2015)CrossRefGoogle Scholar
  10. 10.
    Nie, F., Xiang, S., Liu, Y.: A general graph-based semi-supervised learning with novel class discovery. Neural Comput. Appl. 19, 549–555 (2010)CrossRefGoogle Scholar
  11. 11.
    Yang, S.Z., Hou, C.P., Nie, F.P., Wu, Y.: Unsupervised maximum margin feature selection via L2,1-norm minimization. Neural Comput. Appl. 21(7), 1791–1799 (2012)CrossRefGoogle Scholar
  12. 12.
    Zhang, Z., Zhang, L., Zhao, M.B., Jiang, W.M., Liang, Y.C., Li, F.Z.: Semi-supervised image classification by nonnegative sparse neighborhood propagation. In: Proceedings of the ACM-ICMR, pp. 139–146 (2015)Google Scholar
  13. 13.
    Zhou, D., Bousquet, O., Lal, T.N., Weston, J., Scholkopf, B.: Learning with local and global consistency. Adv. Neural Inf. Process. Syst. 17(4), 321–328 (2004)Google Scholar
  14. 14.
    Zhang, Z., Zhang, Y., Li, F., Zhao, M., Zhang, L., Yan, S.: Discriminative Sparse Flexible Manifold Embedding with Novel Graph for Robust Visual Representation and Label Propagation. Pattern Recogn. 61, 492–510, (2017)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  1. 1.School of Computer Science and Technology & Joint International Research Laboratory of Machine Learning and Neuromorphic ComputingSoochow UniversitySuzhouChina
  2. 2.Collaborative Innovation Center of Novel Software Technology and IndustrializationNanjingChina

Personalised recommendations