Incremental Shared Subspace Learning for Multi-label Classification

  • Lei Zhang
  • Yao Zhao
  • Zhenfeng Zhu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7633)


Multi-label classification plays an increasingly significant role in most applications, such as semantic scene classification. In order to exploit the related information hidden in different labels which is crucial for lots of applications, it is essential to extract a latent structure shared among different labels. This paper presents an incremental approach for extracting a shared subspace on dynamic dataset. With the incremental lossless matrix factorization, the proposed algorithm can be incrementally performed without using original existing input data so that to avoid high computational complexity and decreasing the predictive performance. Experimental results demonstrate that the proposed approach is much more efficient than the non-incremental methods.


Multi-label classification incremental learning shared subspace singular value decomposition 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hoerl, A., Kennard, R.: Ridge regression: Biased estimation for nonorthogonal problems. Technometrics 12(3), 55–67 (1970)zbMATHCrossRefGoogle Scholar
  2. 2.
    Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2(2), 121–167 (1998)CrossRefGoogle Scholar
  3. 3.
    Golub, G.H., Van Loan, C.F.: Matrix Computations. The Johns Hopkins University Press (1996)Google Scholar
  4. 4.
    Tsoumakas, G., Katakis, I.: Multi-Label Classification: An Overview. International Journal of Data Warehousing and Mining 3(3), 1–13 (2007)CrossRefGoogle Scholar
  5. 5.
    Hotelling, H.: Relations between two sets of variates. Biometrika 28(3/4), 321–377 (1936)zbMATHCrossRefGoogle Scholar
  6. 6.
    Ando, R.K., Zhang, T.: A framework for learning predictive structures from multiple tasks and unlabeled data. Journal of Machine Learning Research 6(2), 1817–1853 (2005)MathSciNetzbMATHGoogle Scholar
  7. 7.
    Ji, S., Tang, L., Yu, S., Ye, J.: Extracting shared subspace for multi-label classification. In: SIGKDD, pp. 381–389 (2008)Google Scholar
  8. 8.
    Barutcuoglu, Z., Schapire, R.E., Troyanskaya, O.G.: Hierarchical multi-label prediction of gene function. Bioinformatics 22(7), 830–836 (2006)CrossRefGoogle Scholar
  9. 9.
    Yang, Y., Pedersen, J.O.: A comparative study on feature selection in text categorization. In: ICML, pp. 412–420 (1997)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Lei Zhang
    • 1
  • Yao Zhao
    • 1
  • Zhenfeng Zhu
    • 1
  1. 1.Institute of Information Science, Key Laboratory of Advanced Information Science and Network TechnologyBeijing Jiaotong University BeijingBeijingChina

Personalised recommendations