Multitask Twin Support Vector Machines

  • Xijiong Xie
  • Shiliang Sun
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7664)


Multitask learning is a learning paradigm which seeks to improve the generalization performance of a task with the help of other tasks. Learning multiple related tasks simultaneously has been empirically as well as theoretically shown to improve performance relative to learning each task independently. In this paper, we propose a new classification method named multitask twin support vector machines based on the regularization principle and twin support vector machines. Our new approach is that we put twin support vector machines to multitask learning. Experimental results demonstrate that the proposed method dramatically improves the performance relative to learning each task independently.


Multitask learning Regularization principle Twin support vector machines 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Shawe-Taylor, J., Sun, S.: A Review of Optimization Methodologies in Support Vector Machines. Neurocomputing 74, 3609–3618 (2011)CrossRefGoogle Scholar
  2. 2.
    Mangasarian, O.L., Wild, E.W.: MultisurFace Proximal Support Vector Machine Classification via Generalized Eigenvalues. IEEE Transactions on Pattern Analysis and Machine Intelligence 28, 69–74 (2006)CrossRefGoogle Scholar
  3. 3.
    Jayadeva, Khemchandani, R., Chandra, S.: Twin Support Vector Machines for Pattern Classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(5), 905–910 (2007)CrossRefGoogle Scholar
  4. 4.
    Ghorai, S., Mukherjee, A., Dutta, P.K.: Nonparallel Plane Proximal Classifier. Signal Processing, 510–522 (2009)Google Scholar
  5. 5.
    Caruana, R.: Multitask Learning. Machine Learning 28, 41–75 (1997)CrossRefGoogle Scholar
  6. 6.
    Sun, S.: Multitask Learning for EEG-based Biometrics. In: Proceedings of 19th International Conference on Pattern Recognition, pp. 1–4 (2008)Google Scholar
  7. 7.
    Baxter, J.: A Model for Inductive Bias Learning. Journal of Artificial Intelligence Research 12, 149–198 (2000)MathSciNetzbMATHGoogle Scholar
  8. 8.
    Evgeniou, T., Micchelli, C.A., Pontil, M.: Learning Multiple Tasks with Kernel Methods. Journal of Machine Learning Research 6, 615–637 (2005)MathSciNetzbMATHGoogle Scholar
  9. 9.
    Ji, Y., Sun, S.: Multitask Multiclass Support Vector Machines. In: Proceedings of IEEE 11th International Conference on Data Mining Workshops, pp. 512–518 (2011)Google Scholar
  10. 10.
    Ben-David, S., Schuller, R.: Exploiting Task Relatedness for Multiple Task Learning. In: Schölkopf, B., Warmuth, M.K. (eds.) COLT/Kernel 2003. LNCS (LNAI), vol. 2777, pp. 567–580. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  11. 11.
    Ando, R.K., Zhang, T.: A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data. Journal of Machine Learning Research 6, 1817–1853 (2005)MathSciNetzbMATHGoogle Scholar
  12. 12.
    Bakker, B., Heskes, T.: Task Clustering and Gating for Bayesian Multitask Learning. Journal of Machine Learning Research 4, 83–99 (2003)Google Scholar
  13. 13.
    Evgeniou, T., Pontil, M.: Regularized Multi-Task Learning. In: Proceedings of Knowledge Discovery and Data Mining, pp. 109–117 (2004)Google Scholar
  14. 14.
    Asuncion, A., Newman, D.J.: UCI Machine Learning Repository,
  15. 15.
    Duck Electrical Computer Engineering,

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Xijiong Xie
    • 1
  • Shiliang Sun
    • 1
  1. 1.Department of Computer Science and TechnologyEast China Normal UniversityShanghaiP.R. China

Personalised recommendations