Heterogeneous Domain Adaptation Using Linear Kernel

  • Zengda Guan
  • Shuotian Bai
  • Tingshao Zhu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8351)


When a task of a certain domain doesn’t have enough labels and good features, traditional supervised learning methods usually behave poorly. Transfer learning addresses this problem, which transfers data and knowledge from a related domain to improve the learning performance of the target task. Sometimes, the related task and the target task have the same labels, but have different data distributions and heterogeneous features. In this paper, we propose a general heterogeneous transfer learning framework which combines linear kernel and graph regulation. Linear kernel is used to project the original data of both domains to a Reproducing Kernel Hilbert Space, in which both tasks have the same feature dimensions and close distance of data distributions. Graph regulation is designed to preserve geometric structure of data. We present the algorithms in both unsupervised and supervised way. Experiments on synthetic dataset and real dataset about user web-behavior and personality are performed, and the effectiveness of our method is demonstrated.


Heterogenous Domain Adaptation Linear Kernel Graph Regulation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Pan, S., Yang, Q.: A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22(10), 1345–1359 (2010)CrossRefGoogle Scholar
  2. 2.
    Blitzer, J., McDonald, R., Pereira, F.: Domain Adaptation with Structural Correspondence Learning. In: Proc. Conf. Empirical Methods in Natural Language, pp. 120–128 (2006)Google Scholar
  3. 3.
    Daumé III, H.: Frustratingly Easy Domain Adaptation. In: Proc. 45th Ann. Meeting of the Assoc. Computational Linguistics, pp. 256–263 (2007)Google Scholar
  4. 4.
    Pan, S.J., Kwok, J.T., Yang, Q.: Transfer learning via dimensionality reduction. In: Proc. 23rd AAAI Conf. Artif. Intell., Chicago, IL, pp. 677–682 (2008)Google Scholar
  5. 5.
    Dai, W., Yang, Q., Xue, G., Yu, Y.: Boosting for Transfer Learning. In: Proc. 24th Int’l Conf. Machine Learning, pp. 193–200 (2007)Google Scholar
  6. 6.
    Dai, W., Chen, Y., Xue, G.-R., Yang, Q., Yu, Y.: Translated learning: Transfer learning across different feature spaces. In: NIPS (2009)Google Scholar
  7. 7.
    Yang, Q., Chen, Y., Xue, G., Dai, W., Yu, Y.: Heterogeneous transfer learning for image clustering via the social web. In: Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP, pp. 1–9 (2009)Google Scholar
  8. 8.
    Zhu, Y., Chen, Y., Lu, Z., Pan, S.J., Xue, G., Yu, Y., Yang, Q.: Heterogeneous Transfer Learning for Image Classification. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, pp. 1304–1309 (2011)Google Scholar
  9. 9.
    Shi, X., Liu, Q., Fan, W., Yu, P.S., Zhu, R.: Transfer learning on heterogenous feature spaces via spectral transformation. In: ICDM (2010)Google Scholar
  10. 10.
    Wang, C., Mahadevan, S.: Heterogeneous domain adaptation using manifold alignment. In: IJCAI (2011)Google Scholar
  11. 11.
    Kulis, B., Saenko, K., Darrell, T.: What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In: CVPR (2011)Google Scholar
  12. 12.
    Duan, L., Xu, D., Tsang, I.W.: Learning with Augmented Features for Heterogeneous Domain Adaptation. In: Proceedings of the 29 th International Conference on Machine Learning, Edinburgh, Scotland, UK (2012)Google Scholar
  13. 13.
    Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain Adaptation via Transfer Component Analysis. IEEE Transactions on Neural Networks 22(2), 199–210 (2011)CrossRefGoogle Scholar
  14. 14.
    Gu, Q., Li, Z., Han, J.: Learning a Kernel for Multi-Task Clustering. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence (2011)Google Scholar
  15. 15.
    Borgwardt, K., Gretton, A., Rasch, M., Kriegel, H.P., Scholkopf, B., Smola, A.J.: Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics 22(14), 49–57 (2006)CrossRefGoogle Scholar
  16. 16.
    Cai, D., He, X., Han, J.: Document clustering using locality preserving indexing. IEEE Trans. Knowl. Data Eng. 17(12), 1624–1637 (2005)CrossRefGoogle Scholar
  17. 17.
    Grant, M., Boyd, S.: CVX: Matlab software for disciplined convex programming, version 1.22 (2012),
  18. 18.
    Burger, J.: Personality. Thomson Wadsworth, Belmont (2008)Google Scholar
  19. 19.
    Costa, P., McCrae, R.: Neo personality inventorycrevised (neo-pi-r) and neo five-factor inventory (neo-ffi) professional manual. Psychological Assessment Resources, Odessa (1992)Google Scholar
  20. 20.
    Goldberg, L.: The structure of phenotypic personality traits. American Psychologist 48(1), 26 (1993)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Zengda Guan
    • 1
  • Shuotian Bai
    • 1
  • Tingshao Zhu
    • 1
  1. 1.Institute of PsychologyUniversity of Chinese Academy of Sciences, Chinese Academy of SciencesBeijingChina

Personalised recommendations