Skip to main content

Multiview Transfer Learning and Multitask Learning

  • Chapter
  • First Online:
Multiview Machine Learning

Abstract

Transfer learning is proposed to transfer the learned knowledge from source domains to target domains where the target ones own fewer training data. Multitask learning learns multiple tasks simultaneously and makes use of the relationship among these tasks. Both of these learning methods can combine with the multiview learning, which exploits the information from the consistency of diverse views. In this chapter, we introduce four multiview transfer learning methods and three multiview multitask learning methods. We review research on multiview transfer learning under the large margin framework, discuss multiview discriminant transfer learning in detail, and introduce how to adapt Adaboost into multiview transfer learning. Three multiview multitask learning methods concentrate on the shared structures between tasks and views. The most natural way is to represent the relationships based on the bipartite graph and use an iterative algorithm to optimize its objective function. Another method constructs additional regularization function to ensure the view consistency. In general, convex shared structure learning algorithm provides structure parameters to share information. Besides, we introduce other methods; as supplements, where multi-transfer, multitask multiview discriminant analysis, and clustering are briefly mentioned.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Absil PA, Mahony R, Sepulchre R (2010) Optimization on manifolds: methods and applications. In: Recent advances in optimization and its applications in engineering, pp 125–144

    Chapter  Google Scholar 

  • Dhillon IS (2001) Co-clustering documents and words using bipartite spectral graph partitioning. In: Proceedings of the 7th ACM SIGKDD international conference on knowledge discovery and data mining, pp 269–274

    Google Scholar 

  • Diethe T, Hardoon DR, Shawe-Taylor J (2008) Multiview fisher discriminant analysis. In: Proceedings of NIPS workshop on learning from multiple sources

    Google Scholar 

  • He J, Lawrence R (2011) A graphbased framework for multi-task multi-view learning. In: Proceedings of the 28th international conference on machine learning, pp 25–32

    Google Scholar 

  • Jin X, Zhuang F, Wang S, He Q, Shi Z (2013) Shared structure learning for multiple tasks with multiple views. In: Proceedings of joint european conference on machine learning and knowledge discovery in databases, Springer, pp 353–368

    Google Scholar 

  • Jin X, Zhuang F, Xiong H, Du C, Luo P, He Q (2014) Multi-task multi-view learning for heterogeneous tasks. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, pp 441–450

    Google Scholar 

  • Pan SJ, Yang Q et al (2010) A survey on transfer learning. IEEE Trans Knowl Data Eng 22(10):1345–1359

    Article  Google Scholar 

  • Perkins DN, Salomon G et al (1992) Transfer of learning. Int Encycl Educ 2:6452–6457

    Google Scholar 

  • Tan B, Zhong E, Xiang EW, Yang Q (2014) Multi-transfer: transfer learning with multiple views and multiple sources. Statist Anal Data Min 7(4):282–293

    Article  MathSciNet  Google Scholar 

  • Xu Z, Sun S (2011) Multi-view transfer learning with adaboost. In: Proceedings of the 23rd IEEE international conference on tools with artificial intelligence, IEEE, pp 399–402

    Google Scholar 

  • Xu Z, Sun S (2012) Multi-source transfer learning with multi-view adaboost. In: Proceedings of the 19th international conference on neural information processing, Springer, pp 332–339

    Google Scholar 

  • Yang P, Gao W (2013) Multi-view discriminant transfer learning. In: Proceedings of the 23rd international joint conference on artificial intelligence, pp 1848–1854

    Google Scholar 

  • Zhang D, He J, Liu Y, Si L, Lawrence R (2011) Multi-view transfer learning with a large margin approach. In: Proceedings of the 17th ACM SIGKDD international conference on knowledge discovery and data mining, ACM, pp 1208–1216

    Google Scholar 

  • Zhang J, Huan J (2012) Inductive multi-task learning with multiple view data. In: Proceedings of the 18th ACM SIGKDD international conference on knowledge discovery and data mining, pp 543–551

    Google Scholar 

  • Zhang X, Zhang X, Liu H (2015) Multi-task multi-view clustering for non-negative data. In: Proceedings of the 24th international joint conference on artificial intelligence, pp 4055–4061

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shiliang Sun .

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Singapore Pte Ltd.

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Sun, S., Mao, L., Dong, Z., Wu, L. (2019). Multiview Transfer Learning and Multitask Learning. In: Multiview Machine Learning. Springer, Singapore. https://doi.org/10.1007/978-981-13-3029-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-3029-2_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-3028-5

  • Online ISBN: 978-981-13-3029-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics