Abstract
To achieve good generalization in supervised learning, the training and testing examples are usually required to be drawn from the same source distribution. However, in many cases, this identical distribution assumption might be violated when a task from one new domain(target domain) comes, while there are only labeled data from a similar old domain(auxiliary domain). Labeling the new data can be costly and it would also be a waste to throw away all the old data. In this paper, we present a discriminative approach that utilizes the intrinsic geometry of input patterns revealed by unlabeled data points and derive a maximum-margin formulation of unsupervised transfer learning. Two alternative solutions are proposed to solve the problem. Experimental results on many real data sets demonstrate the effectiveness and the potential of the proposed methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wu, P., Dietterich, T.G.: Improving SVM Accuracy by Training on Auxiliary Data Sources. In: ICML (2004)
Zhang, K., Tsang, I.W., Kwok, J.T.: Maximum Margin Clustering Made Practical. In: ICML (2007)
Platt, J.: Fast Training of Support Vector Machines Using Sequential Minimal Optimization. In: Schölkopf, B., Burges, C., Smola, A. (eds.) Advances in Kernel Methods-Support Vector Learning, pp. 185–208. MIT Press, Cambridge
Zadrozny, B.: Learning and Evaluating Classifiers under Sample Selection Bias. In: ICML (2004)
Bickel, S., Scheffer, T.: Dirichlet-Enhanced Spam Filtering Based on Biased Samples. In: NIPS (2007)
Liao, X., Xue, Y., Carin, L.: Logistic Regression with an Auxiliary Data Source. In: ICML (2005)
Dai, W., Yang, Q., Xue, G.R., Yu, Y.: Boosting for Transfer Learning. In: ICML (2007)
Dai, W., Xue, G.R., Yang, Q., Yu, Y.: Co-Clustering Based Classification for Out-of-Domain Documents. In: SIGKDD (2007)
Ling, X., Dai, W., Xue, G.R., Yang, Q., Yu, Y.: Spectral Domain-Transfer Learning. In: SIGKDD (2008)
Kullback, S., Leibler, R.A.: On Information and Sufficiency. Annals of Mathematical Statistics 22(1), 79–86 (1951)
Joachims, T.: Transductive Inference for Text Classification Using Support Vector Machines. In: ICML (1999)
Kamvar, S.D., Klein, D., Manning, C.D.: Spectral Learning. In: IJCAI (2003)
Yang, J., Yan, R., Hauptmann, A.: Adapting Svm Classifiers to Data with Shifted Distributions. In: Workshop on Knowledge Discovery and Data Mining from Multimedia Data and Multimedia Applications, Omaha, NE (2007)
Porter, M.: An Algorithm for Suffix Stripping Program. Program 14(3), 130–137 (1980)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Su, B., Xu, W., Shen, Y. (2009). Margin-Based Transfer Learning. In: Wang, H., Shen, Y., Huang, T., Zeng, Z. (eds) The Sixth International Symposium on Neural Networks (ISNN 2009). Advances in Intelligent and Soft Computing, vol 56. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01216-7_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-01216-7_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01215-0
Online ISBN: 978-3-642-01216-7
eBook Packages: EngineeringEngineering (R0)