Abstract
Since SVMs have met with significant success in numerous real-world learning, SVM-based active learning has been proposed in the active learning context and it has been successfully applied in the domains like document classification, in which SVMs using linear kernel are known to be effective for the task. However, it is difficult to apply SVM-based active learning to general domains because the kernel used in SVMs should be selected properly before the active learning process but good kernels for the target task is usually unknown. If the pre-selected kernel is inadequate for the target data, both the active learning process and the learned SVM have poor performance. Therefore, new active learning methods are required which effectively find an adequate kernel for the target data as well as the labels of unknown samples in the active learning process.
In this paper, we propose a two-phased SKM-based active learning method for the purpose. By experiments, we show that the proposed SKM-based active learning method has quick response suited to interaction with human experts and can find an appropriate kernel among linear combinations of given multiple kernels.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bach, F.R., Lanckriet, G.R.G., Jordan, M.I.: Multiple kernel learning, conic duality, and the smo algorithm. In: Proc. of 21st International Conference of Machine Learning (2004)
Campbell, C., Cristianini, N., Smola, A.: Query learning with large margin classifiers. In: Proc. of 17th International Conference on Machine Learning, pp. 111–118 (2000)
Platt, J.: Fast training of support vector machines using sequential minimal optimization. In: Advances in Kernel Methods, pp. 185–208. MIT Press, Cambridge (1998)
Schohn, G., Cohn, D.: Less is more: Active learning with support vector machines. In: Proc. of 17th International Conference on Machine Learning, pp. 839–846 (2000)
Sonnenburg, S., Raetsch, G., Schaefer, C., Schoelkopf, B.: Large scale multiple kernel learning. Journal of Machine Learning Research 7, 1531–1565 (2006)
Sonnenburg, S., Ratsch, G., Schafer, C.: A general and efficient multiple kernel learning algorithm. In: Advances in Neural Information Processing Systems, vol. 15. MIT Press, Cambridge (2006)
Tax, D.M.J., Duin, R.P.W.: Data domain description using support vectors. In: Proc. of 7th European Symposium on Artificial Neural Networks, pp. 251–256 (1999)
Tong, S., Koller, D.: Support vector machine active learning with applications to text classification. Journal of Machine Learning Research 2, 45–66 (2001)
Vapnik, V.: Statistical Learning Theory. John Wiley and Sons Inc., Chichester (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Sinohara, Y., Takasu, A. (2009). Two-Phased Active Support Kernel Machine Learning. In: Chawla, S., et al. New Frontiers in Applied Data Mining. PAKDD 2008. Lecture Notes in Computer Science(), vol 5433. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-00399-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-642-00399-8_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-00398-1
Online ISBN: 978-3-642-00399-8
eBook Packages: Computer ScienceComputer Science (R0)