Multiple Kernel Learning Method Using MRMR Criterion and Kernel Alignment
Multiple kernel learning (MKL) is a widely used kernel learning method, but how to select kernel is lack of theoretical guidance. The performance of MKL is depend on the users’ experience, which is difficult to choose the proper kernels in practical applications. In this paper, we propose a MKL method based on minimal redundant maximal relevance criterion and kernel alignment. The main feature of this method compared to others in the literature is that the selection of kernels is considered as a feature selection issue in the Hilbert space, and can obtain a set of base kernels with the highest relevance to the target task and the minimal redundancies among themselves. Experimental results on several benchmark classification data sets show that our proposed method can enhance the performance of MKL.
Keywordsminimal redundant maximal relevance kernel alignment kernel selection multiple kernel learning
Unable to display preview. Download preview PDF.
- 2.Duan, L., Tsang, I.W., Xu, D., Maybank, S.J.: Domain transfer svm for video concept detection. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1375–1381. IEEE (2009)Google Scholar
- 4.Vapnik, V.: The nature of statistical learning theory. Springer (1999)Google Scholar
- 6.Bach, F.R., Lanckriet, G.R., Jordan, M.I.: Multiple kernel learning, conic duality, and the smo algorithm. In: Proceedings of the Twenty-First International Conference on Machine Learning, pp. 41–48. ACM (2004)Google Scholar
- 12.Afkanpour, A., Szepesvari, C., Bowling, M.: Alignment based kernel learning with a continuous set of base kernels. arXiv preprint arXiv:1112.4607 (2011)Google Scholar
- 13.Cristianini, N., Shawe-Taylor, J., Elisseeff, A., et al.: On kernel-target alignment. In: NIPS, pp. 367–373 (2001)Google Scholar
- 14.Bache, K., Lichman, M.: UCI machine learning repository (2013)Google Scholar