Abstract
The hyperparameters selection has a great affection on accuracy of support vector regression (SVR). In order to determine the hyperparameters of SVR, an adaptive chaotic cultural algorithm (ACCA) is employed for the optimal hyperparameters including kernel parameters σ of Gaussian kernel function, regular constant γ and ε in the ε-insensitive loss function. Based on this, a learning algorithm with two-stage is constructed to realize the objective. Firstly, the initialization search spaces of hyperparameters are determined according to their influence on the performance of support vector regression. Secondly, optimal hyperparameters are selected using ACCA. ACCA adopt dual structure in cultural algorithm and adaptive chaotic mutation in evolution induction functions, and uses implicit knowledge extracted from evolution process to control mutation scale, which inducts individuals escaping from local best solutions. Taken the forecasting of gas concentration as example, experiment results indicate optimal hyperparameters can be obtained through above strategy.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Vapnik, V.N.: An Overview of Statistical Learning Theory. IEEE Transactions Neural Networks 10(5), 988–999 (1999)
Li, D., Mersereau, R.M., Simske, S.: Blind image deconvolution through support vector regression. IEEE Transactions on Neural Networks 18(3), 931–935 (2007)
Chapelle, O., Vapnik, V.N., Bousquet, O., Mukherjee, S.: Choosing Multiple parameters for support vector machines. Machine Learning 46(1), 131–159 (2002)
Du, H.F., Gong, M.G., Liu, R.C., et al.: An Adaptive Chaotic Clone Evolutionary Programming. Science in China Ser. E Information Science 35(8), 817–829 (2005)
Xidong, J., Reynolds, R.G.: Using Knowledge-based Evolutionary Computation to Solve Nonlinear Constraint Optimization Problems: a Cultural Algorithm Approach. In: IEEE Congress on Evolutionary Computation, pp. 1672–1678 (1999)
Cheng, J., Bai, J.Y., Qian, J.S., Li, S.Y.: Short-term forecasting method of coal mine gas concentration based on chaotic time series. Journal of China University of Mining and Technology 10(2), 231–235 (2008)
Cao, L.J., Tay, F.E.H.: Support vector machine with adaptive parameters in financial time series forecasting. IEEE Transactions on Neural Networks 14(6), 1506–1518 (2003)
Han, M., Xi, J.H., Xu, S.G., Yin, F.L.: Prediction of chaotic time series based on the recurrent predictor neural network. IEEE Transactions on Signal Processing 52(12), 3409–3416 (2004)
Leung, H., Lo, T., Wang, S.: Prediction of noisy chaotic time series using an optimal radial basis function neural network. IEEE Transactions on Neural Networks 12(5), 1163–1172 (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cheng, J., Qian, J., Guo, Yn. (2009). Adaptive Chaotic Cultural Algorithm for Hyperparameters Selection of Support Vector Regression. In: Huang, DS., Jo, KH., Lee, HH., Kang, HJ., Bevilacqua, V. (eds) Emerging Intelligent Computing Technology and Applications. With Aspects of Artificial Intelligence. ICIC 2009. Lecture Notes in Computer Science(), vol 5755. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04020-7_31
Download citation
DOI: https://doi.org/10.1007/978-3-642-04020-7_31
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04019-1
Online ISBN: 978-3-642-04020-7
eBook Packages: Computer ScienceComputer Science (R0)