Abstract
Support vector regression (SVR) has been a hot research topic for several years as it is an effective regression learning algorithm. Early studies on SVR mostly focus on solving large-scale problems. Nowadays, an increasing number of researchers are focusing on incremental SVR algorithms. However, these incremental SVR algorithms cannot handle uncertain data, which are very common in real life because the data in the training example must be precise. Therefore, to handle the incremental regression problem with uncertain data, an incremental dual nu-support vector regression algorithm (dual-v-SVR) is proposed. In the algorithm, a dual-v-SVR formulation is designed to handle the uncertain data at first, then we design two special adjustments to enable the dual-v-SVR model to learn incrementally: incremental adjustment and decremental adjustment. Finally, the experiment results demonstrate that the incremental dual-v-SVR algorithm is an efficient incremental algorithm which is not only capable of solving the incremental regression problem with uncertain data, it is also faster than batch or other incremental SVR algorithms.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Scholkopf, B., Smola, A.J.: New support vector algorithms. Neural Comput. Learn. II 1245, 1207–1245 (1998)
Chang, C.-C., Lin, C.-J.: Libsvm. ACM Trans. Intell. Syst. Technol. 2, 1–27 (2011)
Gu, B., Sheng, V.S.: A robust regularization path algorithm for ν-support vector classification. IEEE Trans. Neural Netw. Learn. Syst. 28, 1241–1248 (2017)
Wang, G., Zhang, G., Choi, K., Lu, J.: Deep additive least squares support vector machines for classification with model transfer. IEEE Trans. Syst. Man Cybern. Syst. 1–14 (2017)
Smola, A.J., Schölkopf, B.: A tutorial on support vector regression. Stat. Comput. 14, 199–222 (2001)
Shevade, S.K., Keerthi, S.S., Bhattacharyya, C., Murthy, K.R.K.: Improvements to the SMO algorithm for SVM regression. IEEE Trans. Neural Netw. 11, 1188–1193 (2000)
Takahashi, N., Guo, J., Nishi, T.: Global convergence of SMO algorithm for support vector regression. IEEE Trans. Neural Netw. 19, 971–982 (2008)
Collobert, R., Williamson, R.C.: SVMTorch: support vector machines for large-scale regression problems. J. Mach. Learn. Res. 1, 143–160 (2001)
Ma, J., Theiler, J., Perkins, S.: Accurate on-line support vector regression. Neural Comput. 15, 2683–2703 (2003)
Omitaomu, O.A., Jeong, M.K., Badiru, A.B., Hines, J.W.: Online support vector regression approach for the monitoring of motor shaft misalignment and feedwater flow rate. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37, 962–970 (2007)
Omitaomu, O.A., Jeong, M.K., Badiru, A.B.: Online support vector regression with varying parameters for time-dependent data. IEEE Trans. Syst. Man Cybern. Part A Syst. Hum. 41, 191–197 (2011)
Gu, B., Sheng, V.S., Tay, K.Y., Romano, W., Li, S.: Incremental support vector learning for ordinal regression. IEEE Trans. Neural Netw. Learn. Syst. 26, 1403–1416 (2015)
Gu, B., Sheng, V.S., Wang, Z., Ho, D., Osman, S., Li, S.: Incremental learning for ν -support vector regression. Neural Netw. 67, 140–150 (2015)
Hong, D.H., Hwang, C.H.: Interval regression analysis using quadratic loss support vector machine. IEEE Trans. Fuzzy Syst. 13, 229–237 (2005)
Yang, X., Zhang, G., Lu, J., Ma, J.: A kernel fuzzy c-Means clustering-based fuzzy support vector machine algorithm for classification problems with outliers or noises. IEEE Trans. Fuzzy Syst. 19, 105–115 (2011)
Peng, X., Chen, D., Kong, L., Xu, D.: Interval twin support vector regression algorithm for interval input-output data. Int. J. Mach. Learn. Cybern. 6, 719–732 (2015)
Chen, G., Zhang, X., Wang, Z.J., Li, F.: Robust support vector data description for outlier detection with noise or uncertain data. Knowl.-Based Syst. 90, 129–137 (2015)
Yang, X., Tan, L., He, L.: A robust least squares support vector machine for regression and classification with noise. Neurocomputing 140, 41–52 (2014)
Huang, G., Member, S., Song, S., Wu, C., You, K.: Robust support vector regression for uncertain input and output data. IEEE Trans. Neural Netw. Learn. Syst. 23, 1690–1700 (2012)
Gu, B., Wang, J., Yu, Y., Zheng, G., Huang, Y., Xu, T.: Accurate on-line ν-support vector learning. Neural Netw. 27, 51–59 (2012)
Meyer, D., Leisch, F., Hornik, K.: The support vector machine under test. Neurocomputing 55, 169–186 (2003)
Peng, X.: TSVR: an efficient twin support vector machine for regression. Neural Netw. 23, 365–372 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Yu, H., Lu, J., Zhang, G. (2018). An Incremental Dual nu-Support Vector Regression Algorithm. In: Phung, D., Tseng, V., Webb, G., Ho, B., Ganji, M., Rashidi, L. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2018. Lecture Notes in Computer Science(), vol 10938. Springer, Cham. https://doi.org/10.1007/978-3-319-93037-4_41
Download citation
DOI: https://doi.org/10.1007/978-3-319-93037-4_41
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-93036-7
Online ISBN: 978-3-319-93037-4
eBook Packages: Computer ScienceComputer Science (R0)