Abstract
Dual-ν Support Vector Machine (2ν-SVM) is a SVM extension that reduces the complexity of selecting the right value of the error parameter selection. However, the techniques used for solving the training problem of the original SVM cannot be directly applied to 2ν-SVM. An iterative decomposition method for training this class of SVM is described in this chapter. The training is divided into the initialisation process and the optimisation process, with both processes using similar iterative techniques. Implementation issues, such as caching, which reduces the memory usage and redundant kernel calculations are discussed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Burges, C.J.C. (1998), A Tutorial on Support Vector Machines for Pattern Recognition, Data Mining and Knowledge Discovery, Vol. 2, no. 2.
Chang, C.C. and Lin, C.J. (2001a), Training nu-Support Vector Classifiers: Theory and Algorithms, Neural Computation, Vol. 13, no. 9, pp. 2119–2147.
Chang, C.C. and Lin, C.J. (2001b), IJCNN 2001 Challenge: Generalization Ability and Text Decoding, Proceedings of INNS-IEEE International Joint Conference on Neural Networks, IJCNN2001, Washington, DC, USA.
Chew, H.G., Crisp, D.J., Bogner, R.E. and Lim, C.C. (2000), Target Detection in Radar Imagery using Support Vector Machines with Training Size Biasing, Proceedings of the Sixth International Conference on Control, Automation, Robotics and Vision, ICARCV2000, Singapore.
Chew, H.G., Bogner, R.E. and Lim, C.C. (2001a), Dual-nu Support Vector Machine with Error Rate and Training Size Biasing, Proceedings of the 26th International Conference on Acoustics, Speech and Signal Processing, ICASSP2001, Salt Lake City, Utah, USA.
Chew, H.G., Lim, C.C. and Bogner, R.E. (2001b), On Initialising nu-Support Vector Machine Training, Proceedings of the 5th International Conference on Optimisation: Techniques and Applications, ICOTA2001, pp. 1740–1747, Hong Kong.
Fletcher, R. (1987), Practical Methods of Optimization, John Wiley and Sons, Inc., 2nd edition.
Hsu, C.W. and Lin, C.J (2002), A Simple Decomposition Method for Support Vector Machines, Machine Learning, Vol. 46, pp. 291–314.
Joachims, T. (1999), Making Large-scale SVM Learning Practical, in Schölkopf, B., Burges, C.J.C and Smola, A.J. editors, Advances in Kernel Methods — Support Vector Learning, MIT Press, Cambridge, MA, USA.
Osuna, E., Freund, R. and Girosi, F. (1997a), An Improved Training Algorithm for Support Vector Machines, in Principe, J, Gile, L, Morgan, N. and Wilson, E. editors, Neural Networks for Signal Processing VII — Proceedings of the 1997 IEEE Workshop, pp. 276–285, New York, USA.
Osuna, E., Freund, R. and Girosi, F. (1997b), Training support vector machines: An application to face detection, Proceedings of CVPR'97, Puerto Rico.
Platt, J.C. (1999) Fast Training of Support Vector Machines Using Sequential Minimal Optimization, in Schölkopf, B., Burges, C.J.C and Smola, A.J. editors, Advances in Kernel Methods — Support Vector Learning, MIT Press, Cambridge, MA, USA.
Schölkopf, B., Smola, A.J., Williamson, R.C. and Bartlett, P.L. (2000), New Support Vector Algorithms, Neural Computation, Vol. 12, pp. 1207–1245.
Vapnik, V. (1995), The Nature of Statistical Learning Theory, Springer-Verlag, New York, USA.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer Science+Business Media, Inc.
About this paper
Cite this paper
Chew, HG., Lim, CC., Bogner, R.E. (2005). An Implementation of Training Dual-nu Support Vector Machines. In: Qi, L., Teo, K., Yang, X. (eds) Optimization and Control with Applications. Applied Optimization, vol 96. Springer, Boston, MA. https://doi.org/10.1007/0-387-24255-4_7
Download citation
DOI: https://doi.org/10.1007/0-387-24255-4_7
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-24254-5
Online ISBN: 978-0-387-24255-2
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)