Abstract
The purpose of this study is to improve the classification accuracy and stability of learning vector quantization using ensemble learning. We focused on an ensemble learning algorithm based on bootstrap resampling; this algorithm has been widely used in recent years. LVQs were extended to the ensemble model using three similar approaches: bagging, random forest, and double bagging. Through computational experiments using benchmark data, we investigated the compatibility between each approach and LVQ. The results showed that the double bagging approach was superior in ensemble LVQ.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Seni, G., Elder, J.: Ensemble Methods in Data Mining - Improving Accuracy Through Combining Predictons. Morgan and Claypool, San Rafael (2010)
Efron, B., Tibshirani, R.J.: An Introduction to the Bootstrap. Springer, New York (1993)
Breiman, L.: Random Forest. Mach. Learn. 45, 5–32 (2001)
Shigei, N., Miyajima, H., Maeda, M., Ma, L.: Bagging and AdaBoost algorithms for vector quantization. Neurocomputing 73, 106–114 (2009)
Breiman, L.: Bagging predictors. Mach. Learn. 24, 123–140 (1996)
Kohonen, T.: Self-Organizing Maps. Springer, Heidelberg (1995)
Bermejo, S., Cabestany, J.: Local averaging of ensembles of LVQ-based nearrest neighbor classifiers. Appl. Intell. 20, 47–58 (2004)
Pulido, M., Melin, P., Castillo, O.: Particle swarm optimization of ensemble neural networks with fuzzy aggregation for time series prediction of the Mexican Stock Exchange. Inf. Sci. 280, 188–204 (2014)
Alhamdoosh, M., Dianhui, W.: Fast decorrelated neural network ensembles with random weights. Inf. Sci. 264, 104–117 (2014)
Kourentzes, N., Barrow, D., Crone, S.: Neural network ensemble operators for time series forecasting. Expert Syst. Appl. 41, 4235–4244 (2014)
Hothorn, T., Lausen, B.: Double-bagging: combining classifiers by bootstrap aggregation. Pattern Recogn. 36, 1303–1309 (2003)
Rodrigez, J.J., Kuncheva, L.I.: Rotation forest: a new classifier ensemble method. IEEE Trans. Pattern Anal. Mach. Intell. 28(10), 1619–1630 (2006)
Acknowledgments
This work was supported by JSPS KAKENHI Grant-in-Aig for Young Scientists (B) Numbers 15K1625.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this paper
Cite this paper
Saitoh, F. (2016). Ensemble Models of Learning Vector Quantization Based on Bootstrap Resampling. In: Villa, A., Masulli, P., Pons Rivero, A. (eds) Artificial Neural Networks and Machine Learning – ICANN 2016. ICANN 2016. Lecture Notes in Computer Science(), vol 9887. Springer, Cham. https://doi.org/10.1007/978-3-319-44781-0_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-44781-0_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-44780-3
Online ISBN: 978-3-319-44781-0
eBook Packages: Computer ScienceComputer Science (R0)