Abstract
Ensemble learning is one of the main directions in machine learning and data mining, which allows learners to achieve higher training accuracy and better generalization ability. In this paper, with an aim at improving generalization performance, a novel approach to construct an ensemble of neural networks is proposed. The main contributions of the approach are its diversity measure for selecting diverse individual neural networks and weighted fusion technique for assigning proper weights to the selected individuals. Experimental results demonstrate that the proposed approach is effective.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Dietterich, T.G.: Ensemble Learning The Handbook of Brain Theory and Neural Networks, 2nd edn. The MIT Press, Cambridge (2002)
Hansen, L.K., Salamon, P.: Neural Network ensembles. IEEE Trans Pattern Analysis and Machine Intelligence 12(10), 993–1001 (1990)
Sollich, P., Krogh, A.: Learning with ensembles: How over-fitting can be useful. In: Touretzky, D., Mozer, M., Hasselmo, M. (eds.) Advances in Neural Information Processing Systems, vol. 8, pp. 190–196. MIT Press, Cambridge (1996)
Sharkey, A.: Combining Artificial Neural Nets: Ensemble and Modular Multi-Nets Systems. Springer, London (1999)
Valiant, L.G.: A Theory of the learnable. Communications of the ACM 27(11), 1134–1142 (1984)
Breiman, L.: Bagging predictors. Machine Learning 24(2), 123–140 (1996)
Schapire, R.E.: The strength of weak learnability. Machine Learning 5(2), 197–227 (1990)
Tang, J., Zeng, X., Lu, L.: Ensemble Learning Based on the Output Sensitivity of Multilayer Perceptrons. In: Proceedings of IEEE IJCNN, pp. 1067–1072 (2007)
Hagan, M.T., Demuth, H.B., Beale, M.H.: Neural Network Design. PWS Publishing Company (1996)
Zeng, X., Yeung, D.S.: A Quantified Sensitivity Measure for Multilayer Perceptron to Input Perturbation. Neural Computation 15, 183–211 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lu, L., Zeng, X., Wu, S., Zhong, S. (2008). A Novel Ensemble Approach for Improving Generalization Ability of Neural Networks. In: Fyfe, C., Kim, D., Lee, SY., Yin, H. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2008. IDEAL 2008. Lecture Notes in Computer Science, vol 5326. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-88906-9_21
Download citation
DOI: https://doi.org/10.1007/978-3-540-88906-9_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-88905-2
Online ISBN: 978-3-540-88906-9
eBook Packages: Computer ScienceComputer Science (R0)