Abstract
The Artificial Bee Colony (ABC) is a recently introduced swarm intelligence algorithm for optimization, that has previously been applied successfully to the training of neural networks. This paper explores more carefully the performance of the ABC algorithm for optimizing the connection weights of feed-forward neural networks for classification tasks, and presents a more rigorous comparison with the traditional Back-Propagation (BP) training algorithm. The empirical results show that using the standard “stopping early” approach with optimized learning parameters leads to improved BP performance over the previous comparative study, and that a simple variation of the ABC approach provides improved ABC performance too. With both improvements applied, we conclude that the ABC approach does perform very well on small problems, but the generalization performances achieved are only significantly better than standard BP on one out of six datasets, and the training times increase rapidly as the size of the problem grows.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)
Blake, C.L., Merz, C.J.: UCI Repository of Machine Learning Databases. University of California (1998), http://www.ics.uci.edu/~mlearn/MLRepository.html
Bullinaria, J.A.: Using evolution to improve neural network learning: Pitfalls and solutions. Neural Computing and Applications 16, 209–226 (2007)
Cantu-Paz, E., Kamath, C.: An empirical comparison of combinations of evolutionary algorithms and neural networks for classification problems. IEEE Transactions on Systems, Man, and Cybernetics-Part B: Cybernetics 35, 915–927 (2005)
Duch, W., Maszczyk, T., Jankowski, N.: Make it cheap: learning with O(nd) complexity. In: Proceedings of the World Congress on Computational Intelligence, pp. 132–135 (2012)
Engelbrecht, A.P.: Computational Intelligence: An Introduction. Wiley, Sussex (2007)
Karaboga, D.: An idea based on honey bee swarm for numerical optimization. Technical Report TR06, Computer Engineering Department, Erciyes University, Turkey (2005)
Karaboga, D., Akay, B.: A comparative study of Artificial Bee Colony algorithm. Applied Mathematics and Computation 214, 108–132 (2009)
Karaboga, D., Akay, B., Ozturk, C.: Artificial Bee Colony (ABC) optimization algorithm for training feed-forward neural networks. In: Torra, V., Narukawa, Y., Yoshida, Y. (eds.) MDAI 2007. LNCS (LNAI), vol. 4617, pp. 318–329. Springer, Heidelberg (2007)
Karaboga, D., Basturk, B.: On the performance of Artificial Bee Colony (ABC) algorithm. Applied Soft Computing 8, 687–697 (2008)
Karaboga, D., Ozturk, C.: Neural networks training by Artificial Bee Colony algorithm on pattern classification. Neural Network World 19, 279–292 (2009)
Ozturk, C., Karaboga, D.: Hybrid Artificial Bee Colony algorithm for neural network training. In: Proceedings of the IEEE Congress on Evolutionary Computation, pp. 84–88 (2011)
Prechelt, L.: PROBEN1 – A set of benchmarks and benchmarking rules for neural network training algorithms. Technical Report 21/94, Universitat Karlsruhe, Fakult at fur Informatik, Germany (1994)
Qiongshuai, L., Shiqing, W.: A hybrid model of neural network and classification in wine. In: Proceedings of the 3rd International Conference on Computer Research and Development, pp. 58–61 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Bullinaria, J.A., AlYahya, K. (2014). Artificial Bee Colony Training of Neural Networks. In: Terrazas, G., Otero, F., Masegosa, A. (eds) Nature Inspired Cooperative Strategies for Optimization (NICSO 2013). Studies in Computational Intelligence, vol 512. Springer, Cham. https://doi.org/10.1007/978-3-319-01692-4_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-01692-4_15
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01691-7
Online ISBN: 978-3-319-01692-4
eBook Packages: EngineeringEngineering (R0)