A Modified Artificial Fish Swarm Algorithm for the Optimization of Extreme Learning Machines
Neural networks have been largely applied into many real world pattern classification problems. During the training phase, every neural network can suffer from generalization loss caused by overfitting, thereby the process of learning is highly biased. For this work we use Extreme Learning Machine which is an algorithm for training single hidden layer neural networks, and propose a novel swarm-based method for optimizing its weights and improving generalization performance. The algorithm presents the basic Artificial Fish Swarm Algorithm (AFSA) and some features from Differential Evolution (Crossover and Mutation) to improve the quality of the solutions during the search process. The results of the simulations demonstrated good generalization capacity from the best individuals obtained in the training phase.
KeywordsNeural Networks Optimization
Unable to display preview. Download preview PDF.
- 2.Huang, G.B., Wang, D.H., Lan, Y.: Extreme learning machines: a survey. International Journal of Machine Learning and Cybernetics, 1–16 (2011)Google Scholar
- 3.Engelbrecht, A.P.: Fundamentals of computational swarm intelligence, vol. 1. Wiley, NY (2005)Google Scholar
- 4.Wang, C.R., Zhou, C.L., Ma, J.W.: An improved artificial fish-swarm algorithm and its application in feed-forward neural networks. In: Proceedings of 2005 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 2890–2894. IEEE (2005)Google Scholar
- 5.Xu, Y., Shu, Y.: Evolutionary extreme learning machine–based on particle swarm optimization. In: Advances in Neural Networks, ISNN 2006, pp. 644–652 (2006)Google Scholar
- 8.Qu, Y., Shang, C., Wu, W., Shen, Q.: Evolutionary fuzzy extreme learning machine for mammographic risk analysis. International Journal of Fuzzy Systems 13(4) (2011)Google Scholar
- 10.Yazdani, D., Nadjaran Toosi, A., Meybodi, M.: Fuzzy Adaptive Artificial Fish Swarm Algorithm. In: Li, J. (ed.) AI 2010. LNCS, vol. 6464, pp. 334–343. Springer, Heidelberg (2010)Google Scholar
- 12.Blake, C.L., Merz, C.J.: UCI repository of machine learning databases (1998)Google Scholar