Advertisement

A Modified Artificial Fish Swarm Algorithm for the Optimization of Extreme Learning Machines

  • João Fausto Lorenzato de Oliveira
  • Teresa B. Ludermir
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7553)

Abstract

Neural networks have been largely applied into many real world pattern classification problems. During the training phase, every neural network can suffer from generalization loss caused by overfitting, thereby the process of learning is highly biased. For this work we use Extreme Learning Machine which is an algorithm for training single hidden layer neural networks, and propose a novel swarm-based method for optimizing its weights and improving generalization performance. The algorithm presents the basic Artificial Fish Swarm Algorithm (AFSA) and some features from Differential Evolution (Crossover and Mutation) to improve the quality of the solutions during the search process. The results of the simulations demonstrated good generalization capacity from the best individuals obtained in the training phase.

Keywords

Neural Networks Optimization 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Haykin, S.: Neural networks: a comprehensive foundation. Prentice Hall PTR, Upper Saddle River (1994)zbMATHGoogle Scholar
  2. 2.
    Huang, G.B., Wang, D.H., Lan, Y.: Extreme learning machines: a survey. International Journal of Machine Learning and Cybernetics, 1–16 (2011)Google Scholar
  3. 3.
    Engelbrecht, A.P.: Fundamentals of computational swarm intelligence, vol. 1. Wiley, NY (2005)Google Scholar
  4. 4.
    Wang, C.R., Zhou, C.L., Ma, J.W.: An improved artificial fish-swarm algorithm and its application in feed-forward neural networks. In: Proceedings of 2005 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 2890–2894. IEEE (2005)Google Scholar
  5. 5.
    Xu, Y., Shu, Y.: Evolutionary extreme learning machine–based on particle swarm optimization. In: Advances in Neural Networks, ISNN 2006, pp. 644–652 (2006)Google Scholar
  6. 6.
    Zhu, Q.Y., Qin, A.K., Suganthan, P.N., Huang, G.B.: Evolutionary extreme learning machine. Pattern Recognition 38(10), 1759–1763 (2005)CrossRefzbMATHGoogle Scholar
  7. 7.
    Saraswathi, S., Sundaram, S., Sundararajan, N., Zimmermann, M., Nilsen-Hamilton, M.: Icga-pso-elm approach for accurate multiclass cancer classification. IEEE/ACM Transactions on Computational Biology and Bioinformatics 8(2), 452–463 (2011)CrossRefGoogle Scholar
  8. 8.
    Qu, Y., Shang, C., Wu, W., Shen, Q.: Evolutionary fuzzy extreme learning machine for mammographic risk analysis. International Journal of Fuzzy Systems 13(4) (2011)Google Scholar
  9. 9.
    Rao, C.R., Mitra, S.K.: Generalized inverse of matrices and its applications. Wiley, NY (1971)zbMATHGoogle Scholar
  10. 10.
    Yazdani, D., Nadjaran Toosi, A., Meybodi, M.: Fuzzy Adaptive Artificial Fish Swarm Algorithm. In: Li, J. (ed.) AI 2010. LNCS, vol. 6464, pp. 334–343. Springer, Heidelberg (2010)Google Scholar
  11. 11.
    Storn, R., Price, K.: Differential evolution. Journal of Global Optimization 11(4), 341–359 (1997)CrossRefzbMATHMathSciNetGoogle Scholar
  12. 12.
    Blake, C.L., Merz, C.J.: UCI repository of machine learning databases (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • João Fausto Lorenzato de Oliveira
    • 1
  • Teresa B. Ludermir
    • 1
  1. 1.Center of InformaticsFederal University of PernambucoRecifeBrazil

Personalised recommendations