Skip to main content

A Comparison Between ANN Generation and Training Methods and Their Development by Means of Graph Evolution: 2 Sample Problems

  • Conference paper
Computational and Ambient Intelligence (IWANN 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4507))

Included in the following conference series:

  • 2227 Accesses

Abstract

This paper presents a study in which a new technique for automatically developing Artificial Neural Networks (ANNs) by means of Evolutionary Computation (EC) tools is compared with the traditional evolutionary techniques used for ANN development. The technique used here is based on network encoding on graphs and also their performance and evolution. For this comparison, 2 different real-world problems have been solved using various tools, and the results are presented here. According to them, the results obtained with this technique can beat those obtained with other ANN development tools.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Haykin, S.: Neural Networks, 2nd edn. Prentice Hall, Englewood Cliffs (1999)

    MATH  Google Scholar 

  2. Rabuñal, J.R., Dorado, J. (eds.): Artificial Neural Networks in Real-Life Applications. Idea Group Inc., Hershey (2005)

    Google Scholar 

  3. Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)

    MATH  Google Scholar 

  4. Gruau, F.: Genetic micro programming of neural networks. In: Kinnear Jr., K.E. (ed.) Advances in Genetic Programming, pp. 495–518. MIT Press, Cambridge (1994)

    Google Scholar 

  5. Luke, S., Spector, L.: Evolving Graphs and Networks with Edge encoding: Preliminary Report. In: Koza, J. (ed.) Late Breaking Papers at the Genetic Programming 1996 Conference (GP96), pp. 117–124. Stanford Bookstore, Stanford (1996)

    Google Scholar 

  6. Kantschik, W., Dittrich, P., Brameier, M., Banzhaf, W.: Meta-Evolution in Graph GP. In: Langdon, W.B., Fogarty, T.C., Nordin, P., Poli, R. (eds.) EuroGP 1999. LNCS, vol. 1598, pp. 15–28. Springer, Heidelberg (1999)

    Chapter  Google Scholar 

  7. Poli, R.: Evolution of Graph-like Programs with Parallel Distributed Genetic Programming. In: Genetic Algorithms: Proceedings of the Seventh International Conference (1997)

    Google Scholar 

  8. Teller, A., Veloso, M.: Internal reinforcement in a connectionist genetic programming approach. Artificial Intelligence 120(2), 165–198 (2000)

    Article  MATH  Google Scholar 

  9. Janson, D.J., Frenzel, J.F.: Training product unit neural networks with genetic algorithms. IEEE Expert 8, 26–33 (1993)

    Article  Google Scholar 

  10. Deb, K., Anand, A., Joshi, D.: A computationally efficient evolutionary algorithm for real-parameter optimization. Evolutionary Computation 10(4), 371–395 (2002)

    Article  Google Scholar 

  11. Belew, R., McInerney, J., Schraudolph, N.: Evolving networks: using the genetic algorithm with connectioninst learning. In: Proceedings of the Second Artificial Life Conference, New York, pp. 511–547. Addison-Wesley, London (1991)

    Google Scholar 

  12. Marshall, S.J., Harrison, R.F.: Optimization and training of feedforward neural networks by genetic algorithms. In: Proceedings of the Second International Conference on Artificial Neural Networks and Genetic Algorithms, pp. 39–43. Springer, Heidelberg (1991)

    Google Scholar 

  13. Kitano, H.: Designing neural networks using genetic algorithms with graph generation system. Complex Systems 4, 461–476 (1990)

    MATH  Google Scholar 

  14. Nolfi, S., Parisi, D.: Evolution of Artificial Neural Networks. In: Handbook of brain theory and neural networks, 2nd edn., pp. 418–421. MIT Press, Cambridge (2002)

    Google Scholar 

  15. Ozdemir, M., Embrechts, F., Breneman, C.M., Lockwood, L., Bennett, K.P.: Feature selection for in-silico drug design using genetic algorithms and neural networks. In: IEEE Mountain Workshop on Soft Computing in Industrial Applications, pp. 53–57. IEEE Press, New York (2001)

    Chapter  Google Scholar 

  16. Montana, D.J.: Strongly typed genetic programming. Evolutionary Computation 3(2), 199–200 (1995)

    Article  Google Scholar 

  17. Rivero, D., Dorado, J., Rabuñal, J.R., Pazos, A., Pereira, J.: Artificial Neural Network Development by means of Genetic Programming with Graph Codification Enformatika. Transactions on Engineering, Computing and Technology, 209–214 (2006)

    Google Scholar 

  18. Cantú-Paz, E., Kamath, C.: An Empirical Comparison of Combinations of Evolutionary Algorithms and Neural Networks for Classification Problems, IEEE Transactions on systems, Man and Cybernetics – Part B: Cybernetics, 915–927 (2005)

    Google Scholar 

  19. Mertz, C.J., Murphy, P.M.L.: UCI repository of machine learning databases (2002), http://www-old.ics.uci.edu/pub/machine-learning-databases

  20. Reed, R.: Pruning algorithms – a survey. IEEE Transactions on Neural Networks 4(5), 740–747 (1993)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Francisco Sandoval Alberto Prieto Joan Cabestany Manuel Graña

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rivero, D., Dorado, J., Rabuñal, J.R., Gestal, M. (2007). A Comparison Between ANN Generation and Training Methods and Their Development by Means of Graph Evolution: 2 Sample Problems. In: Sandoval, F., Prieto, A., Cabestany, J., Graña, M. (eds) Computational and Ambient Intelligence. IWANN 2007. Lecture Notes in Computer Science, vol 4507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73007-1_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-73007-1_12

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-73006-4

  • Online ISBN: 978-3-540-73007-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics