Abstract
This paper presents a study in which a new technique for automatically developing Artificial Neural Networks (ANNs) by means of Evolutionary Computation (EC) tools is compared with the traditional evolutionary techniques used for ANN development. The technique used here is based on network encoding on graphs and also their performance and evolution. For this comparison, 2 different real-world problems have been solved using various tools, and the results are presented here. According to them, the results obtained with this technique can beat those obtained with other ANN development tools.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Haykin, S.: Neural Networks, 2nd edn. Prentice Hall, Englewood Cliffs (1999)
Rabuñal, J.R., Dorado, J. (eds.): Artificial Neural Networks in Real-Life Applications. Idea Group Inc., Hershey (2005)
Koza, J.R.: Genetic Programming: On the Programming of Computers by Means of Natural Selection. MIT Press, Cambridge (1992)
Gruau, F.: Genetic micro programming of neural networks. In: Kinnear Jr., K.E. (ed.) Advances in Genetic Programming, pp. 495–518. MIT Press, Cambridge (1994)
Luke, S., Spector, L.: Evolving Graphs and Networks with Edge encoding: Preliminary Report. In: Koza, J. (ed.) Late Breaking Papers at the Genetic Programming 1996 Conference (GP96), pp. 117–124. Stanford Bookstore, Stanford (1996)
Kantschik, W., Dittrich, P., Brameier, M., Banzhaf, W.: Meta-Evolution in Graph GP. In: Langdon, W.B., Fogarty, T.C., Nordin, P., Poli, R. (eds.) EuroGP 1999. LNCS, vol. 1598, pp. 15–28. Springer, Heidelberg (1999)
Poli, R.: Evolution of Graph-like Programs with Parallel Distributed Genetic Programming. In: Genetic Algorithms: Proceedings of the Seventh International Conference (1997)
Teller, A., Veloso, M.: Internal reinforcement in a connectionist genetic programming approach. Artificial Intelligence 120(2), 165–198 (2000)
Janson, D.J., Frenzel, J.F.: Training product unit neural networks with genetic algorithms. IEEE Expert 8, 26–33 (1993)
Deb, K., Anand, A., Joshi, D.: A computationally efficient evolutionary algorithm for real-parameter optimization. Evolutionary Computation 10(4), 371–395 (2002)
Belew, R., McInerney, J., Schraudolph, N.: Evolving networks: using the genetic algorithm with connectioninst learning. In: Proceedings of the Second Artificial Life Conference, New York, pp. 511–547. Addison-Wesley, London (1991)
Marshall, S.J., Harrison, R.F.: Optimization and training of feedforward neural networks by genetic algorithms. In: Proceedings of the Second International Conference on Artificial Neural Networks and Genetic Algorithms, pp. 39–43. Springer, Heidelberg (1991)
Kitano, H.: Designing neural networks using genetic algorithms with graph generation system. Complex Systems 4, 461–476 (1990)
Nolfi, S., Parisi, D.: Evolution of Artificial Neural Networks. In: Handbook of brain theory and neural networks, 2nd edn., pp. 418–421. MIT Press, Cambridge (2002)
Ozdemir, M., Embrechts, F., Breneman, C.M., Lockwood, L., Bennett, K.P.: Feature selection for in-silico drug design using genetic algorithms and neural networks. In: IEEE Mountain Workshop on Soft Computing in Industrial Applications, pp. 53–57. IEEE Press, New York (2001)
Montana, D.J.: Strongly typed genetic programming. Evolutionary Computation 3(2), 199–200 (1995)
Rivero, D., Dorado, J., Rabuñal, J.R., Pazos, A., Pereira, J.: Artificial Neural Network Development by means of Genetic Programming with Graph Codification Enformatika. Transactions on Engineering, Computing and Technology, 209–214 (2006)
Cantú-Paz, E., Kamath, C.: An Empirical Comparison of Combinations of Evolutionary Algorithms and Neural Networks for Classification Problems, IEEE Transactions on systems, Man and Cybernetics – Part B: Cybernetics, 915–927 (2005)
Mertz, C.J., Murphy, P.M.L.: UCI repository of machine learning databases (2002), http://www-old.ics.uci.edu/pub/machine-learning-databases
Reed, R.: Pruning algorithms – a survey. IEEE Transactions on Neural Networks 4(5), 740–747 (1993)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rivero, D., Dorado, J., Rabuñal, J.R., Gestal, M. (2007). A Comparison Between ANN Generation and Training Methods and Their Development by Means of Graph Evolution: 2 Sample Problems. In: Sandoval, F., Prieto, A., Cabestany, J., Graña, M. (eds) Computational and Ambient Intelligence. IWANN 2007. Lecture Notes in Computer Science, vol 4507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-73007-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-540-73007-1_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-73006-4
Online ISBN: 978-3-540-73007-1
eBook Packages: Computer ScienceComputer Science (R0)