Abstract
This paper describes the strategy for implementation of Hopfield neural network as associative memory with the genetic algorithm and the Monte Carlo-(MC-) adaptation rule for pattern storage. In the Hopfield type neural networks of associative memory, the appropriate arrangement of synaptic weights provides an associative memory feature in the network. The fixed-point stable state of this model represents the appropriate storage of the input patterns. The aim is to obtain the optimal weight matrix for efficient recalling of any prototype input pattern. The performance of the Hopfield neural network, especially the capacity and the quality of the recalling, can be greatly improved by making use of genetic algorithm and MC-adaptation rule. The experiments consider a neural network trained with multiple numbers of patterns using the Hebbian learning rule. In most cases, the recalling of patterns using genetic algorithm with MC-adaptation rule seems to give better results than the conventional hebbian rule, MC-adaptation rule and simple genetic algorithm recalling techniques.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Hopfield, J.J.: Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy Sciences, USA 79, 2554–2558 (1982)
Hopfield, J.J.: Neural Networks and Physical Systems with Emergent Collective Computational Abilities. Proceedings of the National Academy Sciences, USA 81, 3088–3092 (1984)
Amit, D.J., Gutfreund, H., Somopolinsky, H.: Storing Infinite Number of Patterns in a Spin-glass Model of Neural Networks. Physical Review Letters 55(14), 461–482 (1985)
Amit, D.J.: Modeling Brain Function: The World of Attractor Neural Networks, ch. 2, p. 58. Cambridge University Press, New York (1989)
Haykin, S.: Neural Networks: A Comprehensive Foundation, ch. 14, p. 664. Prentice Hall, Upper Saddle River (1985)
Zhou, Z., Zhao, H.: Improvement of the Hopfield Neural Network by MC-Adaptation Rule. Chin. Phys. Lett. 23(6), 1402–1405 (2006)
Zhao, H.: Designing Asymmetric Neural Networks with Associative Memory. Physical Review 70(6), 066137-4 (2004)
Kawamura, M., Okada, M.: Transient Dynamics for Sequence Processing Neural Networks. J. Phys. A: Math. Gen. 35, 253 (2002)
Amit, D.J.: Mean-field Ising Model and Low Rates in Neural Networks. In: Proceedings of the International Conference on Statistical Physics, Seoul, Korea, June 5-7, pp. 1–10 (1997)
Imada, A., Araki, K.: Genetic Algorithm Enlarges the Capacity of Associative Memory. In: Proc. of the Sixth International Conf. on Genetic Algorithms, pp. 413–420 (1995)
Hopfield, J.J., Tank, D.W.: Neural Computation of Decisions in Optimization Problems. Biological Cybernetics 55, 141–146 (1985)
Tank, D.W., Hopfield, J.J.: Simple Neural Optimization Networks: An A/D Converter. Signal Decision Circuit, and a Linear Programming Circuit. IEEE Trans. Circuits and Syst. 33(5), 533–541 (1986)
Jin, T., Zhao, H.: Pattern Recognition using Asymmetric Attractor Neural Networks. Phys. Rev. E 72(6), 066111-7 (2005)
Kumar, S., Singh, M.P.: Pattern Recall Analysis of the Hopfield Neural Network with a Genetic Algorithm. Computers and Mathematics with Applications 60(4), 1049–1057 (2010)
McEliece, R.J., Posner, E.C., Rodemich, E.R., Venkatesh, S.S.: The Capacity of the Hopfield Associative Memory. IEEE Trans. Information Theory IT-33(4), 461–482 (1987)
Hebb, D.: The Organization of Behaviour. In: A Neuropsychological Theory. Wiley, New York (1949)
Personnaz, L., Guyon, I., Dreyfus, G.: Information Storage and Retrieval in Spin-glas-like Neural Networks. Journal de Physique Letters 46, 359–365 (1985)
Personnaz, L., Guyon, I., Dreyfus, G.: Collective Computational Properties of Neural Networks: New Learning Algorithms. Physical Review A 34, 4217–4228 (1986)
Wu, G.-K., Hong, Z.: Two-Layer Feedback Neural Networks with Associative Memories. Chin. Phys. Lett. 25(11), 3871–3874 (2008)
Zhao, H., Jin, T.: A Global Algorithm for Training Multilayer Neural Networks, arXiv: physics/0607046 (2006)
Amari, S.: Learning and Statistical Inference. In: Arbib, M.A. (ed.) The Handbook of Brain Theory and Neural Networks, pp. 522–526. MIT Press, Cambridge (1993)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer India Pvt. Ltd.
About this paper
Cite this paper
Kumar, S., Goel, R., Singh, M.P. (2012). Implementation of Hopfield Associative Memory with Evolutionary Algorithm and MC-Adaptation Rule for Pattern Storage. In: Deep, K., Nagar, A., Pant, M., Bansal, J. (eds) Proceedings of the International Conference on Soft Computing for Problem Solving (SocProS 2011) December 20-22, 2011. Advances in Intelligent and Soft Computing, vol 131. Springer, New Delhi. https://doi.org/10.1007/978-81-322-0491-6_21
Download citation
DOI: https://doi.org/10.1007/978-81-322-0491-6_21
Publisher Name: Springer, New Delhi
Print ISBN: 978-81-322-0490-9
Online ISBN: 978-81-322-0491-6
eBook Packages: EngineeringEngineering (R0)