Hopfield Recurrent Neural Networks

  • Zhang Yi
  • K. K. Tan
Part of the Network Theory and Applications book series (NETA, volume 13)

Abstract

In 1982, Hopfield proposed a model of neural networks [84], which used two-state threshold “neurons” that followed a stochastic algorithm. This model explored the ability of a network of highly interconnected “neurons” to have useful collective computational properties, such as content addressable memory. However, the model is based on McCulloch-Pitts neurons that are different from real biological neurons and also from the realistic functioning of simple electric circuits. Real neurons have continuous input-output relations and integrative time delays due to capacitance. To overcome such problems, in 1984, Hopfield proposed another continuous time recurrent neural network model with a graded response. It is described by a set of differential equations. This deterministic system has collective properties very close to the earlier stochastic model. Today, this model is well known as the Hopfield model of RNNs and it has found wide applications in various optimisation problems [65,22,107, 182], associative memories, engineering problems, satellite broadcast scheduling problems [64,4], graph partition [190], stereo vision [145], multiuser detector [101], fault detection and isolation [172], affine invariant matching [109], pattern sequence recognition [105], classification [26], etc. The contributions of Hopfield RNN model to the field of neural networks cannot be over-emphasised. In fact, it is the outstanding work of Hopfield that has rekindled research interests in the neural networks from both scientists and engineers.

Keywords

Convergence Analysis Recurrent Neural Network Global Asymptotic Stability Exponential Convergence Multiuser Detector 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer Science+Business Media Dordrecht 2004

Authors and Affiliations

  • Zhang Yi
    • 1
  • K. K. Tan
    • 2
  1. 1.School of Computer Science and EngineeringUniversity of Electronic Science and Technology of ChinaChengduPeople’s Republic of China
  2. 2.Department of Electrical and Computer EngineeringThe National University of SingaporeSingapore

Personalised recommendations