Short Term Memory and Pattern Matching with Simple Echo State Networks

  • Georg Fette
  • Julian Eggert
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3696)


Two recently proposed approaches to recognize temporal patterns have been proposed by Jäger with the so called Echo State Network (ESN) and by Maass with the so called Liquid State Machine (LSM). The ESN approach assumes a sort of “black-box” operability of the networks and claims a broad applicability to several different problems using the same principle. Here we propose a simplified version of ESNs which we call Simple Echo State Network (SESN) which exhibits good results in memory capacity and pattern matching tasks and which allows a better understanding of the capabilities and restrictions of ESNs.


Hide Layer Memory Capacity Hide Unit Output Weight Input Weight 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Jäger, H.: The ”echo state” approach to analysing and training recurrent neural networks. GMD Report 148, GMD - German National Research Institute for Computer Science (2001)Google Scholar
  2. 2.
    Maass, W., Natschläger, T., Markram, H.: Real-time computing without stable states: A new framework for neural computation based on perturbations. Neural Computation 14 (2002)Google Scholar
  3. 3.
    Jäger, H.: Short term memory in echo state networks. GMD Report 152, GMD - German National Research Institute for Computer Science (2002)Google Scholar
  4. 4.
    Fette, G.: Signalverarbeitung in Neuronalen Netzen vom Typ Echo State Networks diploma thesis (german) (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Georg Fette
    • 1
  • Julian Eggert
    • 2
  1. 1.Technische Universität MünchenGarching/MünchenGermany
  2. 2.HONDA Research I. Europe GmbHOffenbach/MainGermany

Personalised recommendations