Skip to main content

Echo State Networks in Dynamic Data Clustering

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8131))

Abstract

The present paper follows the initial work on multidimensional static data clustering using a novel neural network structure, namely Echo state network (ESN). Here we exploit dynamic nature of these networks for solving of clustering task of a multidimensional dynamic data set. The data used in this investigation are taken from an experimental set-up applied for tasting of visual discrimination of complex dot motions. The proposed here model, although far from complicated brain theories, can serve as a good basis for investigation of humans perception.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ackley, D.H., Hinton, G.E., Sejnowski, T.J.: A learning algorithm for Boltzmann machines. Cognitive Science 9, 147–169 (1985)

    Article  Google Scholar 

  2. Alexiev, K., Bocheva, N., Stefanov, S.: Assessment of age-related changes in global motion direction discrimination. In: International Conference Automatics and Informatics 2011, Sofia, Bulgaria, October 3-7, pp. B277–B280 (2011)

    Google Scholar 

  3. Beardsley, S.A., Ward, R.L., Vaina, L.M.: A neural network model of spiral–planar motion tuning in MSTd. Vision Research 43, 577–595 (2003)

    Article  Google Scholar 

  4. Bocheva, N., Bojilov, L.: Neural network model for visual discrimination of complex motion. Comptes rendus de’l Academie bulgare des Sciences 65(10), 1379–1386 (2012)

    Google Scholar 

  5. Brainard, D.H.: The Psychophysics Toolbox. Spatial Vision 10, 433–436 (1997)

    Article  Google Scholar 

  6. Grossberg, S., Pilly, P.K.: Temporal Dynamics of Decision-Making during Motion Perception in the Visual Cortex, Technical Report BU CAS/CNS TR-2007-001 (February 2008)

    Google Scholar 

  7. Hinton, G.E., Salakhutdinov, R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)

    Article  MathSciNet  MATH  Google Scholar 

  8. Hopfield, J.J.: Neural networks and physical systems with emergent collective computational abilities. Proc. of National Academy of Sciences USA 79, 2554–2558 (1982)

    Article  MathSciNet  Google Scholar 

  9. Jaeger, H.: Tutorial on training recurrent neural networks, covering BPPT, RTRL, EKF and the "echo state network" approach. GMD Report 159, German National Research Center for Information Technology (2002)

    Google Scholar 

  10. Jain, A.K., Murty, M.N., Flynn, P.J.: Data Clustering: A Review. ACM Computing Surveys 31(3), 264–323 (1999)

    Article  Google Scholar 

  11. Koprinkova-Hristova, P., Palm, G.: ESN intrinsic plasticity versus reservoir stability. In: Honkela, T. (ed.) ICANN 2011, Part I. LNCS, vol. 6791, pp. 69–76. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  12. Koprinkova-Hristova, P., Tontchev, N.: Echo state networks for multi-dimensional data clustering. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds.) ICANN 2012, Part I. LNCS, vol. 7552, pp. 571–578. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  13. Lukosevicius, M., Jaeger, H.: Reservoir computing approaches to recurrent neural network training. Computer Science Review 3, 127–149 (2009)

    Article  Google Scholar 

  14. Ozturk, M., Xu, D., Principe, J.: Analysis and design of Echo state networks. Neural Computation 19, 111–138 (2007)

    Article  MATH  Google Scholar 

  15. Schrauwen, B., Wandermann, M., Verstraeten, D., Steil, J.J., Stroobandt, D.: Improving reservoirs using intrinsic plasticity. Neurocomputing 71, 1159–1171 (2008)

    Article  Google Scholar 

  16. Steil, J.J.: Online reservoir adaptation by intrinsic plasticity for back-propagation-decoleration and echo state learning. Neural Networks 20, 353–364 (2007)

    Article  MATH  Google Scholar 

  17. Woodward, A., Ikegami, T.: A reservoir computing approach to image classification using coupled echo state and back-propagation neural networks. In: Proc. of 26th Int. Conf. on Image and Vision Computing, Auckland, New Zealand, November 29-December 1, pp. 543–458 (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Koprinkova-Hristova, P., Alexiev, K. (2013). Echo State Networks in Dynamic Data Clustering. In: Mladenov, V., Koprinkova-Hristova, P., Palm, G., Villa, A.E.P., Appollini, B., Kasabov, N. (eds) Artificial Neural Networks and Machine Learning – ICANN 2013. ICANN 2013. Lecture Notes in Computer Science, vol 8131. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-40728-4_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-40728-4_43

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-40727-7

  • Online ISBN: 978-3-642-40728-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics