Skip to main content

Reinforcement Learning Using Kohonen Feature Map Associative Memory with Refractoriness Based on Area Representation

  • Conference paper
Advances in Neuro-Information Processing (ICONIP 2008)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5507))

Included in the following conference series:

  • 1556 Accesses

Abstract

In this paper, we propose a reinforcement learning method using Kohonen Feature Map Associative Memory with Refractoriness based on Area Representation. The proposed method is based on the actor-critic method, and the actor is realized by the Kohonen Feature Map Associative Memory with Refractoriness based on Area Representation. The Kohonen Feature Map Associative Memory with Refractoriness based on Area Representation is based on the self-organizing feature map, and it can realize successive learning and one-to-many associations. Moreover, it has robustness for noisy input and damaged neurons because it is based on the area representation. The proposed method makes use of this property in order to realize the learning during the practice of task. We carried out a series of computer experiments, and confirmed the effectiveness of the proposed method in path-finding problem.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Sutton, R.S., Barto, A.G.: Reinforcement Learning, An Introduction. MIT Press, Cambridge (1998)

    Google Scholar 

  2. Witten, I.H.: An adaptive optimal controller for discrete-time Markov environments. Information and Control 34, 286–295 (1977)

    Article  MathSciNet  MATH  Google Scholar 

  3. Shibata, K., Sugisaka, M., Ito, K.: Fast and stable learning in direct-vision-based reinforcement learning. In: Proceedings of the 6th International Sysmposium on Artificial Life and Robotics, vol. 1, pp. 200–203 (2001)

    Google Scholar 

  4. Ishii, S., Shidara, M., Shibata, K.: A model of emergence of reward expectancy neurons by reinforcement learning. In: Proceedings of the 10th International Sysmposium on Artificial Life and Robotics, vol. GS21-5 (2005)

    Google Scholar 

  5. Imabayashi, T., Osana, Y.: Implementation of association of one-to-many associations and the analog pattern in Kohonen feature map associative emory with area representation. In: Proceedings of IASTED Artificial Intelligence and Applications, Innsbruck (2008)

    Google Scholar 

  6. Kohonen, T.: Self-Organizing Maps. Springer, Heidelberg (1994)

    MATH  Google Scholar 

  7. Abe, H., Osana, Y.: Kohonen feature map associative memory with area representation. In: Proceedings of IASTED Artificial Intelligence and Applications, Innsbruck (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Shimizu, A., Osana, Y. (2009). Reinforcement Learning Using Kohonen Feature Map Associative Memory with Refractoriness Based on Area Representation. In: Köppen, M., Kasabov, N., Coghill, G. (eds) Advances in Neuro-Information Processing. ICONIP 2008. Lecture Notes in Computer Science, vol 5507. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03040-6_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03040-6_26

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03039-0

  • Online ISBN: 978-3-642-03040-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics