Abstract
Fuzzy Q–learning extends the Q–learning algorithm to work in presence of continuous state and action spaces. A Takagi–Sugeno Fuzzy Inference System (FIS) is used to infer the continuous executed action and its action–value, by means of cooperation of several rules. Different kinds of evolution of the parameters of the FIS are possible, depending on different strategies of distribution of the reinforcement signal. In this paper, we compare two strategies: the classical one, focusing on rewarding the rules that have proposed the actions composed to produce the actual action, and a new one we are introducing, where reward goes to the rules proposing actions closest the ones actually executed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Seo, H.-S., Youn, S.J., Oh, K.-W.: A fuzzy reinforcement function for the intelligent agent to process vague goals. In: Fuzzy Information Processing Society, Atlanta, GA, USA, pp. 29–33 (2000)
Berenji, H.R.: A reinforcement learning-based architecture for fuzzy logic control. In: Dubois, D., Prade, H., Yager, R.R. (eds.) Readings in Fuzzy Sets for Intelligent Systems, pp. 368–380. Kaufmann, San Mateo (1993)
Bonarini, A.: Delayed Reinforcement, Fuzzy Q-Learning and Fuzzy Logic Controllers, pp. 447–466. Springer, Heidelberg (1996)
Bonarini, A., Bonacina, C., Matteucci, M.: An approach to the design of reinforcement functions in real wolrd, agent-based applications. IEEE Transactions on Systems. Man, and Cybernetics – Part B
Glorennec, P.Y., Jouffe, L.: Fuzzy Q-learning. In: Proceedings of Fuzz-Ieee 1997, Sixth International Conference on Fuzzy Systems, Barcelona, Spain, pp. 659–662 (1997)
Jouffe, L.: Fuzzy Inference Systems Learning by Reinforcement Methods: Application to a Pig House Atmosphere Control. PhD thesis, Computer Science Department, Universitè de Rennes I, Rennes, France (1997)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press, Cambridge (1998)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. In: Adaptive Computation and Machine Learning Series. MIT Press, Cambridge (1998)
Watkins, C., Dayan, P.: Q-learning. Machine Learning 8, 279–292 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Bonarini, A., Montrone, F., Restelli, M. (2006). Reinforcement Distribution in Continuous State Action Space Fuzzy Q–Learning: A Novel Approach. In: Bloch, I., Petrosino, A., Tettamanzi, A.G.B. (eds) Fuzzy Logic and Applications. WILF 2005. Lecture Notes in Computer Science(), vol 3849. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11676935_5
Download citation
DOI: https://doi.org/10.1007/11676935_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-32529-1
Online ISBN: 978-3-540-32530-7
eBook Packages: Computer ScienceComputer Science (R0)