Abstract
Robot expertness measures are used to improve learning performance of knowledge sharing techniques. In this paper, several fuzzy Q-learning methods for knowledge sharing i.e. Shared Memory, Weighted Strategy Sharing (WSS) and Adaptive Weighted Strategy Sharing (AdpWSS) are studied. A new measure of expertise based on regret evaluation is proposed. Regret measure takes uncertainty bounds of two best actions, i.e. the greedy action and the second best action into account. Knowledge sharing simulations and experiments on real robots were performed to compare the effectiveness of the three expertness measures i.e. Gradient (G), Average Move (AM) and our proposed measure. The proposed measure exhibited the best performance among the three measures. Moreover, our measure that is applied to the AdpWSS does not require the predefined setting of cooperative time, thus it is more practical to be implemented in real-world problems.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Tan, M.: Multi-agent reinforcement learning: Independent vs cooperative agents. In: Proc. 10th Int. Conf. Machine Learning (1993)
Ahmadabadi, M.N., Asadpour, M.: Expertness Based Cooperative Q-Learning. IEEE Trans. SMC–Part B 32(1), 66–76 (2002)
Bitaghsir, A.A., Moghimi, A., Lesani, M., Keramati, M.M., Ahmadabadi, M.N., Arabi, B.N.: Successful Cooperation between Heterogeneous Fuzzy Q-learning Agents. In: IEEE Int. Conf. SMC (2004)
Dixon, K.R., Malak, R.J., Khosla, P.K.: Incorporating Prior Knowledge and Previously Learned Information into Reinforcement Learning Agents. Tech. report. Institute for Complex Engineered Systems, Carnegie Mellon University (2000)
Moreno, D.L., Regueiro, C.B., Iglesias, R., Barro, S.: Using Prior Knowledge to Improve Reinforcement Learning in Mobile Robotics. In: Proc. Towards Autonomous Robotics Systems. Univ. of Essex, UK (2004)
Yamaguchi, T., Tanaka, Y., Yachida, M.: Speed up Reinforcement Learning between Two Agents with Adaptive Mimetism. In: IEEE Int. Conf. IROS, pp. 594–600 (1997)
Ritthipravat, P., Maneewarn, T., Laowattana, D., Wyatt, J.: A Modified Approach to Fuzzy Q-Learning for Mobile Robots. In: Proc. IEEE Int. Conf. SMC (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ritthipravat, P., Maneewarn, T., Wyatt, J., Laowattana, D. (2006). Comparison and Analysis of Expertness Measure in Knowledge Sharing Among Robots. In: Ali, M., Dapoigny, R. (eds) Advances in Applied Artificial Intelligence. IEA/AIE 2006. Lecture Notes in Computer Science(), vol 4031. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11779568_9
Download citation
DOI: https://doi.org/10.1007/11779568_9
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35453-6
Online ISBN: 978-3-540-35454-3
eBook Packages: Computer ScienceComputer Science (R0)