Abstract
Readylog is a logic-based agent programming language and combines many important features from other Golog dialects. One of the features of Readylog is to make use of decision-theoretic planning for specifying the behavior of an agent or robot. In this paper we show a method to reduce the planning time for decision-theoretic planning in the Readylog framework. Instead of planning policies on the fly over and over again, we calculate an abstract policy once and store it in a plan library. This policy can later be re-instantiated. With this plan library the on-line planning time can be significantly reduced. We compare computing policies on the fly with those stored in our plan library with examples from the robotic soccer domain. In the 2D soccer simulation league we show the significant speed-up when using our plan library approach. Moreover, the use of the plan library together with a suitable state space abstraction for the soccer domain makes it possible to apply macro-actions in an otherwise continuous domain.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ferrein, A., Fritz, C., Lakemeyer, G.: Using golog for deliberation and team coordination in robotic soccer. KI Künstliche Intelligenz (1) (2005)
Ferrein, A., Fritz, C., Lakemeyer, G.: On-line Decision-Theoretic Golog for Unpredictable Domains. In: Proc. KI 2004 (2004)
Schiffer, S., Ferrein, A., Lakemeyer, G.: Qualitative world models for soccer robots. In: Qualitative Constraint Calculi Workshop at KI-06 (2006)
Schiffer, S., Ferrein, A., Lakemeyer, G.: Football is coming home. In: Chen, X., Liu, W., Williams, M.-A. (eds.) Proceedings of the International PCAR Symposium (2006)
Boutilier, C., Reiter, R., Soutchanski, M., Thrun, S.: Decision-Theoretic, High-Level Agent Programming in the Situation Calculus. In: Proc. AAAI-00 (2000)
Puterman, M.: Markov Decision Processes: Discrete Dynamic Programming. Wiley, New York, USA (1994)
McCarthy, J.: Situations, Actions and Causal Laws. Technical report, Stanford University (1963)
Reiter, R.: Knowledge in Action. Logical Foundations for Specifying and Implementing Dynamical Systems. MIT Press, Cambridge (2001)
Soutchanski, M.: High-Level Robot Programming in Dynamic and Incompletely Known Environments. PhD thesis, University of Toronto, Toronto, Canada (2003)
Ferrein, A., Fritz, C., Lakemeyer, G.: Extending DTGolog with Options. In: Proc. IJCAI 2003 (2003)
Levesque, H.J., Reiter, R., Lesperance, Y., Lin, F., Scherl, R.B.: GOLOG: A logic programming language for dynamic domains. J. of Log. Progr. 31(1-3) (1997)
Grosskreutz, H., Lakemeyer, G.: cc-Golog – An Action Language with Continous Change. Logic Journal of the IGPL (2002)
De Giacomo, G., Lésperance, Y., Levesque, H.J.: ConGolog, A concurrent programming language based on situation calculus. Artificial Intelligence 121(1–2), 109–169 (2000)
De Giacomo, G., Levesque, H.: An incremental interpreter for high-level programs with sensing. In: Levesque, H.J., Pirri, F. (eds.) Logical foundation for cognitive agents: contributions in honor of Ray Reiter, pp. 86–102. Springer, Berlin (1999)
Grosskreutz, H.: Probabilistic projection and belief update in the pgolog framework. In: Proc. CogRob-00 at ECAI-00 (2000)
Hauskrecht, M., Meuleau, N., Kaelbling, L.P., Dean, T., Boutilier, C.: Hierarchical Solution of Markov Decision Processes using Macro-actions. In: Proc. UAI (1998)
Sutton, R.S., Precup, D., Singh, S.P.: Between MDPs and Semi-MDPs: A Framework for Temporal Abstraction in Reinforcement Learning. Artificial Intelligence 112(1-2), 181–211 (1999)
Thielscher, M.: FLUX: A logic programming method for reasoning agents. Theory and Practice of Logic Programming 5(4-5), 533–565 (2005)
Noda, I., Matsubara, H., Hiraki, K., Frank, I.: Soccer server: a tool for research on multi-agent systems. Applied Artificial Intelligence 12 (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Böhnstedt, L., Ferrein, A., Lakemeyer, G. (2007). Options in Readylog Reloaded – Generating Decision-Theoretic Plan Libraries in Golog. In: Hertzberg, J., Beetz, M., Englert, R. (eds) KI 2007: Advances in Artificial Intelligence. KI 2007. Lecture Notes in Computer Science(), vol 4667. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74565-5_27
Download citation
DOI: https://doi.org/10.1007/978-3-540-74565-5_27
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74564-8
Online ISBN: 978-3-540-74565-5
eBook Packages: Computer ScienceComputer Science (R0)