Abstract
Agents often have preference models that are more complicated than minimizing the expected execution cost. In this paper, we study how they should act in the presence of uncertainty and immediate soft deadlines. Delivery robots, for example, are agents that are often confronted with immediate soft deadlines. We introduce the additive and multiplicative planning-task transformations, that are fast representation changes that transform planning tasks with convex exponential utility functions to planning tasks that can be solved with variants of standard deterministic or probabilistic artificial intelligence planners. Advantages of our representation changes include that they are context-insensitive, fast, scale well, allow for optimal and near-optimal planning, and are grounded in utility theory. Thus, while representation changes are often used to make planning more efficient, we use them to extend the functionality of existing planners, resulting in agents with more realistic preference models.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
D. Bernoulli. Specimen theoriae novae de mensura sortis. Commentarii Academiae Scientiarum Imperialis Petropolitanae, 5, 1738. Translated by L. Sommer, Econometrica, 22: 23–36, 1954.
A. Blum and J. Langford. Probabilistic planning in the graphplan framework. In Proceedings of the European Conference on Planning, 1999.
J. Blythe. Planning with external events. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 94–101, 1994.
C. Boutilier, T. Dean, and S. Hanks. Decision-theoretic planning: Structural assumptions and computational leverage. Journal of Artificial Intelligence Research, 11:1–94, 1999.
J. Bresina and M. Drummond. Anytime synthetic projection: Maximizing the probability of goal satisfaction. In Proceedings of the National Conference on Artificial Intelligence, pages 138–144, 1990.
T. Dean, J. Firby, and D. Miller. Hierarchical planning involving deadlines, travel times, and resources. Computational Intelligence, 4(4):381–398, 1988.
D. Draper, S. Hanks, and D. Weld. Probabilistic planning with information gathering. In Proceedings of the International Conference on Artificial Intelligence Planning Systems, pages 31–37, 1994.
R. Goldman and M. Boddy. Epsilon-safe planning. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 253–261, 1994.
P. Haddawy and S. Hanks. Representation for decision-theoretic planning: Utility functions for deadline goals. In Proceedings of the International Conference on Principles of Knowledge Representation and Reasoning, 1992.
R. Howard and J. Matheson. Risk-sensitive Markov decision processes. Management Science, 18(7):356–369, 1972.
K. Kanazawa and T. Dean. A model for projection and action. In Proceedings of the Inter-national Joint Conference on Artificial Intelligence, pages 985–990, 1989.
S. Koenig and R.G. Simmons. How to make reactive planners risk-sensitive. In Proceedings of the International Conference on Artificial Intelligence Planning Systems, pages 293–298, 1994.
N. Kushmerick, S. Hanks, and D. Weld. An algorithm for probabilistic planning. Artificial Intelligence, 76(1–2):239–286, 1995.
S. Marcus, E. Fernández-Gaucherand, D. Hernández-Hernández, S. Colaruppi, and P. Fard. Risk-sensitive Markov decision processes. In C. Byrnes et. al., editor, Systems and Control in the Twenty-First Century, pages 263–279. Birkhauser, 1997.
R. Neuneier and O. Mihatsch. Risk sensitive reinforcement learning. In Proceedings of the Neural Information Processing Systems, pages 1031–1037, 1999.
N. Onder and M. Pollack. Conditional, probabilistic planning: A unifying algorithm and effective search control machanisms. In Proceedings of the National Conference on Artificial Intelligence, 1999.
J. Pratt. Risk aversion in the small and in the large. Econometrica, 32(1–2):122–136, 1964.
J. von Neumann and O. Morgenstern. Theory of games and economic behavior. Princeton University Press, second edition, 1947.
M. Wellman, M. Ford, and K. Larson. Path planning under time-dependent uncertainty. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 523–539, 1995.
P. Whittle. Risk-Sensitive Optimal Control. Wiley, 1990.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Koenig, S. (2001). Planning-Task Transformations for Soft Deadlines. In: Castelfranchi, C., Lespérance, Y. (eds) Intelligent Agents VII Agent Theories Architectures and Languages. ATAL 2000. Lecture Notes in Computer Science(), vol 1986. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44631-1_21
Download citation
DOI: https://doi.org/10.1007/3-540-44631-1_21
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42422-2
Online ISBN: 978-3-540-44631-6
eBook Packages: Springer Book Archive