Skip to main content

Planning-Task Transformations for Soft Deadlines

  • Conference paper
  • First Online:
Intelligent Agents VII Agent Theories Architectures and Languages (ATAL 2000)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1986))

Included in the following conference series:

  • 844 Accesses

Abstract

Agents often have preference models that are more complicated than minimizing the expected execution cost. In this paper, we study how they should act in the presence of uncertainty and immediate soft deadlines. Delivery robots, for example, are agents that are often confronted with immediate soft deadlines. We introduce the additive and multiplicative planning-task transformations, that are fast representation changes that transform planning tasks with convex exponential utility functions to planning tasks that can be solved with variants of standard deterministic or probabilistic artificial intelligence planners. Advantages of our representation changes include that they are context-insensitive, fast, scale well, allow for optimal and near-optimal planning, and are grounded in utility theory. Thus, while representation changes are often used to make planning more efficient, we use them to extend the functionality of existing planners, resulting in agents with more realistic preference models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. D. Bernoulli. Specimen theoriae novae de mensura sortis. Commentarii Academiae Scientiarum Imperialis Petropolitanae, 5, 1738. Translated by L. Sommer, Econometrica, 22: 23–36, 1954.

    Google Scholar 

  2. A. Blum and J. Langford. Probabilistic planning in the graphplan framework. In Proceedings of the European Conference on Planning, 1999.

    Google Scholar 

  3. J. Blythe. Planning with external events. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 94–101, 1994.

    Google Scholar 

  4. C. Boutilier, T. Dean, and S. Hanks. Decision-theoretic planning: Structural assumptions and computational leverage. Journal of Artificial Intelligence Research, 11:1–94, 1999.

    MATH  MathSciNet  Google Scholar 

  5. J. Bresina and M. Drummond. Anytime synthetic projection: Maximizing the probability of goal satisfaction. In Proceedings of the National Conference on Artificial Intelligence, pages 138–144, 1990.

    Google Scholar 

  6. T. Dean, J. Firby, and D. Miller. Hierarchical planning involving deadlines, travel times, and resources. Computational Intelligence, 4(4):381–398, 1988.

    Article  Google Scholar 

  7. D. Draper, S. Hanks, and D. Weld. Probabilistic planning with information gathering. In Proceedings of the International Conference on Artificial Intelligence Planning Systems, pages 31–37, 1994.

    Google Scholar 

  8. R. Goldman and M. Boddy. Epsilon-safe planning. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 253–261, 1994.

    Google Scholar 

  9. P. Haddawy and S. Hanks. Representation for decision-theoretic planning: Utility functions for deadline goals. In Proceedings of the International Conference on Principles of Knowledge Representation and Reasoning, 1992.

    Google Scholar 

  10. R. Howard and J. Matheson. Risk-sensitive Markov decision processes. Management Science, 18(7):356–369, 1972.

    Article  MATH  MathSciNet  Google Scholar 

  11. K. Kanazawa and T. Dean. A model for projection and action. In Proceedings of the Inter-national Joint Conference on Artificial Intelligence, pages 985–990, 1989.

    Google Scholar 

  12. S. Koenig and R.G. Simmons. How to make reactive planners risk-sensitive. In Proceedings of the International Conference on Artificial Intelligence Planning Systems, pages 293–298, 1994.

    Google Scholar 

  13. N. Kushmerick, S. Hanks, and D. Weld. An algorithm for probabilistic planning. Artificial Intelligence, 76(1–2):239–286, 1995.

    Article  Google Scholar 

  14. S. Marcus, E. Fernández-Gaucherand, D. Hernández-Hernández, S. Colaruppi, and P. Fard. Risk-sensitive Markov decision processes. In C. Byrnes et. al., editor, Systems and Control in the Twenty-First Century, pages 263–279. Birkhauser, 1997.

    Google Scholar 

  15. R. Neuneier and O. Mihatsch. Risk sensitive reinforcement learning. In Proceedings of the Neural Information Processing Systems, pages 1031–1037, 1999.

    Google Scholar 

  16. N. Onder and M. Pollack. Conditional, probabilistic planning: A unifying algorithm and effective search control machanisms. In Proceedings of the National Conference on Artificial Intelligence, 1999.

    Google Scholar 

  17. J. Pratt. Risk aversion in the small and in the large. Econometrica, 32(1–2):122–136, 1964.

    Article  MATH  Google Scholar 

  18. J. von Neumann and O. Morgenstern. Theory of games and economic behavior. Princeton University Press, second edition, 1947.

    Google Scholar 

  19. M. Wellman, M. Ford, and K. Larson. Path planning under time-dependent uncertainty. In Proceedings of the Conference on Uncertainty in Artificial Intelligence, pages 523–539, 1995.

    Google Scholar 

  20. P. Whittle. Risk-Sensitive Optimal Control. Wiley, 1990.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Koenig, S. (2001). Planning-Task Transformations for Soft Deadlines. In: Castelfranchi, C., Lespérance, Y. (eds) Intelligent Agents VII Agent Theories Architectures and Languages. ATAL 2000. Lecture Notes in Computer Science(), vol 1986. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44631-1_21

Download citation

  • DOI: https://doi.org/10.1007/3-540-44631-1_21

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-42422-2

  • Online ISBN: 978-3-540-44631-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics