Skip to main content

The Optimal Control of Partially Observable Semi-Markov Processes Over the Infinite Horizon: Discounted Costs

  • Chapter
Transactions of the Ninth Prague Conference

Part of the book series: Czechoslovak Academy of Sciences ((TPCI,volume 9A))

  • 152 Accesses

Abstract

This paper is devoted to the generalization of the numerical procedure for the finite-horizon partially observed semi-Markov optimization control problem due to White (1976) and also of the numerical procedure for the infinite horizon Markov optimization problem due to Sondik (1977)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Denardo E. (1967): Contraction mappings in the theory underlying dynamic programming. In SIAM Review, 9, 165–177

    Article  MathSciNet  MATH  Google Scholar 

  • Howard R. (1971): Dynamic probabilistic systems. John Wiley

    Google Scholar 

  • Lippman S. (1975): On dynamic programming with unbounded reward. In Management Science, vol.21, no.11, 1225–1232

    Article  MathSciNet  MATH  Google Scholar 

  • Sondik E. (1978)The optimal control of partially observable Markov processes over the infinite horizon-discounted costs. In: Operations Research, vol.26, no.2, 282–303

    Article  MathSciNet  MATH  Google Scholar 

  • White C. (1976): Procedures for the solution of a finite-horizon partially observed semi-Markov optimization problem. In: Operations Research, vol.24, no.2, 348–357

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 1983 ACADEMIA, Publishing House of the Czechoslovak Academy of Sciences, Prague

About this chapter

Cite this chapter

Drăgţ, M. (1983). The Optimal Control of Partially Observable Semi-Markov Processes Over the Infinite Horizon: Discounted Costs. In: Transactions of the Ninth Prague Conference. Czechoslovak Academy of Sciences, vol 9A. Springer, Dordrecht. https://doi.org/10.1007/978-94-009-7013-7_22

Download citation

  • DOI: https://doi.org/10.1007/978-94-009-7013-7_22

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-94-009-7015-1

  • Online ISBN: 978-94-009-7013-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics