Optimality of “full bang to reduce predicted miss” for some partially observed stochastic control problems

  • V. E. Beneš
  • R. W. Rishel
Conference paper
Part of the The IMA Volumes in Mathematics and Its Applications book series (IMA, volume 10)

Abstract

For final value stochastic control problems, the “predicted miss” of the title is the expected final position, conditional on the cumulative information to date, if no further control is exerted. For partially observed problems with bounded control, similar to some proposed by Åström, we use PDE methods to show that predicted miss defines the switching surfaces for an optimal “bang-bang” control law whose gist, simply stated, is to reduce predicted miss. The surfaces in question are explicitly calculated.

Keywords

Filtration 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    K. J. Åström and B. Wittenmark, On self-tuning regulators, Automatica, 9 (1973), p. 183.CrossRefGoogle Scholar
  2. 2.
    V. E. Beneš, Full bang to reduce predicted miss is optimal, SIAM J. Control and Optimization, 14 (1976), p. 62.MATHCrossRefGoogle Scholar
  3. 3.
    W. H. Fleming and R. W. Rishel, Deterministic and stochastic optimal control, Springer-Verlag, New York, 1975.MATHGoogle Scholar
  4. 4.
    N. Ikeda and S. Watanabe, Stochastic differential equations and diffusion processes, North Holland/Kodansha, 1981.Google Scholar
  5. 5.
    M. H. A. Davis and J. M. C. Clark, On “predicted miss” stochastic control problems, Stochastics, 2 (1979), pp. 197–209.MathSciNetMATHCrossRefGoogle Scholar
  6. 6.
    O. A. Oleinik and E. V. Radkevic, Second order equations with nonnegative characteristic form, AMS, Providence, RI, 1973.Google Scholar
  7. 7.
    M. H. Protter and H. F. Weinberger, Maximum principles in differential equations, Prentice-Hall, Englewood Cliffs, NJ, 1967.Google Scholar
  8. 8.
    R. W. Rishel, An exact formula for a linear quadratic adaptive stochastic optimal control law, SIAM J. Control and Optimization, 24 (1986), p. 667.MathSciNetMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag New York Inc. 1988

Authors and Affiliations

  • V. E. Beneš
    • 1
    • 2
  • R. W. Rishel
    • 3
  1. 1.AT&T Bell LaboratoriesMurray HillUSA
  2. 2.Columbia UniversityNew YorkUSA
  3. 3.University of KentuckyLexingtonUSA

Personalised recommendations