Advertisement

Nearly Optimal State Feedback Controls for Stochastic Systems with Wideband Noise Disturbances

  • Harold J. Kushner
  • W. Runggaldier
Part of the Lecture Notes in Control and Information Sciences book series (LNCIS, volume 83)

Abstract

Much of optimal stochastic control theory is concerned with diffusion models. Such models are often only idealizations (or limits in an appropriate sense) of the actual physical process, which might be driven by a wide bandwidth (not white) process or be a discrete parameter system with correlated driving noises. Optimal or nearly optimal controls, derived for the diffusion models, would not normally be useful or even of much interest, if they were not also ‘nearly optimal’ for the physical system which the diffusion approximates. Under quite broad conditions, the ‘nearly optimal’ control for the physical process do have this robustness property, even when compared to controls which can depend on all the (past) driving noise. We treat the problem over a finite time interval, as well as the average cost per unit time problem. Weak convergence methods provide the appropriate analytical tools.

Keywords

Invariant Measure Weak Convergence Stochastic System Wiener Process Average Cost 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. P. Billingsley, Converaence of Probability Measures Wiley, New York, 1968.Google Scholar
  2. T.G. Kurtz, Approximation of Population Processes Vol. 36 in CBMS-NSF Regional Conf. Serjes in Appl. Math., Soc. for Ind. and Appl. Math., Philadelphia, 1981.Google Scholar
  3. H.J. Kushner, Approximation and Weak Convergence Methods for Random Processes: with Applications to Stochastic Systems Theory MIT Press, Cambridge, Mass., USA, 1984.Google Scholar
  4. G.L. Blankenship, G.C. Papanicolaou, “Stability and control of stochastic systems with wide-band noise disturbances II”, Preprint, Electrical Enaineering Dept., Univ. of Maryland (1978).Google Scholar
  5. A. Bensoussan, G.L. Blankenship, “Singular perturbations in stochastic control”, Univ. of Maryland, Electrical Enqineerina Dept. Report, April 1985.Google Scholar
  6. T.G. Kurtz, “Semigroups of conditioned shifts and approximations of Markov processes”, Ann. Prob., 4, 1975, 618–642.CrossRefMathSciNetGoogle Scholar
  7. W.F. Fleming, “Generalized solutions in optimal stochastic control”, Proc. URI Conf. on Control, 1982, p. 147–165.CrossRefGoogle Scholar
  8. W.H. Fleming, M. Nisio, “On stochastic relaxed controls for partially observable diffusions”, Nagoya Math. J., 93, 1984, 71–108.zbMATHMathSciNetGoogle Scholar
  9. H.J. Kushner, “Jump-diffusion approximations for ordinary differential equations with wideband random right hand sides”, SIAM J. on Control and Optim., 17, 1979, 729–744.CrossRefzbMATHMathSciNetGoogle Scholar
  10. A.V. Skorohod, “Limit theorems for stochastic processes”, Theory of Probability and its Applications, 1, 1956, 262–290.MathSciNetGoogle Scholar
  11. V. Benes, “Finite regular invariant measures for Feller processes”, J. of Appl. Prob., 5, 1968.Google Scholar
  12. M. Cox and I. Karatzas, “Stationary and discounted control for diffu-sions”, Report, Columbia University, Statistics Department, 1984, sub-mitted to SIAM J. on Control and Optim.; also in Proc. 3rd Bad Honnef meeting on Stochastic Systems, Bonn, 1985.Google Scholar
  13. H.J. Kushner, “Optimality conditions for the average cost per unit time problem with a diffusion model”, SIAM J. on Control and Optimization, 16, 1978, 330–346.CrossRefzbMATHMathSciNetGoogle Scholar
  14. G. Blankenship and B.C. Papanicolaou, “Stability and control of stochas-tic systems with wide band noise disturbances”, SIAM J. Appl. Math., 34, 1978, 437–476.zbMATHMathSciNetGoogle Scholar
  15. H.J. Kushner and W. Runaaaldier, “Filterina and control for wide band-width noise driven systems”, to appear, SIAM. J. on Control & Optimiza-tion.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht 1986

Authors and Affiliations

  • Harold J. Kushner
    • 1
  • W. Runggaldier
    • 2
  1. 1.Lefschetz Center for Dynamical Systems Division of Applied MathematicsBrown UniversityProvidenceUSA
  2. 2.Istituto di Analisi e MeccanicaUniversity of PadovaPadovaItaly

Personalised recommendations