Skip to main content

On adaptive control of a singularly perturbed diffusion model

  • Conference paper
  • First Online:
  • 143 Accesses

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 184))

Abstract

In the paper a control of a singularly perturbed diffusion with unknown parameter in the drift term of the equation for slow variable, is studied. It is assumed, that the perturbation parameter which is small, and also unknown. An adaptive procedure that guarantees nearly optimal value of the long run average cost functional is constructed. As an intermediate result some new facts concerning the ergodic control of singularly perturbed diffusion are shown.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Bensoussan, Perturbation Methods in Optimal Control, J. Wiley, 1988

    Google Scholar 

  2. V. Borkar, Optimal Control of Diffusion Processes, Longman, 1990

    Google Scholar 

  3. T. Bielecki, L. Stettner, On Ergodic Control Problems for Singularly Perturbed Markov Processes, JAMO 20 (1989), 131–161

    MATH  MathSciNet  Google Scholar 

  4. T. E. Duncan, B. Pasik-Duncan, L. Stettner, Almost Self-Optimizing Strategies for the Adaptive Control of Diffusion Processes, submitted for publication

    Google Scholar 

  5. T. E. Duncan, B. Pasik-Duncan, L. Stettner, On Ergodic and Adaptive Control Problems for Stochastic Differential Delay Equations, in preparation

    Google Scholar 

  6. H. J. Kushner, Optimality conditions for the average cost per unit time problem with a diffusion model, SIAM J. Control Optimiz. 16 (1978), 330–346

    Article  MATH  MathSciNet  Google Scholar 

  7. H. J. Kushner, Weak Convergence Methods and Singularly Perturbed Stochastic Control and Filtering Problems, Birkhäuser, 1990

    Google Scholar 

  8. R. Z. Khasminskii, Stochastic Stability of Differential Equations, Sigthoff and Noordhoff, Alphen van den Rijn, 1980

    Google Scholar 

  9. L. Stettner, On the Existence of an Optimal per Unit Time Control for a Degenerate Diffusion Model, Bull. Pol. Acad. Sci. 34 (1986), 749–769

    MATH  MathSciNet  Google Scholar 

  10. L. Stettner, On nearly Selfoptimizing Strategies for a Discrete Time Uniformly Ergodic Adaptive Model, JAMO to appear

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

T. E. Duncan B. Pasik-Duncan

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer-Verlag

About this paper

Cite this paper

Stettner, L. (1992). On adaptive control of a singularly perturbed diffusion model. In: Duncan, T.E., Pasik-Duncan, B. (eds) Stochastic Theory and Adaptive Control. Lecture Notes in Control and Information Sciences, vol 184. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0113261

Download citation

  • DOI: https://doi.org/10.1007/BFb0113261

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-55962-7

  • Online ISBN: 978-3-540-47327-5

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics