Skip to main content

Approximate impulse control of partially observed systems

  • Conference paper
  • First Online:
  • 123 Accesses

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 91))

Abstract

The stochastic continuous control problem of a diffusion process with noisy observations is studied by using techniques developed in the impulse control theory. ε -optimal separated impulse controls — i.e. which only depend on the filtering process of the partially observed system — are explicitely built by approximating the initial problem by means of a sequence of impulse control ones with vanishing impulse costs.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. BENES, V., and KARATZAS, I.: "Filtering of diffusions controlled through their conditional measures". Stochastics 13 (1984), pp. 1–23.

    Google Scholar 

  2. BENSOUSSAN, A. and LIONS, J.L.: "Contrôle impulsionnel et inéquations quasivaniationnelles". Dunod, Paris 1982.

    Google Scholar 

  3. DAVIS, M.H.A. and KOHLMAN, M.: "On the nonlinear semigroup of stochastic control under partial observations". Preprint.

    Google Scholar 

  4. DELLACHERIE, C. and MEYER, P.A.: "Probabilités et Potentiel". Hermann, Paris 1972 and 1975.

    Google Scholar 

  5. DYNKIN, E.B.: "Markov Processes". Springer-Verlag, Berlin 1965.

    Google Scholar 

  6. EL KAROUI, N.: "Les aspects probabilistes du contrôle stochastique". In Ecole d'Eté de St Flour VIII — Lect. N. Maths 876, Springer-Verlag, Berlin 1981.

    Google Scholar 

  7. EL KAROUI, N. — LEPELTIER, J.P. and MARCHAL, B.: "Arrêt optimal dépendant d'un paramètre et contrôle continu markovien". Unpublished.

    Google Scholar 

  8. EL KAROUI, N. — LEPELTIER, J.P. and MARCHAL, B.: "Semi-groupe de Nisio associé au contrôle de processus de Markov". In. Stochastic Differential Systems — Lect. N. Control and Int. Sc. 43, Springer-Verlag, Berlin

    Google Scholar 

  9. FLEMING, W.H.: "Nonlinear semigroup for controlled partially observed diffusions". Siam J. Control and Opt. 20–2 (1982), pp. 286–301.

    Google Scholar 

  10. IKEDA, N. and WATANABE, S.: "Stochastic differential equations and diffusion processes". North Holland, Amsterdam (1981).

    Google Scholar 

  11. KRYLOV, N.V.: "Controlled diffusion processes". Springer-Verlag, Berlin 1980.

    Google Scholar 

  12. LEPELTIER, J.P. and MARCHAL, B.: "Théorie générale du contrôle impulsionnel markovien". Siam J. Control and Opt. 22–4 (1984), pp. 645–665.

    Google Scholar 

  13. MAZZIOTTO, G.: " Approximations of the optimal stopping problem in partial observation". Preprint.

    Google Scholar 

  14. MAZZIOTTO, G. and SZPIRGLAS, J.: "Separation principle for impulse control with partial information". Stochastics 10 (1983), pp. 47–73.

    Google Scholar 

  15. MAZZIOTTO, G. — STETTNER, L. — SZPIRGLAS, J. and ZABCZYK, J.: "On impulse control with partial observation". To appear.

    Google Scholar 

  16. MENALDI, L.: "On the optimal impulse control problem for degenerate diffusions". Siam J. Control and Opt. 18–6 (1980), pp. 722–739.

    Google Scholar 

  17. MENALDI, L. and ROBIN, M.: "On some cheaps control problems for diffusion processes". Trans. Am. Math. Soc. 278–2 (1983), pp. 771–803.

    Google Scholar 

  18. MENALDI, J.L. and ROFMAN, E.: "On stochastic control problems with impulse cost vanishing". In. Semi-infinite Programming and Applications, pp. 281–294. Lect. N. Economics and Math Systems 215. Springer-Verlag, Berlin 1982.

    Google Scholar 

  19. NAGAI, H.: "On an impulsive control of additive processes". Z. f. Wahr. V. Geb. 53–1 (1980), pp. 1–16.

    Google Scholar 

  20. NISIO, M.: "On stochastic optimal controls and envelope of Markovian semigroups". In Proc. of Intern. Symp. SDE Kyoto 1976, pp. 297–325.

    Google Scholar 

  21. ROBIN, M.: "Contrôle impulsionnel des processus de Markov". Thès Univ. Paris IX (1978).

    Google Scholar 

  22. ZAKAI, M.: "On the optimal filtering of diffusion processes". Z. f. Wahr. V. Geb. 11 (1969), pp. 230–249.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Alfredo Germani

Rights and permissions

Reprints and permissions

Copyright information

© 1987 Springer-Verlag

About this paper

Cite this paper

Mazziotto, G. (1987). Approximate impulse control of partially observed systems. In: Germani, A. (eds) Stochastic Modelling and Filtering. Lecture Notes in Control and Information Sciences, vol 91. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0009053

Download citation

  • DOI: https://doi.org/10.1007/BFb0009053

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-17575-9

  • Online ISBN: 978-3-540-47461-6

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics