Abstract
A Markov chain is observed only through a noisy continuous observation process. A related optimal control problem is formulated in separated form by considering the related Zakai equation. An adjoint process is defined and shown to satisfy a forward stochastic partial differential equation, and also a system of backward parabolic equations.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
A. Bensoussan, Lectures on stochastic control. In Lecture Notes in Mathematics, Vol. 972. Springer-Verlag, Berlin, Heidelberg, New York, 1982.
J.M. Bismut, Linear quadratic optimal stochastic control with random coefficients. S.I.A.M. J. Control and Optimization, Vol. 14, No. 3 (1976), 419–444.
J.M. Bismut, An introductory approach to duality in optimal stochastic control. S.LA.M. Review 20 (1978), 62–78.
J.N. Blagovescenskii and M.I. Freidlin, Some properties of diffusion process depending on a parameter. Dokl Akad. Nauk. 138 (1961); Soviet Math., 2 (1961), 633–636.
M.H.A. Davis, Nonlinear semigroups in the control of partially observable stochastic systems. In Lecture Notes in Mathematics, Vol. 695, Springer-Verlag, Berlin, Heidelberg, New York, 1977, 37–49.
R.J. Elliott, Stochastic Calculus and Applications. Springer-Verlag, Berlin, Heidelberg, New York, 1982.
R.J. Elliott, A partially observed control problem for Markov chains. To appear.
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1993 Springer-Verlag New York, Inc.
About this chapter
Cite this chapter
Elliott, R.J., Yang, H. (1993). Forward and Backward Equations for an Adjoint Process. In: Cambanis, S., Ghosh, J.K., Karandikar, R.L., Sen, P.K. (eds) Stochastic Processes. Springer, New York, NY. https://doi.org/10.1007/978-1-4615-7909-0_8
Download citation
DOI: https://doi.org/10.1007/978-1-4615-7909-0_8
Publisher Name: Springer, New York, NY
Print ISBN: 978-1-4615-7911-3
Online ISBN: 978-1-4615-7909-0
eBook Packages: Springer Book Archive