Skip to main content
Log in

Analysis and Filtration of Special Discrete-Time Markov Processes. I. Martingale Representation

  • Stochastic Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

Part I is devoted to a class of discrete-time processes that are the generalization of Markov chains with a finite or denumerable number of states. Their transition probabilities, martingale representations in forward and backward time, the stochastic measures they generate are studied.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  1. Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, Berlin: Springer-Verlag, 1995.

    Google Scholar 

  2. Rabiner, L.R., A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition, Proc. IEEE, 1989, vol. 77, no.2, pp. 257–286.

    Article  Google Scholar 

  3. Borisov, A.V., Analysis and Estimation of States of Special Jump Markov Processes. I, Avtom. Telemekh., 2004, no. 1, pp. 50–65.

  4. Borisov, A.V., Analysis and Estimation of States of Special Jump Markov Processes. II, Avtom. Telemekh., 2004, no. 5, pp. 61–76.

  5. Devis, M.H.A., Linear Estimation and Stochastic Control, New York: Wiley, 1977. Translated under the title Lineinoe otsenivanie i stokhasticheskoe upravlenie, Moscow: Nauka, 1984.

    Google Scholar 

  6. Wall, J.E., Willsky, A.S., and Sandell, N.R., On the Fixed-Interval Smoothing Problem, Stochastics, 1981, no. 5, pp. 1–42.

  7. Di Masi, G.B. and Kitsul, P.I., Backward Representation for Nonstationary Markov Processes with Finite State Space, Syst. Control Lett., 1994, vol. 22, pp. 445–450.

    Article  Google Scholar 

  8. Liptser, R.Sh. and Shiryaev, A.N., Teoriya martingalov (Theory of Martingales), Moscow: Nauka, 1986.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

__________

Translated from Avtomatika i Telemekhanika, No. 6, 2005, pp. 114–125.

Original Russian Text Copyright © 2005 by Borisov, Miller.

This work was supported by INTAS, project no. YSF 04-83-3623.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Borisov, A.V., Miller, G.B. Analysis and Filtration of Special Discrete-Time Markov Processes. I. Martingale Representation. Autom Remote Control 66, 953–962 (2005). https://doi.org/10.1007/s10513-005-0138-6

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10513-005-0138-6

Keywords

Navigation