Skip to main content
Log in

Filtering of the Markov jump process given the observations of multivariate point process

  • Stochastic Systems, Queueing Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

The problem of optimal filtering of the Markov process with finite number of states through the discrete observations arriving at random time instants was formulated and resolved. It was established that the desired estimate obeys a finite-dimensional differential-difference system which admits an explicit solution. The theoretical results obtained are applicable to the problem of monitoring the telecommunication link.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Cvitanic, J., Liptser, R., and Rozovskii, B., A Filtering Approach to Tracking Volatility from Prices Observed at Random Times, Ann. Appl. Probab., 2006, vol. 16, pp. 1633–1652.

    Article  MATH  MathSciNet  Google Scholar 

  2. Ait-Sahalia, Y. and Mykland, P.A., Estimators of Diffusion with Randomly Spaced Discrete Observations: A General Theory, Ann. Statist., 2004, vol. 32, no. 5, pp. 2186–2222.

    Article  MATH  MathSciNet  Google Scholar 

  3. Ceci, C. and Gerardi, A., Nonlinear Filtering Equation of a Jump Process with Counting Observations, Acta Appl. Math., 2001, vol. 66, no. 2, pp. 139–154.

    Article  MATH  MathSciNet  Google Scholar 

  4. Elliott, R.J., Tsoi, F., and Lui, S.H., Short Rate Analysis and Marked Point Processes, Math. Methods Oper. Res., 1999, vol. 50, pp. 149–160.

    Article  MATH  MathSciNet  Google Scholar 

  5. Miller, B.M., Avrachenkov, K.E., Stepanyan, K.V., and Miller, G.B., Problem of Optimal Stochastic Control of Data Flow through Incomplete Information, Probl. Peredachi Inf., 2005, vol. 41, no. 2, pp. 89–110.

    MathSciNet  Google Scholar 

  6. Borisov, A.V., Bayes Estimation in Observation Systems with Markov Jump Processes: A Game Approach, Informat. Primen., 2007, vol. 1, no. 2, pp. 65–75.

    Google Scholar 

  7. Liptser, R.Sh. and Shiryaev, A.N., Teoriya martingalov (Martigale Theory), Moscow: Nauka, 1986.

    MATH  Google Scholar 

  8. Bjork, T., Finite Optimal Filters for a Class of Nonlinear Diffusions with Jumping Parameters, Stochastics, 1982, no. 6, pp. 121–138.

    Google Scholar 

  9. Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models: Estimation and Control, New York: Springer, 1994.

    Google Scholar 

  10. Wong, E. and Hajek, B., Stochastic Processes in Engineering Systems, New York: Springer, 1985.

    Book  MATH  Google Scholar 

  11. Miller, B.M. and Rubinovich, E.Ya., Optimizatsiya dinamicheskikh sistem s impul’snymi upravleniyami (Optimization of Dynamic Systems with Pulse Controls), Moscow: Nauka, 2005.

    Google Scholar 

  12. Bohacek, S. and Rozovskii, B., A Diffusion Model of Roundtrip Time, Comput. Statist. Data Anal., 2004, vol. 45, no. 1, pp. 25–50.

    Article  MATH  MathSciNet  Google Scholar 

  13. Floyd, S. and Paxson, V., Difficulties in Simulating the Internet, IEEE/ACM Trans. Netw., 2001, vol. 9, pp. 392–403.

    Article  Google Scholar 

  14. Floyd, S. and Kohler, E., Internet Research Needs Better Models, Comput. Commun. Rev., 2003, vol. 33, pp. 29–34.

    Article  Google Scholar 

  15. Borisov, A.V. and Miller, G.B., Analysis and Filtration of Special Discrete-Time Markov Processes. II. Optimal Filtration, Autom. Remote Control, 2005, vol. 66, no. 7, pp. 1125–1136.

    Article  MATH  MathSciNet  Google Scholar 

  16. Batrakova, D.A., Korolev, V.Yu., and Shorgin, S.Ya., A New Method of Probabilistic-Statistical Analysis of Information Flows in Telecommunication Networks, Informat. Primen., 2007, vol. 1, no. 1, pp. 40–53.

    Google Scholar 

  17. Elteto, T. and Molnar, S., On the Distribution of Round-trip Delays in Tcp/Ip Networks, in Proc. 24th Conf. Local Comput. Networks, 1999, pp. 172–181.

    Google Scholar 

  18. Yasuhiro, S., Shingo, A., Ikuo, O., and Chikato, F., Using Mixed Distribution for Modeling End-to-End Delay Characteristics, IEIC Technic. Report., 2005, vol. 105, no. 83, pp. 61–66.

    Google Scholar 

  19. Floyd, S. and Jacobson, V., Random Early Detection Gateways for Congestion Avoidance, IEEE/ACM Trans. Netw., 1993, vol. 1, no. 4, pp. 397–413.

    Article  Google Scholar 

  20. Kushner, H.J., Probability Methods for Approximations in Stochastic Control and for Elliptic Equations, New York: Academic, 1977. Translated under the title Veroyatnostnye metody approksimatsii v stokhasticheskikh zadachakh upravleniya i teorii ellipticheskikh uravnenii, Moscow: Nauka, 1989.

    MATH  Google Scholar 

  21. Zhakod, Zh. and Shiryaev, A.N., Predel’nye teoremy dlya sluchainykh protsessov (Limit Theorems for Random Processes), Moscow: Fizmatlit, 1994, vol. 1.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to A. V. Borisov.

Additional information

Original Russian Text © A.V. Borisov, B.M. Miller, K.V. Semenikhin, 2015, published in Avtomatika i Telemekhanika, 2015, No. 2, pp. 34–60.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Borisov, A.V., Miller, B.M. & Semenikhin, K.V. Filtering of the Markov jump process given the observations of multivariate point process. Autom Remote Control 76, 219–240 (2015). https://doi.org/10.1134/S0005117915020034

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117915020034

Keywords

Navigation