Estimation of Markovian Jump Systems with Unknown Transition Probabilities through Bayesian Sampling

  • Vesselin P. Jilkov
  • X. Rong Li
  • Donka S. Angelova
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2542)


Addressed is the problem of state estimation for dynamic Markovian jump systems (MJS) with unknown transitional probability matrix (TPM) of the embedded Markov chain governing the system jumps. Based on recent authors’ results, proposed is a new TPMestimation algorithm that utilizes stochastic simulation methods (viz. Bayesian sampling) for finite mixtures’ estimation. Monte Carlo simulation results of TMP-adaptive interacting multiple model algorithms for a system with failures and maneuvering target tracking are presented.


Markov Chain Monte Carlo Transition Probability Matrix Finite Mixture Adaptive Estimation Markovian Jump System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Li, X. R.: Hybrid Estimation Techniques. In: Leondes, C. T. (ed.): Control and Dynamic Systems: Advances in Theory and Applications. Vol. 76. Academic Press, New York (1996) 213–287.Google Scholar
  2. 2.
    Sawaragi, Y., Katayama, T., Fujichige, S.: Adaptive Estimation for a Linear System with Interrupted Observations. IEEE Trans. Automatic Control(1973) 152–154.Google Scholar
  3. 3.
    Tugnait, J. K., Haddad, A. H.: Adaptive Estimation in Linear Systems with Unknown Markovian Noise Statistics. IEEE. Trans. Information Theory26 (1980) 66–78.zbMATHCrossRefMathSciNetGoogle Scholar
  4. 4.
    Tugnait, J. K.: Adaptive Estimation and Identification for Discrete Systems with Markov Jump Parameters. IEEE Trans. Automatic ControlAC-27 (1982) 1054–1065.Google Scholar
  5. 5.
    Goutsias, J., Mendel, J. M.: Optimal Simultaneous Detection and Estimation of Filtered Discrete semi-Markov Chains. IEEE. Trans. Information TheoryIT-34 (1988) 551–568.Google Scholar
  6. 6.
    Jilkov, V. P., Li, X. R.: Bayesian Estimation of Transition Probabilities for Markovian Jump Systems. IEEE Trans. Signal Processing(2002) Submitted.Google Scholar
  7. 7.
    Jilkov, V. P., Li, X. R.: Adaptation of Transition Probability Matrix for Multiple Model Estimators. In: Proc. Fourth Intern. Conf. on Information Fusion, Montreal, QC, Canada (2001)Google Scholar
  8. 8.
    Doucet, A., de Frietas, N., Gordon, N. (eds.): Sequential Monte Carlo Methods in Practice. Statistics for Engineering and Information Science. Springer-Verlag, New York (2001)Google Scholar
  9. 9.
    Diebolt, J., Robert, C. P.: Estimation of Finite Mixture Distributions through Bayesian Sampling. J. R. Statist. Soc., 56 (1994) 363–375.zbMATHMathSciNetGoogle Scholar
  10. 10.
    Bar-Shalom, Y., Li, X. R., Kirubarajan, T.: Estimation with Applications to Tracking and Navigation: Theory, Algorithms, and Software. Wiley, New York (2001)Google Scholar
  11. 11.
    Blom, H. A. P., Bar-Shalom, Y.: The Interacting Multiple Model Algorithm for Systems with Markovian Switching Coefficients. IEEE Trans. Automatic ControlAC-33 (1988) 780–783.Google Scholar
  12. 12.
    Mazor, E., Averbuch, A., Bar-Shalom, Y., Dayan, J.: Interacting Multiple Model Methods in Target Tracking: A Survey. IEEE Trans. Aerospace and Electronic SystemsAES-34 (1996) 103–123.Google Scholar
  13. 13.
    Kazakos, D.: Recursive Estimation of Prior Probabilities Using a Mixture. IEEE. Trans. Information TheoryIT-23 (1977) 203–211.Google Scholar
  14. 14.
    Dattatreya, G. R., Kanal, L. N.: Estimation of Mixing Probabilities in Multiclass Finite Mixtures. IEEE Trans. Systems, Man, and Cybernetics, SMC-20 (1990) 149–158Google Scholar
  15. 15.
    Titterington, D., Smith, A., Makov, U.: Statistical Analysis of Finite Mixture Distributions. John Wiley & Sons (1985)Google Scholar
  16. 16.
    Smith, A. F. M., Makov, U. E.: A Quasi-Bayesian Sequential Procedures for Mixtures. J. R. Statist. Soc., 40 (1978) 106–112.zbMATHMathSciNetGoogle Scholar
  17. 17.
    Dempster, A. P., Liard, N. M., Rubin, D. B.: Maximum Likelihood from Incomplete Data Via the EM Algorithm. J. R. Statist. Soc., B 39 (1977) 1–38.Google Scholar
  18. 18.
    Port, S. C.: Theoretical Probability for Applications. John Wiley & Sons (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Vesselin P. Jilkov
    • 1
  • X. Rong Li
    • 1
  • Donka S. Angelova
    • 2
  1. 1.Department of Electrical EngineeringUniversity of New OrleansNew OrleansUSA
  2. 2.Central Laboratory for Parallel ProcessingBulgarian Academy Of SciencesSofiaBulgaria

Personalised recommendations