Advertisement

On the Bias of the SIR Filter in Parameter Estimation of the Dynamics Process of State Space Models

  • Tiancheng LiEmail author
  • Sara Rodríguez
  • Javier Bajo
  • Juan M. Corchado
  • Shudong Sun
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 373)

Abstract

As a popular nonlinear estimation tool, the sampling importance resampling (SIR) filter has been applied with the expectation–maximization (EM) principle, including the typical maximum a posteriori (MAP) estimation and maximum likelihood (ML) estimation, for estimating the parameters of the state space model (SSM). This paper concentrates on an inevitable bias existing in the EM-SIR filter for estimating the dynamics process of the SSM. It is analyzed that the root reason for the bias is the sample impoverishment caused by the resampling procedure employed in the filter. A process noise simulated for the particle propagation that is larger than the real noise involved with the true state will be helpful to counteract sample impoverishment, thereby providing better filtering result. Correspondingly, the EM-SIR filter tends to yield a biased (larger-than-the-truth) estimate of the process noise if it is unknown and needs to be estimated. The bias is elaborated via a straightforward roughening approach by means of both qualitative logical deduction and quantitative numerical simulation. However, it seems hard to fully remove this bias in practice.

Keywords

Particle filter expectation-maximization parameter estimation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Storvik, G.: Particle filter for state-space models with the presence of unknown static parameters. IEEE Transactions on Signal Processing 50(2), 281–289 (2002)CrossRefGoogle Scholar
  2. 2.
    Schön, T.B., Wills, A., Ninness, B.: identification of nonlinear state-space models. Automatica 47(1), 39–49 (2011)CrossRefzbMATHMathSciNetGoogle Scholar
  3. 3.
    Doucet, A., Tadic, V.B.: Parameter estimation in general state-space models using particle methods. Annals of the Institute of Statistical Mathematics 55, 409–422 (2003)zbMATHMathSciNetGoogle Scholar
  4. 4.
    Yildirim, S., Jiang, L., Singh, S.S., Dean, T.A.: Calibrating the Gaussian multi-target tracking model. Statistics and Computing, 1–14 (2014)Google Scholar
  5. 5.
    Dean, T.A., Singh, S.S., Jasra, A., Peters, G.W.: Parameter estimation for hidden Markov models with intractable likelihoods. Scand. J. Statist. 41, 970–987 (2014)CrossRefzbMATHMathSciNetGoogle Scholar
  6. 6.
    Lundquist, C., Karlsson, R., Ozkan, E., Gustafsson, F.: Tire radii estimation using a marginalized particle filter. IEEE Transactions on Intelligent Transportation Systems 15(2), 663–672 (2014)CrossRefGoogle Scholar
  7. 7.
    Zikmundová, M., Helisová, K.S., Beneš, V.: On the use of particle Markov Chain Monte Carlo in parameter estimation of space-time interacting discs. Methodology and Computing in Applied Probability 16(2), 451–463 (2014)CrossRefzbMATHMathSciNetGoogle Scholar
  8. 8.
    Andrieu, C., Doucet, A., Tadic, V.B.: Online parameter estimation in general state-space models. In: Proc. IEEE CDC/ECC, Seville, Spain, pp. 332–337 (2005)Google Scholar
  9. 9.
    Poyiadjis, G., Doucet, A., Singh, S.S.: Parameter approximations of the score and observed information matrix in state space models with application to parameter estimation. Biometrika 98, 65–80 (2011)CrossRefzbMATHMathSciNetGoogle Scholar
  10. 10.
    Kantas, N., Doucet, A., Singh, S.S., Maciejowski, J.M., Chopin, N.: On particle methods for parameter estimation in state-space models. Statistical Science (2015)Google Scholar
  11. 11.
    Olsson, J., Cappe, O., Douc, R., Moulines, E.: SMC Smoothing with application to parameter estimation in nonlinear state-space models. Bernoulli 14(1), 155–179 (2008)CrossRefzbMATHMathSciNetGoogle Scholar
  12. 12.
    Li, T., Sun, S., Sattar, T.P., Corchado, J.M.: Fight sample degeneracy and impoverishment in particle filters: A review of intelligent approaches. Expert Systems with Applications 41(8), 3944–3954 (2014)CrossRefGoogle Scholar
  13. 13.
    Li, T., Bolic, M., Djuric, P.: Resampling methods for particle filtering, IEEE Signal Processing Magazine (to appear, May 2015), doi:10.1109/MSP.2014.2330626Google Scholar
  14. 14.
    Poyiadjis, G., Doucet, A., Singh, S.S.: Maximum likelihood parameter estimation in general state-space models using particle methods. In: Proc. American Stat. Assoc. (2005)Google Scholar
  15. 15.
    Hong, M., Bugallo, M.F., Djurić, P.M.: Joint model selection and parameter estimation by population Monte Carlo simulation. Journal of Selected Topics in Signal Processing 4(3), 526–539 (2010)CrossRefGoogle Scholar
  16. 16.
    Míguez, J., Crisan, D., Djurić, P.M.: On the use of sequential Monte Carlo methods for maximum a posteriori sequence estimation and stochastic global optimization. Statistics and Computing 23(1), 91–107 (2013)CrossRefMathSciNetGoogle Scholar
  17. 17.
    Liu, J., West, M.: Combined parameters and state estimation in simulation based filtering. In: Doucet, A., de Freitas, N., Gordon, N. (eds.) Sequential Monte Carlo Methods in Practice, pp. 197–223. Springer, New York (2001)CrossRefGoogle Scholar
  18. 18.
    Carvalho, C.M., Johannes, M., Lopes, H.F., Polson, N.: Particle learning and smoothing. Statistical Science 25(1), 88–106 (2010)CrossRefMathSciNetGoogle Scholar
  19. 19.
    Lopes, H.F., Tsay, R.S.: Particle filters and Bayesian inference in financial econometrics. J. Forecasting 30, 168–209 (2011)CrossRefzbMATHMathSciNetGoogle Scholar
  20. 20.
    Li, T., Sattar, T.P., Han, Q., Sun, S.: Roughening methods to prevent sample impoverishment in the particle PHD filter. In: 16th International Conference on Information Fusion, Istanbul, Turkey, July 10-12 (2013)Google Scholar
  21. 21.
    Gordon, N., Salmond, D., Smith, A.: Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proc. F Radar Signal Processing 140(2), 107–113 (1993)CrossRefGoogle Scholar
  22. 22.
    Fulop, A., Li, J.: Efficient Learning via Simulation: A marginalized resample-move approach. Journal of Econometrics 176, 146–161 (2013)CrossRefzbMATHMathSciNetGoogle Scholar
  23. 23.
    Li, T., Corchado, J.M., Bajo, J., Sun, S., De Paz, J.F.: Do we always need a filter, arXiv:1408.4636 [stat.AP]Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Tiancheng Li
    • 1
    • 2
    Email author
  • Sara Rodríguez
    • 1
  • Javier Bajo
    • 3
  • Juan M. Corchado
    • 1
  • Shudong Sun
    • 2
  1. 1.BISITE group, Faculty of ScienceUniversity of SalamancaSalamancaSpain
  2. 2.School of Mechanical EngineeringNorthwestern Polytechnical UniversityFremontChina
  3. 3.Department of Artificial IntelligenceTechnical University of MadridMadridSpain

Personalised recommendations