‘Unobserved’ Monte Carlo Methods for Adaptive Algorithms

  • Victor Solo
Part of the International Series in Operations Research & Management Science book series (ISOR, volume 46)


Many Signal Processing and Control problems are complicated by the presence of unobserved variables. Even in linear settings this can cause problems in constructing adaptive parameter estimators. In previous work the author investigated the possibility of developing an on-line version of so-called Markov Chain Monte Carlo methods for solving these kinds of problems. In this article we present a new and simpler approach to the same group of problems based on direct simulation of unobserved variables.


Markov Chain Monte Carlo Adaptive Algorithm 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Benveniste, A., M. Metivier, and P. Priouret. (1990). Adaptive Algorithms and stochastic approximations. Springer-Verlag, New York.CrossRefGoogle Scholar
  2. Dempster, A.P., N.M. Laird, and D.B. Rubin. (1977). Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. B, 39:p.1–38.MathSciNetzbMATHGoogle Scholar
  3. Geman, S. and D. Geman. (1984). Stochastic relaxation, gibbs distributions and the bayesian restoration of images. IEEE. Trans. Patt. Anal. Machine Intell., 6:721–741.CrossRefGoogle Scholar
  4. Kanatani, K. (1996). Statistical optimization for Geometric Computation: Theory and Practice. North-Holland, Amsterdam.zbMATHGoogle Scholar
  5. Kuk, A.Y.C., and Y. W. Cheng. (1997). The Monte Carlo Newton Raphson algorithm. Jl Stat Computation Simul.Google Scholar
  6. Kitagawa, G. (1998). Self organising state space model. Jl. Amer. Stat. Assoc, 93:1203–1215.Google Scholar
  7. Kushner, H.J. (1984). Approximation and weak convergence methods for random processes with application to stochastic system theory. MIT Press, Cambridge MA.zbMATHGoogle Scholar
  8. Ljung, L. (1983). Theory and practice of recursive identification. MIT Press, Cambridge, Massachusetts.zbMATHGoogle Scholar
  9. Metropolis, N., A. Rosenbluth, M. Rosenbluth, A. Teller, and E. Teller. (1953). Equations of state calculations by fast computing machines. J. Chem. Phys., 21:1087–1091.CrossRefGoogle Scholar
  10. Ng, L. and V. Solo. (2001). Errors-in-variables modelling in optical flow estimation. IEEE Trans. Im.Proc., to appear.Google Scholar
  11. Neuman, S.P. and S. Yakowitz. (1979). A statistical approach to the inverse problem of aquifer hydrology, I. Water Resour Res, 15:845–860.CrossRefGoogle Scholar
  12. Rappaport, T.S. (1996). Wireless Communication. Prentice Hall, New York.Google Scholar
  13. Ripley, B.D. (1996). Pattern recognition and Neural networks. Cambridge University Press, Cambridge UK.CrossRefGoogle Scholar
  14. Roberts, G.O. and J.S. Rosenthal. (1998). Markov chain monte carlo: Some practical implications of theoretical results. Canadian Jl. Stat., 26:5–31.MathSciNetCrossRefGoogle Scholar
  15. Sastry, S. and M. Bodson. (1989). Adaptive Control. Prentice Hall, New York.zbMATHGoogle Scholar
  16. Solo, V. and X. Kong. (1995). Adaptive Signal Processing Algorithms. Prentice Hall, New Jersey.Google Scholar
  17. Solo, V. (1999). Adaptive algorithms and Markov chain Monte Carlo methods. In Proc. IEEE Conf Decision Control 1999, Phoenix, Arizona, IEEE.Google Scholar
  18. Solo, V. (2000a). ‘Unobserved’ Monte Carlo method for system identification of partially observed nonlinear state space systems, Part I: Analog observations. In Proc JSM2001, Atlanta, Georgia, August, page to appear. Am Stat Assocn.Google Scholar
  19. Solo, V. (2000b). ‘Unobserved’ Monte Carlo method for system identification of partially observed nonlinear state space systems, Part II: Counting process observations. In Proc 39th IEEE CDC, Sydney Australia. IEEE.Google Scholar
  20. Tekalp, M. (1995). Digital Video Processing. Prentice-Hall, Englewood Cliffs, N.J.Google Scholar
  21. Wei, G.C.G. and M. Tanner. (1990). A Monte Carlo implementation of the EM algorithm and the poor man’s data augmentation algorithms. Jl. Amer. Stat. Assoc, 85:699–704.CrossRefGoogle Scholar
  22. Yakowitz, S. (1969). Mathematics of Adaptive Control Processes. Elsevier, New York.zbMATHGoogle Scholar
  23. Yakowitz, S. (1985). Nonparametric density estimation, prediction and regression for Markov sequences. Jl. Amer. Stat. Assoc, 80:215–221.MathSciNetCrossRefGoogle Scholar
  24. Yakowitz, S. and F. Szidarovszky. (1984). A comparison of kriging with nonparametric regression methods. Jl Mult Anal.Google Scholar

Copyright information

© Springer Science + Business Media, Inc. 2002

Authors and Affiliations

  • Victor Solo
    • 1
  1. 1.School of Electrical Engineering and TelecommunicationsUniversity of New South WalesSydneyAustralia

Personalised recommendations