Skip to main content

On the adaptive stabilization and ergodic behaviour of stochastic systems with jump-Markov parameters via nonlinear filtering

  • Adaptive Control
  • Chapter
  • First Online:
Topics in Stochastic Systems: Modelling, Estimation and Adaptive Control

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 161))

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. V. E. Beneš, “Finite Regular Invariant Measures for Feller Processes,” J. of Appl. Prob., vol. 5, 1968, pp. 203–209.

    Google Scholar 

  2. P. E. Caines, and H. F. Chen, “Optimal Adaptive LQG Control for Systems with Finite State Process Parameters,” IEEE Trans. on Aut. Control, vol. AC-30, no. 2, Feb. 1985, pp. 185–189.

    Article  Google Scholar 

  3. H. F. Chen, and P. E. Caines, “On The Adaptive Control of a Class of Systems with Random Parameters and Disturbances,” Automatica, vol. 21, no. 6, June 1985, pp. 737–741.

    Article  Google Scholar 

  4. H. F. Chen, and P. E. Caines, “On The Adaptive Stabilization of Linear Stochastic Systems with Jump Process Parameters,” Proc. of The IEEE Conf. on Decision & Control, Tampa, Fl, Dec. 1989.

    Google Scholar 

  5. J. L. Doob, Stochastic Processes, John Wiley & Sons Inc., 1953.

    Google Scholar 

  6. J. Ezzine, and A. H. Haddad, “On Largest Lyapunov Exponent Assignment and Almost Sure Stabilization of Hybrid Systems,” Proc. of Am. Control Conf., 1989, pp. 805–809.

    Google Scholar 

  7. A. Friedman, Stochastic Differential Equations and Applications, Vol. I, Academic Press, 1975.

    Google Scholar 

  8. R. Hermann, and A. J. Krener, “Nonlinear Controllability and Observability,” IEEE Trans. on Aut. Control, no. 5, Oct. 1977, pp. 728–740.

    Google Scholar 

  9. W. E. Hopkins, “Optimal Stabilization of Families of Linear Stochastic Differential Equations With Jump Coefficients and Multiplicative Noise,” SIAM J. of Control & Opt., vol. 25, no. 6, Nov. 1987, pp. 1587–1601.

    Google Scholar 

  10. L. Hörmander, “Hypoelliptic Second Order Differential Equations,” Acta Mathematica, vol. 119, Feb. 1968, pp. 147–171.

    Google Scholar 

  11. K. Ichihara, and H. Kunita, “A Classification of The Second Order Degenerate Elliptic Operators and its Probabilistic Characterization,” Z. Wahrscheinlichkeits theorie verw. Gebiete, vol. 30, 1974, pp. 235–254.

    Article  Google Scholar 

  12. G. Kallianpur, Stochastic Filtering Theory, Springer-Verlag, 1980.

    Google Scholar 

  13. W. Kliemann, “Recurrence and Invariant Measures for Degenerate Diffusions,” The Annals of Prob., vol. 15, no. 2, 1987, pp. 690–707.

    Google Scholar 

  14. N. N. Krasovskii, and E. A. Lindskii, “Analytical Design of Controllers in Systems with Random Attributes, parts I, II & III,” Automation And Remote Control, vol. 2, 1962, pp. 1021–1025, 1141–1146, 1289–1294.

    Google Scholar 

  15. R. S. Liptser, and A. N. Shiryaev, Statistics of Random Processes, Vol. I & II, Springer-Verlag, 1977.

    Google Scholar 

  16. M. Mariton, "Controllability, Stability and Pole allocation for Jump Linear Systems," Proc. of The IEEE Conf. on Decision and Control, Athens, Greece, Dec. 1986, pp. 2193–2194.

    Google Scholar 

  17. M. Mariton, "Stochastic Controllability of Linear Systems with Markovian Jumps," Automatica, vol. 23, 1987, pp. 783–785.

    Article  Google Scholar 

  18. S. P. Meyn, and P. E. Caines, "Asymptotic Behaviour of Stochastic Systems Possessing Markovian Realizations," SIAM J. on Control & Optimization. To appear.

    Google Scholar 

  19. S. P. Meyn, and P. E. Caines, "A New Approach to Stochastic Adaptive Control," IEEE Trans. on Aut. Control, vol. AC-32, no. 3, Mar. 1987, pp. 220–226.

    Article  Google Scholar 

  20. S. H. Saperstone, Semidynamical Systems in Infinite Dimensional Spaces, Springer-Verlag, 1981.

    Google Scholar 

  21. D. W. Stroock, and S. R. Varadhan, "On The Support of Diffusion Processes with Applications to the Strong Maximum Principle," Proc. of the 6th Berkeley Symp. on Math. Statist. & Prob., 1972, pp. 333–368.

    Google Scholar 

  22. D. D. Sworder, "Control of Systems Subject to Sudden Change in Character," Proc. of The IEEE, vol. 64, no. 8, Aug. 1976, pp. 1219–1225.

    Google Scholar 

  23. D. D. Sworder, and R. O. Rogers, An LQ Solution to a Control Problem Associated with a Solar Thermal Central Receiver, IEEE Trans. on Aut. Control, Oct. 1983.

    Google Scholar 

  24. W. M. Wonham, "Some Applications of Stochastic Differential Equations to Optimal Nonlinear Filtering," SIAM J. of Control, Vol. 2, no. 3, 1965, pp. 347–369.

    Article  Google Scholar 

  25. W. M. Wonham, "Random Differential Equations in Control Theory," Probabilistic Methods in Applied Mathematics, Vol. II, edited by A. T. Bharucha-Reid, Academic Press, 1970, pp. 131–212.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

L. Gerencséer P. E. Caines

Rights and permissions

Reprints and permissions

Copyright information

© 1991 Springer-Verlag

About this chapter

Cite this chapter

Caines, P.E., Nassiri-Toussi, K. (1991). On the adaptive stabilization and ergodic behaviour of stochastic systems with jump-Markov parameters via nonlinear filtering. In: Gerencséer, L., Caines, P.E. (eds) Topics in Stochastic Systems: Modelling, Estimation and Adaptive Control. Lecture Notes in Control and Information Sciences, vol 161. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0009305

Download citation

  • DOI: https://doi.org/10.1007/BFb0009305

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-54133-2

  • Online ISBN: 978-3-540-47435-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics