Skip to main content

Applications of a Markov Process

  • Chapter
  • First Online:
Analysis and Design of Singular Markovian Jump Systems

Abstract

This chapter studies the applications of a Markov process on deterministic singular systems whose parameters are only with one mode. The first application is on an uncertain singular system which has norm bounded uncertainties on system matrices. According to the maximum singular value of uncertainty, the uncertainty set is separated into several different subsets. Then, the original system without jumping is transformed into an MJS, whose switching probability of subsets is considered in system analysis and synthesis. New version of BRL is developed by exploiting an uncertainty-dependent Lyapunov function. Two conditions for uncertainty-dependent controllers are established. Based on the key idea, the time-varying delay of the singular system is described by a Markov process, whose distribution property is also considered. Sufficient conditions for the solvability of delay-distribution-dependent stability with both exact known or uncertain TRMs are derived, and state feedback controllers depending on such a distribution are designed via the LMI approach.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Xu SY, Lam J (2006) Control and filtering of singular systems. Springer, Berlin

    MATH  Google Scholar 

  2. Gao HJ, Chen TW (2007) New results on stability of discrete-time systems with time-varying state delay. IEEE Trans Autom Control 52:328–334

    Article  MathSciNet  Google Scholar 

  3. Ghaoui LEI, Oustry F, AitRami M (1997) A cone complementarity linearization algorithm for static output-feedback and related problems. IEEE Trans Autom Control 42:1171–1176

    Article  MATH  Google Scholar 

  4. Leibfritz F (2001) An LMI-based algorithm for designing suboptimal static \(H_2/H_\infty \) output feedback controllers. SIAM J Control Optim 39:1171–1735

    Article  MathSciNet  Google Scholar 

  5. Gao HJ, Chen TW, Lam J (2008) A new delay system approach to network-based control. Automatica 44:39–52

    Article  MATH  MathSciNet  Google Scholar 

  6. Huang D, Nguang SK (2008) State feedback control of uncertain networked control systems with random delays. IEEE Trans Autom Control 53:829–834

    Article  MathSciNet  Google Scholar 

  7. Jiang XF, Han QL, Liu SR, Xue AK (2008) A new \(H_\infty \) stabilization criterion for networked control systems. IEEE Trans Autom Control 53:1025–1032

    Article  MathSciNet  Google Scholar 

  8. Peng C, Tian YC, Tadé MO (2008) State feedback controller design of networked control systems with interval time-varying delay and nonlinearity. Int J Robust Nonlinear Control 18:1285–1301

    Article  MATH  Google Scholar 

  9. Yue D, Han QL, Lam J (2005) Network-based robust \(H_\infty \) control of systems with uncertainty. Automatica 41(6):999–1007

    Article  MATH  MathSciNet  Google Scholar 

  10. Yue D, Han QL, Chen P (2004) State feedback controller design of networked control systems. IEEE Trans Circuits Syst II Express Briefs 51:640–644

    Article  Google Scholar 

  11. Zhang XX, Jiang XF, Han QL (2010) An improved stability criterion of networked control systems. In: Proceeding 2010 American control conference, Baltimore, Maryland, pp 586–589

    Google Scholar 

  12. He Y, Wang QG, Lin C, Wu M (2007) Delay-range-dependent stability for systems with time-varying delay. Automatica 43:371–376

    Article  MATH  MathSciNet  Google Scholar 

  13. Jiang XF, Han QL (2008) New stability criteria for linear systems with interval time-varying delay. Automatica 44:2680–2685

    Article  MATH  MathSciNet  Google Scholar 

  14. Kim DS, Lee YS, Kwon WH, Park HS (2003) Maximum allowable delay bounds of networked control systems. Control Eng Pract 11:1301–1313

    Article  Google Scholar 

  15. Park HS, Kim YH, Kim DS, Kwon WH (2002) A scheduling method for network-based control systems. IEEE Trans Control Syst Technol 10:318–330

    Article  Google Scholar 

  16. Shao HY (2008) Improved delay-dependent stability criteria for systems with a delay varying in a range. Automatica 44:3215–3218

    Article  MATH  Google Scholar 

  17. Shao HY (2009) New delay-dependent stability criteria for systems with interval delay. Automatica 45:744–749

    Article  MATH  Google Scholar 

  18. Yue D, Tian EG, Wang ZD, Lam J (2009) Stabilization of systems with probabilistic interval input delays and its applications to networked control systems. IEEE Trans Syst Man Cybern Part A Syst Hum 39:939–945

    Google Scholar 

  19. Zhang W, Branicky MS, Phillips SM (2001) Stability of networked control systems. IEEE Control Syst Mag 21:84–99

    Article  Google Scholar 

  20. Han QL, Gu KJ (2001) Stability of linear systems with time-varying delay: a generalized discretized Lyapunov function approach. Asian J Control 3(3):170–180

    Article  Google Scholar 

  21. Li HY, Gao HJ, Shi P (2010) New passivity analysis for neural networks with discrete and distributed delays. IEEE Trans Neural Networks 21:1842–1847

    Article  Google Scholar 

  22. Wang GL, Zhang QL, Yang CY (2013) Stabilization of linear systems with time-varying delays. Int J Robust Nonlinear Control 23:1581–1596

    Article  MATH  MathSciNet  Google Scholar 

  23. Wang GL, Zhang QL, Sreeram V (2011) Robust \(H_\infty \) control of norm bounded uncertain systems via Markovian approach. Asian J Control 13:956–965

    Article  MATH  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Guoliang Wang .

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Wang, G., Zhang, Q., Yan, X. (2015). Applications of a Markov Process. In: Analysis and Design of Singular Markovian Jump Systems. Springer, Cham. https://doi.org/10.1007/978-3-319-08723-8_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-08723-8_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-08722-1

  • Online ISBN: 978-3-319-08723-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics