Discrete-Time Markovian Jump Linear Systems

  • K. Szajowski
  • W.L. de Koning
Conference paper


The research is oriented to the control of discrete — time linear systems with randomly changing parameters which can be described by a finite — state Markov chain. The cost critrion is a quadratic form of the controls and states of the system. The criterion parameters also depend on the states of the Markov chain. Two models of observation of the Markov chain are adopted — delay for one step and undelay. It is shown that under appropriate mean square detectability and stability conditions the infinite horizon optimal control problem for the general case of Markovian jump linear quadratic systems has a unique solution when the control system is mean square stable. Necessary and sufficient conditions are given to determine if a system is mean square stable.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. H. A. Blom (1991) Hybrid state estimation for systems with semi-markov switching coefficients, in Trans. of European Control Conference’ 91 Grenoble, France, pp. 1132–1137.Google Scholar
  2. L. V. Costa and M. D. Fragoso (1991) Stability results for discrete-time linear systems with markovian jumping parameters, Relatiórios de pesquisa e desenvolvimento 021/91, LNCC/CNPq Rio de Janerio, Nov. 1991.Google Scholar
  3. W. L. De Koning (1982) Infinite horizon optimal control of linear discrete time systems with stochastic parameters, Automatica, 18, pp. 443–453.CrossRefGoogle Scholar
  4. Y. Ji and H. Chizeck (1990) Jump linear quadratic gaussian control: stady-state solution and testable conditions, Control-Theory and Advanced Technology, 6, pp. 289–319.Google Scholar
  5. K. Szajowski and W. De Koning (1992) Discrete-time markovian jump linear systems, Tech. Rep. 92-37, Fac. Mathematics and Informatics, Delft Univ. of Technology.Google Scholar
  6. C. Yang and Y. Bar-Shalom (1991) Stabilizing control of partially observed hybrid systems, in Trans. of European Control Conference’ 91 Grenoble, France pp. 1152–1157.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1993

Authors and Affiliations

  • K. Szajowski
    • 1
  • W.L. de Koning
    • 2
  1. 1.Institute of MathematicsTechnical University of WrocławPoland
  2. 2.Faculty of Technical Mathematics and InformaticsDelft University of TechnologyDelftNetherlands

Personalised recommendations