Skip to main content

Linear Finite-Dimensional Stochastic Systems

  • Chapter
Linear Stochastic Systems

Part of the book series: Series in Contemporary Mathematics ((SCMA,volume 1))

Abstract

This chapter is an introduction to linear state-space modeling of second-order, wide-sense stationary, stochastic vector processes. In particular, we shall discuss modeling of discrete-time purely non deterministic processes with a rational spectral density matrix. These processes turn out to admit representations as the output y of a finite-dimensional linear system

$$\displaystyle{ \left \{\begin{array}{lcl} x(t + 1) &=& Ax(t) + Bw(t)\quad \\ y(t) &=& Cx(t) + Dw(t)\quad \end{array} \right. }$$

driven by a white noise input {w(t)}, where A, B, C and D are constant matrices of appropriate dimensions. These state-space descriptions provide a natural and useful class of parametrized stochastic models widely used in control and signal processing, leading to simple recursive estimation algorithms. Stochastic realization theory consists in characterizing and determining any such representation. This is in turn related to spectral factorization. The structure of these stochastic models is described in geometric terms based on coordinate-free representations and on elementary Hilbert space concepts.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Some background on deterministic state-space modeling is presented in Appendix A.

  2. 2.

    The direction of the arrows reflects anticausality; i.e., the fact that the future of \(\bar{w}\) is mapped into the past of y.

Bibliography

  1. Akaike, H.: Markovian representation of stochastic processes by canonical variables. SIAM J. Control 13, 162–173 (1975)

    Article  MATH  MathSciNet  Google Scholar 

  2. Anderson, B.D.O.: The inverse problem of stationary covariance generation. J. Stat. Phys. 1, 133–147 (1969)

    Article  Google Scholar 

  3. Faurre, P.: Réalisations markoviennes de processus stationnaires. Technical report 13, INRIA (LABORIA), Le Chesnay, Mar 1973

    Google Scholar 

  4. Faurre, P., Clerget, M., Germain, F.: Opérateurs rationnels positifs. Volume 8 of Méthodes Mathématiques de l’Informatique [Mathematical Methods of Information Science]. Dunod, Paris (1979). Application à l’hyperstabilité et aux processus aléatoires

    Google Scholar 

  5. Ferrante, A., Picci, G., Pinzoni, S.: Silverman algorithm and the structure of discrete-time stochastic systems. Linear Algebra Appl. 351–352, 219–242 (2002)

    Article  MathSciNet  Google Scholar 

  6. Fuhrmann, P.A.: Linear Systems and Operators in Hilbert Space. McGraw-Hill, New York (1981)

    MATH  Google Scholar 

  7. Kailath, T.: Linear Systems. Prentice-Hall Information and System Sciences Series. Prentice-Hall Inc., Englewood Cliffs (1980)

    MATH  Google Scholar 

  8. Kalman, R.E.: Lyapunov functions for the problem of Lur′ e in automatic control. Proc. Nat. Acad. Sci. U.S.A. 49, 201–205 (1963)

    Article  MATH  MathSciNet  Google Scholar 

  9. Lindquist, A., Picci, G.: On the structure of minimal splitting subspaces in stochastic realization theory. In: Proceedings of the 1977 IEEE Conference on Decision and Control, New Orleans, 1977, vol. 1, pp. 42–48. IEEE, New York (1977)

    Google Scholar 

  10. Lindquist, A., Picci, G.: A state-space theory for stationary stochastic processes. In: Proceedings of the 21st Midwestern Symposium on Circuits and Systems, Ames, 1978, pp. 108–113 (1978)

    Google Scholar 

  11. Lindquist, A., Picci, G.: On the stochastic realization problem. SIAM J. Control Optim. 17(3), 365–389 (1979)

    Article  MATH  MathSciNet  Google Scholar 

  12. Lindquist, A., Picci, G.: Realization theory for multivariate Gaussian processes I: state space construction. In: Proceedings of the 4th International Symposium on the Mathematical Theory of Networks and Systems, Delft, 1979, pp. 140–148 (1979)

    Google Scholar 

  13. Lindquist, A., Picci, G.: Realization theory for multivariate Gaussian processes: II: state space theory revisited and dynamical representations of finite-dimensional state spaces. In: Second International Conference on Information Sciences and Systems, University of Patras, Patras, 1979, vol. II, pp. 108–129. Reidel, Dordrecht (1980)

    Google Scholar 

  14. Lindquist, A., Picci, G., Ruckebusch, G.: On minimal splitting subspaces and Markovian representations. Math. Syst. Theory 12(3), 271–279 (1979)

    MATH  MathSciNet  Google Scholar 

  15. McKean, H.P., Jr.: Brownian motion with a several-dimensional time. Teor. Verojatnost. i Primenen. 8, 357–378 (1963)

    MathSciNet  Google Scholar 

  16. Pavon, M.: Stochastic realization and invariant directions of the matrix Riccati equation. SIAM J. Control Optim. 28, 155–180 (1980)

    Article  MathSciNet  Google Scholar 

  17. Picci, G.: Stochastic realization of Gaussian processes. Proc. IEEE 64(1), 112–122 (1976). Recent trends in system theory

    Google Scholar 

  18. Popov, V.M.: Hyperstability and optimality of automatic systems with several control functions. Rev. Roumaine Sci. Tech. Sér. Électrotech. Énergét. 9, 629–690 (1964)

    Google Scholar 

  19. Ruckebusch, G.: Représentations markoviennes de processes gaussiens stationnaires et applications statistiques. In: Journees de Statistique des Processus Stochastiques: Proceedings, Grenoble, June 1977, Springer Lecture Notes in Mathematics, vol. 636, pp. 115–139. Springer Berlin Heidelberg (1978)

    Google Scholar 

  20. Ruckebusch, G.: Représentations markoviennes de processus guassiens startionaires. C. R. Acad. Sc. Paris Ser. A 282, 649–651 (1976)

    MATH  Google Scholar 

  21. Ruckebusch, G.: On the theory of Markovian representation. In: Measure Theory Applications to Stochastic Analysis. Proceedings of the Conference on Mathematical Research Institute, Oberwolfach, 1977. Volume 695 of Lecture Notes in Mathematics, pp. 77–87. Springer, Berlin (1978)

    Google Scholar 

  22. Ruckebusch, G.: A state space approach to the stochastic realization problem. In: Proceedings of the 1978 International Symposium on Circuits and Systems, New York (1978)

    Google Scholar 

  23. Yakubovich, V.A.: The solution of some matrix inequalities encountered in automatic control theory. Dokl. Akad. Nauk SSSR 143, 1304–1307 (1962)

    MathSciNet  Google Scholar 

  24. Youla, D.C.: On the factorization of rational matrices. IRE Trans. IT-7, 172–189 (1961)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Lindquist, A., Picci, G. (2015). Linear Finite-Dimensional Stochastic Systems. In: Linear Stochastic Systems. Series in Contemporary Mathematics, vol 1. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-45750-4_6

Download citation

Publish with us

Policies and ethics