Finite Dimensional Linear Stochastic System Identification

  • P. E. Caines


The use of state space systems to represent dynamical systems of various types has a long history in mathematics and physics. Two fundamental examples are the well-known methods for analysing high order ordinary differential equations via the corresponding first order equations and the formulation of Hamiltonian mechanics—within which classical celestial mechanics forms a magnificent special case. Equally, in theoretical engineering, including the information and control sciences, state space methods have played and continue to play a fundamental rôle. From a mathematical viewpoint, the pure state evolution models of dynamical system theory undergo an enormous generalization in control theory to input-output systems, which then fall into equivalence classes according to their input-output behavior. Furthermore, from an engineering viewpoint, a vast array of problems are either initially posed in state space terms (aerospace engineering provides many examples) or are first presented in terms of input-output models which are then transformed into input-stateoutput form (process control being one source of examples). As a result, one of the basic subjects of study in mathematical system theory is the relationship between input-state-output systems and input–output systems. The generality of this relationship is conveyed by the Nerode Theorem which states that any non-anticipative (set-valued) input—(set valued) output system S possesses a state space realization Σ(S), that is to say, there exists an input-state-output system Σ(S) which generates the same input-output trajectories as S.


Asymptotic Normality Hankel Matrix State Space System State Space Realization Finite Dimensional Distribution 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Bokor J. and L. Keviczky, ARMA Canonical Forms Obtained from Constructibility Invariants, Int J Control, 45 (3), 861–873 (1987)MathSciNetMATHCrossRefGoogle Scholar
  2. Brockett, R.W., Some Geometric Questions in the Theory of Linear Systems, IEEE Trans Auto Control, AC-21 (3), 449–455 (1976)MathSciNetCrossRefGoogle Scholar
  3. Byrnes, C., The Moduli Space for Linear Dynamical Systems, in the 1976 Ames Research Center (NASA) Conf. on Geometric Control Theory,eds. C. Martin and R. Hermann, Vol VII, Lie Groups: History, Frontiers and Applications, Math Sci Press, Brookline, MA (1977)Google Scholar
  4. Byrnes, C. and N.E. Hurt, On the Moduli of Linear Dynamical Systems, Stud Anal Adv Math Suppl Stud, 4, 83–122 (1978)MathSciNetGoogle Scholar
  5. Caines, P.E., Linear Stochastic Systems, John-Wiley, NYC, (1988)MATHGoogle Scholar
  6. Caines, P.E. and J. Rissanen, Maximum Likelihood Estimation of Parameters in Multivariate Gausian Stochastic Processes IEEE Trans Inf TheoryIT-20 (1), 102–104 (1974) Google Scholar
  7. Clark, J.M.C., The Consistent Selection of Local Coordinates in Linear System Identification, Joint Atomatic Control Conference,Purdue Univ. Lafayette, Indiana, July (1976)Google Scholar
  8. Deistler, M., The Properties of the Parameterization of ARMAX Systems and their Relevance for Structural Estimation. Econometrica, 51, 1187–1207 (1983)MathSciNetMATHCrossRefGoogle Scholar
  9. Deistler, M. and M. Gevers, Properties of the Parameterization of Monic ARMA Systems, 8th IFA/IFORS Symposium on Identification and System Parameter Estimation, Preprints 2, 1341–1348 (1988)Google Scholar
  10. Delchamps, D.F. Global structure of families of multivariable linear systems with an application to identification, Math Systems Theory, 18, 329–380 (1985)MathSciNetCrossRefGoogle Scholar
  11. Delchamps, D.F., State Space and Input-Output Linear Systems, Springer-Verlag, NYC (1988)Google Scholar
  12. Denham, M.J., Canonical forms for the identification of multivariable linear systems. IEEE Trans Autom Control, AC-19, 646–656 (1974)MathSciNetCrossRefGoogle Scholar
  13. Dickinson, B.W., T. Kailath and M. Morf, Canonical matrix fraction and state-space descriptions for deterministic and stochastic linear systems. IEEE Trans Autom Control, AC-19, 656–667 (1974)MathSciNetCrossRefGoogle Scholar
  14. Dunsmuir, W., A Central Limit Theorem for Parameter Estimation in Stationary Vector Time Series and its Application to Models for a Signal Observed in Noise, Ann Stat, 7 (3), 490–506 (1979)MathSciNetMATHCrossRefGoogle Scholar
  15. Forney, D., Minimal bases of rational vector spaces, with applications to multivariable linear systems, SIAM J Control, 13, 493–520 (1975)MathSciNetMATHCrossRefGoogle Scholar
  16. Gevers, M. and V. Wertz, Uniquely identifiable state—space and ARMA parameterizations for multivariable linear systems, Automatica, 20 (3), 333–347 (1984)MathSciNetMATHCrossRefGoogle Scholar
  17. Glover, K. and J.C. Willems, Parameterizations of linear dynamical system: Canonical forms and identifiability, IEEE Trans Automat Contr, Vol AC-19, 640–646 (1974)Google Scholar
  18. Hannan, E.J., The Statistical Theory of Linear Systems, Chapter 2 in Developments in Statistics, edited by P. Krishnaiah, Academic Press, N.Y., 83–121 (1979)Google Scholar
  19. Hannan, E.J. and M. Deistler, The Statistical Theory of Linear Systems, John Wiley, NYC (1988)Google Scholar
  20. Hanzon, B., Identifiability, Recursive Identification and Spaces of Linear Dynamical Systems, Ph.D. Thesis, University of Gröningen, Gröningen, (1986).Google Scholar
  21. Hazewinkel, M. and R.E. Kalman, On Invariants, Canonical Forms and Moduli for Linear, Constant, Finite Dimensional Dynamical Systems, Mathematical Systems Theory, Udine 1975, Spinger-Verlag, NYC, 48–60 (1976)Google Scholar
  22. Heymann, M., Structure and Realization Problems in the Theory of Dynamical Systems, Springer, CISM Courses and Lectures No. 204, NY (1975)Google Scholar
  23. Kalman, R.E., Mathematical Description of Linear Dynamical Systems, SIAM J Control, 1, 152–192 (1963)MathSciNetMATHGoogle Scholar
  24. Kalman, R.E., Irreducible Realizations and the Degree of a Rational Matrix, SIAM J Appl Math, 13, 520–544 (1965)MathSciNetMATHCrossRefGoogle Scholar
  25. Kalman, R.E., Algebraic Geometric Description of the Class of Linear Systems of Constant Dimension, 8th Annual Princeton Conference on Information Sciences as Systems, Princeton, NJ (1974)Google Scholar
  26. Kalman, R.E., Identifiability and Problems of Model Selection in Econometrics, 4th World Congress of the Econometric Society, Aix-en-Provence, August (1980)Google Scholar
  27. Ljung, L., System Identification: Theory for the User, Prentice Hall, New Jersey, (1987)MATHGoogle Scholar
  28. Rissanen J., Basis of Invariants and Canonical Forms for Linear Dynamic Systems, Automatica, 10, 175–182 (1974)MathSciNetMATHCrossRefGoogle Scholar
  29. Rissanen J., Stochastic Complexity in Statistical Inquiry, World Scientific, Singapore, (1989)MATHGoogle Scholar
  30. Rissanen, J. and P.E. Caines, The Strong Consistency of Maximum Likelihood Estimators of ARMA Processes, The Annals of Statistics, 7 (2), 297–315 (1979)MathSciNetMATHCrossRefGoogle Scholar
  31. Rissanen, J. and L. Ljung. Estimation of Optimum Structures and Parameters for Linear Systems Mathematical Systems Theory, Udine, 92–110 (1975)Google Scholar
  32. Segal, G., The Topology of Spaces of Rational Functions, Acta Mathematica, 143, 39–72 (1979) Van Overbeck, A.J.M., and L. Ljung, On Line Structure Selection for Multivariable State Space Models, Automatica, 18 (5), 529–543 (1982)CrossRefGoogle Scholar
  33. Willems, J.C., From Time Series to Linear Systems, Automatica, Part I, 22 (5), 561–580, Part II, 22 (6), 675–694 (1986); Part III 23 (1), 87–115 (1987)MathSciNetMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1991

Authors and Affiliations

  • P. E. Caines
    • 1
  1. 1.Canadian Institute for Advanced Research and Department of Electrical EngineeringMcGill UniversityMontréalCanada

Personalised recommendations