Mathematics of Complexity and Dynamical Systems

2011 Edition
| Editors: Robert A. Meyers (Editor-in-Chief)

Stochastic Noises, Observation, Identification and Realization with

  • Giorgio Picci
Reference work entry

Article Outline



Stochastic Realization

Wide-Sense Stochastic Realization

Geometric Stochastic Realization

Dynamical System Identification

Future Directions



Markov Process Brownian Particle Stationary Stochastic Process Stochastic Dynamical System Spectral Factor 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in to check access.


Primary Literature

  1. 1.
    Akaike H (1975) Markovian representation of stochastic processes by canonical variables. SIAM J Control 13:162–173MathSciNetMATHCrossRefGoogle Scholar
  2. 2.
    Akaike H (1974) Stochastic Theory of Minimal Realization. IEEE Trans Autom Control AC-19(6):667–674MathSciNetCrossRefGoogle Scholar
  3. 3.
    Anderson BDO (1969) The inverse problem of Stationary Covariance Generation. J Stat Phys 1(1):133–147CrossRefGoogle Scholar
  4. 4.
    Anderson BDO (1967) An algebraic solution to the spectral factorization problem. IEEE Trans Autom Control AC-12:410–414CrossRefGoogle Scholar
  5. 5.
    Anderson BDO (1999) The realization problem for Hidden Markov Models. Math Control Signals Syst 12:80–120MATHCrossRefGoogle Scholar
  6. 6.
    Aoki M (1990) State Space Modeling of Time Series, 2nd edn. Springer, New YorkCrossRefGoogle Scholar
  7. 7.
    Byrnes CI, Lindquist A (1982) The stability and instability of partial realizations. Syst Control Lett 2:2301–2312MathSciNetCrossRefGoogle Scholar
  8. 8.
    Bauer D (2005) Comparing the CCA Subspace Method to Pseudo Maximum Likelihood Methods in the case of No Exogenous Inputs. J Time Ser Anal 26:631–668MathSciNetMATHCrossRefGoogle Scholar
  9. 9.
    Chiuso A, Picci G (2004) The Asymptotic Variance of Subspace Estimates. J Econom 118(1–2):257–291MathSciNetMATHCrossRefGoogle Scholar
  10. 10.
    Chiuso A, Picci G (2004) On the Ill‐conditioning of subspace identification with inputs. Automatica 40(4):575–589MathSciNetMATHCrossRefGoogle Scholar
  11. 11.
    Chiuso A, Picci G (2005) Consistency Analysis of some Closed‐loop Subspace Identification Methods. Automatica 41:377–391, special issue on System IdentificationMathSciNetMATHCrossRefGoogle Scholar
  12. 12.
    Cramèr H (1949) Mathematical Methods of Statistics. Princeton University Press, PrincetonGoogle Scholar
  13. 13.
    Desai UB, Pal D, Kirkpatrick RD (1985) A Realization Approach to Stochastic Model Reduction. Int J Control 42:821–838MATHCrossRefGoogle Scholar
  14. 14.
    Doob JL (1953) Stochastic Processes. Wiley, New YorkMATHGoogle Scholar
  15. 15.
    Faurre P (1969) Identification par minimisation d'une representation Markovienne de processus aleatoires. Symposium on Optimization, Nice 1969. Lecture Notes in Mathematics, vol 132. Springer, New YorkGoogle Scholar
  16. 16.
    Faurre P, Chataigner P (1971) Identification en temp reel et en temp differee par factorisation de matrices de Hankel. French–Swedish colloquium on process control, IRIA RoquencourtGoogle Scholar
  17. 17.
    Faurre P (1973) Realisations Markovienne de processus stationnaires. Report de Recherche no 13, INRIA, RoquencourtGoogle Scholar
  18. 18.
    Ferrante A, Picci G, Pinzoni S (2002) Silverman algorithm and the structure of discrete‐time stochastic systems. Linear Algebra Appl (special issue on systems and control) 351–352:219–242Google Scholar
  19. 19.
    Finesso L, Spreij PJC (2002) Approximate realization of finite Hidden Markov Chains. Proceedings of the 2002 IEEE Information Theory Workshop, Bangalore, pp 90–93Google Scholar
  20. 20.
    Ford GW, Kac M, Mazur P (1965) Statistical mechanics of assemblies of coupled oscillators. J Math Phys 6:504–515MathSciNetMATHCrossRefGoogle Scholar
  21. 21.
    Kalman RE (1963) On a new Criterion of Linear Passive Systems. In: Proc. of the First Allerton Conference. University of Illinois, Urbana Ill, Nov 1963, pp 456–470Google Scholar
  22. 22.
    Kalman RE (1963) Lyapunov Functions for the problem of Lur'e in Automatic Control. Proc Natl Acad Sci 49:201–205MathSciNetMATHCrossRefGoogle Scholar
  23. 23.
    Kalman RE (1965) Linear stochastic filtering: reappraisal and outlook. In: Proc. Symposium on Syatem Theory, Politechnic Institute of Brooklin, pp 197–205Google Scholar
  24. 24.
    Kalman RE, Falb PL, Arbib MA (1969) Topics in Mathematical Systems Theory. McGraw–Hill, New YorkGoogle Scholar
  25. 25.
    Karatzas I, Shreve S (1987) Brownian motion and stochastic calculus. Springer, New YorkGoogle Scholar
  26. 26.
    Katayama T, Picci G (1999) Realization of Stochastic Systems with Exogenous Inputs and Subspace Identification Methods. Automatica 35(10):1635–1652MathSciNetMATHCrossRefGoogle Scholar
  27. 27.
    Katayama T (2005) Subspace methods for System Identification. Springer, New YorkMATHGoogle Scholar
  28. 28.
    Kintchine A (1934) Korrelationstheorie Stationäre Stochastischen Prozessen. Math Annalen 109:604–615CrossRefGoogle Scholar
  29. 29.
    Lax PD, Phillips RS (1967) Scattering Theory. Academic Press, New YorkMATHGoogle Scholar
  30. 30.
    Levy P (1948) Processus stochastiques et Mouvement Brownien. Gauthier–Villars, ParisMATHGoogle Scholar
  31. 31.
    Lewis JT, Thomas LC (1975) How to make a heat bath. In: Arthurs AM (ed) Functional Integration and its Applications. Clarendon, OxfordGoogle Scholar
  32. 32.
    Lewis JT, Maassen H (1984) Hamiltonian models of classical and quantum stochastic processes. In: Accardi L, Frigerio A, Gorini V (eds) Quantum Probability and Applications to the Quantum Theory of Irreversible processes. Springer Lecture Notes in Mathematics, vol 1055. Springer, New York, pp 245–276CrossRefGoogle Scholar
  33. 33.
    Lindquist A, Picci G, Ruckebusch G (1979) On minimal splitting subspaces and Markovian representation. Math Syst Theory 12:271–279MathSciNetMATHCrossRefGoogle Scholar
  34. 34.
    Lindquist A, Picci G (1979) On the stochastic realization problem. SIAM J Control Optim 17:365–389MathSciNetMATHCrossRefGoogle Scholar
  35. 35.
    Lindquist A, Picci G (1985) Realization theory for multivariate stationary Gaussian processes. SIAM J Control Optim 23:809–857MathSciNetMATHCrossRefGoogle Scholar
  36. 36.
    Lindquist A,Pavon M (1984) On the structure of state space models of discrete‐time vector processes. IEEE Trans Autom Control AC-29:418–432MathSciNetCrossRefGoogle Scholar
  37. 37.
    Lindquist A, Picci G (1991) A geometric approach to modelling and estimation of linear stochastic systems. J Math Syst Estim Control 1:241–333MathSciNetGoogle Scholar
  38. 38.
    Lindquist A, Picci G (1996) Canonical correlation analysis approximate covariance extension and identification of stationary time series. Automatica 32:709–733MathSciNetMATHCrossRefGoogle Scholar
  39. 39.
    Lindquist A, Michaletzky G, Picci G (1995) Zeros of Spectral Factors, the Geometry of Splitting Subspaces, and the Algebraic Riccati Inequality. SIAM J Control Optim 33:365–401MathSciNetMATHCrossRefGoogle Scholar
  40. 40.
    Lindquist A, Picci G (1996) Geometric Methods for State Space Identification. In: Identification, Adaptation, Learning. (Lectures given at the NATO-ASI School, From Identification to Learning, Como, Italy, Aug 1994. SpringerGoogle Scholar
  41. 41.
    Lindquist A, Picci G, Linear Stochastic Systems: A Geometric Approach. (in preparation)Google Scholar
  42. 42.
    Ljung L (1987) System Identification – Theory for the User. Prentice–Hall, New YorkMATHGoogle Scholar
  43. 43.
    Martin‐Löf A (1979) Statistical Mechanics and the foundations of Thermodynamics. Lecture Notes in Physics, vol 101. Springer, New YorkGoogle Scholar
  44. 44.
    Moonen M, De Moor B, Vanderberghe L, Vandewalle J (1989) On- and Off-Line Identification of Linear State–Space Models. Int J Control 49:219–232MATHGoogle Scholar
  45. 45.
    Taylor TJ, Pavon M (1988) A solution of the nonlinear stochastic realization problem. Syst Control Lett 11:117–121MathSciNetMATHCrossRefGoogle Scholar
  46. 46.
    Picci G (1978) On the internal structure of finite‐state stochastic processes. In: Mohler R, Ruberti A (eds) Recent developments in Variable Structure Systems. Springer Lecture Notes in Economics and Mathematical Systems. vol 162. Springer, New York, pp 288–304CrossRefGoogle Scholar
  47. 47.
    Picci G, Pinzoni S (1994) Acausal Models and Balanced realizations of stationary processes. Linear Algebra Appl (special issue on Systems Theory) 205–206:957–1003Google Scholar
  48. 48.
    Picci G (1986) Application of stochastic realization theory to a fundamental problem of statistical physics. In: Byrnes CI, Lindquist A (eds) Modeling, Identification and Robust Control. North Holland, AmsterdamGoogle Scholar
  49. 49.
    Picci G, Taylor TJ (1990) Stochastic aggregation of linear Hamiltonian systems with microcanonical distribution. In: Kaashoek MA, van Schuppen JH, Ran ACM (eds) Realization and modeling in System Theory. Birkhäuser, Boston, pp 513–520CrossRefGoogle Scholar
  50. 50.
    Picci G (1992) Markovian representation of linear Hamiltonian systems. In: Guerra F, Loffredo MI, Marchioro C (eds) Probabilistic Methods in Mathematical Physics. World Sciedntific, Singapore, pp 358–373Google Scholar
  51. 51.
    Picci G (1991) Stochastic realization theory. In: Antoulas A (ed) Mathematical System Theory. Springer, New YorkGoogle Scholar
  52. 52.
    Picci G, Taylor TSJ (1992) Generation of Gaussian Processes and Linear Chaos. In: Proc 31st IEEE Conf on Decision and Control. Tucson, pp 2125–2131Google Scholar
  53. 53.
    Picci G, Katayama T (1996) Stochastic realization with exogenous inputs and “Subspace Methods” Identification. Signal Process 52(2):145–160MATHCrossRefGoogle Scholar
  54. 54.
    Picci G (1996) Geometric methods in Stochastic Realization and System Identification. CWI Q (invited paper) 9:205–240MathSciNetMATHGoogle Scholar
  55. 55.
    Picci G (1997) Oblique Splitting Susbspaces and Stochastic Realization with Inputs. In: Helmke U, Prätzel–Wolters D, Zerz E (eds) Operators, Systems and Linear Algebra. Teubner, Stuttgart, pp 157–174Google Scholar
  56. 56.
    Popov VM (1964) Hyperstability and Optimality of Automatic Systems with several Control functions. Rev Rumaine Sci Tech Ser Electrotech Energ 9:629–690Google Scholar
  57. 57.
    Rozanov NI (1963) Stationary Random Processes. Holden‐Day, San FranciscoGoogle Scholar
  58. 58.
    Ruckebusch G (1976) Répresentations markoviennes de processus gaussiens stationnaires. Comptes Rendues Acad Sci Paris Series A 282:649–651MATHGoogle Scholar
  59. 59.
    Ruckebusch G (1978) A state space approach to the stochastic realization problem. Proc 1978 IEEE Intern Symp Circuits and Systems, pp 972–977Google Scholar
  60. 60.
    Ruckebusch G (1978) Factorisations minimales de densités spectrales et répresentations markoviennes. In: Proc 1re Colloque AFCET–SMF, PalaiseauGoogle Scholar
  61. 61.
    Söderström T, Stoica P (1989) System Identification. Prentice–Hall, New YorkGoogle Scholar
  62. 62.
    van Schuppen JH (1989) Stochastic realization problems. In: Nijmeijer H, Schumacher JM (eds) Three decades of mathematical system theory. Lecture Notes in Control and Information Sciences, vol 135. Springer, New York, pp 480–532CrossRefGoogle Scholar
  63. 63.
    Van Overschee P, De Moor B (1993) Subspace algorithms for the stochastic identification problem. Automatica 29:649–660MATHCrossRefGoogle Scholar
  64. 64.
    Van Overschee P, De Moor B (1994) N4SID: Subspace algorithms for the identification of combined deterministic- stochastic systems. Automatica 30:75–93MATHCrossRefGoogle Scholar
  65. 65.
    Verhaegen M (1994) Identification of the deterministic part of MIMO State Space Models given in Innovations form from Input–Output data. Automatica 30:61–74MathSciNetMATHCrossRefGoogle Scholar
  66. 66.
    Vidyasagar M, (Hidden) Markov Models: Theory and Applications to Biology. Princeton University Press, PrincetonGoogle Scholar
  67. 67.
    Wiener N (1930) Generalized Harmonic Analysis. Acta Math 55:117–258MathSciNetMATHCrossRefGoogle Scholar
  68. 68.
    Wiener N (1933) Generalized Harmonic Analysis. In: The Fourier Integral and Certain of its Applications. Cambridge University Press, CambridgeGoogle Scholar
  69. 69.
    Wiener N (1949) Extrapolation, Interpolation and Smoothing of Stationary Time Series. The M.I.T. Press, CambridgeMATHGoogle Scholar
  70. 70.
    Willems JC (1971) Least Squares Stationary Optimal Control and the Algebraic Riccati Equation. IEEE Trans Autom Control AC-16:621–634MathSciNetCrossRefGoogle Scholar
  71. 71.
    Yakubovich VA (1963) Absolute stability of Nonlinear Control Systems in critical case: part I and II. Avtom Telemeh 24:293–303, 717–731Google Scholar
  72. 72.
    Zeiger HP, McEwen AJ (1974) Approximate linear realization of given dimension via Ho's algorithm. IEEE Trans Autom Control AC-19:153CrossRefGoogle Scholar

Books and Reviews

  1. 73.
    Doob JL (1942) The Brownian movement and stochastic equations. Ann Math 43:351–369MathSciNetMATHCrossRefGoogle Scholar
  2. 74.
    Faurre P, Clerget M, Germain F (1979) Opérateurs Rationnels Positifs. Dunod, ParisMATHGoogle Scholar
  3. 75.
    Kalman RE (1981) Realization of covariance sequences. Proc Toeplitz Memorial Conference, Tel Aviv, BirkhäuserGoogle Scholar
  4. 76.
    Nelson E (1967) Dynamical theories of Brownian motion. Princeton University press, PrincetonMATHGoogle Scholar
  5. 77.
    Picci G (1976) Stochastic realization of Gaussian processes. Proc IEEE 64:112–122MathSciNetCrossRefGoogle Scholar
  6. 78.
    Picci G (1992) Stochastic model reduction by aggregation. In: Isidori A, Tarn TJ (eds) Systems Models and Feedback: Theory and Applicatons. Birkhäuser Verlag, Basel, pp 169–177CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2012

Authors and Affiliations

  • Giorgio Picci
    • 1
  1. 1.Department of Information EngineeringUniversity of PaduaPaduaItaly