Identification and Adaptive Control of Linear Stochastic Systems

  • P. R. Kumar


We provide an account of some of the recent progress on identification and adaptive control of linear stochastic systems. This complements a recent survey [1].


Adaptive Control Instrumental Variable Strong Consistency Linear Stochastic System Stochastic Gradient Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    P.R. Kumar, “A Survey of Some Results in Stochastic Adaptive Control,” SIAM Journal on Control and Optimization, vol. 23, No. 3, pp. 329–380, May 1985.MathSciNetzbMATHCrossRefGoogle Scholar
  2. [2]
    G. Goodwin and R.L. Payne, Dynamic System Identification, Academic Press, New York, 1977.zbMATHGoogle Scholar
  3. [3]
    K.L. Chung, “A Course in Probability Theory,” Academic Press, New York, 1974.zbMATHGoogle Scholar
  4. [4]
    L. Ljung, “Consistency of the Least Squares Identification Method,” IEEE Transactions on Automatic Control, vol. AC-21, pp. 779–781, 1976.Google Scholar
  5. [5]
    J. Doob, Stochastic Processes, John Wiley, New York, 1953.zbMATHGoogle Scholar
  6. [6]
    L. Ljung and T. Söderström, Theory and Practice of Recursive Identification, M.I.T. Press, Cambridge, 1983.zbMATHGoogle Scholar
  7. [7]
    V. Solo, “Adaptive Spectral Factorization,” Preprint, 1984.Google Scholar
  8. [8]
    G. Wilson, “Factorization of the Covariance Generating Function of a Pure Moving Average Process,” SIAM Journal on Numerical Analysis, vol. 6, pp. 1–7, 1969.MathSciNetzbMATHCrossRefGoogle Scholar
  9. [9]
    L.V. Ahlfors, Complex Analysis, McGraw-Hill, New York, 1979.zbMATHGoogle Scholar
  10. [10]
    V. Solo, “The Convergence of AML,” IEEE Transactions on Automatic Control, vol. AC-24, pp. 958–963, 1979.Google Scholar
  11. [11]
    L. Ljung, “Analysis of Recursive Stochastic Algorithms,” IEEE Transactions on Automatic Control, vol. AC-22, pp. 551–575, 1977.Google Scholar
  12. [12]
    L. Ljung, “On Positive Real Transfer Functions and the Convergence of Some Recursive Schemes,” IEEE Transactions on Automatic Control, vol. AC-22, pp. 539–551, 1977.Google Scholar
  13. [13]
    H. Kushner and D. Clark, “Stochastic Approximation for Constrained and Unconstrained Systems,” Appl. Math. Sci., vol. 26, 1978.Google Scholar
  14. [14]
    M. Metivier and P. Priouret, “Applications of a Kushner and Clark Lemma to General Classes of Stochastic Algorithms,” IEEE Transactions on Information Theory, vol. IT-30, No. 2, pp. 140–150, 1984.MathSciNetCrossRefGoogle Scholar
  15. [15]
    H. Kushner and A. Shwartz, “An Invariant Measure Approach to the Convergence of Stochastic Approximations with State Dependent Noise,” SIAM Journal on Control and Optimization, vol. 22, pp. 13–27, 1984.MathSciNetzbMATHCrossRefGoogle Scholar
  16. [16]
    H. Kushner, Approximation and Weak Convergence Methods for Random Processes, M.I.T. Press, Cambridge, 1984.zbMATHGoogle Scholar
  17. [17]
    K.J. Aström, Introduction to Stochastic Control Theory, Academic Press, New York, 1970.zbMATHGoogle Scholar
  18. [18]
    K.J. Aström and B. Wittenmark, “On Self-tuning Regulators,” Automatica, vol. 9, pp. 185–199, 1973.zbMATHCrossRefGoogle Scholar
  19. [19]
    G.C. Goodwin and K.S. Sin, Adaptive Filtering Prediction and Control, Prentice Hall, Englewood Cliffs, 1984.zbMATHGoogle Scholar
  20. [20]
    G.C. Goodwin, P. Ramadge and P. Caines, “Discrete Time Stochastic Adaptive Control,” SIAM Journal on Control and Optimization, vol. 19, pp. 829–853, 1981.MathSciNetzbMATHCrossRefGoogle Scholar
  21. [21]
    A. Becker, P.R. Kumar and C.Z. Wei, “Adaptive Control with the Stochastic Approximation Algorithm: Geometry and Convergence,” IEEE Transactions on Automatic Control, vol. AC-30, pp. 330–338, 1985.Google Scholar
  22. [22]
    P.R. Kumar and L. Praly, “Self-tuning and Convergence of Parameter Estimates in Minimum Variance Tracking and Linear Model Following,” University of Illinois, April 1985.Google Scholar
  23. [23]
    V. Peterka, “On Steady State Minimum Variance Control Strategy,” Kybernetica, vol. 8, pp. 218–231, 1972.MathSciNetGoogle Scholar
  24. [24]
    U. Shaked and P.R. Kumar, “Minimum Variance Control of Multivariable ARMAX Systems,” to appear in SIAM Journal on Control and Optimization.Google Scholar
  25. [25]
    W. Lin, P.R. Kumar and T.I. Seidman, “Will the Self-tuning Approach Work for General Cost Criteria?” University of Maryland Baltimore County, 1983, to appear in Systems and Control Letters.Google Scholar

Copyright information

© Springer Science+Business Media New York 1986

Authors and Affiliations

  • P. R. Kumar
    • 1
    • 2
  1. 1.Department of Electrical and Computer EngineeringUniversity of Illinois at Urbana-ChampaignUSA
  2. 2.Coordinated Science LaboratoryUniversity of Illinois at Urbana-ChampaignUSA

Personalised recommendations