Kalman and Adaptive Least Squared Error Filters

  • Saeed V. Vaseghi


Adaptive least squared error filters are used with nonstationary signals and environments, or in applications where a low processing delay is required, such as multi-channel noise reduction, radar signal processing, channel equalisation, echo cancellation, and speech coding. We begin this chapter with a study of state-space Kalman filters. In Kalman theory a state equation models the dynamics of the signal generation process, and an observation equation models the channel distortions and additive noise. We then consider recursive least squared (RLS) error adaptive filters. The RLS filter is a sample adaptive formulation of the Wiener filter, and for stationary signals should converge to the same solution as the Wiener filter. In least squared error filtering, an alternative to using a Wiener-type closed form solution, is an iterative search for the optimal filter coefficients. The steepest descent search is a gradient-based method of searching the least squared error performance curve for the minimum error filter coefficients. We study the steepest descent method, and then consider the LMS method which is a computationally inexpensive gradient search algorithm.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Alexander S. T. (1986) Adaptive Signal Processing: Theory and Applications, Springer-Verlag, New York.zbMATHGoogle Scholar
  2. Bellanger M. G. (1988), Adaptive Filters and Signal Analysis, Marcel-Dekker, New York.Google Scholar
  3. Bershad N. J. (1986), Analysis of the Normalised LMS Algorithm with Gaussian Inputs, IEEE Trans. Acoustic Speech Signal Processing ASSP-34, Pages 793–806.CrossRefGoogle Scholar
  4. Bershad N. J., Qu L. Z. (1989), On the Probability Density Function of the LMS Adaptive Filter Weights, IEEE Trans. Acoustic Speech Signal Processing ASSP-37, Pages 43–56.CrossRefGoogle Scholar
  5. Cioffi J. M., Kailath T., Fast Recursive Least Squares transversal filters for adaptive filtering, IEEE Trans. Acoustic Speech and Signal Processing, Vol. ASSP-32, Pages 304–337.Google Scholar
  6. Classen T. A., Mecklanbrauker W. F., (1985), Adaptive Techniques for signal Processing in Communications, IEEE Communications, Vol-23, Pages 8–19.CrossRefGoogle Scholar
  7. Cowan C. F., Grant P. M. (1985), Adaptive Filters, Prentice-Hall, Englewood Cliffs, N.J.zbMATHGoogle Scholar
  8. Eweda E., Macchi O., (1985), Tracking Error Bounds of Adaptive Nonsationary Filtering, Automatica, Vol. 21, Pages 293–302.MathSciNetzbMATHCrossRefGoogle Scholar
  9. Gabor O., Wilby W. P., Woodcock R. (1960), A Universal Non-linear Filter, Predictor and Simulator which Optimises Itself by a Learning Process, IEE Proc. Vol. 108 Pages 422–38.Google Scholar
  10. Gabriel W. F. (1976), Adaptive Arrays: An Introduction, Proc. IEEE Vol. 64 Pages 239–272.CrossRefGoogle Scholar
  11. Haykin S.(1991), Adaptive Filter Theory, Prentice Hall, Englewood Cliffs, N.J.zbMATHGoogle Scholar
  12. Hodgkiss W. S., Alexandrou D (1983), Applications of Adaptive Least Squares Lattice Structures to Problems in Under Water Acoustics, Proc. SPIE Vol. 431 Real Time Signal Processing Pages 45–48.Google Scholar
  13. Honig M.L., Messerschmitt D. G. (1984), Adaptive filters: Structures, Algorithms and Applications, Kluwer Boston, Hingham, Mass.zbMATHGoogle Scholar
  14. Kailath T. (1970), The Innovations Approach to Detection and Estimation Theory, Proc. IEEE, Vol. 58, Pages 680–95.MathSciNetCrossRefGoogle Scholar
  15. Kalman R. E. (1960), A New Approach to Linear Filtering and Prediction Problems, Trans. of the ASME, Series D, Journal of Basic Engineering, Vol. 82 Pages 34–45.Google Scholar
  16. Kalman R. E., Bucy R. S. (1961), New Results in Linear Filtering and Prediction Theory, Trans. ASME J. Basic Eng., Vol. 83, Pages 95–108.MathSciNetCrossRefGoogle Scholar
  17. Widrow B. (1990), 30 Years of Adaptive Neural Networks: Perceptron, Madaline, and Back Propagation, Proc. IEEE, Special Issue on Neural Networks I, Vol. 78.Google Scholar
  18. Widrow B., Sterns S.D.(1985), Adaptive Signal Processing Prentice Hall, Englewood Cliffs, N.J.Google Scholar
  19. Wilkinson J. H. (1965), The Algebraic Eigenvalue Problem, Oxford University Press, Oxford.zbMATHGoogle Scholar
  20. Zadeh L. A., Desoer C. A. (1963), Linear System Theory: The State-Space Approach, McGraw-Hill.zbMATHGoogle Scholar

Copyright information

© John Wiley & Sons Ltd. and B.G. Teubner 1996

Authors and Affiliations

  • Saeed V. Vaseghi
    • 1
  1. 1.Queen’s UniversityBelfastUK

Personalised recommendations