Hierarchical Filters in a Collaborative Filtering Framework for System Identification and Knowledge Retrieval

  • Christos Boukis
  • Anthony G. Constantinides

This chapter provides a critical review of hierarchical filters and the associated adaptive learning algorithms. Hierarchical filters are collaborative adaptive filtering architectures where short-length adaptive transversal filters are combined into layers, which are then combined into a multilayered structures. These structures offer potentially faster speed of convergence compared to the standard finite impulse response (FIR) filters, which is due to the small order of their constituting sub-filters. Several approaches can be used to adapt the coefficients of hierarchical filters. These include the use of the standard least mean square (LMS) algorithm for every sub-filter, via a variant of linear backpropagation, through to using a different algorithm for every layer and every sub-filter within the layer. Unless the input signal is white or the unknown channel is sparse, hierarchical filters converge to biased solutions. We make use of this property to propose a collaborative approach to the identification of sparse channels. The performances of these algorithms are evaluated for a variety of applications, including system identification and sparsity detection. The benefits and limitations of hierarchical adaptive filtering in this context are highlighted.


Input Layer Finite Impulse Response Less Mean Square Recursive Little Square Gradient Descent Algorithm 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Balakrishan, J., Sethares, W., Johnson, C.: Approximate channel identification via δ-signed correlation. Int. J. Adapt. Control Signal Proc. 16, 309–323 (2002)CrossRefGoogle Scholar
  2. 2.
    Beaufays, F.: Transform-domain adaptive filters: An analytical approach. IEEE Trans. Signal Proc. 43, 422–431 (1995)CrossRefGoogle Scholar
  3. 3.
    Boukis, C., Mandic, D.: A global gradient descent algorithm for hierarchical FIR adaptive filters. In: International Conference on DSP, pp. 1285–1288 (2002)Google Scholar
  4. 4.
    Boukis, C., Mandic, D., Constantinides, A.: A hierarchical feedforward adaptive filter for system identification. In: IEEE Workshop on Neural Networks for Signal Processing, pp. 269–278 (2002)Google Scholar
  5. 5.
    Boukis, C., Polymenakos, L.: Using hierarchical filters to detect sparseness within unknown channels. In: Knowledge-Based Intelligent Information and Engineering Systems, Lecture Notes on Artificial Intelligence, vol. 4253, pp. 1216–1223. Springer (2006)Google Scholar
  6. 6.
    Burdic, W.: Underwater Systems Analysis. Prentice-Hall, Englewood Cliffs, NJ (1984)Google Scholar
  7. 7.
    Farhang-Boroujeny, B.: Adaptive Filters: Theory and Applications. Wiley, New York (1998)Google Scholar
  8. 8.
    Haykin, S.: Neural Networks, A Comprehensive Foundation. Prentice-Hall, Englewood Cliffs (1994)MATHGoogle Scholar
  9. 9.
    Kalouptsidis, N.: Signal Processing Systems: Theory and Design. Wiley, New York (1997)Google Scholar
  10. 10.
    Kautz, W.: Transient synthesis in the time domain. IRE Trans. Circuit Theory CT-1(3), 29–39 (1954)Google Scholar
  11. 11.
    Macleod, M.: Performance of the hierarchical LMS algorithm. IEEE Commun. Lett. 9(12), 436–437 (2002)Google Scholar
  12. 12.
    Martin, R., Sethares, W., Williamson, R., Johnson, C.: Exploiting sparsity in adaptive filters. IEEE Trans. Signal Proc. 50(8), 1883–1894 (2002)CrossRefGoogle Scholar
  13. 13.
    Nascimento, V.: Analysis of the hierarchical LMS algorithm. IEEE Signal Proc. Lett. 10(3), 78–81 (2003)CrossRefGoogle Scholar
  14. 14.
    Polycarpou, M., Ioannou, P.: Learning and convergence analysis of neural-type structured networks. IEEE Trans. Signal Proc. 3(1), 39–50 (1992)Google Scholar
  15. 15.
    Principe, J., de Vries, B., de Oliveira, P.: The gamma filter – a new class of adaptive IIR filters with restricted feedback. IEEE Trans. Signal Proc. 41(2), 649–656 (1993)MATHCrossRefGoogle Scholar
  16. 16.
    Stoica, P., Agrawal, M., Ahgren, P.: On the hierarchical least-squares algorithm. IEEE Commun. Lett. 6(4), 153–155 (2002)CrossRefGoogle Scholar
  17. 17.
    Wahlberg, B.: System identification using laguerre models. IEEE Trans. Automat. Contr. 36(5), 551–562 (1991)MATHCrossRefMathSciNetGoogle Scholar
  18. 18.
    Widrow, B., Stearns, S.: Adaptive Signal Processing. Prentice-Hall, Englewood Cliffs (1985)MATHGoogle Scholar
  19. 19.
    Woo, T.K.: Fast hierarchical least mean square algorithm. IEEE Signal Proc. Lett. 8(11), 289–291 (2001)CrossRefGoogle Scholar
  20. 20.
    Woo, T.K.: HRLS: A more efficient RLS algorithm for adaptive FIR filtering. IEEE Signal Proc. Lett. 5(3), 81–84 (2001)Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Christos Boukis
    • 1
  • Anthony G. Constantinides
    • 2
  1. 1.Athens Information TechnologyGreece
  2. 2.Imperial College LondonLondonUK

Personalised recommendations