Collaborative Adaptive Filters for Online Knowledge Extraction and Information Fusion

  • Beth Jelfs
  • Phebe Vayanos
  • Soroush Javidi
  • Vanessa Su Lee Goh
  • Danilo Mandic

We present a method for extracting information (or knowledge) about the nature of a signal. This is achieved by employing recent developments in signal characterisation for online analysis of the changes in signal modality. We show that it is possible to use the fusion of the outputs of adaptive filters to produce a single collaborative hybrid filter and that by tracking the dynamics of the mixing parameter of this filter rather than the actual filter performance, a clear indication as to the nature of the signal is given. Implementations of the proposed hybrid filter in both the real R and the complex C domains are analysed and the potential of such a scheme for tracking signal nonlinearity in both domains is highlighted. Simulations on linear and nonlinear signals in a prediction configuration support the analysis; real world applications of the approach have been illustrated on electroencephalogram (EEG), radar and wind data.


Input Signal Convex Combination Radar Data Tracking Capability Normalise Little Mean Square 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    The McMaster IPIX radar sea clutter database.
  2. 2.
    Aihara, K. (ed.): Applied Chaos and Applicable Chaos. Tokyo: Science–Sha (1994)Google Scholar
  3. 3.
    Alexiadis, M.C., Dokopoulos, P.S., Sahsamanoglou, H.S., Manousaridis, I.M.: Short-term forecasting of wind speed and related electrical power. Solar Energy 63(1), 61–68 (1998)CrossRefGoogle Scholar
  4. 4.
    Arenas-Garcia, J., Figueiras-Vidal, A., Sayed, A.: Steady state performance of convex combinations of adaptive filters. In: Proceedings IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP ’05), vol. 4, pp. 33–36 (2005)Google Scholar
  5. 5.
    Cichocki, A., Unbehauen, R.: Neural Networks for Optimisation and Signal Processing. Wiley, New York (1993)Google Scholar
  6. 6.
    Gautama, T., Mandic, D., Hulle, M.V.: Signal nonlinearity in fMRI: a comparison between BOLD and MION. IEEE Transactions on Medical Imaging, 22(5), 636–644 (2003)CrossRefGoogle Scholar
  7. 7.
    Gautama, T., Mandic, D., Hulle, M.V.: The delay vector variance method for detecting determinism and nonlinearity in time series. Physica D 190(3–4), 167–176 (2004)MATHCrossRefMathSciNetGoogle Scholar
  8. 8.
    Gautama, T., Mandic, D., Hulle, M.V.: On the characterisaion of the deterministic/stochastic and linear/nonlinear nature of time series. Technical report dpm-04-5, Imperial College (2004)Google Scholar
  9. 9.
    Goh, S.L., Mandic, D.P.: A general complex valued RTRL algorithm for nonlinear adaptive filters. Neural Computation 16(12), 2699–2731 (2004)MATHCrossRefGoogle Scholar
  10. 10.
    Haykin, S., Principe, J.: Making sense of a complex world [chaotic events modeling]. IEEE Signal Processing Magazine 15(3), 66–81 (1998)CrossRefGoogle Scholar
  11. 11.
    Jelfs, B., Vayanos, P., Chen, M., Goh, S.L., Boukis, C., Gautama, T., Rutkowski, T., Kuh, T., Mandic, D.: An online method for detecting nonlinearity within a signal. In: Proceedings 10th International Conference on Knowledge-Based and Intelligent Information and Engineering Systems KES2006, vol. 3, pp. 1216–1223 (2006)Google Scholar
  12. 12.
    Kim, T., Adali, T.: Approximation by fully complex multilayer perceptrons. Neural Computation 15(7), 1641–1666 (2003)MATHCrossRefGoogle Scholar
  13. 13.
    Kozat, S., Singer, A.: Multi-stage adaptive signal processing algorithms. In: Proceedings of the IEEE Sensor Array and Multichannel Signal Processing Workshop, pp. 380–384 (2000)Google Scholar
  14. 14.
    Mandic, D.: NNGD algorithm for neural adaptive filters. Electronics Letters 36(9), 845–846 (2000)CrossRefGoogle Scholar
  15. 15.
    Mandic, D.: A generalized normalized gradient descent algorithm. IEEE Signal Processing Letters 11(2), 115–118 (2004)CrossRefGoogle Scholar
  16. 16.
    Mandic, D., Vayanos, P., Boukis, C., Jelfs, B., Goh, S., Gautama, T., Rutkowski, T.: Collaborative adaptive learning using hybrid filters. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2007, vol. 3, pp. 921–924 (2007)Google Scholar
  17. 17.
    Mizuta, H., Jibu, M., Yana, K.: Adaptive estimation of the degree of system nonlinearity. In: Proceedings IEEE Adaptive Systems for Signal Processing and Control Symposium (AS-SPCC), pp. 352–356 (2000)Google Scholar
  18. 18.
    Narendra, K., Parthasarathy, K.: Identification and control of dynamical systems using neural networks. IEEE Transactions on Neural Networks 1(1), 4–27 (1990)CrossRefGoogle Scholar
  19. 19.
    Schreiber, T.: Interdisciplinary application of nonlinear time series methods. Physics Reports 308(1), 1–64 (1999)CrossRefMathSciNetGoogle Scholar
  20. 20.
    Schreiber, T., Schmitz, A.: Discrimination power of measures for nonlinearity in a time series. Physical Review E 55(5), 5443–5447 (1997)CrossRefGoogle Scholar
  21. 21.
    Schreiber, T., Schmitz, A.: Surrogate time series. Physica D 142, 346–382 (2000)MATHCrossRefMathSciNetGoogle Scholar
  22. 22.
    Widrow, B., McCool, J., Ball, M.: The complex LMS algorithm. Proceedings of the IEEE 63(4), 719–720 (1975)CrossRefGoogle Scholar
  23. 23.
    Widrow, B., Stearns, S.D.: Adaptive Signal Processing. Prentice-Hall, Englewood Cliffs, NJ (1985)MATHGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2008

Authors and Affiliations

  • Beth Jelfs
    • 1
  • Phebe Vayanos
    • 1
  • Soroush Javidi
    • 1
  • Vanessa Su Lee Goh
    • 2
  • Danilo Mandic
    • 1
  1. 1.Imperial College LondonLondonUK
  2. 2.Nederlandse Aardolie MaatschappijNetherlands

Personalised recommendations