A novel cost-effective sparsity-aware algorithm with Kalman-based gain for the identification of long acoustic impulse responses

A Correction to this article was published on 18 August 2020

This article has been updated


In this paper, a new robust sparsity (or sparseness)-aware adaptive filtering algorithm is proposed for the purpose of system identification and acoustic echo cancelation. It is named the improved proportionate fast normalized least mean square (IPFNLMS) algorithm. This latter has been derived by an effective integration of the update control matrix of the improved proportionate NLMS (IPNLMS) algorithm to the Kalman-based adaptation gain of the fast-NLMS (FNLMS) algorithm. Simulations were carried out both in synthetic and real long acoustic impulse responses at different sparseness levels with stationary and non-stationary inputs, followed by a verification with real experiment data. Results have shown interesting improvements for the proposed algorithm with respect to its ancestors in terms of convergence speed, steady-state performance, tracking capability and robustness against system sparsity variation.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15

Change history


  1. 1.

    Haykin, S.: Adaptive Filter Theory, 4th edn. Prentice-Hall, Upper Saddle River (2002)

    MATH  Google Scholar 

  2. 2.

    Sayed, A.H.: Fundamentals of Adaptive Filtering. Wiley, New York (2003)

    Google Scholar 

  3. 3.

    Tedjani, A., Benallal, A.: Performance study of three different sparse adaptive filtering algorithms for echo cancellation in long acoustic impulse responses. In: 2017 5th International Conference on Electrical Engineering-Boumerdes (ICEE-B), Boumerdes, pp. 1–7 (2017)

  4. 4.

    Eweda, E.: Transient performance degradation of the LMS, RLS, sign, signed regressor, and sign-sign algorithms with data correlation. IEEE Trans. Circuits Syst. II Analog Digit. Signal Process. 46(8), 1055–1062 (1999)

    Article  Google Scholar 

  5. 5.

    Tedjani, A., Benallal, A.: Compressive sensing based and PNLMS-type sparse adaptive filtering algorithms for the identification of long acoustic impulse response. In: Chadli, M., Bououden, S., Ziani, S., Zelinka, I. (eds.) Advanced Control Engineering Methods in Electrical Engineering Systems. ICEECA 2017 (LNEE, vol. 522), ch. 39, pp. 510–525. Springer, Cham (2019)

  6. 6.

    Duttweiler, D.L.: Proportionate normalized least-mean-squares adaptation in echo cancelers. IEEE Trans. Speech Audio Process. 8(5), 508–518 (2000)

    Article  Google Scholar 

  7. 7.

    Benesty, J., Gay, S.L.: An improved PNLMS algorithm. In: Proceedings of IEEE ICASSAP, Orlando, Florida, USA, vol. 2, pp. 1881–1884 (2002)

  8. 8.

    Khong, A.W.H., Naylor, P. A.: Efficient use of sparse adaptive filters. In: 2006 Fortieth Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA, pp. 1375–1379 (2006)

  9. 9.

    Loganathan, P.: Sparseness-controlled adaptive algorithms for supervised and unsupervised system identification. Ph.D. dissertation, Dept. of Electrical and Electronic Eng., Imperial College, London (2011)

  10. 10.

    Carmi, A.Y., Mihaylova, L., Godsill, S.J. (eds.): Compressed Sensing & Sparse Filtering. Springer, New York (2014)

    MATH  Google Scholar 

  11. 11.

    Gui, G., Dai, L., Kumagai, S., Adachi, F.: Variable earns profit: improved adaptive channel estimation using sparse VSS-NLMS algorithms. In: 2014 IEEE International Conference on Communications (ICC), Sydney, NSW, pp. 4390–4394 (2014)

  12. 12.

    Gui, G., Peng, W., Xu, L., Liu, B., Adachi, F.: Variable-step-size based sparse adaptive filtering algorithm for channel estimation in broadband wireless communication systems. EURASIP J. Wirel. Commun. Netw. 2014(1), 195 (2014)

    Article  Google Scholar 

  13. 13.

    Tedjani, A.: Study of sparse adaptive algorithms for the identification of acoustic impulse responses. Magister thesis, Dept. of Electronics, Univ. of Blida 1, Algeria (2016)

  14. 14.

    Babadi, B., Kalouptsidis, N., Tarokh, V.: SPARLS: the sparse RLS algorithm. IEEE Trans. Signal Process. 58(8), 4013–4025 (2010)

    MathSciNet  Article  Google Scholar 

  15. 15.

    Angelosante, D., Giannakis, G.B.: RLS-weighted Lasso for adaptive estimation of sparse signals. In: 2009 IEEE International Conference on Acoustics, Speech and Signal Processing, Taipei, Taiwan, pp. 3245–3248 (2009)

  16. 16.

    Angelosante, D., Bazerque, J.A., Giannakis, G.B.: Online adaptive estimation of sparse signals: where RLS meets the \( \ell_{1} \)-norm. IEEE Trans. Signal Process. 58(7), 3436–3447 (2010)

  17. 17.

    Kopsinis, Y., Slavakis, K., Theodoridis, S.: Online sparse system identification and signal reconstruction using projections onto weighted \( \ell_{1} \)-balls. IEEE Trans. Signal Process. 59(3), 936–952 (2011)

  18. 18.

    Arezki, M., Benallal, A., Guessoum, A., Berkani, D.: Three new versions of numerically stable fast least-squares algorithms (NS-FRLS) for adaptive filtering. In: Proceedings of 4th International Symposium on Communication Systems Networks and Digital Signal Processing, Newcastle, United Kingdom, pp. 528–532 (2004)

  19. 19.

    Benallal, A., Benkrid, A.: A simplified FTF-type algorithm for adaptive filtering. Signal Process. 87(5), 904–917 (2007)

    Article  Google Scholar 

  20. 20.

    Arezki, M., Benallal, A., Meyrueis, P., Berkani, D.: A new algorithm with low complexity for adaptive filtering. IAENG J. Eng. Lett. 18(3), 205–211 (2010)

    Google Scholar 

  21. 21.

    Benallal, A., Arezki, M.: A fast convergence normalized least-mean-square type algorithm for adaptive filtering. Int. J. Adapt. Control Signal Process. 28(10), 1073–1080 (2014)

    MathSciNet  Article  Google Scholar 

  22. 22.

    Arezki, M., Benallal, A., Meyrueis, P., Berkani, D.: Performance analysis of the fast-NLMS type algorithm. In: Proceedings of the World Congress on Engineering (WCE), London, UK, vol. I, p. 4 (2017)

  23. 23.

    Sayoud, A., Djendi, M., Medahi, S., Guessoum, A.: A dual fast NLMS adaptive filtering algorithm for blind speech quality enhancement. Appl. Acoust. 135, 101–110 (2018)

    Article  Google Scholar 

  24. 24.

    Messini, M., Djendi, M.: A new adaptive filtering algorithm for stereophonic acoustic echo cancellation. Appl. Acoust. 146, 345–354 (2019)

    Article  Google Scholar 

  25. 25.

    Djendi, M., Sayoud, A.: A new dual subband fast NLMS adaptive filtering algorithm for blind speech quality enhancement and acoustic noise reduction. Int. J. Speech Technol. 22(2), 391–406 (2019)

    Article  Google Scholar 

  26. 26.

    Benesty, J., Gänsler, T., Morgan, D.R., Sondhi, M.M., Gay, S.L.: A family of robust PNLMS-like algorithms for network echo cancellation. In: Advances in Network and Acoustic Echo Cancellation, ch. 2, pp. 31–54. Springer, Berlin Heidelberg (2001)

  27. 27.

    Hänsler, E., Schmidt, G. (eds.): Topics in Acoustic Echo and Noise Control: Selected Methods for the Cancellation of Acoustical Echoes, the Reduction of Background Noise, and Speech Processing. Springer, Berlin Heidelberg (2006)

    Google Scholar 

  28. 28.

    Hoyer, P.O.: Non-negative matrix factorization with sparseness constraints. J. Mach. Learn. Res. 5, 1457–1469 (2004)

    MathSciNet  MATH  Google Scholar 

  29. 29.

    Slock, D.T.M.: On the convergence behaviour of the LMS and the normalized LMS algorithms. IEEE Trans. Signal Process. 41(9), 2811–2825 (1993)

    MathSciNet  Article  Google Scholar 

  30. 30.

    Mader, A., Puder, H., Schmidt, G.U.: Step-size control for acoustic echo cancellation filters—an overview. Signal Process. 80, 1697–1719 (2000)

    Article  Google Scholar 

  31. 31.

    Deng, H., Doroslovacki, M.: Improving convergence of the PNLMS algorithm for sparse impulse response identification. IEEE Signal Process. Lett. 12(3), 181–184 (2005)

    Article  Google Scholar 

Download references


The authors would like to thank the editors and the anonymous reviewers for their thoughtful comments and constructive suggestions that helped to improve the quality of this paper.

Author information



Corresponding author

Correspondence to Ayoub Tedjani.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Tedjani, A., Benallal, A. A novel cost-effective sparsity-aware algorithm with Kalman-based gain for the identification of long acoustic impulse responses. SIViP 14, 1679–1687 (2020). https://doi.org/10.1007/s11760-020-01715-2

Download citation


  • Adaptive filtering
  • Sparse algorithms
  • System identification
  • Acoustic echo cancelation
  • Convergence speed
  • Tracking capability