Ensemble Joint Approximate Diagonalization by an Information Theoretic Approach

  • Yoshitatsu Matsuda
  • Kazunori Yamaguchi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8228)


Joint approximate diagonalization (JAD) is a widely-used method for blind source separation, which can separate non-Gaussian sources without any other prior knowledge. In this paper, a new extension of JAD (named ensemble JAD) is proposed in order to ameliorate the robustness for a small size of samples by an information theoretic approach. In JAD, the cumulant matrices are estimated and represented by the average (namely, the first-order moment) over given samples. On the other hand, ensemble JAD preserves the ensemble of all the cumulant matrices for each sample without averaging them. Then, the second-order moments among the ensemble are utilized for estimating the sources. Numerical experiments verify the validity of this method when the sub-Gaussian (negative kurtosis) sources are included.


independent component analysis joint approximate diagonalization information theoretic approach higher-order cumulants 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Amari, S., Cichocki, A.: A new learning algorithm for blind signal separation. In: Touretzky, D., Mozer, M., Hasselmo, M. (eds.) Advances in Neural Information Processing Systems 8, pp. 757–763. MIT Press, Cambridge (1996)Google Scholar
  2. 2.
    Cardoso, J.F.: High-order contrasts for independent component analysis. Neural Computation 11(1), 157–192 (1999)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Cardoso, J.F., Souloumiac, A.: Blind beamforming for non Gaussian signals. IEE Proceedings-F 140(6), 362–370 (1993)Google Scholar
  4. 4.
    Cichocki, A., Amari, S.: Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. Wiley (2002)Google Scholar
  5. 5.
    Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley (2001)Google Scholar
  6. 6.
    Matsuda, Y., Yamaguchi, K.: An adaptive threshold in joint approximate diagonalization by assuming exponentially distributed errors. Neurocomputing 74, 1994–2001 (2011)CrossRefGoogle Scholar
  7. 7.
    Matsuda, Y., Yamaguchi, K.: A robust objective function of joint approximate diagonalization. In: Villa, A.E.P., Duch, W., Érdi, P., Masulli, F., Palm, G. (eds.) ICANN 2012, Part II. LNCS, vol. 7553, pp. 205–212. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  8. 8.
    Mendel, J.: Tutorial on higher-order statistics (spectra) in signal processing and system theory: theoretical results and some applications. Proceedings of the IEEE 79(3), 278–305 (1991)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Yoshitatsu Matsuda
    • 1
  • Kazunori Yamaguchi
    • 1
  1. 1.Department of General Systems Studies, Graduate School of Arts and SciencesThe University of TokyoMeguro-kuJapan

Personalised recommendations