Skip to main content

Evolutionary Algorithm Using Mutual Information for Independent Component Analysis

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 2687))

Abstract

Independent Component Analysis (ICA) is a method for finding underlying factors from multidimensional statistical data. ICA differs from other similar methods in that it looks for components that are both statistically independent and nongaussian. Blind Source Separation (BSS) consists in recovering unobserved signals from a known set of mixtures. Thus, ICA and BSS are equivalent when the mixture is assumed to be linear up to possible permutations and invertible scalings. However, when the mixing model is nonlinear, additional constraints are needed to assure that independent components correspond to the original signals. In this paper, we propose a simple though effective method based on estimating the probability densities of the outputs for solving the BSS problem in linear and nonlinear mixtures making use of genetic algorithms. A post-nonlinear mixture model is assumed so that the solution space in the nonlinear case is restricted to signals equivalent to the original ones.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. S-I. Amari, A. Cichocki, H. Yang, A New Learning Algorithm for Blind Signal Separation, In Advances in Neural Information Processing Systems, vol. 8, (1996).

    Google Scholar 

  2. A. Bell & T.J. Sejnowski: An Information-Maximization Approach to Blind Separation and Blind Deconvolution. Neural Computation 1129–59 (1995).

    Google Scholar 

  3. J.F. Cardoso, A. Souloumiac, "Blind beamforming for non Gaussian signals", IEEE Proceedings-F, vol. 140, no. 6, pp. 362–370, December 1993

    Google Scholar 

  4. P. Comon, Independent component analysis, a new concept?, Signal Processing, vol. 36, no. 3, pp. 287–314, 1994.

    Article  MATH  Google Scholar 

  5. D.E. Goldberg, ”Genetic Algorithms in Search, Optimization and Machine Learning”, AddisonWesley, Reading, MA, (1989).

    MATH  Google Scholar 

  6. Hyvärinen, J. Karhunen y E. Oja, Independent Component Analysis. J. Wiley-Interscience. (2001).

    Google Scholar 

  7. A. Hyvärinen and P. Pajunen. Nonlinear Independent Component Analysis: Existence and Uniqueness results. Neural Networks 12(3): pp. 429–439, 1999.

    Article  Google Scholar 

  8. C. Jutten and J.F. Cardoso. Source separation: really blind? In Proc. NOLTA, pages 79–84, 1995.

    Google Scholar 

  9. T-W. Lee, Independent Component Analysis: Theory and Applications, Kluwer Academic Publishers, (1998)

    Google Scholar 

  10. Z. Michalewicz, Genetic Algorithms + Data Structures = Evolution Programs, Springer-Verlag, New York USA, Third Edition, (1999).

    MATH  Google Scholar 

  11. C.G. Puntonet, A. Prieto, Neural net approach for blind separation of sources based on geometric properties, Neurocomputing, 18 (3), (1998), pp. 141–164.

    Google Scholar 

  12. F. Rojas, I. Rojas, R.M. Clemente, C.G. Puntonet. “Nonlinear Blind Source Separation using Genetic Algorithms” Proceedings of the 3rd International Conference On Independent Component Analysis and Signal Separation (ICA2001). pp. 400–405, December 9–13, 2001, San Diego, CA, (USA)

    Google Scholar 

  13. I. Rojas, C.G. Puntonet, A. Cañas, B. Pino, J. Fernández, F. Rojas, “Genetic Algorithms for the Blind Separation of Sources” Proceedings of the 1st Artificial Intelligence and Applications (AIA), pp. 131–135, September 4‐7, 2001, Marbella, (Spain).

    Google Scholar 

  14. A. Taleb, C. Jutten, “Source Separation in Post-Nonlinear Mixtures”, IEEE Transactions on Signal Processing, vol. 47 no. 10, pp. 2807–2820 (1999).

    Article  Google Scholar 

  15. Y. Tan, J. Wang, Nonlinear blind source separation using higher order statistics and a genetic algorithm Ying Tan; Jun Wang; Evolutionary Computation, IEEE Transactions on, Volume: 5 Issue: 6, pp. 600–612 (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2003 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Rojas, F., Puntonet, C.G., Álvarez, M., Rojas, I. (2003). Evolutionary Algorithm Using Mutual Information for Independent Component Analysis. In: Mira, J., Álvarez, J.R. (eds) Artificial Neural Nets Problem Solving Methods. IWANN 2003. Lecture Notes in Computer Science, vol 2687. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44869-1_30

Download citation

  • DOI: https://doi.org/10.1007/3-540-44869-1_30

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-40211-4

  • Online ISBN: 978-3-540-44869-3

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics