Abstract
In recent years, there has been an increasing interest in developing new algorithms for digital signal processing by applying and generalising existing numerical linear algebra tools. A recent result shows that the FastICA algorithm, a popular state-of-the-art method for linear Independent Component Analysis (ICA), shares a nice interpretation as a Newton type method with the Rayleigh Quotient Iteration (RQI), the latter method wellknown to the numerical linear algebra community. In this work, we develop an analogous theory of single vector iteration ICA methods. Two classes of methods are proposed for the one-unit linear ICA problem, namely, power ICA methods and inverse iteration ICA methods. By means of a scalar shift, scalar shifted versions of both power ICA method and inverse iteration ICA method are proposed and proven to be locally quadratically convergent to a correct demixing vector.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Douglas, S.: Relationships between the FastICA algorithm and the Rayleigh Quotient Iteration. In: Rosca, J., Erdogmus, D., PrÃncipe, J.C., Haykin, S. (eds.) ICA 2006. LNCS, vol. 3889, pp. 781–789. Springer, Heidelberg (2006)
Shen, H., Hüper, K.: Local convergence analysis of FastICA. In: Rosca, J., Erdogmus, D., PrÃncipe, J.C., Haykin, S. (eds.) ICA 2006. LNCS, vol. 3889, pp. 893–900. Springer, Heidelberg (2006)
Shen, H., Hüper, K., Seghouane, A.K.: Geometric optimisation and FastICA algorithms. In: Proceedings of the 17th International Symposium of Mathematical Theory of Networks and Systems (MTNS 2006), Kyoto, Japan, pp. 1412–1418 (2006)
Parlett, B.N.: The Symmetric Eigenvalue Problem. SIAM Classic. In: Applied Mathematics Series, Philadelphia, vol. 20 (1998)
Hyvärinen, A., Karhunen, J., Oja, E.: Independent Component Analysis. Wiley, New York (2001)
Regalia, P., Kofidis, E.: Monotonic convergence of fixed-point algorithms for ICA. IEEE Transactions on Neural Networks 14(4), 943–949 (2003)
Hüper, K.: A Calculus Approach to Matrix Eigenvalue Algorithms. Habilitation Dissertation, Department of Mathematics, University of Würzburg, Germany (2002)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Shen, H., Hüper, K. (2007). On the Relationships Between Power Iteration, Inverse Iteration and FastICA. In: Davies, M.E., James, C.J., Abdallah, S.A., Plumbley, M.D. (eds) Independent Component Analysis and Signal Separation. ICA 2007. Lecture Notes in Computer Science, vol 4666. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-74494-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-540-74494-8_14
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-74493-1
Online ISBN: 978-3-540-74494-8
eBook Packages: Computer ScienceComputer Science (R0)