Linear Multilayer ICA Using Adaptive PCA
- 64 Downloads
Linear multilayer independent component analysis (LMICA) is an approximate algorithm for ICA. In LMICA, approximate independent components are efficiently estimated by optimizing only highly dependent pairs of signals when all the sources are super-Gaussian. In this paper, the nonlinear functions in LMICA are generalized, and a new method using adaptive PCA is proposed for the selection of pairs of highly dependent signals. In this method, at first, all the signals are sorted along the first principal axis of their higher-order correlation matrix. Then, the sorted signals are divided into two groups so that relatively highly correlated signals are collected in each group. Lastly, each of them is sorted recursively. This process is repeated until each group consists of only one or two signals. Because a well-known adaptive PCA algorithm named PAST is utilized for calculating the first principal axis, this method is quite simple and efficient. Some numerical experiments verify the effectiveness of LMICA with this improvement.
KeywordsIndependent component analysis Adaptive PCA Massive data analysis Image processing
Unable to display preview. Download preview PDF.
- 2.Amari S, Cichocki A (1996) A new learning algorithm for blind signal separation. In: Touretzky D, Mozer M, Hasselmo M (eds) Advances in neural information processing systems 8. MIT Press, Cambridge, MA, pp 757–763Google Scholar
- 4.Burnham KP, Anderson DR (2002) Model selection and multimodel inference: a practical-theoretic approach, 2nd edn. Springer, Berlin, NYGoogle Scholar
- 7.Cichocki A, Kasprzak W, Amari S (1995) Multi-layer neural networks with a local adaptive learning rule for blind separation of source signals. In: Proceedings of NOLTA95, vol 1. Las Vegas, USA, pp 61–66Google Scholar
- 12.Matsuda Y, Yamaguchi K (2007) Extraction of approximate independent components from large natural scenes. In: ICONIP 2007, vol 4984. Springer, Kitakyushu, pp 635–642Google Scholar
- 14.Matsuda Y, Yamaguchi K (2008) A connection-limited neural network by infomax and infomin. In: Proceedings of IJCNN2008, Hong Kong, IEEE, pp 2531–2537Google Scholar