Abstract
It is known that independent component analysis (ICA) generates filters that are similar to the receptive fields of primary visual cortex (V1) cells. However, ICA fails to yield the frequency tuning exhibited by V1 receptive fields. This work analysis how the shape of IC filters depend on second-order statistics of the input data. Specifically, we show theoretically and through experimentation how the structure of IC filters change with second-order statistics and different types of data preprocessing. Here, we preprocess natural scenes according to four conditions: whitening, pseudo-whitening, local-whitening and high-pass filtering. As results, we show that the filter structure is strongly modulated by the inverse of the covariance of the input signal. However, the distribution of size in frequency domain are similarly biased for all preprocessing conditions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Hateren, J.H., van der Schaaf, A.: Independent component filters of natural images compared with simple cells in primary visual cortex. Proc. R. Soc. Lond. B 265, 359–366 (1998)
Baddeley, R.: Searching for Filters With ”Interesting” Output Distributions: An Uninteresting Direction to Explore? Network 7, 409–421 (1996)
Thomson, M.G.A.: Higher-order structure in natural scenes. JOSA A 16(7), 1549–1533 (1999)
Thomson, M.G.A.: Sensory coding and the second spectra of natural signals. Phys. Rev. Lett. 86, 2901–2904 (2001)
Lewicki, M.S.: Efficient coding of natural sounds. Nature Neuroscience 5(4), 356–363 (2002)
Bell, A.J., Sejnowski, T.J.: The “independent components” of natural scenes are edge filters. Vision Research 37(23), 3327–3338 (1997)
Hyvrinen, A.: Fast and Robust Fixed-Point Algorithms for Independent Component Analysis. IEEE Transactions on Neural Networks 10(3), 626–634 (1999)
McGill Color Image Database, http://tabby.vision.mcgill.ca/
Smith, E., Lewicki, M.S.: Efficient Auditory Coding. Nature 439, 70–79 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cavalcante, A., Barros, A.K., Takeuchi, Y., Ohnishi, N. (2011). Effects of Second-Order Statistics on Independent Component Filters. In: Lu, BL., Zhang, L., Kwok, J. (eds) Neural Information Processing. ICONIP 2011. Lecture Notes in Computer Science, vol 7062. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24955-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-24955-6_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24954-9
Online ISBN: 978-3-642-24955-6
eBook Packages: Computer ScienceComputer Science (R0)