Ultra-Rapid Scene Categorization with a Wave of Spikes
Recent experimental work has shown that the primate visual system can analyze complex natural scenes in only 100–150 ms. Such data, when combined with anatomical and physiological knowledge, seriously constrains current models of visual processing. In particular, it suggests that a lot of processing can be achieved using a single feed-forward pass through the visual system, and that each processing layer probably has no more than around 10 ms before the next stage has to respond. In this time, few neurons will have generated more than one spike, ruling out most conventional rate coding models. We have been exploring the possibility of using the fact that strongly activated neurons tend to fire early and that information can be encoded in the order in which a population of cells fire. These ideas have been tested using SpikeNet, a computer program that simulates the activity of very large networks of asynchronously firing neurons. The results have been extremely promising, and we have been able to develop artificial visual systems capable of processing complex natural scenes in real time using standard computer hardware (see http://www.spikenet-technology.com).
KeywordsVisual System Firing Rate Human Visual System Natural Image Natural Scene
Unable to display preview. Download preview PDF.
- 8.Rousselet, G.A., Fabre-Thorpe, M., Thorpe, S.J., Parallel processing in high level categorisation of natural images. Nature Neuroscience, 5: (2002) 629–30.Google Scholar
- 9.Li, F.F., VanRullen, R., Koch, C., Perona, P., Rapid natural scene categorization in the near absence of attention. Proc Natl Acad Sci U S A, 99: (2002) 9596–601.Google Scholar
- 10.Thorpe, S.J., Bacon, N., Rousselet, G., Macé, M.J.-M., Fabre-Thorpe, M., Rapid categorisation of natural scenes: feed-forward vs. feedback contribution evaluated by backwards masking. Perception, 31 suppl: (2002) 150.Google Scholar
- 14.Rolls, E.T., Deco, G., Computational Neuroscience of Vision. Oxford: Oxford University Press (2002)Google Scholar
- 15.Oram, M.W., Perrett, D.I., Time course of neural responses discriminating different views of the face and head. J Neurophysiol, 68: (1992) 70–84.Google Scholar
- 17.Thorpe, S.J., Imbert, M., Biological constraints on connectionist models., inR. Pfeifer, et al., Editors. (eds) Connectionism in Perspective., Elsevier: Amsterdam. (1989) 63–92.Google Scholar
- 19.van Rossum, M.C., Turrigiano, G.G., Nelson, S.B., Fast propagation of firing rates through layered networks of noisy neurons. J Neurosci, 22: (2002) 1956–66.Google Scholar
- 21.Thorpe, S.J., Spike arrival times: A highly efficient coding scheme for neural networks., in R. Eckmiller, G. Hartman, and G. Hauske, Editors. (eds) Parallel processing in neural systems, Elsevier: North-Holland. (1990) 91–94.Google Scholar
- 28.VanRullen, R., Delorme, A., Thorpe, S.J., Feed-forward contour integration in primary visual cortex based on asynchronous spike propagation. Neurocomputing, 38-40: (2001) 1003–1009.Google Scholar
- 31.Ullman, S., Vidal-Naquet, M., Sali, E., Visual features of intermediate complexity and their use in classification. Nat Neurosci, 5: (2002) 682–7.Google Scholar