A Tiny Flat-island in a Huge Lake — How can we search for it if completely flatland elsewhere?
In the background of this paper, lies a simulation of an associative memory model with spiking neurons. We want, however, to put the issue aside for a while, since we came across a problem, very simple but extremely difficult one, when we explored a fitness landscape — a weight configuration space of high dimensionality where weight solutions are supposed to look like peaks. In the landscape, the location of one of those peaks is already known. This is called the Hebbian peak — a weight configuration in which two neurons are wired when they both fire. We guess many other peaks exist though we have not found any yet so far. During we searched for such solutions, we observed that the fitness landscape was almost everywhere completely flatland of altitude zero except for the Hebbian peak which shows a peculiar shape like a-tiny-flat-island-in-a-huge-lake. In such circumstances how could we search for other peaks? This paper is a call for challenges to the problem.
KeywordsAssociative Memory Spiking Neuron Evolutionary Computations Fitness Landscape Needle in Haystack Random Hill-climbing Baldwin Effect Artificial Immune System
Unable to display preview. Download preview PDF.
- G. E. Hinton and S. J. Nowlan (1987) "How Learning can Guide Evolution." Complex Systems, 1, pp. 495–502.Google Scholar
- H. R. Wilson (1999) “Spikes, Decisions, and Actions: The Dynamical Foundations of Neuroscience.” Oxford University Press.Google Scholar
- D. Marr (1971) “A Theory for Archicortex.” Philosophical Transactions of the Royal Society of London, B262, pp. 23–81.Google Scholar
- D. O. Hebb (1949) “The Organization of Behavior.” Wiley.Google Scholar
- K. I. Naka and W. A. Rushton (1966) “S-potentials from Colour Units in the Retina of Fish.” Journal of Physiology, 185, pp. 584–599.Google Scholar
- S. Wright (1932) “The Roles of Mutation, Inbreeding, Crossbreeding and Selection in Evolution.” Proceedings of the 6th International Congress of Genetics, pp. 56–366.Google Scholar
- S. A. Kauffman, S. A. (1993) “The origin of Order: Self-organization and Selection in Evolution.” Oxford University Press.Google Scholar
- Kwee-Bo Sim and Dong-Wook Lee (2003) “Modeling of Positive Selection for the Development of a Computer Immune System and a Self-Recognition Algorithm.” International Journal of Control, Automation, and Systems Vol. 1, No. 4, pp. 453–458.Google Scholar
- S. Forrest, A. S. Perelson, L. Allen, and R. Cherukuri, (1994) “Self-nonself discrimination in a computer.” Proceedings of the IEEE Symposium on Research in Security and Privacy, pp. 202–212.Google Scholar
- J. Kim and P. Bentley (2001) “Investigating the roles of Negative Selection and Clonal Selection in an Artificial Immune System for Network Intrusion Detection.” Technical Report, Department of Computer Science, London.Google Scholar