A Tiny Flat-island in a Huge Lake — How can we search for it if completely flatland elsewhere?

  • Akira Imada
Conference paper


In the background of this paper, lies a simulation of an associative memory model with spiking neurons. We want, however, to put the issue aside for a while, since we came across a problem, very simple but extremely difficult one, when we explored a fitness landscape — a weight configuration space of high dimensionality where weight solutions are supposed to look like peaks. In the landscape, the location of one of those peaks is already known. This is called the Hebbian peak — a weight configuration in which two neurons are wired when they both fire. We guess many other peaks exist though we have not found any yet so far. During we searched for such solutions, we observed that the fitness landscape was almost everywhere completely flatland of altitude zero except for the Hebbian peak which shows a peculiar shape like a-tiny-flat-island-in-a-huge-lake. In such circumstances how could we search for other peaks? This paper is a call for challenges to the problem.


Associative Memory Spiking Neuron Evolutionary Computations Fitness Landscape Needle in Haystack Random Hill-climbing Baldwin Effect Artificial Immune System 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

2 References

  1. [1]
    G. E. Hinton and S. J. Nowlan (1987) "How Learning can Guide Evolution." Complex Systems, 1, pp. 495–502.Google Scholar
  2. [2]
    J. J. Hopfield (1982) "Neural Networks and Physical Systems with Emergent Collective Computational Abilities." Proceedings of the National Academy of Sciences, USA 79, pp. 2554–2558.MathSciNetCrossRefGoogle Scholar
  3. [3]
    W. S. McCulloch and W. Pitts (1943) “A Logical Calculus of Ideas Immanent in Nervous Activity.” Bulletin of Mathematical Biophysics, 5, pp. 115–113.MathSciNetGoogle Scholar
  4. [4]
    H. R. Wilson (1999) “Spikes, Decisions, and Actions: The Dynamical Foundations of Neuroscience.” Oxford University Press.Google Scholar
  5. [5]
    D. Marr (1971) “A Theory for Archicortex.” Philosophical Transactions of the Royal Society of London, B262, pp. 23–81.Google Scholar
  6. [6]
    D. O. Hebb (1949) “The Organization of Behavior.” Wiley.Google Scholar
  7. [7]
    K. I. Naka and W. A. Rushton (1966) “S-potentials from Colour Units in the Retina of Fish.” Journal of Physiology, 185, pp. 584–599.Google Scholar
  8. [8]
    S. Wright (1932) “The Roles of Mutation, Inbreeding, Crossbreeding and Selection in Evolution.” Proceedings of the 6th International Congress of Genetics, pp. 56–366.Google Scholar
  9. [9]
    A. Bray, and M. Moore (1980) "Metastable States in Spin Glasses.” Journal of Physics C: Solid State Physics 13, pp. L469–L476.CrossRefGoogle Scholar
  10. [10]
    C. Macken, P. Hagan, and A. Perelson (1991) “Evolutionary Walks on Rugged Landscapes.” SIAM Journal of Applied Mathematics 51, pp. 799–827.MathSciNetCrossRefGoogle Scholar
  11. [11]
    W. Fontana, and P. Schuster (1987) “A Computer Model of Evolutionary Optimization.” Biophysical Chemistry 26, ppl23–147.CrossRefGoogle Scholar
  12. [12]
    J. Maynard Smith, J. (1970) Natural Selection and the Concept of a Protein Space. Nature 225. pp563–564.CrossRefGoogle Scholar
  13. [13]
    S. A. Kauffman, S. A. (1993) “The origin of Order: Self-organization and Selection in Evolution.” Oxford University Press.Google Scholar
  14. [14]
    E. D. Weinberger, E. D. (1990) “Correlated and Uncorrelated Fitness Landscapes and How to Tell the Difference.” Biological Cybernetics 63, pp. 325–336.zbMATHCrossRefGoogle Scholar
  15. [15]
    Kwee-Bo Sim and Dong-Wook Lee (2003) “Modeling of Positive Selection for the Development of a Computer Immune System and a Self-Recognition Algorithm.” International Journal of Control, Automation, and Systems Vol. 1, No. 4, pp. 453–458.Google Scholar
  16. [16]
    S. Forrest, A. S. Perelson, L. Allen, and R. Cherukuri, (1994) “Self-nonself discrimination in a computer.” Proceedings of the IEEE Symposium on Research in Security and Privacy, pp. 202–212.Google Scholar
  17. [17]
    J. Kim and P. Bentley (2001) “Investigating the roles of Negative Selection and Clonal Selection in an Artificial Immune System for Network Intrusion Detection.” Technical Report, Department of Computer Science, London.Google Scholar

Copyright information

© Springer Science+Business Media, Inc. 2005

Authors and Affiliations

  • Akira Imada
    • 1
  1. 1.Brest State Technical UniversityBrestBelarus

Personalised recommendations