Advertisement

Journal of Computational Neuroscience

, Volume 23, Issue 1, pp 129–141 | Cite as

Retrograde adaptive resonance theory based on the role of nitric oxide in long-term potentiation

  • Peng Jia
  • Junsong Yin
  • Dewen Hu
  • Zongtan Zhou
Article

Abstract

Adaptive resonance theory (ART) demonstrates how the brain learns to recognize and categorize vast amounts of information by using top–down expectations and attentional focusing. ART 3, one member of the ART family, embeds the computational properties of the chemical synapse in its search process, but it converges slowly and is lack of stability when being applied in pattern recognition and analysis. To overcome these problems, Nitric Oxide (NO), which serves as a newly discovered retrograde messenger in Long-Term Potentiation (LTP), is introduced in retrograde adaptive resonance theory (ReART) model presented in this paper. In the presented model a novel search hypothesis is proposed to incorporate angle and amplitude information of an external input vector to decide whether the input matches the long-term memory (LTM) weights of an active node or not, and the embedded NO retrograde mechanism makes the search procedure a closed loop, which improves the stability and convergence speed of the transmitter releasing mechanism in a synapse. To make the model more adaptive and practical, a forgetting mechanism is built to improve the weights updating process. Experimental results indicate that the proposed ReART model achieves low error rate, fast convergence and self-organizing weights regulation.

Keywords

Neural networks Adaptive resonance theory Retrograde ART (ReART) Nitric oxide Long-term potentiation Forgetting mechanism 

Notes

Acknowledgements

The authors would like to thank the action editor and the anonymous reviewer for their constructive comments. This work was supported in part by Natural Science Foundation of China (No. 60171003, 30370416, 60575044, 60675005), National Distinguished Young Scholars Fund of China (No. 60225015).

References

  1. Ahn, J.-H., & Oh, J.-H. (2003). A constrained EM algorithm for principal component analysis. Neural Computation, 15, 57–65.PubMedCrossRefGoogle Scholar
  2. Bolshakov, V. Y., & Siegelbaum, S. A. (1994). Postsynaptic induction and presynaptic expression of hippocampal long-term depression. Science, 264, 1148–1152.PubMedCrossRefGoogle Scholar
  3. Bredt, D., & Snyder, S. (1992). Nitric oxide, a novel neuronal messenger. Neuron, 8, 3–11.PubMedCrossRefGoogle Scholar
  4. Burette, A., Zabel, U., Weinberg, R. J., Schmidt, H. H. H. W., & Valtschanoff, J. G. (2002). Synaptic localization of nitric oxide synthase and soluble guanylyl cyclase in the hippocampus. Journal of Neuroscience, 22, 8961–8970.PubMedGoogle Scholar
  5. Carpenter, G. A., & Grossberg, S. (1987). A massively parallel architecture for a self-organizing neural pattern recognition machine. Computer Vision, Graphics, and Image Processing, 37, 54–115.CrossRefGoogle Scholar
  6. Carpenter, G. A., & Grossberg, S. (1990). ART 3: Hierarchical search using chemical transmitters in self-organizing pattern recognition architectures. Neural Networks, 3, 129–152.CrossRefGoogle Scholar
  7. Carpenter, G. A., & Grossberg, S. (2002). Adaptive resonance theory. The Handbook of Brain Theory and Neural networks, second edition.Google Scholar
  8. Carpenter, G. A., Grossberg, S., & Reynolds, J. H. (1991a). ARTMAP: Supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks, 4, 565–588.CrossRefGoogle Scholar
  9. Carpenter, G. A., Grossberg, S., & Rosen, D. B. (1991b). Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance system. Neural Networks, 4, 759–771.CrossRefGoogle Scholar
  10. Chang, H. C., Kopaska-Merkel, D. C., Chen, H. C., & Durrans, S. R. (2000). Lithofacies identification using multiple adaptive resonance theory neural networks and group decision expert system. Computers & Geosciences, 26, 591–601.CrossRefGoogle Scholar
  11. Christelle, L. M. B., & Garthwaite, J. (2003). On the role of nitric oxide in hippocampal long-term potentiation. Journal of Neuroscience, 23(5),: 1941–1948.Google Scholar
  12. Feng, R., & José, L. C. (2006). Magnetoencephalographic artifact identification and automatic removal based on independent component analysis and categorization approaches. Journal of Neuroscience Methods, 157, 337–354.CrossRefGoogle Scholar
  13. Fisher, R. A. (1936). The use of multiple measurements in taxonomic problems. Annals of Eugenics, 7, 179–188.Google Scholar
  14. Garthwaite, J., Charles, S., & Chess-Williams, R. (1988). Endothelium-derived relaxing factor release on activation of NMDA receptors suggests role as interneurons messager in the brain. Nature, 336, 385–388.PubMedCrossRefGoogle Scholar
  15. Gladys, Y. K., & Kelly, T. P. (1999). Nitric oxide acts as a postsynaptic signaling molecule in calcium/calmodulin-induced synaptic potentiation in hippocampal CA1 pyramidal neurons. Journal of Neuroscience, 19, 6784–6794.Google Scholar
  16. Grossberg, S. (1980). How does a brain build a cognitive code? Psychological Review, 87, 1–51.PubMedCrossRefGoogle Scholar
  17. Grossberg, S., Govindarajan, K. K., Wyse, L. L., & Cohen, M. A. (2004). ARTSTREAM: A neural network model of auditory scene analysis and source segregation. Neural Networks, 17, 511–536.PubMedCrossRefGoogle Scholar
  18. Jollife, I. (1986). Principal component analysis. Berlin Heidelberg New York: Springer.Google Scholar
  19. José, L. C., & Wolfram, S. (1999). A predictive reinforcement model of dopamine neurons for learning approach behavior. Journal of Computational Neuroscience, 6, 191–214.CrossRefGoogle Scholar
  20. Kohonen, T. (1997). Self-organizing maps. (2nd ed.). Berlin Heidelberg New York: Springer.Google Scholar
  21. Kumar, S., & Guez, A. (1991). ART based adaptive pole placement for neuralcontrollers. Neural Networks, 4, 319–335.CrossRefGoogle Scholar
  22. Lancaster, J. R. (1994). Simulation of the diffusion and reaction of endogenously produced nitric oxide. Proceedings of the National Academy of Sciences USA, 91, 8137–8141.Google Scholar
  23. Ledo, A., Barbosa, R. M., Gerhardt, G. A., Cadenas, E., & Laranjinha, J. (2005). Concentration dynamics of nitric oxide in rat hippocampal subregions evoked by stimulation of the NMDA glutamate receptor. Journal of Neuroscience, 102, 17483–17488.Google Scholar
  24. Levine, D. S., & Penz, P. A. (1990). ART 1.5-A simplified adaptive resonance network for classifying low-dimensional analog data. In International Joint Conference on Neural Networks (Washington), (pp. 639–642). Hillsdale, NJ: Erlbaum.Google Scholar
  25. MacQueen, J. B. (1967). Some methods for classification and analysis of multivariate observations. In Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability, 1 (pp. 281–297). Berkeley, CA: University of California Press.Google Scholar
  26. Malenka, C. R., & Nicoll, A. R. (1999). Long-term potentiation—A decade of progress? Science, 285.Google Scholar
  27. Ochsner, K. N., Bunge, S. A., Gross, J. J., & Gabrieli, J. D. E. (2002). Rethinking feelings: An fMRI study of the cognitive regulation of emotion. Journal of Cognitive Neuroscience, 14, 1215–1229.PubMedCrossRefGoogle Scholar
  28. Philippides, A., Husbands, P., & O’Shea, M. (2000). Four-dimensional neuronal signaling by nitric oxide: A computational analysis. Journal of Neuroscience, 20, 1199–1207.PubMedGoogle Scholar
  29. Quah, K. H., Quek, C., & Leedham, G. (2005). Reinforcement learning combined with a fuzzy adaptive learning control network (FALCON-R) for pattern classification. Pattern Recognition, 38, 513–526.CrossRefGoogle Scholar
  30. Rosenberg, P. A., Li, Y., Le, M., & Zhang, Y. (2000). Nitric oxide-stimulated increase in extracellular adenosine accumulation in rat forebrain neurons in culture is associated with ATP hydrolysis and inhibition of adenosine kinase activity. Journal of Neuroscience, 20, 6294–6301.PubMedGoogle Scholar
  31. Roweis, S. T., & Saul, L. K. (2000). Nonlinear dimensionality reduction by locally linear embedding. Science, 290, 2323–2326.PubMedCrossRefGoogle Scholar
  32. Smith, T. M. C., & Philippides, A. (2000). Nitric oxide signalling in real and artificial neural networks. British Telecom Technology Journal, 18, 140–149.Google Scholar
  33. Solan, Z., & Ruppin, E. (2001). Similarity in perception: A window to brain organization. Journal of Cognitive Neuroscience, 13, 18–30.PubMedCrossRefGoogle Scholar
  34. Stephen, J. V., Gregory, L. H., & Michael, G. (2005). Boosted ARTMAP: Modifications to fuzzy ARTMAP motivated by boosting theory. Neural Networks, 1–23.Google Scholar
  35. Whitlock, J. R., Heynen, A. J., Shuler, M. G., & Bear, M. F. (2006). Learning induces long-term potentiation in the hippocampus. Science, 313, 1093–1097.PubMedCrossRefGoogle Scholar
  36. Williamson, J. R. (1997). A constructive, incremental-learning network for mixture modeling and classification. Neural Computation, 9, 1517–1543.CrossRefGoogle Scholar
  37. Wood, J., & Garthwaite, J. (1994). Models of the diffusional spread of nitric oxide: Implications for neural nitric oxide signaling and its pharmacological properties. Neuropharmacology, 33, 1235–1244.PubMedCrossRefGoogle Scholar
  38. Yang, T. (2003). Multi-layer cellular neural networks: Theory and applications to modeling nitric oxide diffusion in nervous systems. International Journal of Computational Cognition, 1, 1–23.Google Scholar
  39. Yoshihara, M., Adolfsen, B., Galle, K. T., & Littleton, J. T. (2005). Retrograde signaling by Syt 4 induces presynaptic release and synapse-specific growth. Science, 310, 858–863.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  1. 1.College of Mechatronics and AutomationNational University of Defense TechnologyChangshaChina

Personalised recommendations