Reinforcement Neuronal Signals and Dimensionality Reduction in the Cortico-Basal Ganglia System

  • Genela Morris
  • David Arkadir
  • Hagai Bergman
Part of the Advances in Behavioral Biology book series (ABBI, volume 53)

Abstract

Although anatomical studies of the basal ganglia show extensive convergence and lateral inhibitory connections (Bolam et al., 2000), physiological studies failed to show correlated pallidal activity (Nini et al., 1995;Raz et al., 2000). These seemingly contradictory results can be explained within a model, which postulates that the basal ganglia reduce the dimensionality of cortical information using optimal extraction methods (Bar-Gad et al., 2000). Such compression can be controlled by the reinforcement neuronal systems of the basal ganglia, i.e., the midbrain dopaminergic neurons (Schultz, 1998) and the cholinergic interneurons of the striatum (Graybiel et al., 1994). Previous studies have shown that midbrain dopaminergic neurons respond to mismatch between the animal’s predictions and reality. Thus, dopaminergic neurons respond to primary rewards only when the reward occurs unpredictably (Hollerman and Schultz, 1998). In a trained animal, the dopaminergic neurons increase their discharge with the earliest reward-predicting stimulus, and reduce their discharge when this prediction fails to occur (Mirenowicz and Schultz, 1994). The tonically active neurons (TANs) of the striatum (presumably the cholinergic interneurons of this structure (Wilson et al., 1990;Aosaki et al., 1995)) show responses of a similar nature (Graybiel et al., 1994;Ravel et al., 1999), although with reverse polarity.

Keywords

Basal Ganglion Future Reward Midbrain Dopaminergic Neuron Cholinergic Interneuron Pallidal Neuron 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References List

  1. 1.
    Aosaki T, Graybiel AM, Kimura M (1994) Effect of the nigrostriatal dopamine system on acquired neural responses in the striatum of behaving monkeys. Science 265: 412–415.PubMedCrossRefGoogle Scholar
  2. 2.
    Aosaki T, Kimura M, Graybiel AM (1995) Temporal and spatial characteristics of tonically active neurons of the primate’s striatum. J Neurophysiol 73: 1234–1252.PubMedGoogle Scholar
  3. 3.
    Aosaki T, Kiuchi K, Kawaguchi Y (1998) Dopamine D1-like receptor activation excites rat striatal large aspiny neurons in vitro. J Neurosci 18: 5180–5190.PubMedGoogle Scholar
  4. 4.
    Bar-Gad I, Havazelet Heimer G, Goldberg JA, Ruppin E, Bergman H (2000) Reinforcement driven dimensionality reduction — a model for information processing in the basal ganglia. Journal of Basic & Clinical Physiology & Pharmacology 11: 305–320.Google Scholar
  5. 5.
    Bolam JP, Hanley JJ, Booth PA, Bevan MD (2000) Synaptic organisation of the basal ganglia. J Anat 196: 527–542.PubMedCrossRefGoogle Scholar
  6. 6.
    Graybiel AM, Aosaki T, Flaherty AW, Kimura M (1994) The basal ganglia and adaptive motor control. Science 265: 1826–1831.PubMedCrossRefGoogle Scholar
  7. 7.
    Hollerman JR, Schultz W (1998) Dopamine neurons report an error in the temporal prediction of reward during learning. Nat Neurosci 1: 304–309.PubMedCrossRefGoogle Scholar
  8. 8.
    Kawaguchi Y, Wilson CJ, Augood S J, Emson PC (1995) Striatal interneurons: chemical, physiological and morphological characterization. TINS 18: 527–535.PubMedGoogle Scholar
  9. 9.
    Kitai ST, Surmeier DJ (1992) Cholinergic and dopaminergic modulation of potassium conductances in neostriatal neurons. Adv Neurol 60: 40–52.Google Scholar
  10. 10.
    Mesulam MM, Mash D, Hersh L, Bothwell M, Geula C (1992) Cholinergic innervation of the human striatum, globus pallidus, subthalamic nucleus, substantia nigra, and red nucleus. J Comp Neurol 323: 252–268.PubMedCrossRefGoogle Scholar
  11. 11.
    Mirenowicz J, Schultz W (1994) Importance of unpredictability for reward responses in primate dopamine neurons. J Neurophysiol 72: 1024–1027.PubMedGoogle Scholar
  12. 12.
    Nini A, Feingold A, Slovin H, Bergman H (1995) Neurons in the globus pallidus do not show correlated activity in the normal monkey, but phase-locked oscillations appear in the MPTP model of parkinsonism. J Neurophysiol 74: 1800–1805.PubMedGoogle Scholar
  13. 13.
    Pisani A, Bonsi P, Centonze D, Calabresi P, Bernardi G (2000) Activation of D2-like dopamine receptors reduces synaptic inputs to striatal cholinergic interneurons. J Neurosci Online 20: RC69.Google Scholar
  14. 14.
    Ravel S, Legallet E, Apicella P (1999) Tonically active neurons in the monkey striatum do not preferentially respond to appetitive stimuli. Exp Brain Res 128: 531–534.PubMedCrossRefGoogle Scholar
  15. 15.
    Raz A, Frechter-Mazar V, Feingold A, Abeles M, Vaadia E, Bergman H (2001) Activity of pallidal and striatal tonically active neurons is correlated in MPTP-treated monkeys but not in normal monkeys. The Journal of Neuroscience 21:RC128: 1–5.Google Scholar
  16. 16.
    Raz A, Vaadia E, Bergman H (2000) Firing pattern and correlations of spontaneous discharge of pallidal neurons in the normal and the tremulous MPTP vervet model of parkinsonism. J Neurosci 20: 8559–8571.PubMedGoogle Scholar
  17. 17.
    Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1–27.PubMedGoogle Scholar
  18. 18.
    Watanabe K, Kimura M (1998) Dopamine receptor-mediated mechanisms involved in the expression of learned activity of primate striatal neurons. J Neurophysiol 79: 2568–2580.PubMedGoogle Scholar
  19. 19.
    Wilson CJ, Chang HT, Kitai ST (1990) Firing patterns and synaptic potentials of identified giant aspiny interneurons in the rat neostriatum. J Neurosci 10: 508–519.PubMedGoogle Scholar
  20. 20.
    Yan Z, Song WJ, Surmeier J (1997) D2 dopamine receptors reduce N-type Ca2+ currents in rat neostriatal cholinergic interneurons through a membrane-delimited, protein-kinase-C-insensitive pathway. J Neurophysiol 77: 1003–1015.PubMedGoogle Scholar
  21. 21.
    Yelnik J, Percheron G, Francois C, Gamier A (1993) Cholinergic neurons of the rat and primate striatum are morphologically different. Prog Brain Res 99: 25–34.PubMedCrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2002

Authors and Affiliations

  • Genela Morris
  • David Arkadir
  • Hagai Bergman
    • 1
  1. 1.Department of Physiology, the Center for Neural Computation and the Eric Roland Center for Neurodegenerative diseasesThe Hebrew UniversityJerusalemIsrael

Personalised recommendations