Asymmetric Encoding of Positive and Negative Expectations by Low-Frequency Discharge Basal Ganglia Neurons

Conference paper
Part of the Advances in Behavioral Biology book series (ABBI, volume 58)

Abstract

Experimental and theoretical studies depict the basal ganglia as a reinforcement learning system where the dopaminergic neurons provide reinforcement error signal by modulation of their firing rate. However, the low tonic discharge rate of the dopaminergic neurons suggests that their capability to encode negative events by suppressing firing rate is limited. We recorded the activity of single neurons in the basal ganglia of two monkeys during the performance of probabilistic conditioning task with food, neutral and air-puff outcomes. In a related paper we analyzed the activity of five basal ganglia populations; here, we extend this to the low-frequency discharge (LFD) neurons of the main axis of the basal ganglia, that is, the striatal phasically active neurons (PANs), and the LFD neurons in the external segment of the globus pallidus (GPe). The licking and blinking behavior during the cue presentation epoch reveals that monkeys expected different probabilistic appetitive, neutral, and aversive outcomes. Nevertheless, the activity of single striatal and GPe neurons is more strongly modulated by expectation of reward than by expectation of the aversive event. The neural-behavioral asymmetry suggests that expectation of aversive events and rewards is differentially represented at many levels of the basal ganglia.

Keywords

Dopamine 

References

  1. Arkadir D, Morris G, Vaadia E and Bergman H (2004) Independent coding of movement direction and reward prediction by single pallidal neurons. J Neurosci 24: 10047–10056.CrossRefPubMedGoogle Scholar
  2. Bayer HM and Glimcher PW (2005) Midbrain dopamine neurons encode a quantitative reward prediction error signal. Neuron 47: 129–141.CrossRefPubMedGoogle Scholar
  3. Bayer HM, Lau B and Glimcher PW (2007) Statistics of midbrain dopamine neuron spike trains in the awake primate. J Neurophysiol 98: 1428–1439.CrossRefPubMedGoogle Scholar
  4. Coizet V, Dommett EJ, Redgrave P and Overton PG (2006) Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience 139: 1479–1493.CrossRefPubMedGoogle Scholar
  5. Darbaky Y, Baunez C, Arecchi P, Legallet E and Apicella P (2005) Reward-related neuronal activity in the subthalamic nucleus of the monkey. Neuroreport 16: 1241–1244.CrossRefPubMedGoogle Scholar
  6. Fiorillo CD, Tobler PN and Schultz W (2003) Discrete coding of reward probability and uncertainty by dopamine neurons. Science 299: 1898–1902.CrossRefPubMedGoogle Scholar
  7. Graybiel AM, Aosaki T, Flaherty AW and Kimura M (1994) The basal ganglia and adaptive motor control. Science 265: 1826–1831.CrossRefPubMedGoogle Scholar
  8. Guarraci FA and Kapp BS (1999) An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res 99: 169–179.CrossRefPubMedGoogle Scholar
  9. Joshua M, Elias S, Levine O and Bergman H (2007) Quantifying the isolation quality of extracellularly recorded action potentials. J Neurosci Methods 163: 267–282.CrossRefPubMedGoogle Scholar
  10. Joshua M, Adler A, Mitelman R, Vaadia E and Bergman H (2008) Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J Neurosci 28: 11673–11684.CrossRefPubMedGoogle Scholar
  11. Joshua M, Adler A, Rusin B, Vaadia E and Bergman H (2009) Encoding of probabilistic rewarding and aversive events by pallidal and nigral neurons. J. Neurophysiol 101: 758–772.CrossRefPubMedGoogle Scholar
  12. Kimura M, Rajkowski J and Evarts E (1984) Tonically discharging putamen neurons exhibit set-dependent responses. Proc Natl Acad Sci USA 81: 4998–5001.CrossRefPubMedGoogle Scholar
  13. Konorski J (1967) Integrative Activity of the Brain: An Interdisciplinary Approach. Chicago: Chicago University Press.Google Scholar
  14. Lau B and Glimcher PW (2007) Action and outcome encoding in the primate caudate nucleus. J Neurosci 27: 14502–14514.CrossRefPubMedGoogle Scholar
  15. LeDoux JE (2000) The amygdala and emotion: a view through fear. In: Aggleton JP (ed) The Amygdala. Oxford: Oxford University Press, pp 289–310.Google Scholar
  16. Matsumoto M and Hikosaka O (2007) Lateral habenula as a source of negative reward signals in dopamine neurons. Nature 447: 1111–1115.CrossRefPubMedGoogle Scholar
  17. McCormick DA and Thompson RF (1984) Cerebellum: essential involvement in the classically conditioned eyelid response. Science 223: 296–299.CrossRefPubMedGoogle Scholar
  18. Mirenowicz J and Schultz W (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379: 449–451.CrossRefPubMedGoogle Scholar
  19. Morris G, Arkadir D, Nevet A, Vaadia E and Bergman H (2004) Coincident but distinct messages of midbrain dopamine and striatal tonically active neurons. Neuron 43: 133–143.CrossRefPubMedGoogle Scholar
  20. Nakahara H, Itoh H, Kawagoe R, Takikawa Y and Hikosaka O (2004) Dopamine neurons can represent context-dependent prediction error. Neuron 41: 269–280.CrossRefPubMedGoogle Scholar
  21. Pasquereau B, Nadjar A, Arkadir D, Bezard E, Goillandeau M, Bioulac B, Gross CE and Boraud T (2007) Shaping of motor responses by incentive values through the basal ganglia. J Neurosci 27: 1176–1183.CrossRefPubMedGoogle Scholar
  22. Ravel S, Legallet E and Apicella P (2003) Responses of tonically active neurons in the monkey striatum discriminate between motivationally opposing stimuli. J Neurosci 23: 8489–8497.PubMedGoogle Scholar
  23. Samejima K, Ueda Y, Doya K and Kimura M (2005) Representation of action-specific reward values in the striatum. Science 310: 1337–1340.CrossRefPubMedGoogle Scholar
  24. Sato M and Hikosaka O (2002) Role of primate substantia nigra pars reticulata in reward-oriented saccadic eye movement. J Neurosci 22: 2363–2373.PubMedGoogle Scholar
  25. Satoh T, Nakai S, Sato T and Kimura M (2003) Correlated coding of motivation and outcome of decision by dopamine neurons. J Neurosci 23: 9913–9923.PubMedGoogle Scholar
  26. Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80: 1–27.PubMedGoogle Scholar
  27. Shimo Y and Hikosaka O (2001) Role of tonically active neurons in primate caudate in reward-oriented saccadic eye movement. J Neurosci 21: 7804–7814.PubMedGoogle Scholar
  28. Tobler PN, Fiorillo CD and Schultz W (2005) Adaptive coding of reward value by dopamine neurons. Science 307: 1642–1645.CrossRefPubMedGoogle Scholar
  29. Tversky A and Kahneman D (1981) The framing of decisions and the psychology of choice. Science 211: 453–458.CrossRefPubMedGoogle Scholar
  30. Ungless MA, Magill PJ and Bolam JP (2004) Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303: 2040–2042.CrossRefPubMedGoogle Scholar
  31. Wilson CJ, Chang HT and Kitai ST (1990) Firing patterns and synaptic potentials of identified giant aspiny interneurons in the rat neostriatum. J Neurosci 10: 508–519.PubMedGoogle Scholar
  32. Yamada H, Matsumoto N and Kimura M (2004) Tonically active neurons in the primate caudate nucleus and putamen differentially encode instructed motivational outcomes of action. J Neurosci 24: 3500–3510.CrossRefPubMedGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Interdisciplinary Center for Neural ComputationThe Hebrew UniversityJerusalemIsrael

Personalised recommendations