Encyclopedia of Computational Neuroscience

Living Edition
| Editors: Dieter Jaeger, Ranu Jung

Associations and Rewards in the Auditory Cortex

  • Michael BroschEmail author
Living reference work entry

Latest version View entry history

DOI: https://doi.org/10.1007/978-1-4614-7320-6_105-5
  • 108 Downloads

Definition

In psychology, the term association refers to a connection between different elementary mental entities (sensations, thoughts, feelings; Dudai 2002). Aside from innate, reflex-like associations, novel associations are typically acquired during learning. In Pavlovian/classical conditioning, a stimulus-stimulus association is formed by repetitively pairing an initially neutral stimulus with a biologically significant unconditioned stimulus that automatically triggers an unconditioned behavioral response. In instrumental/operant conditioning, a stimulus-response association is formed in the presence of reinforcers. Reinforcers can be either positive, such as water, food, money, and brain stimulation reward, and result in an increase in the probability of a response to the stimulus. Negative reinforcers (e.g., footshocks, airpuffs, money loss) decrease the probability of a response to the stimulus. If the reinforcer is removed, the learned associations risk extinction.

Detailed Description

Classical View of Brain Structures Reflecting Associations and Reinforcement

Traditionally associative functions are assigned to the so-called association cortex (Creutzfeldt 1983). Inspired by “associationism” (the philosophical doctrine that the mind learns and construes the world bottom up by associating mental entities) and based on anatomical considerations, Flechsig originally defined the association cortex as that part of the cerebral cortex that appeared to lack direct afferences from the senses and efferences to peripheral motor structures. He proposed that the association cortex provides the substrate for the fusion of primary sensations to obtain ideas of objects as a whole. This idea is challenged, inter alia, by studies demonstrating associative functions already in primary sensory cortices, which have direct afferences from the senses. In addition, the sensory cortex is affected by reinforcement (Shuler and Bear 2006; Brosch et al. 2011a; Arsenault et al. 2013; Weis et al. 2013), which generally is thought to involve the limbic system, including the hypothalamus, amygdala, hippocampus, septal nuclei, ventral tegmental area, and anterior cingulate gyrus. These findings put into question the existence of unisensory cortical areas at all (Ghazanfar and Schroeder 2006).

Learning

Learning associations between stimuli, between stimuli and behavioral responses, or between stimuli and reinforcers change the auditory cortex, such as the feature sensitivity (spectrotemporal receptive field) of neurons in the auditory cortex, their response strength and response latency, as well as interneuronal synchrony (Scheich and Brosch 2013; Shepard et al. 2013). In detection tasks, the direction of the receptive field change at the frequency of the conditioned tone depends on the valence of the tone (Scheich et al. 2011); if it is negative (associated with punishment), the response to the tone is increased (receptive field is sensitized at the conditioned tone frequency); if it is positive (associated with reward), the response is decreased (receptive field is suppressed at the conditioned tone frequency). In frequency discrimination tasks, slopes of spectral tuning curves become sharper around the conditioned frequencies. In categorization tasks, stimuli of the same category evoke (spatiotemporal) neuronal activity patterns that are more similar to each other than those evoked by stimuli of other categories.

These changes coincide with or may even form the basis of changes in representation maps (e.g., tonotopic frequency map) in the auditory cortex that occur, at least transiently, after learning (Shepard et al. 2013; Grosso et al. 2015). They may also underlie plasticity of neuronal mass activity, as revealed by electro- and magnetoencephalography (EEG, MEG) or functional magnetic resonance imaging (fMRI) (Rüsseler et al. 2005).

Neuromodulators

The formation of novel associations in the auditory cortex requires the involvement of neuromodulators (Shepard et al. 2013). Some of the described changes can also be mimicked by repetitively pairing auditory stimuli with electrical stimulation of neuromodulatory systems, such as the ventral tegmental area (dopamine; Huang et al. 2016a), the nucleus basalis of Meynert (acetylcholine; Bakin and Weinberger 1996), the locus coeruleus (norepinephrine; Martins and Froemke 2015), or the vagus nerve (triggering widespread release of neuromodulators; Engineer et al. 2011). Formation of associations in the auditory cortex also involves cognitive factors: changes in the auditory cortex and learning do not occur when an animal is passively exposed to the stimulus-reward pairings of another animal while it was instrumentally conditioned (Blake et al. 2006).

Neuronal Correlates of Association

Sustained firing and slow firing changes may provide neuronal correlates of associations between mental entities (Brosch et al. 2011a). The main condition necessary for the emergence of slow firing changes is that subjects have learnt that conditioned associations are contingent on reinforcers. When the reinforcer is removed, the slow firing changes disappear within a few trials, concomitantly with behavioral changes (Huang et al. 2016b). These firings may be related to the contingent negative variation (Walter et al. 1964), an event-related potential that can be obtained in electroencephalography in humans. It is considered to reflect the contingency and the contiguity of two events that have a motivational “value.”

Different types of events may be associated through event-related slow firing changes (Brosch et al. 2011a). Events that trigger such changes can be auditory (and possibly visual) stimuli, reinforcers, and behavioral responses, like grasping. An event with which slow firing changes end is the reinforcer. Slow firing changes have been observed between (1) an auditory stimulus and a reinforcer, (2) a behavioral response and an auditory stimulus, and (3) a behavioral response and another behavioral response.

The association between behaviorally significant events provided by slow firing changes might even be directed in some cases, that is, this type of firing might provide some sort of either prospective coding of an upcoming event or retrospective coding about a preceding event.

Neuronal Correlates of Rewards

In animals actively engaged in listening to auditory stimuli, direct reflections of rewards have been demonstrated in the auditory cortex. Neuronal activity in the auditory cortex varied with the size of the delivered reward and the size of the reward that was expected to be earned in a future auditory task, as well as the magnitude of the mismatch between the expected and delivered reward (the reward prediction error) (Brosch et al. 2011b). Reflections of rewards are also present in other sensory cortices (Shuler and Bear 2006; Arsenault et al. 2013).

References

  1. Arsenault J, Nelissen K, Jarraya B, Vanduffel W (2013) Dopaminergic reward signals selectively decrease fMRI activity in primate visual cortex. Neuron 77(6):1174–1186CrossRefGoogle Scholar
  2. Bakin JS, Weinberger NM (1996) Induction of a physiological memory in the cerebral cortex by stimulation of the nucleus basalis. Proc Natl Acad Sci USA 93:11219–11224CrossRefGoogle Scholar
  3. Blake DT, Heiser MA, Caywood M, Merzenich MM (2006) Experience-dependent adult cortical plasticity requires cognitive association between sensation and reward. Neuron 52:371–381CrossRefGoogle Scholar
  4. Brosch M, Selezneva E, Scheich H (2011a) Formation of associations in auditory cortex by slow changes of tonic firing. Hear Res 271:66–73CrossRefGoogle Scholar
  5. Brosch M, Selezneva E, Scheich H (2011b) Representation of reward feedback in primate auditory cortex. Front Syst Neurosci 5:5CrossRefGoogle Scholar
  6. Creutzfeldt OD (1983) Cortex Cerebri: Leistung, Strukturelle und Funktionelle Organisation der Hirnrinde. Springer, Berlin/Heidelberg/New YorkCrossRefGoogle Scholar
  7. Dudai Y (2002) Memory from a to Z. Oxford University Press, OxfordGoogle Scholar
  8. Engineer ND, Riley JR, Seale JD, Vrana WA, Shetake JA, Sudanagunta SP, Borland MS, Kilgard MP (2011) Reversing pathological neural activity using targeted plasticity. Nature 470:101–104CrossRefGoogle Scholar
  9. Ghazanfar AA, Schroeder CE (2006) Is neocortex essentially multisensory? Trends Cogn Sci 10:278–285CrossRefGoogle Scholar
  10. Grosso A, Cambiaghi M, Concina G, Sacco T, Sacchetti B (2015) Auditory cortex involvement in emotional learning and memory. Neuroscience 299:45–55CrossRefGoogle Scholar
  11. Huang Y, Mylius J, Scheich H, Brosch M (2016a) Tonic effects of the dopaminergic ventral midbrain on the auditory cortex of awake macaque monkeys. Brain Struct Funct 221:969–967CrossRefGoogle Scholar
  12. Huang Y, Matysiak A, König R, Heil P, Brosch M (2016b) Persistent neural activity in auditory cortex is related to auditory working memory in humans and nonhuman primates. eLife 5. Pii: e15441.  https://doi.org/10.7554/eLife
  13. Martins AR, Froemke RC (2015) Coordinated forms of noradrenergic plasticity in the locus coeruleus and primary auditory cortex. Nat Neurosci 18:1483–1492CrossRefGoogle Scholar
  14. Rüsseler J, Nager W, Möbes J, Münte TF (2005) Cognitive adaptations and neuroplasticity: lessons from event-related brain potentials. In: König R, Heil P, Budinger E, Scheich H (eds) Auditory cortex: towards a synthesis of human and animal research. Lawrence Erlbaum, Mahwah, pp 467–484Google Scholar
  15. Scheich H, Brosch M (2013) Task-related activation of the auditory cortex. In: Cohen YE, Popper AN, Fay RR (eds) Neural correlates of auditory cognition, springer handbook of auditory research. Springer, New York/Heidelberg/Dordrecht/LondonGoogle Scholar
  16. Scheich H, Brechmann A, Brosch M, Budinger E, Ohl FW, Selezneva E, Stark H, Tischmeyer W, Wetzel W (2011) Behavioral semantics of learning and crossmodal processing in auditory cortex: the semantic processor concept. Hear Res 271:3–15CrossRefGoogle Scholar
  17. Shepard KN, Kilgard MP, Liu RC (2013) Experience-dependent plasticity and the auditory cortex. In: Cohen YE, Popper AN, Fay RR (eds) Neural correlates of auditory cognition, springer handbook of auditory research. Springer, New York/Heidelberg/Dordrecht/LondonGoogle Scholar
  18. Shuler MG, Bear MF (2006) Reward timing in the primary visual cortex. Science 311:1606–1609CrossRefGoogle Scholar
  19. Walter WG, Cooper R, Aldridge VJ, McCallum WC, Winter AL (1964) Contingent negative variation: an electric sign of sensorimotor association and expectancy in the human brain. Nature 203:380–383CrossRefGoogle Scholar
  20. Weis T, Puschmann S, Brechmann A, Thiel CM (2013) Positive and negative reinforcement activate human auditory cortex. Front Hum Neurosci 7:842CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Leibniz Institute for NeurobiologyMagdeburgGermany

Section editors and affiliations

  • Rodica Curtu
    • 1
  1. 1.Department of MathematicsUniversity of IowaIowa CityUSA