Abstract
Memory for reward- and punishment-related information is important to effectively obtain rewards and avoid punishments. Functional neuroimaging findings of studies investigating memory enhancement for reward- and punishment-related information are methodologically categorized into two main types: conditioning and stimuli associated with a reward or punishment. In conditioning, memory enhancement involves interactions between regions related to reward and punishment, including the substantia nigra, ventral tegmental area, striatum and insula, and regions related to memory, including the hippocampus and parahippocampal cortex. Memory enhancement for stimuli associated with a reward or punishment involves interactions between the orbitofrontal cortex, which is related to reward outcomes, or the insula, which is related to punishment outcomes, and the hippocampus, which is important for memory. In addition, findings from functional neuroimaging studies have revealed that the memory enhancement in conditioning is arranged in a three-layered hierarchical structure of psychological components, involving interactions between reward-/punishment-related regions and memory-related regions, modulations of cognitive factors that are associated with the prefrontal cortex, and modulations of social factors that are associated with the ventromedial prefrontal cortex, the temporo-parietal junction, and the posterior superior temporal sulcus. This three-layered hierarchical structure (i.e., modulatory effects of cognitive and social factors on the interaction between reward/punishment and memory processes) could be critical for human beings, who are social animals, in obtaining rewards and avoiding punishments.
References
Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD (2006) Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron 50(3):507–517
Ballard IC, Murty VP, Carter RM, MacInnes JJ, Huettel SA, Adcock RA (2011) Dorsolateral prefrontal cortex drives mesolimbic dopaminergic regions to initiate motivated behavior. J Neurosci 31(28):10340–10346
Basten U, Biele G, Heekeren HR, Fiebach CJ (2010) How the brain integrates costs and benefits during decision making. Proc Natl Acad Sci U S A 107(50):21767–21772
Bauch EM, Rausch VH, Bunzeck N (2014) Pain anticipation recruits the mesolimbic system and differentially modulates subsequent recognition memory. Hum Brain Mapp 35(9):4594–4606
Bault N, Pelloux B, Fahrenfort JJ, Ridderinkhof KR, van Winden F (2015) Neural dynamics of social tie formation in economic decision-making. Soc Cogn Affect Neurosci 10(6):877–884
Behrens TE, Hunt LT, Woolrich MW, Rushworth MF (2008) Associative learning of social value. Nature 456(7219):245–249
Bialleck KA, Schaal HP, Kranz TA, Fell J, Elger CE, Axmacher N (2011) Ventromedial prefrontal cortex activation is associated with memory formation for predictable rewards. PLoS One 6(2):e16695
Breiter HC, Etcoff NL, Whalen PJ, Kennedy WA, Rauch SL, Buckner RL, Strauss MM, Hyman SE, Rosen BR (1996) Response and habituation of the human amygdala during visual processing of facial expression. Neuron 17(5):875–887
Bulganin L, Wittmann BC (2015) Reward and novelty enhance imagination of future events in a motivational-episodic network. PLoS One 10(11):e0143477
Cahill L, Haier RJ, Fallon J, Alkire MT, Tang C, Keator D, Wu J, McGaugh JL (1996) Amygdala activity at encoding correlated with long-term, free recall of emotional information. Proc Natl Acad Sci U S A 93(15):8016–8021
Callan DE, Schweighofer N (2008) Positive and negative modulation of word learning by reward anticipation. Hum Brain Mapp 29(2):237–249
Canli T, Zhao Z, Desmond JE, Glover G, Gabrieli JDE (1999) fMRI identifies a network of structures correlated with retention of positive and negative emotional memory. Psychobiology 27(4):441–452
Canli T, Zhao Z, Brewer J, Gabrieli JD, Cahill L (2000) Event-related activation in the human amygdala associates with later memory for individual emotional experience. J Neurosci 20(19):RC99
Carter RM, Macinnes JJ, Huettel SA, Adcock RA (2009) Activation in the VTA and nucleus accumbens increases in anticipation of both gains and losses. Front Behav Neurosci 3:21
Coghill RC, Talbot JD, Evans AC, Meyer E, Gjedde A, Bushnell MC, Duncan GH (1994) Distributed processing of pain and vibration by the human brain. J Neurosci 14(7):4095–4108
Cohen MS, Rissman J, Suthana NA, Castel AD, Knowlton BJ (2014) Value-based modulation of memory encoding involves strategic engagement of fronto-temporal semantic processing regions. Cogn Affect Behav Neurosci 14(2):578–592
Coizet V, Dommett EJ, Redgrave P, Overton PG (2006) Nociceptive responses of midbrain dopaminergic neurones are modulated by the superior colliculus in the rat. Neuroscience 139(4):1479–1493
Cooper JC, Knutson B (2008) Valence and salience contribute to nucleus accumbens activation. NeuroImage 39(1):538–547
Critchley HD, Rolls ET (1996) Hunger and satiety modify the responses of olfactory and visual neurons in the primate orbitofrontal cortex. J Neurophysiol 75(4):1673–1686
D’Ardenne K, McClure SM, Nystrom LE, Cohen JD (2008) BOLD responses reflecting dopaminergic signals in the human ventral tegmental area. Science 319(5867):1264–1267
D’Esposito M, Aguirre GK, Zarahn E, Ballard D, Shin RK, Lease J (1998) Functional MRI studies of spatial and nonspatial working memory. Brain Res Cogn Brain Res 7(1):1–13
Davachi L (2006) Item, context and relational episodic encoding in humans. Curr Opin Neurobiol 16(6):693–700
Delgado MR, Frank RH, Phelps EA (2005) Perceptions of moral character modulate the neural systems of reward during the trust game. Nat Neurosci 8(11):1611–1618
Delgado MR, Schotter A, Ozbay EY, Phelps EA (2008) Understanding overbidding: using the neural circuitry of reward to design economic auctions. Science 321(5897):1849–1852
Diana RA, Yonelinas AP, Ranganath C (2007) Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn Sci 11(9):379–386
Dillon DG, Dobbins IG, Pizzagalli DA (2014) Weak reward source memory in depression reflects blunted activation of VTA/SN and parahippocampus. Soc Cogn Affect Neurosci 9(10):1576–1583
Eichenbaum H, Yonelinas AP, Ranganath C (2007) The medial temporal lobe and recognition memory. Annu Rev Neurosci 30:123–152
Fareri DS, Delgado MR (2014) Differential reward responses during competition against in- and out-of-network others. Soc Cogn Affect Neurosci 9(4):412–420
Fareri DS, Niznikiewicz MA, Lee VK, Delgado MR (2012) Social network modulation of reward-related signals. J Neurosci 32(26):9045–9052
Fareri DS, Chang LJ, Delgado MR (2015) Computational substrates of social value in interpersonal collaboration. J Neurosci 35(21):8170–8180
Gerraty RT, Davidow JY, Wimmer GE, Kahn I, Shohamy D (2014) Transfer of learning relates to intrinsic connectivity between hippocampus, ventromedial prefrontal cortex, and large-scale networks. J Neurosci 34(34):11297–11303
Gruber MJ, Ritchey M, Wang SF, Doss MK, Ranganath C (2016) Post-learning hippocampal dynamics promote preferential retention of rewarding events. Neuron 89(5):1110–1120
Guarraci FA, Kapp BS (1999) An electrophysiological characterization of ventral tegmental area dopaminergic neurons during differential pavlovian fear conditioning in the awake rabbit. Behav Brain Res 99(2):169–179
Haber SN, Knutson B (2010) The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35(1):4–26
Halko ML, Hlushchuk Y, Hari R, Schurmann M (2009) Competing with peers: mentalizing-related brain activity reflects what is at stake. NeuroImage 46(2):542–548
Hamann SB, Ely TD, Grafton ST, Kilts CD (1999) Amygdala activity related to enhanced memory for pleasant and aversive stimuli. Nat Neurosci 2(3):289–293
Hampton AN, Bossaerts P, O’Doherty JP (2008) Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc Natl Acad Sci U S A 105(18):6741–6746
Hare TA, Camerer CF, Rangel A (2009) Self-control in decision-making involves modulation of the vmPFC valuation system. Science 324(5927):646–648
Hutcherson CA, Bushong B, Rangel A (2015) A neurocomputational model of altruistic choice and its implications. Neuron 87(2):451–462
Joshua M, Adler A, Mitelman R, Vaadia E, Bergman H (2008) Midbrain dopaminergic neurons and striatal cholinergic interneurons encode the difference between reward and aversive events at different epochs of probabilistic classical conditioning trials. J Neurosci 28(45):11673–11684
Kable JW, Glimcher PW (2007) The neural correlates of subjective value during intertemporal choice. Nat Neurosci 10(12):1625–1633
Kim H, Shimojo S, O’Doherty JP (2006) Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol 4(8):e233
Knutson B, Westdorp A, Kaiser E, Hommer D (2000) FMRI visualization of brain activity during a monetary incentive delay task. NeuroImage 12(1):20–27
Knutson B, Fong GW, Adams CM, Varner JL, Hommer D (2001) Dissociation of reward anticipation and outcome with event-related fMRI. Neuroreport 12(17):3683–3687
Knutson B, Fong GW, Bennett SM, Adams CM, Hommer D (2003) A region of mesial prefrontal cortex tracks monetarily rewarding outcomes: characterization with rapid event-related fMRI. NeuroImage 18(2):263–272
Koster R, Guitart-Masip M, Dolan RJ, Duzel E (2015) Basal ganglia activity mirrors a benefit of action and reward on long-lasting event memory. Cereb Cortex 25(12):4908–4917
Kuhl BA, Shah AT, DuBrow S, Wagner AD (2010) Resistance to forgetting associated with hippocampus-mediated reactivation during new learning. Nat Neurosci 13(4):501–506
Le Bouc R, Pessiglione M (2013) Imaging social motivation: distinct brain mechanisms drive effort production during collaboration versus competition. J Neurosci 33(40):15894–15902
Li P, Shen Y, Sui X, Chen C, Feng T, Li H, Holroyd C (2013) The neural basis of responsibility attribution in decision-making. PLoS One 8(11):e80389
Lim SL, O’Doherty JP, Rangel A (2013) Stimulus value signals in ventromedial PFC reflect the integration of attribute value signals computed in fusiform gyrus and posterior superior temporal gyrus. J Neurosci 33(20):8729–8741
Lisman JE, Grace AA (2005) The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron 46(5):703–713
Loh E, Kumaran D, Koster R, Berron D, Dolan R, Duzel E (2015) Context-specific activation of hippocampus and SN/VTA by reward is related to enhanced long-term memory for embedded objects. Neurobiol Learn Mem 134(Pt A):65–77
Matsumoto M, Hikosaka O (2009) Two types of dopamine neuron distinctly convey positive and negative motivational signals. Nature 459(7248):837–841
McClure SM, Berns GS, Montague PR (2003) Temporal prediction errors in a passive learning task activate human striatum. Neuron 38(2):339–346
Mirenowicz J, Schultz W (1996) Preferential activation of midbrain dopamine neurons by appetitive rather than aversive stimuli. Nature 379(6564):449–451
Mitchell JP (2009) Inferences about mental states. Philos Trans R Soc Lond Ser B Biol Sci 364(1521):1309–1316
Mobbs D, Yu R, Meyer M, Passamonti L, Seymour B, Calder AJ, Schweizer S, Frith CD, Dalgleish T (2009) A key role for similarity in vicarious reward. Science 324(5929):900
Morris JS, Dolan RJ (2001) Involvement of human amygdala and orbitofrontal cortex in hunger-enhanced memory for food stimuli. J Neurosci 21(14):5304–5310
Morris JS, Frith CD, Perrett DI, Rowland D, Young AW, Calder AJ, Dolan RJ (1996) A differential neural response in the human amygdala to fearful and happy facial expressions. Nature 383(6603):812–815
Murty VP, Adcock RA (2014) Enriched encoding: reward motivation organizes cortical networks for hippocampal detection of unexpected events. Cereb Cortex 24(8):2160–2168
Murty VP, Labar KS, Adcock RA (2012) Threat of punishment motivates memory encoding via amygdala, not midbrain, interactions with the medial temporal lobe. J Neurosci 32(26):8969–8976
Nishijo H, Ono T, Nishino H (1988) Single neuron responses in amygdala of alert monkey during complex sensory stimulation with affective significance. J Neurosci 8(10):3570–3583
Nitschke JB, Sarinopoulos I, Mackiewicz KL, Schaefer HS, Davidson RJ (2006) Functional neuroanatomy of aversion and its anticipation. NeuroImage 29(1):106–116
O’Doherty JP, Deichmann R, Critchley HD, Dolan RJ (2002) Neural responses during anticipation of a primary taste reward. Neuron 33(5):815–826
O’Doherty JP, Dayan P, Friston K, Critchley H, Dolan RJ (2003) Temporal difference models and reward-related learning in the human brain. Neuron 38(2):329–337
Owen AM (1997) The functional organization of working memory processes within human lateral frontal cortex: the contribution of functional neuroimaging. Eur J Neurosci 9(7):1329–1339
Pessiglione M, Seymour B, Flandin G, Dolan RJ, Frith CD (2006) Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature 442(7106):1042–1045
Phan KL, Sripada CS, Angstadt M, McCabe K (2010) Reputation for reciprocity engages the brain reward center. Proc Natl Acad Sci U S A 107(29):13099–13104
Phillips ML, Young AW, Senior C, Brammer M, Andrew C, Calder AJ, Bullmore ET, Perrett DI, Rowland D, Williams SC, Gray JA, David AS (1997) A specific neural substrate for perceiving facial expressions of disgust. Nature 389(6650):495–498
Pikkarainen M, Ronkko S, Savander V, Insausti R, Pitkanen A (1999) Projections from the lateral, basal, and accessory basal nuclei of the amygdala to the hippocampal formation in rat. J Comp Neurol 403(2):229–260
Ploghaus A, Tracey I, Gati JS, Clare S, Menon RS, Matthews PM, Rawlins JN (1999) Dissociating pain from its anticipation in the human brain. Science 284(5422):1979–1981
Pribram KH, Maclean PD (1953) Neuronographic analysis of medial and basal cerebral cortex. II. Monkey. J Neurophysiol 16(3):324–340
Reysen MB (2003) The effects of social pressure on group recall. Mem Cogn 31(8):1163–1168
Reysen MB, Adair SA (2008) Social processing improves recall performance. Psychon Bull Rev 15(1):197–201
Rilling J, Gutman D, Zeh T, Pagnoni G, Berns G, Kilts C (2002) A neural basis for social cooperation. Neuron 35(2):395–405
Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD (2004a) The neural correlates of theory of mind within interpersonal interactions. NeuroImage 22(4):1694–1703
Rilling JK, Sanfey AG, Aronson JA, Nystrom LE, Cohen JD (2004b) Opposing BOLD responses to reciprocated and unreciprocated altruism in putative reward pathways. Neuroreport 15(16):2539–2543
Rolls ET, Sienkiewicz ZJ, Yaxley S (1989) Hunger modulates the responses to gustatory stimuli of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. Eur J Neurosci 1(1):53–60
Rolls ET, Yaxley S, Sienkiewicz ZJ (1990) Gustatory responses of single neurons in the caudolateral orbitofrontal cortex of the macaque monkey. J Neurophysiol 64(4):1055–1066
Rutecki PA, Grossman RG, Armstrong D, Irish-Loewen S (1989) Electrophysiological connections between the hippocampus and entorhinal cortex in patients with complex partial seizures. J Neurosurg 70(5):667–675
Samanez-Larkin GR, Gibbs SE, Khanna K, Nielsen L, Carstensen LL, Knutson B (2007) Anticipation of monetary gain but not loss in healthy older adults. Nat Neurosci 10(6):787–791
Sanghera MK, Rolls ET, Roper-Hall A (1979) Visual responses of neurons in the dorsolateral amygdala of the alert monkey. Exp Neurol 63(3):610–626
Schultz W (1998) Predictive reward signal of dopamine neurons. J Neurophysiol 80(1):1–27
Schultz W, Dayan P, Montague PR (1997) A neural substrate of prediction and reward. Science 275(5306):1593–1599
Schurz M, Radua J, Aichhorn M, Richlan F, Perner J (2014) Fractionating theory of mind: a meta-analysis of functional brain imaging studies. Neurosci Biobehav Rev 42:9–34
Scott TR, Yan J, Rolls ET (1995) Brain mechanisms of satiety and taste in macaques. Neurobiology 3(3-4):281–292
Seid-Fatemi A, Tobler PN (2015) Efficient learning mechanisms hold in the social domain and are implemented in the medial prefrontal cortex. Soc Cogn Affect Neurosci 10(5):735–743
Shigemune Y, Abe N, Suzuki M, Ueno A, Mori E, Tashiro M, Itoh M, Fujii T (2010) Effects of emotion and reward motivation on neural correlates of episodic memory encoding: a PET study. Neurosci Res 67(1):72–79
Shigemune Y, Tsukiura T, Kambara T, Kawashima R (2014) Remembering with gains and losses: effects of monetary reward and punishment on successful encoding activation of source memories. Cereb Cortex 24(5):1319–1331
Smith EE, Jonides J (1999) Storage and executive processes in the frontal lobes. Science 283(5408):1657–1661
Suzuki WA, Amaral DG (1994) Perirhinal and parahippocampal cortices of the macaque monkey: cortical afferents. J Comp Neurol 350(4):497–533
Tricomi E, Fiez JA (2012) Information content and reward processing in the human striatum during performance of a declarative memory task. Cogn Affect Behav Neurosci 12(2):361–372
Tsukiura T, Cabeza R (2008) Orbitofrontal and hippocampal contributions to memory for face-name associations: the rewarding power of a smile. Neuropsychologia 46(9):2310–2319
Tsukiura T, Cabeza R (2011) Remembering beauty: roles of orbitofrontal and hippocampal regions in successful memory encoding of attractive faces. NeuroImage 54(1):653–660
Tsukiura T, Shigemune Y, Nouchi R, Kambara T, Kawashima R (2013) Insular and hippocampal contributions to remembering people with an impression of bad personality. Soc Cogn Affect Neurosci 8(5):515–522
Ungless MA, Magill PJ, Bolam JP (2004) Uniform inhibition of dopamine neurons in the ventral tegmental area by aversive stimuli. Science 303(5666):2040–2042
Van den Bos W, Talwar A, McClure SM (2013) Neural correlates of reinforcement learning and social preferences in competitive bidding. J Neurosci 33(5):2137–2146
Van Overwalle F (2009) Social cognition and the brain: a meta-analysis. Hum Brain Mapp 30(3):829–858
Van Overwalle F, Baetens K (2009) Understanding others’ actions and goals by mirror and mentalizing systems: a meta-analysis. NeuroImage 48(3):564–584
Votinov M, Pripfl J, Windischberger C, Sailer U, Lamm C (2015) Better you lose than I do: neural networks involved in winning and losing in a real time strictly competitive game. Sci Rep 5:11017
Wang Q, Luo S, Monterosso J, Zhang J, Fang X, Dong Q, Xue G (2014) Distributed value representation in the medial prefrontal cortex during intertemporal choices. J Neurosci 34(22):7522–7530
Wicker B, Keysers C, Plailly J, Royet JP, Gallese V, Rizzolatti G (2003) Both of us disgusted in my insula: the common neural basis of seeing and feeling disgust. Neuron 40(3):655–664
Wimmer GE, Shohamy D (2012) Preference by association: how memory mechanisms in the hippocampus bias decisions. Science 338(6104):270–273
Wimmer GE, Braun EK, Daw ND, Shohamy D (2014) Episodic memory encoding interferes with reward learning and decreases striatal prediction errors. J Neurosci 34(45):14901–14912
Wittmann BC, Schott BH, Guderian S, Frey JU, Heinze HJ, Duzel E (2005) Reward-related FMRI activation of dopaminergic midbrain is associated with enhanced hippocampus-dependent long-term memory formation. Neuron 45(3):459–467
Wittmann BC, Schiltz K, Boehler CN, Duzel E (2008) Mesolimbic interaction of emotional valence and reward improves memory formation. Neuropsychologia 46(4):1000–1008
Wittmann BC, Tan GC, Lisman JE, Dolan RJ, Duzel E (2013) DAT genotype modulates striatal processing and long-term memory for items associated with reward and punishment. Neuropsychologia 51(11):2184–2193
Wolosin SM, Zeithamova D, Preston AR (2012) Reward modulation of hippocampal subfield activation during successful associative encoding and retrieval. J Cogn Neurosci 24(7):1532–1547
Wolosin SM, Zeithamova D, Preston AR (2013) Distributed hippocampal patterns that discriminate reward context are associated with enhanced associative binding. J Exp Psychol Gen 142(4):1264–1276
Wrase J, Kahnt T, Schlagenhauf F, Beck A, Cohen MX, Knutson B, Heinz A (2007) Different neural systems adjust motor behavior in response to reward and punishment. NeuroImage 36(4):1253–1262
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Japan KK
About this chapter
Cite this chapter
Shigemune, Y., Tsukiura, T. (2017). Modulatory Mechanism of Three-Layered Hierarchical Structure in Memories Associated with Rewards and Punishments. In: Tsukiura, T., Umeda, S. (eds) Memory in a Social Context. Springer, Tokyo. https://doi.org/10.1007/978-4-431-56591-8_6
Download citation
DOI: https://doi.org/10.1007/978-4-431-56591-8_6
Published:
Publisher Name: Springer, Tokyo
Print ISBN: 978-4-431-56589-5
Online ISBN: 978-4-431-56591-8
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)