Abstract
Phenomena like faster reacquisition of learned associations after extinction were initially explained via residual synaptic plasticity in the relevant neural circuits. However, this account cannot explain many recent behavioral findings. This includes phenomena like savings in extinction, reinstatement, spontaneous recovery and renewal. These phenomena point to the possibility that extinction isn’t a mere reversal of the associations formed during acquisition. It instead involves the superimposition of some separate decremental process that works to inhibit the previously learned responses. We have explored this dual-pathway account using a neurocomputational model of conditioning. In our model, associations related to acquisition and extinction are maintained side by side as a result of the interaction between general neural learning processes and the presence of lateral inhibition between neurons. The model captures relevant behavioral phenomena that prompted the hypothesis of separate acquisition and extinction pathways. It also shows how seemingly complex behavior can emerge out of relatively simple underlying neural mechanisms.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Amano, T., Unal, C.T., Pare, D.: Synaptic correlates of fear extinction in the amygdala. Nature Neuroscience 13, 1097–6256 (2010)
Bellgowan, P.S., Helmstetter, F.J.: Neural systems for the expression of hypoalgesia during nonassociative fear. Behavioral Neuroscience 110, 727–736 (1996)
Bouton, M.E.: Context and behavioral processes in extinction. Learning and Memory 11, 485–494 (2004)
Bouton, M.E., Brooks, D.C.: Time and context effects on performance in a pavlovian discrimination reversal. Journal of Experimental Psychology: Animal Behavior Processes 19(2), 165–179 (1993)
Grossberg, S., Schmajuk, N.A.: Neural dynamics of attentionally-modulated pavlonian conditioning: Conditioned reinforcement, inhibition, and opponent processing. Psychology 15, 195–240 (1987)
Maren, S.: Long-term potentiation in the amygdala: A mechanism for emotional learning and memory. Trends in Neuroscience 23, 345–346 (1999)
Medina, J.F., Garcia, K.S., Mauk, M.D.: A mechanism for savings in the cerebellum. The Journal of Neuroscience 21(11), 4081–4089 (2001)
O’Reilly, R.C., Munakata, Y.: Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain. MIT Press, Cambridge (2000)
Quirk, G.J., Garcia, R., Gonzalez-Lima, F.: Prefrontal mechanisms in extinction of conditioned fear. Biological Psychiatry 60, 337–343 (2006)
Redish, A.D., Jensen, S., Johnson, A., Kurth-Nelson, Z.: Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling. Psychological Review 114(3), 784–805 (2007)
Rescorla, R.A.: Retraining of extinguished pavlovian stimuli. Journal of Experimental Psychology: Animal Behavior Processes 27(2), 115–124 (2001)
Rescorla, R.A., Heth, C.D.: Reinstatement of fear to an extinguished conditioned stimulus. Journal of Experimental Psychology: Animal Behavior Processes 104(1), 88–96 (1975)
Rescorla, R.A., Wagner, A.R.: A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, pp. 64–99. Appleton-Century-Crofts, New York (1972)
Rose, J.K., Rankin, C.H.: Analysis of habituation in c. elegans. Learning Memory 8, 63–69 (2001)
Shabel, S.J., Janak, P.H.: Substantial similarity in amygdala neuronal activity during conditioned appetitive and aversive emotional arousal. Proceedings of the National Academy of Sciences 106, 15031–15036 (2009)
Wagner, A.R., Brandon, S.E.: A componential theory of pavlovian conditioning. In: Mowrer, R.R., Klein, S.B. (eds.) Handbook of Contemporary Learning Theories, pp. 23–64. Erlbaum, Hillsdale (2001)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gupta, A., Vig, L. (2011). A Dual Association Model for Acquisition and Extinction. In: Pirrone, R., Sorbello, F. (eds) AI*IA 2011: Artificial Intelligence Around Man and Beyond. AI*IA 2011. Lecture Notes in Computer Science(), vol 6934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23954-0_15
Download citation
DOI: https://doi.org/10.1007/978-3-642-23954-0_15
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23953-3
Online ISBN: 978-3-642-23954-0
eBook Packages: Computer ScienceComputer Science (R0)