Skip to main content

A Dual Association Model for Acquisition and Extinction

  • Conference paper
AI*IA 2011: Artificial Intelligence Around Man and Beyond (AI*IA 2011)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 6934))

Included in the following conference series:

  • 949 Accesses

Abstract

Phenomena like faster reacquisition of learned associations after extinction were initially explained via residual synaptic plasticity in the relevant neural circuits. However, this account cannot explain many recent behavioral findings. This includes phenomena like savings in extinction, reinstatement, spontaneous recovery and renewal. These phenomena point to the possibility that extinction isn’t a mere reversal of the associations formed during acquisition. It instead involves the superimposition of some separate decremental process that works to inhibit the previously learned responses. We have explored this dual-pathway account using a neurocomputational model of conditioning. In our model, associations related to acquisition and extinction are maintained side by side as a result of the interaction between general neural learning processes and the presence of lateral inhibition between neurons. The model captures relevant behavioral phenomena that prompted the hypothesis of separate acquisition and extinction pathways. It also shows how seemingly complex behavior can emerge out of relatively simple underlying neural mechanisms.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Amano, T., Unal, C.T., Pare, D.: Synaptic correlates of fear extinction in the amygdala. Nature Neuroscience 13, 1097–6256 (2010)

    Article  Google Scholar 

  2. Bellgowan, P.S., Helmstetter, F.J.: Neural systems for the expression of hypoalgesia during nonassociative fear. Behavioral Neuroscience 110, 727–736 (1996)

    Article  Google Scholar 

  3. Bouton, M.E.: Context and behavioral processes in extinction. Learning and Memory 11, 485–494 (2004)

    Article  Google Scholar 

  4. Bouton, M.E., Brooks, D.C.: Time and context effects on performance in a pavlovian discrimination reversal. Journal of Experimental Psychology: Animal Behavior Processes 19(2), 165–179 (1993)

    Google Scholar 

  5. Grossberg, S., Schmajuk, N.A.: Neural dynamics of attentionally-modulated pavlonian conditioning: Conditioned reinforcement, inhibition, and opponent processing. Psychology 15, 195–240 (1987)

    Google Scholar 

  6. Maren, S.: Long-term potentiation in the amygdala: A mechanism for emotional learning and memory. Trends in Neuroscience 23, 345–346 (1999)

    Article  Google Scholar 

  7. Medina, J.F., Garcia, K.S., Mauk, M.D.: A mechanism for savings in the cerebellum. The Journal of Neuroscience 21(11), 4081–4089 (2001)

    Google Scholar 

  8. O’Reilly, R.C., Munakata, Y.: Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain. MIT Press, Cambridge (2000)

    Google Scholar 

  9. Quirk, G.J., Garcia, R., Gonzalez-Lima, F.: Prefrontal mechanisms in extinction of conditioned fear. Biological Psychiatry 60, 337–343 (2006)

    Article  Google Scholar 

  10. Redish, A.D., Jensen, S., Johnson, A., Kurth-Nelson, Z.: Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling. Psychological Review 114(3), 784–805 (2007)

    Article  Google Scholar 

  11. Rescorla, R.A.: Retraining of extinguished pavlovian stimuli. Journal of Experimental Psychology: Animal Behavior Processes 27(2), 115–124 (2001)

    Google Scholar 

  12. Rescorla, R.A., Heth, C.D.: Reinstatement of fear to an extinguished conditioned stimulus. Journal of Experimental Psychology: Animal Behavior Processes 104(1), 88–96 (1975)

    Google Scholar 

  13. Rescorla, R.A., Wagner, A.R.: A theory of pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement. In: Classical Conditioning II: Current Research and Theory, pp. 64–99. Appleton-Century-Crofts, New York (1972)

    Google Scholar 

  14. Rose, J.K., Rankin, C.H.: Analysis of habituation in c. elegans. Learning Memory 8, 63–69 (2001)

    Article  Google Scholar 

  15. Shabel, S.J., Janak, P.H.: Substantial similarity in amygdala neuronal activity during conditioned appetitive and aversive emotional arousal. Proceedings of the National Academy of Sciences 106, 15031–15036 (2009)

    Article  Google Scholar 

  16. Wagner, A.R., Brandon, S.E.: A componential theory of pavlovian conditioning. In: Mowrer, R.R., Klein, S.B. (eds.) Handbook of Contemporary Learning Theories, pp. 23–64. Erlbaum, Hillsdale (2001)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Gupta, A., Vig, L. (2011). A Dual Association Model for Acquisition and Extinction. In: Pirrone, R., Sorbello, F. (eds) AI*IA 2011: Artificial Intelligence Around Man and Beyond. AI*IA 2011. Lecture Notes in Computer Science(), vol 6934. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23954-0_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-23954-0_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-23953-3

  • Online ISBN: 978-3-642-23954-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics