Human appetitive Pavlovian-to-instrumental transfer: a goal-directed account
Pavlovian-to-instrumental transfer (PIT) tasks assess the impact of environmental stimuli on instrumental actions. Since their initial translation from animal to human experiments, PIT tasks have provided insight into the mechanisms that underlie reward-based behaviour. This review first examines the main types of PIT tasks used in humans. We then seek to contribute to the current debate as to whether human PIT effects reflect a controlled, goal-directed process, or a more automatic, non-goal-directed mechanism. We argue that the data favour a goal-directed process. The extent to which the major theories of PIT can account for these data is then explored. We discuss a number of associative accounts of PIT as well as dual-process versions of these theories. Ultimately, however, we favour a propositional account, in which human PIT effects are suggested to be driven by both perceived outcome availability and outcome value. In the final section of the review, we present the potential objections to the propositional approach that we anticipate from advocates of associative link theories and our response to them. We also identify areas for future research.
This research was supported by an Australian Government Research Training Program Scholarship.
- Allman, M. J., DeLeon, I. G., Cataldo, M. F., Holland, P. C., & Johnson, A. W. (2010). Learning processes affecting human decision making: An assessment of reinforcer-selective Pavlovian-to-instrumental transfer following reinforcer devaluation. Journal of Experimental Psychology: Animal Behavior Processes,36, 402–408. https://doi.org/10.1037/a0017876.CrossRefPubMedGoogle Scholar
- Corbit, L. H., & Balleine, B. W. (2011). The general and outcome-specific forms of Pavlovian-instrumental transfer are differentially mediated by the nucleus accumbens core and shell. Journal of Neuroscience,31, 11786–11794. https://doi.org/10.1523/JNEUROSCI.2711-11.2011.CrossRefPubMedGoogle Scholar
- Corbit, L. H., Janak, P. H., & Balleine, B. W. (2007). General and outcome-specific forms of Pavlovian-instrumental transfer: the effect of shifts in motivational state and inactivation of the ventral tegmental area. European Journal of Neuroscience,26, 3141–3149. https://doi.org/10.1111/j.1460-9568.2007.05934.x.CrossRefPubMedGoogle Scholar
- Corbit, L. H., Muir, J. L., & Balleine, B. W. (2001). The role of the nucleus accumbens in instrumental conditioning: Evidence of a functional dissociation between accumbens core and shell. The Journal of Neuroscience : The Official Journal of the Society for Neuroscience, 21, 3251–60. http://www.jneurosci.org/content/21/9/3251.
- de Wit, S., & Dickinson, A. (2015). Ideomotor mechanisms of goal-directed behavior. In T. S. Braver (Ed.), Motivation and cognitive control (pp. 135–154). Routledge.Google Scholar
- Everitt, B. J., & Robbins, T. W. (2016). Drug addiction: Updating actions to habits to compulsions 10 years on. Annual Review of Psychology,63, 23–50. https://doi.org/10.1146/annurev-psych-122414-033457.CrossRefGoogle Scholar
- Garbusow, M., Schad, D. J., Sebold, M., Friedel, E., Bernhardt, N., Koch, S. P., & Heinz, A. (2016). Pavlovian-to-instrumental transfer effects in the nucleus accumbens relate to relapse in alcohol dependence. Addiction Biology,21, 719–731. https://doi.org/10.1111/adb.12243.CrossRefPubMedGoogle Scholar
- Heyes, C., & Dickinson, A. (1990). The intentionality of animal action. Mind & Language,5, 87–103. https://doi.org/10.1111/j.1468-0017.1990.tb00154.x.CrossRefGoogle Scholar
- Hogarth, L., Balleine, B. W., Corbit, L. H., & Killcross, S. (2013). Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Annals of the New York Academy of Sciences,1282, 12–24. https://doi.org/10.1111/j.1749-6632.2012.06768.x.CrossRefPubMedGoogle Scholar
- Hogarth, L., Lam-Cassettari, C., Pacitti, H., Currah, T., Mahlberg, J., Hartley, L., et al. (2018). Intact goal-directed control in treatment-seekingdrug users indexed by outcome-devaluation and Pavlovian to instrumental transfer: critique of habit theory. European Journal of Neuroscience, 50(3), 2513–2525. https://doi.org/10.1111/ejn.13961.CrossRefPubMedGoogle Scholar
- Hogarth, L., Retzler, C., Munafò, M. R., Tran, D. M. D., Troisi, J. R., Rose, A. K., & Field, M. (2014). Extinction of cue-evoked drug-seeking relies on degrading hierarchical instrumental expectancies. Behaviour Research and Therapy,59, 61–70. https://doi.org/10.1016/j.brat.2014.06.001.CrossRefPubMedPubMedCentralGoogle Scholar
- Hommel, B. (2013). Ideomotor action control: on the perceptual grounding of voluntary actions and agents. In W. Prinz, M. Beisert, & A. Herwig (Eds.), Action Science: Foundations of an Emerging Discipline (pp. 113–136). Cambridge, MA: The MIT Press.Google Scholar
- Huys, Q. J. M., Cools, R., Gölzer, M., Friedel, E., Heinz, A., Dolan, R. J., & Dayan, P. (2011). Disentangling the roles of approach, activation and valence in instrumental and Pavlovian responding. PLoS Computational Biology,7, e1002028. https://doi.org/10.1371/journal.pcbi.1002028.CrossRefPubMedPubMedCentralGoogle Scholar
- Lovibond, P. F. (1981). Appetitive Pavlovian-instrumental interactions: effects of inter-stimulus interval and baseline reinforcement conditions. The Quarterly Journal of Experimental Psychology B, Comparative and Physiological Psychology,33, 257–269. https://doi.org/10.1080/14640748108400811.CrossRefPubMedGoogle Scholar
- McLaren, I. P. L., Forrest, C. L. D., McLaren, R. P., Jones, F. W., Aitken, M. R. F., & Mackintosh, N. J. (2014). Associations and propositions: The case for a dual-process account of learning in humans. Neurobiology of Learning and Memory,108, 185–195. https://doi.org/10.1016/j.nlm.2013.09.014.CrossRefPubMedGoogle Scholar
- Prévost, C., Liljeholm, M., Tyszka, J. M., & O’Doherty, J. P. (2012). Neural correlates of specific and general Pavlovian-to-instrumental transfer within human amygdalar subregions: A high-resolution fMRI study. The Journal of Neuroscience,32(24), 8383–8390. https://doi.org/10.1523/JNEUROSCI.6237-11.2012.CrossRefPubMedPubMedCentralGoogle Scholar
- Seabrooke, T., Le Pelley, M. E., Porter, A., & Mitchell, C. J. (2018a). Extinguishing cue-controlled reward choice: Effects of Pavlovian extinction on outcome-selective Pavlovian-instrumental transfer. Journal of Experimental Psychology: Animal Learning and Cognition,44, 280–292. https://doi.org/10.1037/xan0000176.CrossRefGoogle Scholar
- Trapold, M. A., & Overmier, J. B. (1972). The second learning process in instrumental conditioning. In A. A. Black & W. F. Prokasy (Eds.), ClassicalConditioning II: Current Theory and Research (1st ed., pp. 427–452). New York: Appelton-Century-Crofts.Google Scholar
- van Steenbergen, H., Watson, P., Wiers, R. W., Hommel, B., & de Wit, S. (2017). Dissociable corticostriatal circuits underlie goal-directed versus cue-elicited habitual food seeking after satiation: Evidence from a multimodal MRI study. European Journal of Neuroscience,46, 1815–1827. https://doi.org/10.1111/ejn.13586.CrossRefPubMedGoogle Scholar