Skip to main content
SpringerLink
Log in

A Hierarchical Instrumental Decision Theory of Nicotine Dependence

  • Chapter
  • First Online:
The Neurobiology and Genetics of Nicotine and Tobacco

Part of the book series: Current Topics in Behavioral Neurosciences ((CTBN,volume 23))

Abstract

It is important to characterize the learning processes governing tobacco-seeking in order to understand how best to treat this behavior. Most drug learning theories have adopted a Pavlovian framework wherein the conditioned response is the main motivational process. We favor instead a hierarchical instrumental decision account, wherein expectations about the instrumental contingency between voluntary tobacco-seeking and the receipt of nicotine reward determines the probability of executing this behavior. To support this view, we review titration and nicotine discrimination research showing that internal signals for deprivation/satiation modulate expectations about the current incentive value of smoking, thereby modulating the propensity of this behavior. We also review research on cue-reactivity which has shown that external smoking cues modulate expectations about the probability of the tobacco-seeking response being effective, thereby modulating the propensity of this behavior. Economic decision theory is then considered to elucidate how expectations about the value and probability of response-nicotine contingency are integrated to form an overall utility estimate for that option for comparison with qualitatively different, nonsubstitute reinforcers, to determine response selection. As an applied test for this hierarchical instrumental decision framework, we consider how well it accounts for individual liability to smoking uptake and perseveration, pharmacotherapy, cue-extinction therapies, and plain packaging. We conclude that the hierarchical instrumental account is successful in reconciling this broad range of phenomenon precisely because it accepts that multiple diverse sources of internal and external information must be integrated to shape the decision to smoke.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ahmed SH (2010) Validation crisis in animal models of drug addiction: beyond non-disordered drug use toward drug addiction. Neurosci Biobehav Rev 35:172–184

    CAS  PubMed  Google Scholar 

  • Ahmed SH, Koob GF (2005) Transition to drug addiction: a negative reinforcement model based on an allostatic decrease in reward function. Psychopharmacology 180:473–490

    CAS  PubMed  Google Scholar 

  • Ahmed SH, Lenoir M, Guillem K (2013) Neurobiology of addiction versus drug use driven by lack of choice. Curr Opin Neurobiol 23:581–587

    CAS  PubMed  Google Scholar 

  • Anthony JC, Warner LA, Kessler RC (1994) Comparative epidemiology of dependence on tobacco, alcohol, controlled substances, and inhalants: basic findings from the national comorbidity survey. Exp Clin Psychopharmacol 2:244–268

    Google Scholar 

  • Baker TB, Piper ME, McCarthy DE, Majeskie MR, Fiore MC (2004) Addiction motivation reformulated: an affective processing model of negative reinforcement. Psychol Rev 111:33–51

    PubMed  Google Scholar 

  • Balleine BW, Ostlund SB (2007) Still at the choice-point: action selection and initiation in instrumental conditioning. In: Balleine BW, Doya K, Doherty JO, Sakagami M (eds) Reward and decision making in corticobasal ganglia networks (Annals of the New York Academy of Sciences.). Blackwell Publishing, Malden, pp 147–171

    Google Scholar 

  • Banks ML, Negus SS (2012) Preclinical determinants of drug choice under concurrent schedules of drug self-administration. Adv Pharmacol Sci 2012:281768

    PubMed Central  PubMed  Google Scholar 

  • Behm F, Rose J (1994) Reducing craving for cigarettes while decreasing smoke intake using capsaicin-enhanced low tar cigarette. Exp Clin Psychopharmacol 2:143–153

    Google Scholar 

  • Belin D, Mar AC, Dalley JW, Robbins TW, Everitt BJ (2008) High impulsivity predicts the switch to compulsive cocaine-taking. Science 320:1352–1355

    CAS  PubMed Central  PubMed  Google Scholar 

  • Benowitz NL, Jacob P (1990) Intravenous nicotine replacement suppresses nicotine intake from cigarette smoking. J Pharmacol Exp Ther 254:1000–1005

    CAS  PubMed  Google Scholar 

  • Benowitz N, Porchet H, Jacob P (1990) Pharmacokinetics, metablolism, and pharmacodynamics of nicotine. In: Wonnacott S, Russell M, Stolerman I (eds) Nicotine psychopharmacology molecular, cellular and behavioral aspects. Oxford University Press, New York, pp 112–157

    Google Scholar 

  • Bickel WK, Madden GJ (1999) A comparison of measures of relative reinforcing efficacy and behavioral economics: cigarettes and money in smokers. Behav Pharmacol 10:627–637

    CAS  PubMed  Google Scholar 

  • Bouton ME, Doyle-Burr C, Vurbic D (2012) Asymmetrical generalization of conditioning and extinction from compound to element and element to compound. J Exp Psychol Anim Behav Process 38:381–393

    PubMed Central  PubMed  Google Scholar 

  • Bradfield LA, Balleine BW (2013) Hierarchical and binary associations compete for behavioral control during instrumental biconditional discrimination. J Exp Psychol Anim Behav Process 39:2–13

    PubMed  Google Scholar 

  • Brandon T, Drobes D, Unrod M, Heckman B, Oliver J, Roetzheim R, Karver S, Small B (2011) Varenicline effects on craving, cue reactivity, and smoking reward. Psychopharmacology 218:1–13

    Google Scholar 

  • Brody AL, Mandelkern MA, Jarvik ME, Lee GS, Smith EC, Huang JC, Bota RG, Bartzokis G, London ED (2004) Differences between smokers and nonsmokers in regional gray matter volumes and densities. Biol Psychiatry 55:77–84

    PubMed  Google Scholar 

  • Carter BL, Tiffany ST (2001) The cue-availability paradigm: the effects of cigarette availability on cue reactivity in smokers. Exp Clin Psychopharmacol 9:183–190

    CAS  PubMed  Google Scholar 

  • Chait L, Griffiths R (1982) Differential control of puff duration and interpuff interval in cigarette smokers. Pharmacol Biochem Behav 17:155–158

    CAS  PubMed  Google Scholar 

  • Chase HW, MacKillop J, Hogarth L (2013) Isolating behavioral economic indices of demand in relation to nicotine dependence. Psychopharmacology 226:371–380

    CAS  PubMed  Google Scholar 

  • Chassin L, Presson CC, Pitts SC, Sherman SJ (2000) The natural history of cigarette smoking from adolescence to adulthood in a midwestern community sample: multiple trajectories and their psychosocial correlates. Health Psychol 19:223–231

    CAS  PubMed  Google Scholar 

  • Collins BN, Brandon TH (2002) Effects of extinction context and retrieval cues on alcohol cue reactivity among nonalcoholic drinkers. J Consult Clin Psychol 70:390–397

    PubMed  Google Scholar 

  • Colwill RM, Rescorla RA (1990) Evidence for the hierarchical structure of instrumental learning. Anim Learn Behav 18:71–82

    Google Scholar 

  • Conklin CA, Tiffany ST (2002) Applying extinction research and theory to cue-exposure addiction treatments. Addiction 97:155–167

    PubMed  Google Scholar 

  • Corbit LH, Nie H, Janak PH (2012) Habitual alcohol seeking: time course and the contribution of subregions of the dorsal striatum. Biol Psychiatry 72:389–395

    PubMed Central  PubMed  Google Scholar 

  • Corrigall W, Coen K (1989a) Nicotine maintains robust self-administration in rats on a limited-access schedule. Psychopharmacology 99:473–478

    CAS  PubMed  Google Scholar 

  • Corrigall WA, Coen KM (1989b) Nicotine maintains robust self-administration in rats on a limited-access schedule. Psychopharmacology 99:473–478

    CAS  PubMed  Google Scholar 

  • Davidson TL (1993) The nature and function of interoceptive signal to feed: towards integration of physiological and learning perspectives. Psychol Rev 100:640–657

    CAS  PubMed  Google Scholar 

  • Davidson TL, Aparicio J, Rescorla R (1988) Transfer between Pavlovian facilitators and instrumental discriminative stimuli. Anim Learn Behav 16:285–291

    Google Scholar 

  • de Wit S, Dickinson A (2009) Associative theories of goal-directed behavior: a case for animal–human translational models. Psychol Res 73:463–476

    PubMed Central  PubMed  Google Scholar 

  • de Wit S, Ridderinkhof KR, Fletcher P, Dickinson A (2012) Resolution of outcome-induced response conflict by humans after extended training. Psychol Res 47:1–14

    Google Scholar 

  • Delamater AR (1996) Effects of several extinction treatments upon the integrity of Pavlovian stimulus-outcome associations. Learn Behav 24:437–449

    Google Scholar 

  • Delfino RJ, Jamner LD, Whalen CK (2001) Temporal analysis of the relationship of smoking behavior and urges to mood states in men versus women. Nicotine Tob Res 3:235–248

    CAS  PubMed  Google Scholar 

  • Devito EE, Herman AI, Waters AJ, Valentine GW, Sofuoglu M (2014) Subjective, physiological, and cognitive responses to intravenous nicotine: effects of sex and menstrual cycle phase. Neuropsychopharmacology 39:1431–1440

    CAS  PubMed  Google Scholar 

  • Di Ciano P, Everitt BJ (2003) Differential control over drug-seeking behavior by drug-associated conditioned reinforcers and discriminative stimuli predictive of drug availability. Behav Neurosci 117:952–960

    PubMed  Google Scholar 

  • Dickinson A, Balleine BW (2002) The role of learning in the operation of motivational systems. In: Gallistel CR (ed) Stevens’ handbook of experimental psychology, learning, motivation and emotion, vol 3, 3rd edn. Wiley, New York, pp 497–533

    Google Scholar 

  • Dickinson A, Balleine B (2010) The cognitive/motivational interface. In: Kringelbach ML, Berridge KC (eds) Pleasures of the brain. The neural basis of taste, smell and other rewards. Oxford University Press, Oxford, pp 74–84

    Google Scholar 

  • Dickinson A, Wood N, Smith JW (2002) Alcohol seeking by rats: action or habit? Q J Exp Psychol B Comp Physiol Psychol 55:331–348

    Google Scholar 

  • Dols M, Willems B, van den Hout M, Bittoun R (2000) Smokers can learn to influence their urge to smoke. Addict Behav 25:103–108

    CAS  PubMed  Google Scholar 

  • Dols M, Hout Mvd, Kindt M, Willems B (2002) The urge to smoke depends on the expectation of smoking. Addiction 97:87–93

    CAS  PubMed  Google Scholar 

  • Donatelle RJ, Prows SL, Champeau D, Hudson D (2000) Randomised controlled trial using social support and financial incentives for high risk pregnant smokers: significant other supporter (SOS) program. Tob Control 9:iii67–iii69

    Google Scholar 

  • Donny E, Caggiula A, Knopf S, Brown C (1995) Nicotine self-administration in rats. Psychopharmacology 122:390–392

    CAS  PubMed  Google Scholar 

  • Doran N, Spring B, McChargue D, Pergadia M, Richmond M (2004) Impulsivity and smoking relapse. Nicotine Tob Res 6:641–647

    PubMed  Google Scholar 

  • Drobes DJ, Tiffany ST (1997) Induction of smoking urge through imaginal and in vivo procedures: physiological and self-report manifestations. J Abnorm Psychol 106:15–25

    CAS  PubMed  Google Scholar 

  • Droungas A, Ehrman R, Childress A, O’Brien C (1995) Effects of smoking cues and cigarette availability on craving and smoking behavior. Addict Behav 20:657–673

    CAS  PubMed  Google Scholar 

  • Dwyer DM, Dunn MJ, Rhodes SEV, Killcross AS (2010) Lesions of the prelimbic prefrontal cortex prevent response conflict produced by action–outcome associations. Q J Exp Psychol 63:417–424

    Google Scholar 

  • Eder A, Müsseler J, Hommel B (2012) The structure of affective action representations: temporal binding of affective response codes. Psychol Res 76:111–118

    PubMed  Google Scholar 

  • Eissenberg T (2004) Measuring the emergence of tobacco dependence: the contribution of negative reinforcement models. Addiction 99:5–29

    PubMed  Google Scholar 

  • Elash CA, Burton SM, Tiffany ST (1994) The effect of imagery-induced urges on smoking behavior. Paper presented at the annual meeting of the Midwestern Psychological Association, Chicago

    Google Scholar 

  • Epstein LH, Bulik CM, Perkins KA, Caggiulla AR, Rodefer J (1991) Behavioral economics analysis of smoking: money and food as alternatives. Pharmacol Biochem Behav 38:715–721

    CAS  PubMed  Google Scholar 

  • Everitt BJ, Robbins TW (2013) From the ventral to the dorsal striatum: devolving views of their roles in drug addiction. Neurosci Biobehav Rev 37:1946–1954

    PubMed  Google Scholar 

  • Ferguson SG, Shiffman S (2009) The relevance and treatment of cue-induced cravings in tobacco dependence. J Subst Abuse Treat 36:235–243

    PubMed  Google Scholar 

  • Ferguson SG, Shiffman S, Gwaltney CJ (2006) Does reducing withdrawal severity mediate nicotine patch efficacy? A randomized clinical trial. J Consult Clin Psychol 74:1153–1161

    PubMed  Google Scholar 

  • Feyerabend C, Ings R, Russell M (1985) Nicotine pharmacokinetics and its application to intake from smoking. Br J Pharmacol 19:239–247

    CAS  Google Scholar 

  • Franklin T, Wang Z, Suh JJ, Hazan R, Cruz J, Li Y, Goldman M, Detre JA, O’Brien CP, Childress AR (2011) Effects of varenicline on smoking cue-triggered neural and craving responses. Arch Gen Psychiatry 68:516–526

    CAS  PubMed Central  PubMed  Google Scholar 

  • Gámez AM, Rosas JM (2005) Transfer of stimulus control across instrumental responses is attenuated by extinction in human instrumental conditioning. Int J Psychol Psychol Ther 5:207–222

    Google Scholar 

  • Gerhardstein L, Wang A, Burki N (1993) Nicotine is responsible for airway irritation evoked by cigarette smoking inhalation in men. J Appl Physiol 75:1955–1961

    PubMed  Google Scholar 

  • Glad W, Adesso VJ (1976) The relative importance of socially induced tension and behavioral contagion for smoking behavior. J Abnorm Psychol 85:119–121

    Google Scholar 

  • Grindley GC (1932) The formation of a simple habit in guinea-pigs. Br J Psychol 23:127–147

    Google Scholar 

  • Hammond LJ (1980) The effect of contingency upon the appetitive conditioning of free-operant behavior. J Exp Anal Behav 34:297–304

    CAS  PubMed Central  PubMed  Google Scholar 

  • Hanson H, Ivester C, Morton B (1979) Nicotine self-administration in rats. In: Krasnegor N (ed) Cigarette smoking as a dependence process. NIDA Research Monograph 23, USD-HEW, Rockville

    Google Scholar 

  • Harris CM, Emmett-Oglesby MW, Robinson NG, Lal H (1986) Withdrawal from chronic nicotine substitutes partially for the interoceptive stimulus produced by pentylenetetrazol (PTZ). Psychopharmacology 90:85–89

    CAS  PubMed  Google Scholar 

  • Harris JA, Andrew BJ, Kwok DWS (2013) Magazine approach during a signal for food depends on Pavlovian, not instrumental, conditioning. J Exp Psychol Anim Behav Process 39:107–116

    PubMed  Google Scholar 

  • Harvey DM, Yasar S, Heishman SJ, Panlilio LV, Henningfield JE, Goldberg SR (2004) Nicotine serves as an effective reinforcer of intravenous drug-taking behavior in human cigarette smokers. Psychopharmacology 175:134–142

    CAS  PubMed  Google Scholar 

  • Hasenfratz M, Baldinger B, Battig K (1993) Nicotine or tar titration in cigarette smoking behavior. Psychopharmacology 112:253–258

    CAS  PubMed  Google Scholar 

  • Herman CP (1974) External and internal cues as determinants of the smoking behavior of light and heavy smokers. J Pers Soc Psychol 30:664–672

    Google Scholar 

  • Heyes C, Dickinson A (1990) The intentionality of animal action. Mind Lang 5:87–104

    Google Scholar 

  • Heyman GM (2013) Addiction and choice: theory and new data. Front Psychiatry 4:31

    PubMed Central  PubMed  Google Scholar 

  • Hitsman B, Hogarth L, Tseng L-J, Teige JC, Shadel WG, DiBenedetti DB, Danto S, Lee TC, Price LH, Niaura R (2013) Dissociable effect of acute varenicline on tonic versus cue-provoked craving in non-treatment-motivated heavy smokers. Drug Alcohol Depend 130:135–141

    CAS  PubMed  Google Scholar 

  • Hogarth L (2011) The role of impulsivity in the aetiology of drug dependence: reward sensitivity versus automaticity. Psychopharmacology 215:567–580

    CAS  PubMed Central  PubMed  Google Scholar 

  • Hogarth L (2012) Goal-directed and transfer-cue-elicited drug-seeking are dissociated by pharmacotherapy: evidence for independent additive controllers. J Exp Psychol Anim Behav Process 38:266–278

    PubMed  Google Scholar 

  • Hogarth L, Chase HW (2011) Parallel goal-directed and habitual control of human drug-seeking: implications for dependence vulnerability. J Exp Psychol Anim Behav Process 37:261–276

    PubMed  Google Scholar 

  • Hogarth L, Chase HW (2012) Evaluating psychological markers for human nicotine dependence: tobacco choice, extinction, and Pavlovian-to-instrumental transfer. Exp Clin Psychopharmacol 20:213–224

    PubMed  Google Scholar 

  • Hogarth L, Dickinson A, Wright A, Kouvaraki M, Duka T (2007) The role of drug expectancy in the control of human drug seeking. J Exp Psychol Anim Behav Process 33:484–496

    PubMed  Google Scholar 

  • Hogarth L, Dickinson A, Janowski M, Nikitina A, Duka T (2008) The role of attentional bias in mediating human drug seeking behavior. Psychopharmacology 201:29–41

    CAS  PubMed  Google Scholar 

  • Hogarth L, Dickinson A, Duka T (2010) The associative basis of cue elicited drug taking in humans. Psychopharmacology 208:337–351

    CAS  PubMed  Google Scholar 

  • Hogarth L, Attwood AS, Bate HA, Munafò MR (2012a) Acute alcohol impairs human goal-directed action. Biol Psychol 90:154–160

    Google Scholar 

  • Hogarth L, Chase HW, Baess K (2012b) Impaired goal-directed behavioral control in human impulsivity. Q J Exp Psychol 65:305–316

    Google Scholar 

  • Hogarth L, Balleine BW, Corbit LH, Killcross S (2013a) Associative learning mechanisms underpinning the transition from recreational drug use to addiction. Ann N Y Acad Sci 1282:12–24

    Google Scholar 

  • Hogarth L, Field M, Rose AK (2013b) Phasic transition from goal-directed to habitual control over drug-seeking produced by conflicting reinforcer expectancy. Addict Biol 18:88–97

    Google Scholar 

  • Hogarth L, Retzler C, Munafò MR, Tran DMD, Troisi JRI, Rose A, Jones A, Field M (2014) Extinction of cue-evoked drug-seeking relies on targeting hierarchical instrumental knowledge. Behav Res Ther 59:61–70

    PubMed Central  PubMed  Google Scholar 

  • Hogarth L, Maynard OM, Munafò MR (2014) Plain cigarette packs do not exert pavlovian to instrumental transfer of control over tobacco-seeking. Addiction

    Google Scholar 

  • Hommel B (1993) Inverting the Simon effect by intention. Psychol Res 55:270–279

    Google Scholar 

  • Hutcheson DM, Everitt BJ, Robbins TW, Dickinson A (2001) The role of withdrawal in heroin addiction: enhances reward or promotes avoidance? Nat Neurosci 4:943–947

    CAS  PubMed  Google Scholar 

  • Jarvik ME, Caskey NH, Rose JE, Herskovic JE, Sadeghpour M (1989) Anxiolytic effects of smoking associated with four stressors. Addict Behav 14:379–386

    CAS  PubMed  Google Scholar 

  • Jimenez-Gomez C, Shahan TA (2008) Matching law analysis of rats’ alcohol self-administration in a free-operant choice procedure. Behav Pharmacol 19:353–356

    PubMed  Google Scholar 

  • Johnson MW, Bickel WK (2003) The behavioral economics of cigarette smoking: the concurrent presence of a substitute and an independent reinforcer. Behav Pharmacol 14:137–144

    CAS  PubMed  Google Scholar 

  • Kennerley SW, Walton ME (2011) Decision making and reward in frontal cortex: complementary evidence from neurophysiological and neuropsychological studies. Behav Neurosci 125:297–317

    PubMed Central  PubMed  Google Scholar 

  • Killen JD, Fortmann SP (1997) Craving is associated with smoking relapse: findings from three prospective studies. Exp Clin Psychopharmacol 5:137–142

    CAS  PubMed  Google Scholar 

  • Koch I, Kunde W (2002) Verbal response-effect compatibility. Mem Cogn 30:1297–1303

    Google Scholar 

  • Kunde W (2001) Response-effect compatibility in manual choice reaction tasks. J Exp Psychol Hum Percept Perform 27:387–394

    CAS  PubMed  Google Scholar 

  • Litvin EB, Brandon TH (2010) Testing the influence of external and internal cues on smoking motivation using a community sample. Exp Clin Psyhopharmacol 18:61–70

    Google Scholar 

  • Liu X, Jernigan C (2012) Effects of caffeine on persistence and reinstatement of nicotine-seeking behavior in rats: interaction with nicotine-associated cues. Psychopharmacology 220:541–550

    CAS  PubMed Central  PubMed  Google Scholar 

  • Lu CH, Proctor RW (1995) The influence of irrelevant location information on performance: a review of the Simon and spatial Stroop effects. Psychon Bull Rev 2:174–207

    CAS  PubMed  Google Scholar 

  • MacKillop J, O’Hagen S, Lisman SA, Murphy JG, Ray LA, Tidey JW, McGeary JE, Monti PM (2010) Behavioral economic analysis of cue-elicited craving for alcohol. Addiction 105:1599–1607

    Google Scholar 

  • MacKillop J, Few LR, Murphy JG, Wier LM, Acker J, Murphy C, Stojek M, Carrigan M, Chaloupka F (2012) High-resolution behavioral economic analysis of cigarette demand to inform tax policy. Addiction 107:2191–2200

    Google Scholar 

  • Manzardo AM, Stein L, Belluzzi JD (2002) Rats prefer cocaine over nicotine in a two-lever self-administration choice test. Brain Res 924:10–19

    CAS  PubMed  Google Scholar 

  • Marissen MAE, Franken IHA, Waters AJ, Blanken P, van den Brink W, Hendriks VM (2006) Attentional bias predicts heroin relapse following treatment. Addiction 101:1306–1312

    PubMed  Google Scholar 

  • Maude-Griffin PM, Tiffany ST (1996) Production of smoking urges through imagery: the impact of affect and smoking abstinence. Exp Clin Psychopharmacol 4:198–208

    Google Scholar 

  • McCarthy DE, Piasecki TM, Lawrence DL, Jorenby DE, Shiffman S, Baker TB (2008) Psychological mediators of bupropion sustained-release treatment for smoking cessation. Addiction 103:1521–1533

    PubMed Central  PubMed  Google Scholar 

  • Meeter M, Shohamy D, Myers CE (2009) Acquired equivalence changes stimulus representations. J Exp Anal Behav 91:127–141

    CAS  PubMed Central  PubMed  Google Scholar 

  • Mitchell CJ, De Houwer J, Lovibond PF (2009) The propositional nature of human associative learning. Behav Brain Sci 32:183–198

    PubMed  Google Scholar 

  • Moeller SJ, Beebe-Wang N, Woicik PA, Konova AB, Maloney T, Goldstein RZ (2013) Choice to view cocaine images predicts concurrent and prospective drug use in cocaine addiction. Drug Alcohol Depend 130:178–185

    PubMed Central  PubMed  Google Scholar 

  • Mucha RF, Pauli P, Angrilli A (1998) Conditioned responses elicited by experimentally produced cues for smoking. Can J Physiol Pharmacol 76:259–268

    CAS  PubMed  Google Scholar 

  • Nelson AJD, Killcross S (2013) Accelerated habit formation following amphetamine exposure is reversed by D1, but enhanced by D2, receptor antagonists. Front Neurosci 7:76

    Google Scholar 

  • Nemeth-Coslett R, Griffiths R (1984a) Determinants of puff duration in cigarette smokers: I. Pharmacol Biochem Behav 20:965–971

    CAS  PubMed  Google Scholar 

  • Nemeth-Coslett R, Griffiths R (1984b) Determinants of puff duration in cigarette smokers: II. Pharmacol Biochem Behav 21:903–912

    CAS  PubMed  Google Scholar 

  • Niaura RS, Abrams DB, Pedraza M, Monti P, Rosenhow DJ (1992) Smokers reactions to interpersonal interactions and presentation of smoking cues. Addict Behav 17:557–566

    CAS  PubMed  Google Scholar 

  • Nil R, Battig K (1989) Separate effects of cigarette smoke yield and smoke taste on smoking behavior. Psychopharmacology 99:54–59

    CAS  PubMed  Google Scholar 

  • O’Connell K, Martin E (1987) Highly tempting situations associated with abstinance, temporary lapse, and relapse among participants in smoking cessation program. J Consult Clin Psychol 55:367–371

    PubMed  Google Scholar 

  • Ostlund SB, Balleine BW (2008) The disunity of Pavlovian and instrumental values. Behav Brain Sci 31:456

    Google Scholar 

  • Overmier JB, Bull JA, Trapold MA (1971) Discriminative cue properties of different fears and their role in response selection in dogs. J Comp Physiol Psychol 76:478–482

    CAS  PubMed  Google Scholar 

  • Palmatier MI, Bevins RA (2008) Occasion setting by drug states: functional equivalence following similar training history. Behav Brain Res 195:260–270

    PubMed Central  PubMed  Google Scholar 

  • Panlilio LV, Schindler CW, Weiss SJ (1996) Cocaine self-administration increased by compounding discriminative stimuli. Psychopharmacology 125:202–208.

    Google Scholar 

  • Patterson F, Jepson C, Loughead J, Perkins K, Strasser AA, Siegel S, Frey J, Gur R, Lerman C (2010) Working memory deficits predict short-term smoking resumption following brief abstinence. Drug Alcohol Depend 106:61–64

    PubMed Central  PubMed  Google Scholar 

  • Payne T, Etscheidt M, Corrigan S (1990) Conditioning arbitrary stimuli to cigarette smoke intake: a preliminary study. J Subst Abuse 2:113–119

    CAS  PubMed  Google Scholar 

  • Payne TJ, Schare ML, Levis DJ, Colletti G (1991) Exposure to smoking-relevant cues: effects on desire to smoke and topographical components of smoking behavior. Addict Behav 16:467–479

    CAS  PubMed  Google Scholar 

  • Perkins KA, Grobe JE, Stiller RL, Fonte C, Goettler JE (1992) Nasal spray nicotine replacement suppresses cigarette smoking desire and behavior. Clin Pharmacol Ther 52:627–634

    CAS  PubMed  Google Scholar 

  • Perkins KA, Epstein LH, Grobe J, Fonte C (1994) Tobacco abstinence, smoking cues, and the reinforcing value of smoking. Pharmacol Biochem Behav 47:107–112

    CAS  PubMed  Google Scholar 

  • Perkins KA, Grobe J, Fonte C (1997a) Influence of acute smoking exposure on the subsequent reinforcing value of smoking. Exp Clin Psychopharmacol 5:277–285

    Google Scholar 

  • Perkins KA, Sanders M, D’Amico D, Wilson A (1997b) Nicotine discrimination and self-administration in humans as a function of smoking status. Psychopharmacology 131:361–370

    Google Scholar 

  • Perkins KA, Sanders M, Fonte C, Wilson AS, White W, Stiller R, McNamara D (1999) Effects of central and peripheral nicotinic blockade on human nicotine discrimination. Psychopharmacology 142:158–164

    CAS  PubMed  Google Scholar 

  • Perkins KA, Broge M, Gerlach D, Sanders M, Grobe JE, Cherry C, Wilson AS (2002) Acute nicotine reinforcement, but not chronic tolerance, predicts withdrawal and relapse after quitting smoking. Health Psychol 21:332–339

    PubMed  Google Scholar 

  • Perkins KA, Giedgowd GE, Karelitz JL, Conklin CA, Lerman C (2012) Smoking in response to negative mood in men versus women as a function of distress tolerance. Nicotine Tob Res 14:1418–1425

    PubMed Central  PubMed  Google Scholar 

  • Piper ME, Federmen EB, McCarthy DE, Bolt DM, Smith SS, Fiore MC, Baker TB (2008) Using mediational models to explore the nature of tobacco motivation and tobacco treatment effects. J Abnorm Psychol 117:94–105

    PubMed  Google Scholar 

  • Pittenger ST, Bevins RA (2013) Interoceptive conditioning with a nicotine stimulus is susceptible to reinforcer devaluation. Behav Neurosci 127:465–473

    PubMed Central  PubMed  Google Scholar 

  • Price KL, Saladin ME, Baker NL, Tolliver BK, DeSantis SM, McRae-Clark AL, Brady KT (2010) Extinction of drug cue reactivity in methamphetamine-dependent individuals. Behav Res Ther 48:860–865

    PubMed Central  PubMed  Google Scholar 

  • Quick SL, Pyszczynski AD, Colston KA, Shahan TA (2011) Loss of alternative non-drug reinforcement induces relapse of cocaine-seeking in rats: role of dopamine D1 receptors. Neuropsychopharmacology 36:1015–1020

    CAS  PubMed Central  PubMed  Google Scholar 

  • Rachlin H (1997) Four teleological theories of addiction. Psychon Bull Rev 4:462–473

    Google Scholar 

  • Rangel A, Camerer C, Montague PR (2008) A framework for studying the neurobiology of value-based decision making. Nat Rev Neurosci 9:545–556

    CAS  PubMed  Google Scholar 

  • Remedios J, Woods C, Tardif C, Janak PH, Chaudhri N (2014) Pavlovian-conditioned alcohol-seeking behavior in rats is invigorated by the interaction between discrete and contextual alcohol cues: implications for relapse. Brain Behav 4:278–289

    PubMed Central  PubMed  Google Scholar 

  • Rescorla RA (1987) A Pavlovian analysis of goal-directed behavior. Am Psychol 42:119–129

    Google Scholar 

  • Rescorla RA (1991) Associative relations in instrumental learning—the 18 Bartlett memorial lecture. Q J Exp Psychol B Comp Physiol Psychol 43:1–23

    Google Scholar 

  • Rescorla RA (1992a) Associations between an instrumental discriminative stimulus and multiple outcomes. J Exp Psychol Anim Behav Process 18:95–104

    Google Scholar 

  • Rescorla RA (1992b) Response-outcome versus outcome-response associations in instrumental learning. Anim Learn Behav 20:223–232

    Google Scholar 

  • Rescorla RA (1994) Control of instrumental performance by Pavlovian and instrumental stimuli. J Exp Psychol Anim Behav Process 20:44–50

    CAS  PubMed  Google Scholar 

  • Rescorla RA, Cunningham CL (1979) Spatial contiguity facilitates Pavlovian second-order conditioning. J Exp Psychol Anim Behav Process 5:152–161

    CAS  PubMed  Google Scholar 

  • Roll JM, Higgins ST (2000) A within-subject comparison of three different schedules of reinforcement of drug abstinence using cigarette smoking as an exemplar. Drug Alcohol Depend 58:103–109

    CAS  PubMed  Google Scholar 

  • Rosas JM, Paredes-Olay MC, García-Gutiérrez A, Espinosa JJ, Abad MJF (2010) Outcome-specific transfer between predictive and instrumental learning is unaffected by extinction but reversed by counterconditioning in human participants. Learn Motiv 41:48–66

    Google Scholar 

  • Rose JE, Corrigall WA (1997) Nicotine self-administration in animals and humans: similarities and differences. Psychopharmacology 130:28–40

    CAS  PubMed  Google Scholar 

  • Rose J, Heskovic J, Trilling Y, Jarvik M (1985) Transdermal nicotine reduces cigarette craving and nicotine preference. Clin Pharmacol Ther 38:450–456

    CAS  PubMed  Google Scholar 

  • Rose J, Sampson A, Levin E, Henningfield J (1989) Mecamylamine increase nicotine preference and attenuates nicotine discrimination. Pharmacol Biochem Behav 32:399–938

    Google Scholar 

  • Rose JE, Behm FM, Levin ED (1993) Role of nicotine dose and sensory cues in the regulation of smoke intake. Pharmacol Biochem Behav 44:891–900

    CAS  PubMed  Google Scholar 

  • Rose JE, Westman EC, Behm FM (1996) Nicotine/mecamylamine combination treatment for smoking cessation. Drug Dev Res 38:243–256

    CAS  Google Scholar 

  • Rose JE, Westman EC, Behm FM, Johnson MP, Goldberg JS (1999) Blockade of smoking satisfaction using the peripheral nicotinic antagonist trimethaphan. Pharmacol Biochem Behav 62:165–172

    CAS  PubMed  Google Scholar 

  • Russell M, Wilson C, Patel U, Fayerband C, Cole P (1975) Plasma nicotine levels after smoking cigarettes with high median and low nicotine yields. Br Med J 2:414–416

    CAS  PubMed Central  PubMed  Google Scholar 

  • Rusted JM, Mackee A, Williams R, Willner P (1998) Deprivation state but not nicotine content of the cigarette affects responding by smokers on a progressive ratio task. Psychopharmacology 140:411–417

    CAS  PubMed  Google Scholar 

  • Åžahin E, Çakmak M, DoÄŸar MR, UÄŸur E, Üçoluk G (2007) To afford or not to afford: a new formalization of affordances toward affordance-based robot control. Adapt Behav 15:447–472

    Google Scholar 

  • Scherer G (1999) Smoking behavior and compensation: a review of the literature. Psychopharmacology 145:1–20

    CAS  PubMed  Google Scholar 

  • Shahan TA, Bickel WK, Badger GJ, Giordano LA (2001) Sensitivity of nicotine-containing and de-nicotinized cigarette consumption to alternative non-drug reinforcement: a behavioral economic analysis. Behav Pharmacol 12:277–284

    CAS  PubMed  Google Scholar 

  • Shiffman S (1986) A cluster-analytic classification of smoking relapse episodes. Addict Behav 11:295–307

    CAS  PubMed  Google Scholar 

  • Shiffman S (2009) Responses to smoking cues are relevant to smoking and relapse. Addiction 104:1617–1618

    PubMed  Google Scholar 

  • Shiffman S, Ferguson SG, Gwaltney CJ (2006) Immediate hedonic response to smoking lapses: relationship to smoking relapse, and effects of nicotine replacement therapy. Psychopharmacology 184:608–618

    CAS  PubMed  Google Scholar 

  • Shiffman S, Dunbar M, Kirchner T, Li X, Tindle H, Anderson S, Scholl S (2013) Smoker reactivity to cues: effects on craving and on smoking behavior. J Abnorm Psychol 122:264–280

    PubMed Central  PubMed  Google Scholar 

  • Shoaib M, Stolerman I (1999) Plasma nicotine and cotinine levels following intravenous nicotine self-administration in rats. Psychopharmacology 143:318–321

    CAS  PubMed  Google Scholar 

  • Shoptaw S, Rotheram-Fuller E, Yang X, Frosch D, Nahom D, Jarvik ME, Rawson RA, Ling W (2002) Smoking cessation in methadone maintenance. Addiction 97:1317–1328

    PubMed  Google Scholar 

  • Skinner BF (1938) The behavior of organisms: an experimental analysis. Appleton-Century, Oxford

    Google Scholar 

  • Stairs DJ, Neugebauer NM, Bardo MT (2010) Nicotine and cocaine self-administration using a multiple schedule of intravenous drug and sucrose reinforcement in rats. Behav Pharmacol 21:182–193

    CAS  PubMed Central  PubMed  Google Scholar 

  • Stolerman I, Garcha H, Pratt J, Kumar R (1984) Role of training dose in discrimination of nicotine and related compounds in rats. Psychopharmacology 84:413–419

    CAS  PubMed  Google Scholar 

  • Stolerman IP, Rauch RJ, Norris EA (1987) Discriminative stimulus effects of a nicotine-midazolam mixture in rats. Psychopharmacology 93:250–256

    CAS  PubMed  Google Scholar 

  • Surawy B, Stepney R, Cox T (1985) Does watching others smoke increase smoking? Br J Addict 80:207–210

    CAS  PubMed  Google Scholar 

  • Thewissen R, Snijders SJBD, Havermans RC, van den Hout M, Jansen A (2006) Renewal of cue-elicited urge to smoke: implications for cue exposure treatment. Behav Res Ther 44:1441–1449

    PubMed  Google Scholar 

  • Tiffany ST (1990) A cognitive model of drug urges and drug-use behavior: role of automatic and nonautomatic processes. Psychol Rev 97:147–168

    CAS  PubMed  Google Scholar 

  • Tiffany ST, Drobes DJ (1991) The development and initial validation of a questionnaire on smoking urges. Br J Addict 86:1467–1476

    CAS  PubMed  Google Scholar 

  • Tiffany ST, Cox LS, Elash CA (2000) Effects of transdermal nicotine patches on abstinence-induced and cue-elicited craving in cigarette smokers. J Consult Clin Psychol 68:233–240

    CAS  PubMed  Google Scholar 

  • Tiffany ST, Warthen MW, Goedeker KC (2009) The functional significance of craving in nicotine dependence. In: Caggiula AR, Bevins RA (eds) The motivational impact of nicotine and its role in tobacco use (Nebraska symposium on motivation). Springer, New York, pp 1–27

    Google Scholar 

  • Trapold MA (1970) Are expectancies based upon different positive reinforcing events discriminably different? Learn Motiv 1:129–140

    Google Scholar 

  • Troisi JRII (2003) Nicotine vs. ethanol discrimination: extinction and spontaneous recovery of responding. Integr Physiol Behav Sci 38:104–123

    PubMed  Google Scholar 

  • Troisi JRII (2006) Pavlovian-instrumental transfer of the discriminative stimulus effects of nicotine and ethanol in rats. Psychol Rec 56:499–512

    Google Scholar 

  • Troisi JRII (2013a) Acquisition, extinction, recovery, and reversal of different response sequences under conditional control by nicotine in rats. J Gen Psychol 140:187–203

    PubMed Central  PubMed  Google Scholar 

  • Troisi JRII (2013b) The Pavlovian vs. operant interoceptive stimulus effects of EtOH: commentary on Besheer, Fisher, & Durant (2012). Alcohol 47:433–436

    CAS  PubMed  Google Scholar 

  • Troisi JRII (2013c) Perhaps more consideration of Pavlovian operant interactions may improve the clinical efficacy of behaviorally based drug treatment programs. Psychol Rec 63:863–894

    PubMed Central  PubMed  Google Scholar 

  • Troisi JRII, LeMay BJ, Järbe TUC (2010) Transfer of the discriminative stimulus effects of Δ9-THC and nicotine from one operant response to another in rats. Psychopharmacology 212:171–179

    CAS  PubMed  Google Scholar 

  • Troisi JRII, Bryant E, Kane J (2012) Extinction of the discriminative stimulus effects of nicotine with a devalued reinforcer: recovery following revaluation. Psychol Rec 62:707–718

    Google Scholar 

  • Troisi JRII, Dooley TF, Craig EM (2013) The discriminative stimulus effects of a nicotine-ethanol compound in rats: extinction with the parts differs from the whole. Behav Neurosci 127:899–912

    CAS  PubMed  Google Scholar 

  • Urcuioli PJ (2005) Behavioral and associative effects of differential outcomes in discrimination learning. Anim Learn Behav 33:1–21

    Google Scholar 

  • Ussher MH, Taylor A, Faulkner G (2012) Exercise interventions for smoking cessation. The Cochrane Database of Systematic Reviews 1:CD002295

    Google Scholar 

  • VanderVeen JW, Cohen LM, Cukrowicz KC, Trotter DRM (2008) The role of impulsivity on smoking maintenance. Nicotine Tob Res 10:1397–1404

    PubMed  Google Scholar 

  • Vlaev I, Chater N, Stewart N, Brown GDA (2011) Does the brain calculate value? Trends Cogn Sci 15:546–554

    PubMed  Google Scholar 

  • Volpp KG, Gurmankin Levy A, Asch DA, Berlin JA, Murphy JJ, Gomez A, Sox H, Zhu J, Lerman C (2006) A randomized controlled trial of financial incentives for smoking cessation. Cancer Epidemiol Biomark Prev 15:12–18

    Google Scholar 

  • Westman EC, Behm FM, Rose JE (1995) Airway sensory replacement combined with nicotine replacement for smoking cessation—a randomized, placebo controlled trial using a citric acid inhaler. Chest 107:1358–1364

    CAS  PubMed  Google Scholar 

  • Wiley R, Wickham J (1974) The fabrication and application of a puff-by-puff smoking machine. Tob Sci 18:67–69

    Google Scholar 

  • Willner P, Jones C (1996) Effects of mood manipulation on subjective and behavioral measures of cigarette craving. Behav Pharmacol 7:355–363

    PubMed  Google Scholar 

  • Willner P, Hardman S, Eaton G (1995) Subjective and behavioral evaluation of cigarette cravings. Psychopharmacology 118:171–177

    CAS  PubMed  Google Scholar 

  • Winterbauer NE, Bouton ME (2010) Mechanisms of resurgence of an extinguished instrumental behavior. J Exp Psychol Anim Behav Process 36:343–353

    PubMed Central  PubMed  Google Scholar 

  • Woolverton WL, Anderson KG (2006) Effects of delay to reinforcement on the choice between cocaine and food in rhesus monkeys. Psychopharmacology 186:99–106

    CAS  PubMed  Google Scholar 

  • Xue YX, Luo YX, Wu P, Shi HS, Xue LF, Chen C, Zhu WL, Ding ZB, Bao YP, Shi J, Epstein DH, Shaham Y, Lu L (2012) A memory retrieval-extinction procedure to prevent drug craving and relapse. Science 336:241–245

    CAS  PubMed Central  PubMed  Google Scholar 

Download references

Acknowledgments

Funding: This work was supported by the MRC (G0701456: LH) and ESCR (RES-000-22-4365: LH); and by New Hampshire IDeA Network of Biological Research Excellence (NH-INBRE; NIH Grant Number 1P20RR030360-01 from the INBRE Program of the National Center for Research Resources: JRT).

Author information

Authors and Affiliations

  1. School of Psychology, University of Exeter, Washington Singer Building, Perry Road, Exeter Ex4 4QG, UK

    Lee Hogarth

  2. Department of Psychology, Saint Anselm College, Manchester, NH 03102, USA

    Joseph R. Troisi II

Authors
  1. Lee Hogarth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Joseph R. Troisi II
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Lee Hogarth .

Editor information

Editors and Affiliations

  1. Ninewells Hospital, University of Dundee Medical School, Dundee, United Kingdom

    David J.K. Balfour

  2. School of Experimental Psychology, University of Bristol, Bristol, United Kingdom

    Marcus R. Munafò

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Hogarth, L., Troisi II, J.R. (2015). A Hierarchical Instrumental Decision Theory of Nicotine Dependence. In: Balfour, D., Munafò, M. (eds) The Neurobiology and Genetics of Nicotine and Tobacco. Current Topics in Behavioral Neurosciences, vol 23. Springer, Cham. https://doi.org/10.1007/978-3-319-13665-3_7

Download citation

Publish with us

Policies and ethics

Search

Navigation