Abstract
Rationale
Discounting of delayed and probabilistic reinforcement is linked to increased drug use and pathological gambling. Understanding the neurobiology of discounting is important for designing treatments for these disorders. Glutamate is considered to be involved in addiction-like behaviors; however, the role of ionotropic glutamate receptors (iGluRs) in discounting remains unclear.
Objectives
The current study examined the effects of N-methyl-D-aspartate (NMDA) and α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid (AMPA) glutamate receptor blockade on performance in delay and probability discounting tasks.
Methods
Following training in either delay or probability discounting, rats (n = 12, each task) received pretreatments of the NMDA receptor antagonists MK-801 (0, 0.01, 0.03, 0.1, or 0.3 mg/kg, s.c.) or ketamine (0, 1.0, 5.0, or 10.0 mg/kg, i.p.), as well as the AMPA receptor antagonist CNQX (0, 1.0, 3.0, or 5.6 mg/kg, i.p.). Hyperbolic discounting functions were used to estimate sensitivity to delayed/probabilistic reinforcement and sensitivity to reinforcer amount.
Results
An intermediate dose of MK-801 (0.03 mg/kg) decreased sensitivity to both delayed and probabilistic reinforcement. In contrast, ketamine did not affect the rate of discounting in either task but decreased sensitivity to reinforcer amount. CNQX did not alter sensitivity to reinforcer amount or delayed/probabilistic reinforcement.
Conclusions
These results show that blockade of NMDA receptors, but not AMPA receptors, decreases sensitivity to delayed/probabilistic reinforcement (MK-801) and sensitivity to reinforcer amount (ketamine). The differential effects of MK-801 and ketamine demonstrate that sensitivities to delayed/probabilistic reinforcement and reinforcer amount are pharmacologically dissociable.
Similar content being viewed by others
References
Ainslie G (1975) Specious reward: a behavioral theory of impulsiveness and impulse control. Psychol Bull 82:463–496
Almasi-Nasrabadi M, Javadi-Paydar M, Mahdavian S, Babaei R, Sharifian M, Norouzi A, Dehpour AR (2012) Involvement of NMDA receptors in the beneficial effects of pioglitazone on scopolamine-induced memory impairment in mice. Behav Brain Res 231:138–145
Amador M, Dani JA (1991) MK-801 inhibition of nicotinic acetylcholine receptor channels. Synapse 7:207–215
Andrade LF, Petry NM (2012) Delay and probability discounting in pathological gamblers with and without a history of substance use problems. Psychopharmacology (Berl) 219:491–499
Bäckström P, Hyytiä P (2004) Ionotropic glutamate receptor antagonists modulate cue-induced reinstatement of ethanol-seeking behavior. Alcohol Clin Exp Res 28:558–565
Bickel WK, Odum AL, Madden GJ (1999) Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers. Psychopharmacology (Berl) 146:447–454
Burns GA, Ritter RC (1997) The non-competitive NMDA antagonist MK-801 increases food intake in rats. Pharmacol Biochem Behav 56:145–149
Coffey SF, Gudleski GD, Saladin ME, Brady KT (2003) Impulsivity and rapid discounting of delayed hypothetical rewards in cocaine-dependent individuals. Exp Clin Psychopharmacol 11:18–25
Cottone P, Lemolo A, Narayan AR, Kwak J, Momaney D, Sabino V (2013) The uncompetitive NMDA receptor antagonists ketamine and memantine preferentially increase the choice for a small, immediate reward in low-impulsive rats. Psychopharmacology (Berl) 226:127–138
National Research Council (2011) Guide for the care and use of laboratory animals, 8th edn. National Academies Press, Washington
Danysz W, Parson CG, Kornhuber J, Schmidt WJ, Quack G (1997) Aminoadamantanes as NMDA receptor antagonists and antiparkinsonian agents—preclinical studies. Neurosci Biobehav Rev 21:455–468
Floresco SB, Whelan JM (2009) Perturbations in different forms of cost/benefit decision making induced by repeated amphetamine exposure. Psychopharmacology (Berl) 205:189–201
Floresco SB, Tse MT, Ghods-Sharifi S (2008) Dopaminergic and glutamateric regulation of effort- and delay-based decision making. Neuropsychopharmacology 33:1966–1979
Frankiewicz T, Potier B, Bashir ZI, Collingridge GL, Parsons CG (1996) Effects of memantine and MK-801 on NMDA-induced currents in cultured neurons and on synaptic transmission and LTP in area CA1 of rat hippocampal slices. Br J Pharmacol 117:689–697
Fredriksson A, Archer T (2002) Functional alteration by NMDA antagonist: effects of L-Dopa, neuroleptics and postnatal administration. Amino Acids 23:111–132
Garcia LS, Comim CM, Valvassori SS, Réus GZ, Stertz L, Kapczinski F, Gavioli EC, Quevedo J (2009) Ketamine treatment reverses behavioral and physiological alterations induced by chronic mild stress in rats. Prog Neuropsychopharmacol Biol Psychiatry 33:450–455
Green L, Myerson J, Ostaszewski P (1999) Amount of reward has opposite effects on the discounting of delayed and probabilistic outcomes. J Exp Anal Psychol Learn Mem Cogn 25:418–427
Gupta A, Devi LA, Gomes I (2011) Potentiation of mu-opioid receptor-mediated signaling by ketamine. J Neurochem 119:294–302
Hadamitzky M, Feja M, Becker T, Koch M (2009) Effects of acute systemic administration of serotonin2A/C receptor ligands in a delay-based decision-making task in rats. Behav Pharmacol 20:415–423
Halliwell RF, Peters JA, Lambert JJ (1989) The mechanism of action and pharmacological specificity of the anticonvulsant NMDA antagonist MK-801: a voltage clamp study on neuronal cells in culture. Br J Pharmacol 96:480–494
Ho M-Y, Mobini S, Chiang T-J, Bradshaw CM, Szabadi E (1999) Theory and method in the quantitative analysis of “impulsive choice” behaviour: implications for psychopharmacology. Psychopharmacology (Berl) 146:362–372
Holt DD, Newquist MH, Smits RR, Tiry AM (2014) Discounting of food, sex, and money. Psycho Bull Rev 21:794–802
Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263–292
Kalivas PW (2009) The glutamate homeostasis hypothesis of addiction. Nat Rev Neurosci 10:561–572
Kapur S, Seeman P (2002) NMDA receptor antagonists ketamine and PCP have direct effects on the dopamine D2 and serotonin 5-HT2 receptors—implications for models of schizophrenia. Mol Psychiatry 7:837–844
Killeen PR (2011) Models of trace decay, eligibility for reinforcement, and delay of reinforcement gradients, from exponential to hyperboloid. Behav Processes 87:57–63
Koffarnus MN, Newman AH, Grundt P, Rice KC, Woods JH (2011) Effects of selective dopaminergic compounds on a delay-discounting task. Behav Pharmacol 22:300–311
Lesch KP, Merker S, Reif A, Novak M (2013) Dances with black widow spiders: dysregulation of glutamate signalling enters center stage in ADHD. Eur J Neuropharmacol 23:479–491
Liu YP, Wilkinson LS, Robbins TW (2004) Effects of acute and chronic buspirone on impulsive choice and efflux of 5-HT and dopamine in hippocampus, nucleus accumbens and prefrontal cortex. Psychopharmacology (Berl) 173:175–185
Madden GJ, Petry NM, Badger GJ, Bickel WK (1997) Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. Exp Clin Psychopharmacol 5:256–262
Madden GJ, Petry NM, Johnson PS (2009) Pathological gamblers discount probabilistic rewards less steeply than matched controls. Exp Clin Psychopharmacol 17:283–290
Mazur JE (1987) An adjusting procedure for studying delayed reinforcement. In: Commons ML, Mazur JE, Nevin JA, Rachlin H (eds) The effect of delay and of intervening events on reinforcement value. Erlbaum, Hillsdale, pp 53–73
Mendez IA, Gilbert RJ, Bizon JL, Setlow B (2012) Effects of acute administration of nicotine and muscarinic cholinergic agonists and antagonists on performance in different cost-benefit decision making tasks in rats. Psychopharmacology (Berl) 224:489–499
Mitchell SH (1999) Measures of impulsivity in cigarette smokers and non-smokers. Psychopharmacology (Berl) 146:455–464
Mobini S, Chiang T-J, Ho M-Y, Bradshaw CM, Szabadi E (2000) Effects of central 5-hydroxytryptamine depletion on sensitivity to delayed and probabilistic reinforcement. Psychopharmacology (Berl) 152:390–397
Myerson J, Green L (1995) Discounting of delayed rewards: models of individual choice. J Exp Anal Behav 64:263–276
Ninan I, Kulkarni SK (1998) Dopamine receptor sensitive effect of dizocilpine on feeding behaviour. Brain Res 812:157–163
Ohmura Y, Takahashi T, Kitamura N (2005) Discounting delayed and probabilistic monetary gains and losses by smokers of cigarettes. Psychopharmacology (Berl) 182:508–515
Oliver YP, Ripley TL, Stephens DN (2009) Ethanol effects on impulsivity in two mouse strains: similarities to diazepam and ketamine. Psychopharmacology (Berl) 204:679–692
Parsons CG, Quack G, Bresink I, Baran L, Przegalinski E, Kostowski W, Krzascik P, Hartman S, Danysz W (1995) Comparison of the potency, kinetics and voltage-dependency of a series of uncompetitive NMDA receptor antagonists in vitro with anticonvulsive and motor impairment activity in vivo. Neuropharmacology 34:1239–1258
Pattij T, Vanderschuren LJ (2008) The neuropharmacology of impulsive behaviour. Trends Pharmacol Sci 29:192–199
Petry NM (2001) Pathological gamblers, with and without substance use disorders, discount delayed rewards at high rates. J Abnorm Psychol 110:482–487
Rachlin H, Raineri A, Cross D (1991) Subjective probability and delay. J Exp Anal Behav 55:233–244
Rammes G, Rupprecht R, Ferrari U, Zieglgänsberger W, Parsons CG (2001) The N-methyl-D-aspartate receptor channel blockers memantine, MRZ 2/579 and other amino-alkyl-cyclohexanes antagonize 5-HT(3) receptor currents in cultured HEK-293 and N1E-115 cell systems in a non-competitive manner. Neurosci Lett 306:81–84
Reynolds B, Patak M, Shroff P, Penfold RB, Melanko S, Duhig AM (2007) Laboratory and self-report assessments of impulsive behavior in adolescent daily smokers and nonsmokers. Exp Clin Psychopharmacol 15:264–271
Riedel G, Platt B, Micheau J (2003) Glutamate receptor function in learning and memory. Behav Brain Res 140:1–47
Robson MJ, Elliott M, Seminerio MJ, Matsumoto RR (2012) Evaluation of sigma (σ) receptors in the antidepressant-like effects of ketamine in vitro and in vivo. Eur Neuropsychopharmacol 22:308–317
Schmaal L, Goudriaan AE, van der Meer J, van den Brink W, Veltman DJ (2012) The association between cingulate cortex glutamate concentration and delay discounting is mediated by resting state functional connectivity. Brain Behav 2:553–562
St Onge JR, Floresco SB (2009) Dopaminergic modulation of risk-based decision making. Neuropsychopharmacology 34:681–697
Talpos JC, Wilkinson LS, Robbins TW (2006) A comparison of multiple 5-HT receptors in two tasks measuring impulsivity. J Psychopharmacol 20:47–58
Tsukada H, Nishiyama S, Fukumoto D, Sato K, Kakiuchi T, Domino E (2005) Chronic NMDA antagonism impairs working memory, decreases extracellular dopamine, and increases D1 receptor binding in prefrontal cortex of conscious monkeys. Neuropharmacology 30:1861–1869
van Gaalen MM, van Koten R, Schoffelmeer ANM, Vanderschuren JMJ (2006) Critical involvement of dopaminergic neurotransmission in impulsive decision making. Biol Psychiatry 60:66–73
Vuchinich RE, Simpson CA (1998) Hyperbolic temporal discounting in social drinkers and problem drinkers. Exp Clin Psychopharmacol 6:292–305
Winstanley CA, Dalley JW, Theobald DEH, Robbins TW (2003) Global 5-HT depletion attenuates the ability of amphetamine to decrease impulsive choice on a delay-discounting task in rats. Psychopharmacology (Berl) 170:320–331
Wooters TE, Dwoskin LP, Bardo MT (2011) Discriminative stimulus effects of NMDA, AMPA, and mGluR5 glutamate receptor ligands in methamphetamine-trained rats. Behav Pharmacol 22:516–524
Yi R, Landes RD (2012) Temporal and probability discounting by cigarette smokers following acute smoking abstinence. Nicotine Tob Res 14:547–558
Acknowledgments
The authors would like to thank Emily Denehy and Travis McCuddy for technical assistance.
Conflict of interest
The authors declare no conflict of interest.
Author information
Authors and Affiliations
Corresponding author
Additional information
The current study was supported by NIH grants P50 DA05312, R01 DA12964, K99 DA033373, and T32 DA016176.
Rights and permissions
About this article
Cite this article
Yates, J.R., Batten, S.R., Bardo, M.T. et al. Role of ionotropic glutamate receptors in delay and probability discounting in the rat. Psychopharmacology 232, 1187–1196 (2015). https://doi.org/10.1007/s00213-014-3747-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00213-014-3747-3