Advertisement

Toward a Unifying Account of Impulsivity and the Development of Self-Control

Original Research
  • 149 Downloads

Abstract

Impulsivity has traditionally been thought to involve various behavioral traits that can be measured using different laboratory protocols. Whereas some authors regard different measures of impulsivity as reflecting fundamentally distinct and unrelated behavioral tendencies (fragmentation approach), others regard those different indexes as analogue forms of the same behavioral tendency, only superficially different (unification approach). Unifying accounts range from mere intuitions to more sophisticated theoretical systems. Some of the more complete attempts at unifying are intriguing but have validity weaknesses. We propose a new unifying attempt based on theoretical points posed by other authors and supplemented by theory and research on associative learning. We then apply these assumptions to characterize the paradigms used to study impulsivity in laboratory settings and evaluate their scope as an attempt at unification. We argue that our approach possesses a good balance of parsimony and empirical and theoretical grounding, as well as a more encompassing scope, and is more suitable for experimental testing than previous theoretical frameworks. In addition, the proposed approach is capable of generating a new definition of impulsivity and outlines a hypothesis of how self-control can be developed. Finally, we examine the fragmentation approach from a different perspective, emphasizing the importance of finding similarities among seemingly different phenomena.

Keywords

Conditioned reinforcement Delay discounting Impulsiveness Negative contingency learning Pavlovian–operant interactions Response inhibition 

Notes

Acknowledgements

The preparation of this article was supported by the Dirección General de Asuntos del Personal Académico (DGAPA) postdoctoral fellowship grant (UNAM 2016–2017) and by the Sistema Nacional de Investigadores (SNI) grant (File 64324). The authors wish to thank the Facultad de Psicología and the Laboratorio de Mecanismos Neurales y Cognitivos del Aprendizaje. The technical revision of the initial draft of this article was funded by the head of the Centro de Estudios e Investigaciones en Comportamiento. The authors also wish to thank Peter Killeen for his useful comments on an earlier version of this article.

Compliance with Ethical Standards

Conflict of Interest

The authors declare that they have no conflict of interest.

References

  1. Ainslie, G. (1975). Specious reward: a behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463–496.PubMedCrossRefGoogle Scholar
  2. Anker, J. J., Zlebnik, N. E., Gliddon, L. A., & Carroll, M. E. (2009). Performance under a go/no-go task in rats selected for high and low impulsivity with a delay-discounting procedure. Behavioural Pharmacology, 20, 406–414.PubMedCrossRefGoogle Scholar
  3. Arce, E., & Santistevan, C. (2006). Impulsivity: a review. Psicothema, 18, 213–220.PubMedGoogle Scholar
  4. Bari, A., & Robbins, T. W. (2013). Inhibition and impulsivity: behavioral and neural basis of response control. Progress in Neurobiology, 108, 44–79.PubMedCrossRefGoogle Scholar
  5. Barkley, R. A. (1997). Behavioral inhibition, sustained attention, and executive functions: constructing a unifying theory of ADHD. Psychological Bulletin, 121, 65–94.PubMedCrossRefGoogle Scholar
  6. Barratt, E. S. (1959). Anxiety and impulsiveness related to psychomotor efficiency. Perceptual and Motor Skills, 9, 191–198.CrossRefGoogle Scholar
  7. Bickel, W. K., Jarmolowicz, D. P., Mueller, E. T., & Gatchalian, K. M. (2011a). The behavioral economics and neuroeconomics of reinforcer pathologies: implications for etiology and treatment of addiction. Current Psychiatry Reports, 13, 406–415.PubMedPubMedCentralCrossRefGoogle Scholar
  8. Bickel, W. K., Landes, R. D., Christensen, D. R., Jackson, L., Jones, B. A., Nelson, Z. K., & Redish, A. D. (2011b). Single- and cross-commodity discounting among cocaine addicts: the commodity and its temporal location determine discounting rate. Psychopharmacology, 217, 177–187.PubMedPubMedCentralCrossRefGoogle Scholar
  9. Brown, P. L., & Jenkins, H. M. (1968). Auto-shaping of the pigeon’s key peck. Journal of the Experimental Analysis of Behavior, 11, 1–8.PubMedPubMedCentralCrossRefGoogle Scholar
  10. Brucks, D., Marshall-Pescini, S., Wallis, L. J., Huber, L., & Range, F. (2017). Measures of dogs’ inhibitory control abilities do not correlate across tasks. Frontiers in Psychology, 8, 849.PubMedPubMedCentralCrossRefGoogle Scholar
  11. Burgos, J. E. (2010). The operant/respondent distinction: a computational neural-network analysis. In N. Schmajuk (Ed.), Computational models of conditioning (pp. 144–171). Cambridge: Cambridge University Press.Google Scholar
  12. Burgos, J. E., & Bevins, R. (1997). The P system: a scheme for organizing Pavlovian procedures. Behavior Research Methods, Instruments, & Computers, 29, 473–483.CrossRefGoogle Scholar
  13. Buss, A. H., & Plomin, R. (1975). A temperament theory of personality development. New York: Wiley.Google Scholar
  14. Cardinal, R. N. (2006). Neural systems implicated in delayed and probabilistic reinforcement. Neural Networks, 19, 1277–1301.PubMedCrossRefGoogle Scholar
  15. Cardinal, R. N., Robbins, T. W., & Everitt, B. J. (2000). The effects of d-amphetamine, chlordiazepoxide, alpha-flupenthixol and behavioural manipulations on choice of signalled and unsignalled delayed reinforcement in rats. Psychopharmacology, 152, 362–375.PubMedCrossRefGoogle Scholar
  16. Cho, S. S., Ko, J. H., Pellecchia, G., Van Eimeren, T., Cilia, R., & Strafella, A. P. (2010). Continuous theta burst stimulation of right dorsolateral prefrontal cortex induces changes in impulsivity level. Brain Stimulation, 3(3), 170–176.PubMedCrossRefGoogle Scholar
  17. Chow, J. J., Nickell, J. R., Darna, M., & Beckmann, J. S. (2016). Toward isolating the role of dopamine in the acquisition of incentive salience attribution. Neuropharmacology, 109, 320–331.PubMedPubMedCentralCrossRefGoogle Scholar
  18. Cole, M. R. (1990). Operant hoarding: a new paradigm for the study of self-control. Journal of the Experimental Analysis of Behavior, 53, 247–261.PubMedPubMedCentralCrossRefGoogle Scholar
  19. Colwill, R. M., & Rescorla, R. A. (1986). Associative structures in instrumental learning. The Psychology of Learning and Motivation, 20, 55–104.CrossRefGoogle Scholar
  20. Critchfield, T. S., & Kollins, S. H. (2001). Temporal discounting: basic research and the analysis of socially important behavior. Journal of Applied Behavior Analysis, 34, 101–122.PubMedPubMedCentralCrossRefGoogle Scholar
  21. Cronin, P. B. (1980). Reinstatement of postresponse stimuli prior to reward in delayed-reward discrimination learning by pigeons. Animal Learning and Behavior, 8, 352–358.CrossRefGoogle Scholar
  22. D’Amato, M. R. (1955). Secondary reinforcement and magnitude of primary reinforcement. Journal of Comparative and Physiological Psychology, 48, 378–380.PubMedCrossRefGoogle Scholar
  23. Dadarlat, M., O’Doherty, J. E., & Sabes, P. N. (2014). A learning-based approach to artificial sensory feedback leads to optimal integration. Nature Neuroscience, 18, 138–144.PubMedPubMedCentralCrossRefGoogle Scholar
  24. Dalley, J. W., & Robbins, T. W. (2017). Fractioning impulsivity. Nature, 18, 158–171.Google Scholar
  25. Daly, H. B., & Daly, J. T. (1982). A mathematical model of reward and aversive nonreward: its application in over 30 appetitive learning situations. Journal of Experimental Psychology: General, 111, 441–480.CrossRefGoogle Scholar
  26. de Wit, S., & Dickinson, A. (2009). Associative theories of goal-directed behaviour: a case for animal–human translational models. Psychological Research, 73, 463–476.PubMedPubMedCentralCrossRefGoogle Scholar
  27. Dellu-Hagedorn, F. (2006). Relationship between impulsivity, hyperactivity and working memory: a differential analysis in the rat. Behavioral and Brain Functions, 2(10), 1–18.Google Scholar
  28. Dinsmoor, J. A. (2001). Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. Journal of the Experimental Analysis of Behavior, 75, 311–333.PubMedPubMedCentralCrossRefGoogle Scholar
  29. Dixon, M. R., & Holton, B. (2009). Altering the magnitude of delay discounting by pathological gamblers. Journal of Applied Behavior Analysis, 42, 269–275.PubMedPubMedCentralCrossRefGoogle Scholar
  30. Dixon, M. R., Jacobs, E. A., & Sanders, S. (2006). Contextual control of delay discounting by pathological gamblers. Journal of Applied Behavior Analysis, 39, 413–422.PubMedPubMedCentralCrossRefGoogle Scholar
  31. Donahoe, J., Burgos, J., & Palmer, D. (1993). A selectionist approach to reinforcement. Journal of the Experimental Analysis of Behavior, 69, 17–40.CrossRefGoogle Scholar
  32. Doughty, A. H., & Richards, J. B. (2002). Effects of reinforcer magnitude on responding under differential-reinforcement-of-low-rate schedules of rats and pigeons. Journal of the Experimental Analysis of Behavior, 78, 17–30.PubMedPubMedCentralCrossRefGoogle Scholar
  33. Eagle, D. M., Bari, A., & Robbins, T. W. (2008). The neuropsychopharmacology of action inhibition: cross-species translation of the stop-signal and go/no-go tasks. Psychopharmacology, 199, 439–456.PubMedCrossRefGoogle Scholar
  34. Einstein, A. (1954). Ideas and opinions (S. Bargmann, Trans.). New York: Bonanza.Google Scholar
  35. El Massioui, N., Lamirault, C., Yagüe, S., Adjeroud, N., Garces, D., Maillard, A., et al. (2016). Impaired decision making and loss of inhibitory-control in a rat model of Huntington disease. Frontiers in Behavioral Neuroscience, 10, 204.PubMedPubMedCentralCrossRefGoogle Scholar
  36. Enquist, M., Lind, J., & Ghirlanda, S. (2016). The power of associative learning and the ontogeny of optimal behavior. Royal Society Open Science, 3, 160734.PubMedPubMedCentralCrossRefGoogle Scholar
  37. Estle, S. J., Green, L., Myerson, J., & Holt, D. D. (2007). Discounting of monetary and directly consumable rewards. Psychological Science, 18, 58–63.PubMedCrossRefGoogle Scholar
  38. Evans, T. A., Beran, M. J., Paglieri, F., & Addessi, E. (2012). Delaying gratification for food and tokens in capuchin monkeys (Cebus apella) and chimpanzees (Pan troglodytes): when quantity is salient, symbolic stimuli do not improve performance. Animal Cognition, 15, 539–548.PubMedCrossRefGoogle Scholar
  39. Evenden, J. L. (1999). Varieties of impulsivity. Psychopharmacology, 146, 348–361.PubMedCrossRefGoogle Scholar
  40. Gibbon, J., Berryman, R., & Thompson, R. L. (1974). Contingency spaces and measures in classical and instrumental conditioning. Journal of the Experimental Analysis of Behavior, 21, 585–605.PubMedPubMedCentralCrossRefGoogle Scholar
  41. Gordon, M. (1979). The assessment of impulsivity and mediating behaviors in hyperactive and nonhyperactive boys. Journal of Abnormal Child Psychology, 7, 317–326.PubMedCrossRefGoogle Scholar
  42. Green, L., & Myerson, J. (2010). Experimental and correlational analyses of delay and probability discounting. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: theory, science, and neuroscience of discounting (pp. 67–92). Washington, DC: American Psychological Association.Google Scholar
  43. Green, L., Myerson, J., & Macaux, E. W. (2005). Temporal discounting when the choice is between two delayed rewards. Journal of Experimental Psychology: Learning, Memory, and Cognition, 31, 1121–1133.PubMedGoogle Scholar
  44. Greenwald, A. G. (1970). Sensory feedback mechanisms in performance control: with special reference to the ideo-motor mechanism. Psychological Review, 77(2), 73–99.PubMedCrossRefGoogle Scholar
  45. Guthrie, E. R. (1940). Association and the law of effect. The Psychological Review, 47, 127–148.CrossRefGoogle Scholar
  46. Hackenberg, T. D. (2005). Of pigeons and people: some observations on species differences in choice and self-control. Brazilian Journal of Behavior Analysis, 1(2), 135–147.Google Scholar
  47. Hearst, E., & Jenkins, H. M. (1974). Sign tracking: the stimulus reinforcer relation and directed action. Austin: The Psychonomic Society.Google Scholar
  48. Herrnstein, R. J. (1969). Method and theory in the study of avoidance. Psychological Review, 76, 49–69.PubMedCrossRefGoogle Scholar
  49. Higley, J. D., & Linnoila, M. (1997). A nonhuman primate model of excessive alcohol intake (personality and neurobiological parallels of type I- and type II-like alcoholism). In M. Galanter (Ed.), Recent developments in alcoholism (Vol. 13, pp. 191–219). New York: Plenum.Google Scholar
  50. Ho, M. Y., Al-Zahrani, S. S., Al-Ruwaitea, A. S., Bradshaw, C. M., & Szabadi, E. (1998). 5-Hydroxytryptamine and impulse control: prospects for a behavioural analysis. Journal of Psychopharmacology, 12, 68–78.PubMedCrossRefGoogle Scholar
  51. Jackson, K., & Hackenberg, T. D. (1996). Token reinforcement, choice, and self-control in pigeons. Journal of the Experimental Analysis of Behavior, 66, 29–49.PubMedPubMedCentralCrossRefGoogle Scholar
  52. Jwaideh, A. R., & Mulvaney, D. E. (1976). Punishment of observing by a stimulus associated with the lower of two reinforcement frequencies. Learning and Motivation, 7, 211–222.CrossRefGoogle Scholar
  53. Kehoe, E. J. (1982). Overshadowing and summation in compound stimulus conditioning of the rabbit’s nictitating membrane response. Journal of Experimental Psychology: Animal Behavioral Processes, 8, 313–328.Google Scholar
  54. Kehoe, E. J., & Holt, P. E. (1984). Transfer across CS-US intervals and sensory modalities in classical conditioning in the rabbit. Animal Learning & Behavior, 12, 122–128.CrossRefGoogle Scholar
  55. Kerlinger, F. N., & Lee, H. B. (2000). Foundations of behavioral research. Fort Worth: Harcourt College Publishers.Google Scholar
  56. Killeen, P. R. (1982). Incentive theory: II. Models for choice. Journal of the Experimental Analysis of Behavior, 38, 217–232.PubMedPubMedCentralCrossRefGoogle Scholar
  57. Killeen, P. R. (2001). The four causes of behavior. Current Directions in Psychological Science, 10(4), 136–140.PubMedPubMedCentralCrossRefGoogle Scholar
  58. Killeen, P. R. (2014). Pavlov + Skinner = Premack. International Journal of Comparative Psychology, 27, 544–568.Google Scholar
  59. Killeen, P. R. (2015). Models of ADHD: five ways smaller sooner is better. Journal of Neuroscience Methods, 252, 2–13.PubMedCrossRefGoogle Scholar
  60. Killeen, P. R., Sanabria, F., & Dolgov, I. (2009). The dynamics of conditioning and extinction. Journal of Experimental Psychology: Animal Behavior Processes, 35, 447–472.PubMedPubMedCentralGoogle Scholar
  61. Kirk, J. M., & Logue, A. W. (1997). Effects of deprivation level on humans’ self-control for food reinforcers. Appetite, 28, 215–226.PubMedCrossRefGoogle Scholar
  62. Koffarnus, M. N., Jarmolowicz, D. P., Mueller, E. T., & Bickel, W. K. (2013). Changing delay discounting in the light of the competing neurobehavioral decision systems theory: a review. Journal of the Experimental Analysis of Behavior, 99, 32–57.PubMedCrossRefGoogle Scholar
  63. Lattal, K. A. (2010). Delayed reinforcement of operant behavior. Journal of the Experimental Analysis of Behavior, 93, 129–139.PubMedPubMedCentralCrossRefGoogle Scholar
  64. Laude, J. R., Stagner, J. P., & Zentall, T. R. (2014). Suboptimal choice by pigeons may result from the diminishing effect of nonreinforcement. Journal of Experimental Psychology: Animal Learning and Cognition, 40, 12–21.Google Scholar
  65. Leitenberg, H. (1965). Is time from positive reinforcement an aversive event? A review of experimental evidence. Psychological Bulletin, 72, 193–203.Google Scholar
  66. Lejuez, C. W., Read, J. P., Kahler, C. W., Richards, J. B., Ramsey, S. E., Stuart, G. L., et al. (2002). Evaluation of a behavioral measure of risk taking: the Balloon Analogue Risk Task (BART). Journal of Experimental Psychology: Applied, 8, 75–84.PubMedGoogle Scholar
  67. Logan, G. D., & Cowan, W. B. (1984). On the ability to inhibit thought and action: a theory of an act of control. Psychological Review, 91, 295–327.CrossRefGoogle Scholar
  68. Logue, A. W. (1988). Research in self-control: an integrating framework. Behavioral and Brain Sciences, 11, 665–679.CrossRefGoogle Scholar
  69. Lopatto, D., & Lewis, P. (1985). Contributions of elicitation to measures of self-control. Journal of the Experimental Analysis of Behavior, 44, 69–77.PubMedPubMedCentralCrossRefGoogle Scholar
  70. MacCorquodale, K., & Meehl, P. E. (1948). On a distinction between hypothetical constructs and intervening variables. Psychological Review, 55, 95–107.PubMedCrossRefGoogle Scholar
  71. MacKillop, J., Weafer, J., Gray, J. C., Oshri, A., Palmer, A., & de Wit, H. (2016). The latent structure on impulsivity: Impulsive choice, impulsive action, and impulsive personality traits. Psychopharmacology, 233, 3361–3370.PubMedPubMedCentralCrossRefGoogle Scholar
  72. Madden, G. J., & Bickel, W. K. (2010). Introduction. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: the behavioral and neurological science of discounting (pp. 3–8). Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  73. Madden, G. J., Petry, N. M., Badger, G. J., & Bickel, W. K. (1997). Impulsive and self-control choices in opioid-dependent patients and non-drug-using control participants: drug and monetary rewards. Experimental and Clinical Psychopharmacology, 5, 256–262.PubMedCrossRefGoogle Scholar
  74. Mancebo, M. (2002). Ability to postpone reinforcement by boys with attention deficit hyperactivity disorder (Unpublished doctoral dissertation). Hofstra University, Hempstead.Google Scholar
  75. Mannuzza, S., Klein, R. G., Bessler, A., Malloy, P., & Heynes, M. E. (1997). Educational and occupational outcome of hyperactive boys grown up. Journal of the American Academy of Child and Adolescent Psychiatry, 36, 1222–1227.PubMedCrossRefGoogle Scholar
  76. Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analysis of behavior: vol. 5. The effect of delay and of intervening events of reinforcement value (pp. 55–73). Hillsdale: Erlbaum.Google Scholar
  77. Mazur, J. E. (1995). Conditioned reinforcement and choice with delayed and uncertain primary reinforcers. Journal of the Experimental Analysis of Behavior, 63, 139–150.PubMedPubMedCentralCrossRefGoogle Scholar
  78. McClure, S. M., Ericson, K. M., Laibson, D. I., Loewenstein, G., & Cohen, J. D. (2007). Time discounting for primary rewards. Journal of Neuroscience, 27, 5796–5804.PubMedCrossRefGoogle Scholar
  79. McDonald, J., Schleifer, L., Richards, J. B., & de Wit, H. (2003). Effects of THC on behavioral measures of impulsivity in humans. Neuropsychopharmacology, 28, 1356–1365.PubMedCrossRefGoogle Scholar
  80. McReynolds, W. T., Green, L., & Fisher, E. B. (1983). Self-control as choice management with reference to the behavioral treatment of obesity. Health Psychology, 2, 261–276.CrossRefGoogle Scholar
  81. Miller, E., Joseph, S., & Tudway, J. (2004). Assessing the component structure of four self-report measures of impulsivity. Personality and Individual Differences, 37, 349–358.CrossRefGoogle Scholar
  82. Miyazaki, K., Miyazaki, K. W., & Doya, K. (2012). The role of serotonin in the regulation of patience and impulsivity. Molecular Neurobiology, 45, 213–224.PubMedPubMedCentralCrossRefGoogle Scholar
  83. Monterosso, J., & Ainslie, G. W. (1999). Beyond discounting: possible experimental models of impulse control. Psychopharmacology, 146, 339–347.PubMedCrossRefGoogle Scholar
  84. Mowrer, O. H. (1956). Two-factor learning theory reconsidered, with special reference to secondary reinforcement and the concept of habit. Psychological Review, 63, 114–128.PubMedCrossRefGoogle Scholar
  85. Nafcha, O., Higgins, E. T., & Eitam, B. (2016). Control feedback as the motivational force behind habitual behavior. Progress in Brain Research, 229, 49–68.PubMedCrossRefGoogle Scholar
  86. Nieuwenhuis, S., Yeung, N., van den Wildenberg, W., & Ridderinkhof, K. R. (2003). Electrophysiological correlates of anterior cingulate in a go/no-go task: effects of response conflict and trial type frequency. Cognitive, Affective, & Behavioral Neuroscience, 3, 17–26.CrossRefGoogle Scholar
  87. Odum, A. L. (2011a). Delay discounting: I’m a k, you’re a k. Journal of the Experimental Analysis of Behavior, 96, 427–439.PubMedPubMedCentralCrossRefGoogle Scholar
  88. Odum, A. L. (2011b). Delay discounting: trait variable? Behavioural Processes, 87, 1–9.PubMedPubMedCentralCrossRefGoogle Scholar
  89. Odum, A. L., & Baumann, A. A. (2010). Delay discounting: state and trait variable. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: the behavioral and neurological science of discounting (pp. 39–65). Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  90. Orduña, V. (2015). Impulsivity and sensitivity to amount and delay of reinforcement in an animal model of ADHD. Behavioral Brain Research, 294, 62–71.CrossRefGoogle Scholar
  91. Orduña, V., Valencia-Torres, L., & Bouzas, A. (2009). DRL performance of spontaneously hypertensive rats: dissociation of timing and inhibition of responses. Behavior Brain Research, 201, 158–165.CrossRefGoogle Scholar
  92. Parkinson, J. A., Crofts, H. S., McGuigan, M., Tomic, D. L., Everitt, B., & Roberts, A. C. (2001). The role of the primate amygdala in conditioned reinforcement. The Journal of Neuroscience, 21, 7770–7780.PubMedGoogle Scholar
  93. Parkinson, J. A., Olmstead, M. C., Burns, L. H., Robbins, T. W., & Everitt, B. J. (1999). Dissociation effects of lesions of the nucleus accumbens core and shell on appetitive Pavlovian approach behavior and the potentiation of conditioned reinforcement and locomotor activity by D-amphetamine. The Journal of Neuroscience, 19, 2401–2411.PubMedGoogle Scholar
  94. Pattij, T., & Vanderschuren, L. J. (2008). The neuropharmacology of impulsive behavior. Trends in Pharmacological Sciences, 29(4), 192–199.PubMedCrossRefGoogle Scholar
  95. Piazza, P. V., Demeniere, J. M., Le Moal, M., & Simon, H. (1989). Factors that predict individual vulnerability to amphetamine self-administration. Science, 245, 1511–1513.PubMedCrossRefGoogle Scholar
  96. Poulos, C. X., Le, A. D., & Parker, J. L. (1995). Impulsivity predicts individual susceptibility to high levels of alcohol self-administration. Behavioural Pharmacology, 6, 810–814.PubMedCrossRefGoogle Scholar
  97. Prasad, C., & Prasad, A. (1995). A relationship between increased voluntary alcohol preference and basal hypocorticosteronemia associated with attenuated rise in corticosterone output during stress. Alcohol, 12, 59–63.PubMedCrossRefGoogle Scholar
  98. Prével, A., Rivière, V., Darcheville, J.-C., & Urcelay, G. P. (2016). Conditioned reinforcement and backward association. Learning and Motivation, 56, 38–47.CrossRefGoogle Scholar
  99. Rachlin, H. (1995). Self-control: beyond commitment. Behavioral and Brain Sciences, 18, 109–159.CrossRefGoogle Scholar
  100. Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II (pp. 64–99). New York: Appleton-Century-Crofts.Google Scholar
  101. Reynolds, B., de Wit, H., & Richards, J. B. (2002). Delay of gratification and delay discounting in rats. Behavioural Processes, 59, 157–168.PubMedCrossRefGoogle Scholar
  102. Reynolds, B., Ortengren, A., Richards, J. B., & de Wit, H. (2006). Dimensions of impulsive behavior: personality and behavioral measures. Personality and Individual Differences, 40, 305–315.CrossRefGoogle Scholar
  103. Richards, J. B., Gancarz, A. M., & Hawk, L. W. (2011). Animal models of behavioral processes that underlie the occurrence of impulsive behaviors in humans. In M. T. Bardo, D. H. Fishbein, & R. Milich (Eds.), Inhibitory control and drug abuse prevention (pp. 13–41). New York: Springer.CrossRefGoogle Scholar
  104. Richards, J. B., Sabol, K. E., & Seiden, L. S. (1993). DRL interresponse-time distributions: quantification by peak deviation analysis. Journal of the Experimental Analysis of Behavior, 60, 361–385.PubMedPubMedCentralCrossRefGoogle Scholar
  105. Robbins, T. W. (2002). The 5-choice serial reaction time task: behavioural pharmacology and functional neurochemistry. Psychopharmacology, 163, 362–380.PubMedCrossRefGoogle Scholar
  106. Robinson, T. E., & Flagel, S. B. (2009). Dissociating the predictive and incentive motivational properties of reward-related cues through the study of individual differences. Biological Psychiatry, 65, 859–873.Google Scholar
  107. Rosati, A. G., Stevens, J. R., Hare, B., & Hauser, M. D. (2007). The evolutionary origins of human patience: temporal preferences in chimpanzees, bonobos, and human adults. Current Biology, 17, 1663–1668.PubMedCrossRefGoogle Scholar
  108. Sagvolden, T., & Berger, D. F. (1996). An animal model of attention deficit disorder: the female shows more behavioral problems and is more impulsive than the male. European Psychology, 1, 113–122.CrossRefGoogle Scholar
  109. Sanabria, F., & Killeen, P. R. (2008). Evidence for impulsivity in the spontaneously hypertensive rat drawn from complementary response-withholding tasks. Behavioral and Brain Functions, 4(7), 1–17.Google Scholar
  110. Sanabria, F., Sitomer, M. T., & Killeen, P. R. (2006). Negative automaintenance omission training is effective. Journal of the Experimental Analysis of Behavior, 86, 1–10.PubMedPubMedCentralCrossRefGoogle Scholar
  111. Schachar, R., Logan, G. D., Robaey, P., Chen, S., Ickowicz, A., & Barr, C. (2007). Restraint and cancellation: multiple inhibition deficits in attention deficit hyperactivity disorder. Journal of Child Psychology, 35, 229–238.Google Scholar
  112. Schubiner, H., Tzelepis, A., Milberger, S., Lockhart, N., Kruger, M., Kelley, B. J., & Schoener, E. P. (2000). Prevalence of attention deficit hyperactivity disorder and conduct disorder among substance abusers. Journal of Clinical Psychiatry, 64, 244–251.CrossRefGoogle Scholar
  113. Schwartz, B. (1978). Stimulus-reinforcer contingencies and local behavioral contrast. Journal of the Experimental Analysis of Behavior, 29, 297–308.PubMedPubMedCentralCrossRefGoogle Scholar
  114. Sescousse, G., Caldú, X., Segura, B., & Dreher, J. C. (2013). Processing of primary and secondary rewards: a quantitative meta-analysis and review of human functional neuroimaging studies. Neuroscience & Biobehavioral Reviews, 37, 681–696.CrossRefGoogle Scholar
  115. Siddall, E., & Marples, N. (2008). Better to be bimodal: the interaction of color and odor on learning and memory. Behavioral Ecology, 19, 425–432.CrossRefGoogle Scholar
  116. Sidman, M. (1960). Tactics of scientific research. New York: Basic Books.Google Scholar
  117. Silbersweig, D., Clarkin, J. F., Goldstein, M., Kernberg, O. F., Tuescher, O., Levy, K. N., et al. (2007). Failure of frontolimbic inhibitory function in the context of negative emotion in borderline personality disorder. The American Journal of Psychiatry, 164, 1832–1841.PubMedCrossRefGoogle Scholar
  118. Skinner, B. F. (1951). Science and human behavior. New York: Macmillan.Google Scholar
  119. Sosa, R., Santos, C. V., & Flores, C. (2011). Training a new response using conditioned reinforcement. Behavioural Processes, 87, 231–236.PubMedCrossRefGoogle Scholar
  120. Soubrié, P. (1986). Reconciling the role of central serotonin neurons in human and animal behavior. Behavioral and Brain Sciences, 9, 319–364.CrossRefGoogle Scholar
  121. Stahl, C., Voss, A., Schmitz, F., Nuzbaum, M., Tüscher, O., Lieb, K., & Klauer, K. C. (2014). Behavioral components of impulsivity. Journal of Experimental Psychology: General, 143, 850–886.CrossRefGoogle Scholar
  122. Stephens, D. W., & Anderson, D. (2001). The adaptive value of preference for immediacy: when shortsighted rules have farsighted consequences. Behavioral Ecology, 12, 330–339.CrossRefGoogle Scholar
  123. Stevens, S. S. (1951). Mathematics, measurement and psychophysics. In S. S. Stevens (Ed.), Handbook of experimental psychology (pp. 1–49). New York: Wiley.Google Scholar
  124. Stevens, J. R., & Stephens, D. W. (2010). The adaptive nature of impulsivity. In G. J. Madden & W. K. Bickel (Eds.), Impulsivity: the behavioral and neurological science of discounting (pp. 361–387). Washington, DC: American Psychological Association.CrossRefGoogle Scholar
  125. Suminski, A. J., Tkach, D., Fagg, A. H., & Hatsopoulos, N. H. (2010). Incorporating feedback from multiple sensory modalities enhances brain–machine interface control. The Journal of Neuroscience, 15, 16777–16787.CrossRefGoogle Scholar
  126. Tomie, A. (1995). CAM: an animal learning model of excessive and compulsive implement-assisted drug-taking in humans. Clinical Psychology Review, 15, 145–167.CrossRefGoogle Scholar
  127. Tomie, A. (1996). Locating reward cue at response manipulandum (CAM) induces symptoms of drug abuse. Neuroscience and Biobehavioral Review, 20, 505–535.CrossRefGoogle Scholar
  128. Tomie, A., Aguado, A. S., Pohorecky, L. A., & Benjamin, D. (1998). Ethanol induces impulsive-like responding in a delay-of-reward operant choice procedure: impulsivity predicts autoshaping. Psychopharmacology, 139, 376–382.PubMedCrossRefGoogle Scholar
  129. Trujano, R. E., López, P., Rojas-Leguizamón, M., & Orduña, V. (2016). Optimal behavior by rats in a choice task is associated to a persistent conditioned inhibition effect. Behavioural Processes, 130, 65–70.PubMedCrossRefGoogle Scholar
  130. Verbruggen, F., & Logan, G. D. (2009). Models of response inhibition in the stop-signal and stop-change paradigms. Neuroscience & Biobehavioral Reviews, 33, 647–661.  https://doi.org/10.1016/j.neubiorev.2008.08.014 CrossRefGoogle Scholar
  131. Vuchinich, R. E., & Tucker, J. A. (1983). Behavioral theories of choice as a framework for studying drinking behavior. Journal of Abnormal Psychology, 92, 408–416.PubMedCrossRefGoogle Scholar
  132. Wasserman, E. A., Franklin, S., & Hearst, E. (1974). Pavlovian appetitive contingencies and approach versus withdrawal to conditioned stimuli in pigeons. Journal of Comparative and Physiological Psychology, 86, 616–627.PubMedCrossRefGoogle Scholar
  133. Williams, B. A. (1994). Conditioned reinforcement: neglected or outmoded explanatory construct. Psychonomic Bulletin & Review, 1, 457–475.CrossRefGoogle Scholar
  134. Williams, D. R., & Williams, H. (1969). Auto-maintenance in the pigeon: sustained pecking despite contingent nonreinforcement. Journal of the Experimental Analysis of Behavior, 12, 511–529.PubMedPubMedCentralCrossRefGoogle Scholar
  135. Winstanley, C. A., Dalley, J. K., Theobald, D. E. H., & Robbins, T. W. (2004). Fractionating impulsivity: Contrasting effects of impulsive behavior. Neuropsychopharmacology, 29, 1331–1343.PubMedCrossRefGoogle Scholar
  136. Wright, L., Lipszyc, J., Dupuis, A., Thayapararajah, S. W., & Schachar, R. (2014). Response inhibition and psychopathology: a meta-analysis of go/no-go task performance. Journal of Abnormal Psychology, 123, 429–439.PubMedCrossRefGoogle Scholar

Copyright information

© Association for Behavior Analysis International 2018

Authors and Affiliations

  1. 1.Escuela de PsicologíaUniversidad Anáhuac México SurMexico CityMexico
  2. 2.Facultad de PsicologíaUniversidad Nacional Autónoma de MéxicoMéxico CityMexico
  3. 3.Centro de Estudios e Investigaciones en ComportamientoUniversidad de GuadalajaraGuadalajaraMexico

Personalised recommendations