Skip to main content

Delayed Reinforcement and Self-Control: Increasing Tolerance for Delay with Children and Adults with Autism

  • Chapter
  • First Online:

Part of the book series: Autism and Child Psychopathology Series ((ACPS))

Abstract

Impulsivity, behavior analytically defined as a tendency to allocate responding to sooner, smaller reinforcers rather than waiting for larger, delayed reinforcers, is a frequent problem in the autism population. Negative effects of delays, such as teaching difficulties, problem behavior, and diminished receipt of reinforcement may result if a client has not learned to tolerate delays through a specific history of reinforcement. Self-control, or choosing the more advantageous delayed reinforcer, is affected by features of the choice context such as the quality and magnitude of the reinforcer, the length and consistency of the delay, and discriminability of the contingencies. Effective self-control training techniques often seek to control these factors to increase tolerance for delay and may include components such as progressive schedules to fade in delays to larger reinforcement, activities during the delay, choice and the illusion of control, or group contingencies to decrease the amount with which a time delay affects choice making. Recommendations and future directions are discussed.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  • Ainslie, G. W. (1974). Impulse control in pigeons. Journal of the Experimental Analysis of Behavior, 21, 485–489. doi:10.1901/jeab.1974.21-485.

    Article  PubMed Central  PubMed  Google Scholar 

  • Barnes-Holmes, D., Keane, J., Barnes-Holmes, Y., & Smeets, P. M. (2000). Derived transfer of emotive functions as a means of establishing differential preferences for soft drinks. The Psychological Record, 50, 493–511. contextualscience.org/publications.

    Google Scholar 

  • Binder, L. M., Dixon, M. R., & Ghezzi, P. M. (2000). A procedure to teach self-control to children with attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 33, 233–237. doi:10.1901/jaba.2000.33-233.

    Article  PubMed Central  PubMed  Google Scholar 

  • Bradley, E. A., & Isaacs, B. J. (2006). Inattention, hyperactivity, and impulsivity in teenagers with intellectual disabilities, with and without autism. Canadian Journal of Psychiatry, 51, 598–606. http://www.ncbi.nlm.nih.gov/pubmed/.

  • Chung, S. (1965). Effects of delayed reinforcement in a concurrent situation. Journal of the Experimental Analysis of Behavior, 8, 439–444. doi:10.1901/jeab.1965.8-439.

    Article  PubMed Central  PubMed  Google Scholar 

  • Cooper, J. O., Heron, T. E., & Heward, W. L. (2007). Applied behavior analysis (2nd ed.). Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Darcheville, J. C., Riviere, V., & Wearden, J. H. (1993). Fixed-interval performance and self-control in infants. Journal of the Experimental Analysis of Behavior, 60, 239–254. doi:10.1901/jeab.1993.60-239.

    Article  PubMed Central  PubMed  Google Scholar 

  • Davison, M. C. (1969). Preference for mixed-interval versus fixed-interval schedules. Journal of the Experimental Analysis of Behavior, 12, 247–252. doi:10.1901/jeab.1969.12-247.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., & Cummings, A. (2001). Self-control in children with autism: Response allocation during delays to reinforcement. Journal of Applied Behavior Analysis, 34, 491–495. doi:10.1901/jaba.2001.34-491.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., & Falcomata, T. S. (2004). Preference for progressive delays and concurrent physical therapy exercise in an adult with acquired brain injury. Journal of Applied Behavior Analysis, 37, 101–105. doi:10.1901/jaba.2004.37-101.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., & Holcomb, S. (2000). Teaching self-control to small groups of dually diagnosed adults. Journal of Applied Behavior Analysis, 33, 611–614. doi:10.1901/jaba.2000.33-611.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., & Tibbetts, P. A. (2009). The effects of choice on self-control. Journal of Applied Behavior Analysis, 42, 243–252. doi:10.1901/jaba.2009.42-243.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., Hayes, L. J., Binder, L. M., Manthey, S., Sigman, C., & Zdanowski, D. M. (1998). Using a self-control training procedure to increase appropriate behavior. Journal of Applied Behavior Analysis, 31, 203–210. doi:10.1901/jaba.1998.31-203.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., Horner, M. J., & Guercio, J. (2003a). Self-control and the preference for delayed reinforcement: An example in brain injury. Journal of Applied Behavior Analysis, 36, 371–374. doi:10.1901/jaba.2003.36-371.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., Rehfeldt, R., & Randich, L. (2003b). Enhancing tolerance to delayed reinforcers: The role of intervening activities. Journal of Applied Behavior Analysis, 36, 263–266. doi:10.1901/jaba.2003.36-263.

    Article  PubMed Central  PubMed  Google Scholar 

  • Dixon, M. R., Jacobs, E. A., & Sanders, S. (2006). Contextual control of delay discounting by pathological gamblers. Journal of Applied Behavior Analysis, 39, 413–422. doi:10.1901/jaba.2006.173-05.

    Article  PubMed Central  PubMed  Google Scholar 

  • Falcomata, T. S. & Dixon, M. R. (2004). Enhancing physical therapy exercises in persons with acquired brain injury through a self-control training procedure. European Journal of Behavior Analysis, 5, 29–41. doi:10.1901/jaba.2004.37-101.

    Google Scholar 

  • Fantino, E. (1969). Choice and rate of reinforcement. Journal of the Experimental Analysis of Behavior, 12, 723–730. doi:10.1901/jeab.1969.12-723.

    Article  PubMed Central  PubMed  Google Scholar 

  • Fantino, E., Freed, D., Preston, R. A., & Williams, W. A. (1991). Choice and conditioned reinforcement. Journal of the Experimental Analysis of Behavior, 55, 177–188. doi:10.1901/jeab.1991.55-177.

    Article  PubMed Central  PubMed  Google Scholar 

  • Ferster, C. B. (1953). Sustained behavior under delayed reinforcement. Journal of Experimental Psychology, 45, 218–224. doi:10.1037/h0062158.

    Article  PubMed  Google Scholar 

  • Fisher, W. W., Thompson, R. H., Piazza, C. C., Crosland, K., & Gotjen, D. (1997). On the relative reinforcing effects of choice and differential consequences. Journal of Applied Behavior Analysis, 30, 423–438. doi:10.1901/jaba.1997.30-423.

    Article  PubMed Central  PubMed  Google Scholar 

  • Forzano, L. B., & Logue, A. W. (1995). Self-control and impulsiveness in children and adults: Effects of food preferences. Journal of the Experimental Analysis of Behavior, 64, 33–46. doi:10.1901/jeab.1995.64-33.

    Article  PubMed Central  PubMed  Google Scholar 

  • Fowler, S. A., & Baer, D. M. (1981). Do I have to be good all day? The timing of delayed reinforcement as a factor in generalization. Journal of Applied Behavior Analysis, 14, 13–24. doi:10.1901/jaba.1981.14-13.

    Article  PubMed Central  PubMed  Google Scholar 

  • Gottschalk, J. M., Libby, M. E., & Graff, R. B. (2000). The effects of establishing operations on preference assessment outcomes. Journal of Applied Behavior Analysis, 33, 85–88. doi:10.1901/jaba.2000.33-85.

    Article  PubMed Central  PubMed  Google Scholar 

  • Grosch, J., & Neuringer, A. (1981). Self-control in pigeons under the Mischel paradigm. Journal of the Experimental Analysis of Behavior, 35, 3–21. doi:10.1901/jeab.1981.35-3.

    Article  PubMed Central  PubMed  Google Scholar 

  • Hayes, S. C., Barnes-Holmes, D., & Roach, B. (2001). Relational frame theory: A post-Skinnerian account of human language and cognition. New York: Kluwer Academic.

    Google Scholar 

  • Hursh, S. R. (1984). Behavioral economics. Journal of the Experimental Analysis of Behavior, 42, 435–452. doi:10.1901/jeab.1984.42-435.

    Article  PubMed Central  PubMed  Google Scholar 

  • Hyten, C., Madden, G. J., & Field, D. P. (1994). Exchange delays and impulsive choice in adult humans. Journal of the Experimental Analysis of Behavior, 62, 225–233. doi:10.1901/jeab.1994.62-225.

    Article  PubMed Central  PubMed  Google Scholar 

  • Ito, M., & Nakamura, K. (1998). Humans’ choice in a self-control choice situation: Sensitivity to reinforcer amount, reinforcer delay, and overall reinforcement density. Journal of the Experimental Analysis of Behavior, 69, 87–102. doi:10.1901/jeab.1998.69-87.

    Article  PubMed Central  PubMed  Google Scholar 

  • King, G. R., & Logue, A. W. (1990). Humans’ sensitivity to variation in reinforcer amount: Effects of the method of reinforcer delivery. Journal of the Experimental Analysis of Behavior, 53, 33–45. doi:10.1901/jeab.1990.53-33.

    Article  PubMed Central  PubMed  Google Scholar 

  • Malott, R. W., & Trojan, E. A. (2007). Principles of behavior (6th ed.). Upper Saddle River: Prentice Hall.

    Google Scholar 

  • Mazur, J. E. (1987). An adjusting procedure for studying delayed reinforcement. In M. L. Commons, J. E. Mazur, J. A. Nevin, & H. Rachlin (Eds.), Quantitative analyses of behavior: Vol. 5. The effect of delay and of intervening events on reinforcement value (pp. 55–73). Hillsdale: Erlbaum.

    Google Scholar 

  • Mazur, J. E., & Logue, A. W. (1978). Choice in a “Self-control” paradigm: Effects of a fading procedure. Journal of the Experimental Analysis of Behavior, 30, 11–17. doi:10.1901/jeab.1978.30-11.

    Article  PubMed Central  PubMed  Google Scholar 

  • McCarthy, D., & Davison, M. (1986). Delayed reinforcement and delayed choice in symbolic matching to sample: Effects on stimulus discriminability. Journal of the Experimental Analysis of Behavior, 46, 293–303. doi:10.1901/jeab.1986.46-293.

    Article  PubMed Central  PubMed  Google Scholar 

  • Mischel, H. N., & Mischel, W. (1983). The development of children’s knowledge of self-control strategies. Child Development, 54, 603–619. doi:10.1007/978-3-642-70967-8_22.

    Article  Google Scholar 

  • Mischel, W., Shoda, Y., & Rodriguez, M. L. (1989). Delay of gratification in children. Science, 244, 933–938. doi:10.1126/science.2658056.

    Article  PubMed  Google Scholar 

  • Neef, N. A., Mace, F. C., & Shade, D. (1993). Impulsivity in students with serious emotional disturbance: The interactive effects of reinforcer rate, delay, and quality. Journal of Applied Behavior Analysis, 26, 37–52. doi:10.1901/jaba.1993.26-37.

    Article  PubMed Central  PubMed  Google Scholar 

  • Neef, N. A., Bicard, D. F., & Endo, S. (2001). Assessment of impulsivity and the development of self-control in students with attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 34, 397–408. doi:10.1901/jaba.2001.34-397.

    Article  PubMed Central  PubMed  Google Scholar 

  • Neef, N. A., Marckel, J., Ferreri, S. J., Bicard, D. F., Endo, S., Aman, M. G., & Armstrong, N. (2005). Behavioral assessment of impulsivity: A comparison of children with and without attention deficit hyperactivity disorder. Journal of Applied Behavior Analysis, 38, 23–37. doi:10.1901/jaba.2005.146-02.

    Article  PubMed Central  PubMed  Google Scholar 

  • Neuringer, A. J. (1967). Effects of reinforcement magnitude on choice and rate of responding. Journal of the Experimental Analysis of Behavior, 10, 417–424. doi:10.1901/jeab.1967.10-417.

    Article  PubMed Central  PubMed  Google Scholar 

  • Nietzsche, F. (1996). Human, all too human: A book for free spirits (R. J. Hollingdale, Trans.). Cambridge University Press. (Original work published in 1878).

    Google Scholar 

  • Ragotzy, S. P., Blakely, E., & Poling, A. (1988). Self-control in mentally retarded adolescents: Choice as a function of amount and delay of reinforcement. Journal of the Experimental Analysis of Behavior, 49, 191–199. doi:10.1901/jeab.1988.49-191.

    Article  PubMed Central  PubMed  Google Scholar 

  • Reed, D. D., & Martens, B. K. (2011). Temporal discounting predicts student responsiveness to exvhange delays in a classroom token system. Journal of Applied Behavior Analysis, 44, 1–18. doi:10.1901/jaba.2011.44-1.

    Article  PubMed Central  PubMed  Google Scholar 

  • Rider, D. P. (1983). Preference for mixed versus constant delays of reinforcement: Effect and probability of the short, mixed delay. Journal of the Experimental Analysis of Behavior, 39, 257–266. doi:10.1901/jeab.1983.39-257.

    Article  PubMed Central  PubMed  Google Scholar 

  • Schwarz, M. L., & Hawkins, R. P. (1970). Application of delayed reinforcement procedures to the behavior of an elementary school child. Journal of Applied Behavior Analysis, 3, 85–96. doi:10.1901/jaba.1970.3-85.

    Article  PubMed Central  PubMed  Google Scholar 

  • Schweitzer, J. B., & Sulzer-Azaroff, B. (1988). Self-control: Teaching tolerance for delay in impulsive children. Journal of the Experimental Analysis of Behavior, 50, 173–186. doi:10.1901/jeab.1988.50-173.

    Article  PubMed Central  PubMed  Google Scholar 

  • Skinner, B. F. (1948). Walden two. New York: The Macmillan Company.

    Google Scholar 

  • Skinner, B. F. (1969). Contingencies of reinforcement: A theoretical analysis. New York: Meredith Corporation.

    Google Scholar 

  • Skinner, B. F. (1971). Beyond freedom and dignity. Indianapolis: Hackett Publishing Company, Inc.

    Google Scholar 

  • Skinner, B. F. (1974). About behaviorism. New York: Random House.

    Google Scholar 

  • Solnick, J. V., Kennenberg, C. H., Eckerman, D. A., & Waller, M. B. (1980). An experimental analysis of impulsivity and impulse control in humans. Learning and Motivation, 11, 61–77. doi:10.1016/0023-9690(80)90021-1.

    Article  Google Scholar 

  • Stokes, T. F., & Baer, D. M. (1977). An implicit technology of generalization. Journal of Applied Behavior Analysis, 10, 349–367. doi:10.1901/jaba.1977.10-349.

    Article  PubMed Central  PubMed  Google Scholar 

  • Stromer, R., McComas, J. J., & Rehfeldt, R. (2000). Designing interventions that include delayed reinforcement: Implications of recent laboratory research. Journal of Applied Behavior Analysis, 33, 359–371. doi:10.1901/jaba.2000.33-359.

    Article  PubMed Central  PubMed  Google Scholar 

  • Van Houten, R., Malenfant, J. E. L., Austin, J., & Lebbon, A. (2005). The effects of a seatbelt-gearshift delay prompt on the seatbelt use of motorists who do not regularly wear seatbelts. Journal of Applied Behavior Analysis, 38, 195–203. doi:10.1901/jaba.2005.48-04.

    Article  PubMed Central  PubMed  Google Scholar 

  • Van Houten, R., Malenfant, J. E., Reagan, I., Sifrit, K., Compton, R., & Tenenbaum, J. (2010). Increasing seat belt use in service vehicle drivers with a gearshift delay. Journal of Applied Behavior Analysis, 43, 369–380. doi:10.1901/jaba.2010.43-369.

    Article  PubMed Central  PubMed  Google Scholar 

  • Vollmer, T. R., Borrero, J. C., Lalli, J. S., & Daniel, D. (1999). Evaluating self-control and impulsivity in children with severe behavior disorders. Journal of Applied Behavior Analysis, 32, 451–466. doi:10.1901/jaba.1999.32-451.

    Article  PubMed Central  PubMed  Google Scholar 

  • Weatherly, J. N., & Dixon, M. R. (2007). Toward an integrative behavioral model of gambling. Analysis of Gambling Behavior, 1, 4–18. http://arts-sciences.und.edu/psychology/analysis_of_gambling_behavior/analysisofgamblingbehavior.cfm.

    Google Scholar 

  • Williams, B. A. (1999). Value transmission in discrimination learning involving stimulus chains. Journal of the Experimental Analysis of Behavior, 72, 177–185. doi:10.1901/jeab.1999.72-177.

    Article  PubMed Central  PubMed  Google Scholar 

  • Zlomke, K. R., & Dixon, M. R. (2006). Modification of slot-machine preferences through the use of a conditional discrimination paradigm. Journal of Applied Behavior Analysis, 39, 351–361. doi:10.1901/jaba.2006.109-04.

    Article  PubMed Central  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mark R. Dixon .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Science+Business Media New York

About this chapter

Cite this chapter

Whiting, S., Dixon, M. (2015). Delayed Reinforcement and Self-Control: Increasing Tolerance for Delay with Children and Adults with Autism. In: DiGennaro Reed, F., Reed, D. (eds) Autism Service Delivery. Autism and Child Psychopathology Series. Springer, New York, NY. https://doi.org/10.1007/978-1-4939-2656-5_15

Download citation

Publish with us

Policies and ethics