Skip to main content

Concurrent Schedules: Response versus Reinforcement Interaction

  • Chapter
Book cover Classical Conditioning and Operant Conditioning
  • 735 Accesses

Abstract

The fact is now well established that presentation of reinforcers contingent upon a specific response will usually increase the rate of that response, and subsequent removal of reinforcers will decrease the response rate (Skinner, 1938). Skinner once briefly introduced and quickly withdrew a principle stating that the rate (strength) of one response (R) might be directly proportional to the absolute reinforcement rate (r) for that response; expressed mathematically,

$$ R = Kr. $$
(1)

.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Alleman, H. D., and Zeiler, M. D.: Patterning with fixed-time schedules of response-independent reinforcement. J. Exp. Anal. Behav., 22, 135–141, 1974.

    Article  PubMed  Google Scholar 

  • Bacotti, A. V.: Matching under concurrent fixed-ratio variable-interval schedules of food presentation. J. Exp. Anal. Behav., 27, 171–182, 1977.

    Article  PubMed  Google Scholar 

  • Baum, W. M.: The correlation-based law of effect. J. Exp. Anal. Behav., 20, 137–153, 1973.

    Article  PubMed  Google Scholar 

  • Baum, W. M.: On two types of deviation from the matching law: bias and undermatching. J. Exp. Anal. Behav., 22, 231–242, 1974.

    Article  PubMed  Google Scholar 

  • Boren, J. J.: Stimulus probes of the fixed ratio run. Paper delivered at Eastern Psychological Association, Philadelphia, 1961.

    Google Scholar 

  • Browne, M. P., and Dinsmoor, J. A.: Selective observing of discriminative stimuli. Proceedings of the 80th Annual Convention of the American Psychological Association, 1972, pp. 745–746.

    Google Scholar 

  • Brownstein, A. J., and Pliskoff, S. S.: Some effects of relative reinforcement rate and changeover delay in response-independent concurrent schedules of reinforcement. J. Exp. Anal. Behav., 11, 683–688, 1968.

    Article  PubMed  Google Scholar 

  • Buel, C. L.: Investigation of the temporal parameters in omission training with humans in a two-key situation. Psychol. Record, 25, 99–109, 1975.

    Google Scholar 

  • Carlson, J. G., and Aroksaar, R. E.: Effects of time-out upon concurrent operant responding. Psychol. Record, 20, 365–371, 1970.

    Google Scholar 

  • Catania, A. C.: Concurrent performances: reinforcement interaction and response independence. J. Exp. Anal. Behav., 6, 253–263, 1963.

    Article  PubMed  Google Scholar 

  • Catania, A. C.: Concurrent operants. In, W. K. Honig (ed.): Operant Behavior: Areas of Research and Application. New York, Appleton-Century-Crofts, 1966.

    Google Scholar 

  • Catania, A. C.: Concurrent performances: inhibition of one response by reinforcement of another. J. Exp. Anal. Behav., 12, 731–744, 1969.

    Article  PubMed  Google Scholar 

  • Catania, A. C.: Self-inhibiting effects of reinforcement. J. Exp. Anal. Behav., 19, 517–526, 1973.

    Article  PubMed  Google Scholar 

  • Catania, A. C., and Dobson, R.: Concurrent performances: rate and accuracy of free-operant oddity responding. J. Exp. Anal. Behav., 17, 25–35, 1972.

    Article  PubMed  Google Scholar 

  • Catania, A. C., and Reynolds, G. S.: A quantitative analysis of the responding maintained by interval schedules of reinforcement. J. Exp. Anal. Behav., 11, 327–383, 1968.

    Article  PubMed  Google Scholar 

  • Catania, A. C., Silverman, P. J., and Stubbs, D. A.: Concurrent performances: stimulus-control gradients during schedules of signaled and unsignaled concurrent reinforcement. J. Exp. Anal. Behav., 21, 99–107, 1974.

    Article  PubMed  Google Scholar 

  • Chung, S. H.: Effects of delayed reinforcement in a concurrent situation. J. Exp. Anal. Behav., 8, 439–444, 1965.

    Article  PubMed  Google Scholar 

  • Chung, S. H., and Herrnstein, R. J.: Choice and delay of reinforcement. J. Exp. Anal. Behav., 10, 67–74, 1967.

    Article  PubMed  Google Scholar 

  • Davis, H., Iriye, C., and Hubbard, J.: Response independent food as an extinction procedure for responding on DRL schedules. Psychol. Record, 23, 33–38, 1973.

    Google Scholar 

  • Davis, J., and Bitterman, M. E.: Differential reinforcement of other behavior (DRO): a yoked-con-trol comparison. J. Exp. Anal. Behav., 15, 237–241, 1971.

    Article  PubMed  Google Scholar 

  • Deluty, M. Z.: Choice and the rate of punishment in concurrent schedules. J. Exp. Anal. Behav., 25, 75–80, 1976a.

    Article  PubMed  Google Scholar 

  • Deluty, M. Z.: Excitatory and inhibitory effects of free reinforcers. Anim. Learning Behav., 4, 436–440, 1976b.

    Article  Google Scholar 

  • deVilliers, P.: Choice in concurrent schedules and a quantitative formulation of the law of effect. In, W. K. Honig and J. E. R. Staddon (eds.): Handbook of Operant Behavior. Englewood Cliffs, N.J., Prentice-Hall, 1977.

    Google Scholar 

  • Dunham, P. J.: Punishment: method and theory. Psychol. Rev., 78, 58–70, 1971.

    Article  Google Scholar 

  • Dunham, P. J.: Some effects of punishment upon unpunished responding. J. Exp. Anal. Behav., 17, 443–450, 1972.

    Article  PubMed  Google Scholar 

  • Edwards, D. D., Peek, V., and Wolfe, F.: Independently delivered food decelerates fixed ratio rates. J. Exp. Anal. Behav., 14, 301–307, 1970.

    Article  PubMed  Google Scholar 

  • Fenner, D. H.: Key pecking in pigeons maintained by short-interval adventitious schedules of reinforcement. Proceedings of the 77th Annual Convention of the American Psychological Association, 1969, pp. 831–832.

    Google Scholar 

  • Ferster, C. B.: Concurrent schedules of reinforcement in the chimpanzee. Science, 125, 1090–1091, 1957.

    Article  PubMed  Google Scholar 

  • Ferster, C. B.: A complex concurrent schedule of reinforcement. J. Exp. Anal. Behav., 2, 65–80, 1959.

    Article  PubMed  Google Scholar 

  • Ferster, C. B., and Skinner, B. F.: Schedules of Reinforcement. New York, Appleton-Century-Crofts, 1957.

    Book  Google Scholar 

  • Findley, J. D.: Preference and switching under concurrent scheduling. J. Exp. Anal. Behav., 1, 123–144, 1958.

    Article  PubMed  Google Scholar 

  • Fleshier, M., and Hoffman, H. S.: A progression for generating variable-interval schedules. J. Exp. Anal. Behav., 5, 529–530, 1962.

    Article  Google Scholar 

  • Henton, W. W.: Avoidance response rates during a pre-food stimulus in monkeys. J. Exp. Anal. Behav., 17, 269–275, 1972.

    Article  PubMed  Google Scholar 

  • Henton, W. W., and Iversen, I. H.: Concurrent response rates during pre-event stimuli. Paper presented at the Easter Conference: English Experimental Analysis of Behavior Group, Cambridge, March 1973.

    Google Scholar 

  • Herbert, E. W.: Two-key concurrent responding: response-reinforcement dependencies and blackout. J. Exp. Anal. Behav., 14, 61–70, 1970.

    Article  PubMed  Google Scholar 

  • Herrnstein, R. J.: Relative and absolute strength of response as a function of frequency of reinforcement. J. Exp. Anal. Behav., 4, 267–272, 1961.

    Article  PubMed  Google Scholar 

  • Herrnstein, R. J.: On the law of effect. J. Exp. Anal. Behav., 13, 243–266, 1970.

    Article  PubMed  Google Scholar 

  • Herrnstein, R. J.: Formal properties of the matching law. J. Exp. Anal. Behav., 21, 159–164, 1974.

    Article  PubMed  Google Scholar 

  • Iversen, I. H.: Behavioral interactions in concurrent reinforcement schedules. Paper presented at Easter Conference of the English Experimental Analysis of Behavior Group, Bangor, April 1974.

    Google Scholar 

  • Iversen, I. H.: Reciprocal response interactions in concurrent variable-interval and discrete-trial fixed-ratio schedules. Scand. J. Psychol., 16, 280–284, 1975a.

    Article  Google Scholar 

  • Iversen, I. H.: Response versus reinforcement interaction in concurrent reinforcement schedules. Paper presented at Easter Conference of the English Experimental Analysis of Behavior Group. Exeter, March 1975b.

    Google Scholar 

  • Iversen, I. H.: Interactions between reinforced responses and collateral responses. Psychol. Record, 26, 399–413, 1976.

    Google Scholar 

  • Kantor, J. R., and Smith, N. W.: The Science of Psychology: An Interbehavioral Survey. Chicago, Ill., Principia Press, 1975.

    Google Scholar 

  • Katz, R. C.: Effects of punishment in an alternative response context as a function of relative reinforcement rate. Psychol. Record. 23, 65–74, 1973.

    Google Scholar 

  • Kimble, G. A.: Foundations of Conditioning and Learning. New York, Appleton-Century-Crofts, 1967.

    Google Scholar 

  • LaBounty, C. E., and Reynolds, G. S.: An analysis of response and time matching to reinforcement in concurrent ratio-interval schedules. J. Exp. Anal. Behav., 19, 155–166, 1973.

    Article  PubMed  Google Scholar 

  • Lachter, G. D.: Some temporal parameters of non-contingent reinforcement. J. Exp. Anal. Behav., 16, 207–217, 1971.

    Article  PubMed  Google Scholar 

  • Lattal, K. A.: Response-reinforcer independence and conventional extinction after fixed-interval and variable-interval schedules. J. Exp. Anal. Behav., 18, 133–140, 1972.

    Article  PubMed  Google Scholar 

  • Lattal, K. A.: Response-reinforcer dependence and independence in multiple and mixed schedules. J. Exp. Anal. Behav., 20, 265–271, 1973.

    Article  PubMed  Google Scholar 

  • Lattal, K. A.: Combinations of response-reinforcer dependence and independence. J. Exp. Anal. Behav., 22, 357–362, 1974.

    Article  PubMed  Google Scholar 

  • Lattal, K. A., and Bryan, A. J.: Effects of concurrent response-independent reinforcement on fixed-interval schedule performance. J. Exp. Anal. Behav., 26, 495–504, 1976.

    Article  PubMed  Google Scholar 

  • Lowry, M. A., and Lachter, G. D.: Response elimination: a comparison of four procedures. Learning Motivation, 8, 69–76, 1977.

    Article  Google Scholar 

  • Moffit, M., and Shimp, C. P.: Two-key concurrent paced variable-interval paced variable-interval schedules of reinforcement. J. Exp. Anal. Behav., 16, 39–49, 1971.

    Article  Google Scholar 

  • Neuringer, A. J.: Superstitious key pecking after three peck-produced reinforcements. J. Exp. Anal. Behav., 13, 127–134, 1970.

    Article  PubMed  Google Scholar 

  • Nevin, J. A.: Rates and patterns of responding with concurrent fixed-interval and variable-interval reinforcement. J. Exp. Anal. Behav., 16, 241–247, 1971.

    Article  PubMed  Google Scholar 

  • Nevin, J. A.: The maintenance of behavior. In, J. A. Nevin and G. S. Reynolds (eds.): The Study of Behavior. Glenview, Ill., Scott, Foresman, 1973.

    Google Scholar 

  • Pavlov, I. P.: Conditioned Reflexes (Translated by G. V. Anrep). London, Oxford 1927 (reprinted, New York, Dover, 1960).

    Google Scholar 

  • Pliskoff, S. S., and Green, D.: Effects on concurrent performances of stimulus correlated with reinforcer availability. J. Exp. Anal. Behav., 17, 221–227, 1972.

    Article  PubMed  Google Scholar 

  • Pliskoff, S. S., Shull, R. L., and Gollub, L. R.: The relation between response rates and reinforcement rates in a multiple schedule. J. Exp. Anal. Behav., 11, 271–284, 1968.

    Article  PubMed  Google Scholar 

  • Powers, R. B., and Osborne, J. G.: Fundamentals of Behavior. San Francisco, West, 1976.

    Google Scholar 

  • Premack, D.: Reinforcement theory. In, D. Levine (ed.): Nebraska Symposium on Motivation. Lincoln, University of Nebraska Press, 1965.

    Google Scholar 

  • Rachlin, H.: Contrast and matching. Psychol. Rev., 80, 217–234, 1973.

    Article  Google Scholar 

  • Rachlin, H., and Baum, W. M.: Response rate as a function of amount of reinforcement for a signalled concurrent response. J. Exp. Anal. Behav., 12, 11–16, 1969.

    Article  PubMed  Google Scholar 

  • Rachlin, H., and Baum, W. M.: Effects of alternate reinforcement: Does the source matter? J. Exp. Anal. Behav., 18, 231–241, 1972.

    Article  PubMed  Google Scholar 

  • Schneider, J. W.: Reinforcer effectiveness as a function of reinforcer rate and magnitude: a comparison of concurrent performance s. J. Exp. Anal. Behav., 20, 461–471, 1973.

    Article  PubMed  Google Scholar 

  • Schoenfeld, W. N., and Farmer, J.: Reinforcement schedules and the “behavior stream.” In, W. N. Schoenfeld (ed.): The Theory of Reinforcement Schedules. New York, Appleton-Century-Crofts, 1970.

    Google Scholar 

  • Schroeder, S. R.: Perseveration in concurrent performances by the developmentally retarded. Psychol. Record, 25, 51–64, 1975.

    Google Scholar 

  • Sherman, J. A., and Thomas, J. R.: Some factors controlling preference between fixed-ratio and variable-ratio schedules of reinforcement. J. Exp. Anal. Behav., 11, 689–702, 1968.

    Article  PubMed  Google Scholar 

  • Shull, R. L., and Pliskoff, S. S.: Changeover delay and concurrent schedules: some effects on relative performance measures. J. Exp. Anal. Behav., 10, 517–527, 1967.

    Article  PubMed  Google Scholar 

  • Sidman, M.: Time discrimination and behavioral interaction in a free operant situation. J. Comp. Physiol. Psychol., 49, 469–473, 1956.

    Article  PubMed  Google Scholar 

  • Sidman, M.: Tactics of Scientific Research: Evaluating Experimental Data in Psychology. New York, Basic Books, 1960.

    Google Scholar 

  • Sidman, M.: Time out from avoidance as a reinforcer: a study of response interactions. J. Exp. Anal. Behav., 5, 423–434, 1962.

    Article  PubMed  Google Scholar 

  • Skinner, B. F.: The Behavior of Organisms. New York, Appleton-Century-Crofts, 1938.

    Google Scholar 

  • Skinner, B. F.: Superstition in the pigeon. J. Exp. Psychol., 38, 168–172, 1948.

    Article  PubMed  Google Scholar 

  • Skinner, B. F.: Are theories of learning necessary? Psychol. Rev., 57, 193–216, 1950.

    Article  PubMed  Google Scholar 

  • Skinner, B. F.: Science and Human Behavior. New York, Macmillan, 1953.

    Google Scholar 

  • Skinner, B. F.: Contingencies of Reinforcement. New York, Appleton-Century-Crofts, 1969.

    Google Scholar 

  • Spence, K. W.: The differential response in animals to stimuli varying within a single dimension. Psychol. Rev., 44, 430–444, 1937.

    Article  Google Scholar 

  • Staddon, J. E. R.: Learning as adaptation. In, W. K. Estes (ed.): Handbook of Learning and Cognitive Processes, vol. 2. Hillsdale, N. J., Lawrence Erlbaum, 1975.

    Google Scholar 

  • Staddon, J. E. R.: Schedule-induced behavior. In, W. K. Honig and J. E. R. Staddon (eds.): Handbook of Operant Behavior. Englewood Cliffs, N. J., Prentice-Hall, 1977.

    Google Scholar 

  • Thomas, J. R.: Fixed-ratio punishment by timeout of concurrent variable-interval behavior. J. Exp. Anal. Behav., 11, 609–616, 1968.

    Article  PubMed  Google Scholar 

  • Todorov, J. C.: Concurrent performances: effect of punishment contingent on the switching response. J. Exp. Anal. Behav., 16, 51–62, 1971.

    Article  PubMed  Google Scholar 

  • Verhave, T.: Some observations concerning prepotency and probability of postponing shock with a two-lever avoidance procedure. J. Exp. Anal Behav., 4, 187–192, 1961.

    Article  PubMed  Google Scholar 

  • Zeiler, M. D.: Eliminating behavior with reinforcement. J. Exp. Anal. Behav. 16, 401–405, 1971

    Article  PubMed  Google Scholar 

  • Zeiler, M. D.: Positive reinforcement and the elimination of reinforced responses. J. Exp. Anal. Behav. 26, 37–44, 1976.

    Article  PubMed  Google Scholar 

  • Zeiler, M. D.: Elimination of reinforced behavior: intermittent schedules of not-responding. J. Exp. Anal Behav. 27, 23–32, 1977.

    Article  PubMed  Google Scholar 

  • Zener, K.: The significance of behavior accompanying conditioned salivary secretion for theories of the conditioned response. Am. J. Psychol., 50, 384–403, 1937.

    Article  Google Scholar 

Download references

Authors

Rights and permissions

Reprints and permissions

Copyright information

© 1978 Springer-Verlag New York Inc.

About this chapter

Cite this chapter

Iversen, I.H. (1978). Concurrent Schedules: Response versus Reinforcement Interaction. In: Classical Conditioning and Operant Conditioning. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-6310-4_4

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-6310-4_4

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4612-6312-8

  • Online ISBN: 978-1-4612-6310-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics