A Synergetic Model for Operant Behaviors Under the Control of Fixed Interval Reinforcement Schedules

  • Shih-Che Lin
  • Jay-Shake Li


This study presents a nonlinear dynamical model for operant responses under the FI reinforcement schedule based on the synergetic concept. The model simulates different types of behavioral dynamics seen in the extended return map (ERM) patterns, as well as the “scalloped-curve” using data averaged over a whole session. We compared our results with the performance of a very popular model for operant behaviors, Machado’s LeT model. It was found that although both models can successfully reproduce the scalloped-curve built from the averaged data, only the synergetic model is capable of simulating the real time dynamics of FI-responses revealed in the ERM-patterns.


Operant FI schedule synergetic extended return map LeT 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Gibbon, J.: Scalar Expectancy Theory and Weber’s Law in Animal Timing. Psychological Review 84 (1977) 279–325.CrossRefGoogle Scholar
  2. 2.
    Killeen, P., Fetterman, G.: A Behavioral Theory of Timing. Psychological Review 95 (1988) 274–295.PubMedCrossRefGoogle Scholar
  3. 3.
    Machado, A.: Learning the Temporal Dynamics of Behavior. Psychological Review 104 (1997) 241–265.PubMedCrossRefGoogle Scholar
  4. 4.
    Hoyert, M.S.: Order and Chaos in Fixed? Interval Schedules of Reinforcement. Journal of the Experimental Analysis of Behavior 57 (1992) 336–339.CrossRefGoogle Scholar
  5. 5.
    Palya, W.L.: Dynamics in the fine structure of schedule? Controlled Behavior. Journal of the Experimental Analysis of Behavior 57 (1992) 267–287.PubMedCrossRefGoogle Scholar
  6. 6.
    Li, J.-S., Huston, J.P.: Nonlinear Dynamics of Operant Behavior: A New Approach via the Extended Return Map. Reviews in the Neurosciences 13 (2002) 31–57.PubMedGoogle Scholar
  7. 7.
    Li, J.-S., Huston, J.P., Krauth, J.: Operant Behavior of Rats Under Fixed-Interval Reinforcement Schedules: A Dynamical Analysis Via the Extended Return Map. Nonlinear Dynamics, Psychology, and Life Sciences 10 (2006) 215–240.PubMedGoogle Scholar
  8. 8.
    Ditzinger, T., Haken, H. A synergetic model of multistability in perception. In: P. Kruse and M. Stadler (eds.), Ambiguity in Mind and Nature: Multistable Cognitive Phenomena, Springer Verlag, Berlin, 1995, pp. 255–274.Google Scholar
  9. 9.
    Ditzinger, T., Tuller, B., Haken, H., Kelso, J.A.S.: A synergetic model for the verbal transformation effect. Biological Cybernetics 77 (1997)31–40.PubMedCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Shih-Che Lin
    • 1
  • Jay-Shake Li
  1. 1.Departmet of Psychology National ChungCheng University 168Ming-Hsiung Chia-YiTaiwan

Personalised recommendations