Analysis of a Stochastic Lot Scheduling Problem with Strict Due-Dates

  • Nicky D. van ForeestEmail author
  • Jacob Wijngaard
Part of the International Series in Operations Research & Management Science book series (ISOR, volume 248)


This chapter considers admission control and scheduling rules for a single machine production environment. Orders arrive at a single machine and can be grouped into several product families. Each order has a family dependent due-date, production duration, and reward. When an order cannot be served before its due-date it has to be rejected. Moreover, when the machine changes the production of one type of family to another family, a setup time is incurred. The problem is to find long-run average optimal policies that accept or reject orders and schedule the accepted orders.

To obtain insight into the optimal performance of the system we model it as a Markov decision process (MDP). This formal description leads to, at least, three tangible goals. First, for small scale problems the optimal admission and scheduling policy can be obtained with, e.g., policy iteration. Second, simple heuristic policies can be formulated in terms of the concepts developed for the MDP, i.e., the states, actions and (action-dependent) transition matrices. Finally, the simulator required to study the performance of heuristic policies for large scale problems can be directly implemented as an MDP. Thus, the formal description of the system in terms of an MDP has considerable off-spin beyond the mere numerical aspects of solving the MDP for small-scale systems.


Arrival Rate Optimal Policy Setup Time Markov Decision Process Product Family 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    E. Winands, I. Adan, G. van Houtum, Eur. J. Oper. Res. 210 (1), 1 (2011)CrossRefGoogle Scholar
  2. 2.
    H. Ten Kate, Order acceptance and production control. Ph.D. thesis, University of Groningen, Groningen, 1995Google Scholar
  3. 3.
    E. Schmidt, M. Dada, J. Ward, D. Adams, Interfaces 31 (3), 16 (2001)CrossRefGoogle Scholar
  4. 4.
    L. Strijbosch, R. Heuts, M. Luijten, Int. J. Oper. Prod. Manage. 22 (5), 549 (2002)CrossRefGoogle Scholar
  5. 5.
    R. Germs, N. van Foreest, Int. J. Prod. Res. 51, 940 (2013)CrossRefGoogle Scholar
  6. 6.
    R. Germs, N. van Foreest, Eur. J. Oper. Res. 213, 375 (2011)CrossRefGoogle Scholar
  7. 7.
    N.D. van Foreest, J. Wijngaard, J.T. Van der Vaart, Int. J. Prod. Res. 48, 3561 (2010)CrossRefGoogle Scholar
  8. 8.
    J. Bertrand, J. Wortmann, J. Wijngaard, Production Control, a Structural and Design Oriented Approach (Elsevier, Amsterdam, 1990)Google Scholar
  9. 9.
    R. Haijema, N. van Dijk, J. van der Wal, C.S. Sibinga, Int. J. Prod. Econ. 121 (2), 464 (2009)CrossRefGoogle Scholar
  10. 10.
    H. Takagi, in Stochastic Analysis of Computer and Communication Systems, ed. by H. Takagi (Elsevier, Amsterdam, 1990), pp. 267–318Google Scholar
  11. 11.
    H. Takagi, Adv. Appl. Probab. 23 (2), 373 (1991)CrossRefGoogle Scholar
  12. 12.
    E. Kim, M. Van Oyen, IIE Trans. 32 (9), 807 (2000)Google Scholar
  13. 13.
    L. Kleinrock, H. Levy, J. Oper. Res. 36 (5), 716 (1988)CrossRefGoogle Scholar
  14. 14.
    R. Righter, J.G. Shantikumar, Oper. Res. 12 (3), 146 (1998)CrossRefGoogle Scholar
  15. 15.
    D. Markovitz, L. Wein, Oper. Res. 49 (2), 246 (2001)CrossRefGoogle Scholar
  16. 16.
    M. Reiman, L. Wein, Oper. Res. 46 (4), 532 (1998)CrossRefGoogle Scholar
  17. 17.
    O. Boxma, H. Levy, J. Westrate, Queueing Syst. 9, 133 (1994)CrossRefGoogle Scholar
  18. 18.
    Z. Liu, P. Nain, D. Towsley, Queueing Syst. 11, 59 (1992)CrossRefGoogle Scholar
  19. 19.
    N. Vandaele, I.V. Nieuwenhuyse, S. Cupers, Eur. J. Oper. Res. 151, 181 (2003)CrossRefGoogle Scholar
  20. 20.
    M. Pinedo, Planning and Scheduling in Manufacturing and Services, 2nd edn. (Springer, New York, 2008)Google Scholar
  21. 21.
    M. Puterman, Markov Decision Processes, Discrete Stochastic Dynamic Programming (Wiley, New York, 1994)Google Scholar
  22. 22.
    H. Tijms, A First Course in Stochastic Models (Wiley, Chichester, 2003)CrossRefGoogle Scholar
  23. 23.
    R. Haijema, J. Van der Wal, N.M. van Dijk, Comput. Oper. Res. 34, 760 (2007)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Faculty of Economics and BusinessUniversity of GroningenGroningenThe Netherlands

Personalised recommendations