A Discrete Event Simulation Based Production Line Optimization through Markov Decision Process

  • Yuan Feng
  • Wenhui Fan
  • Yuanhui Qin
Part of the Communications in Computer and Information Science book series (CCIS, volume 402)


In this paper, we built simulation model of the production line from one car engine parts plant in Beijing, in order to find proper solutions to raise productivity. The method of Discrete Event Simulation was used to construct the simulation model on account of the fact that production line was a typical discrete event system. Besides, worker heterogeneity, stochastic environment and the effect of worker learning and forgetting were introduced into simulation model to make it closer to reality. We proposed different schedule policies to manage the running of production line with the verification from simulation experiments. Then, by taking advantage of the simulation results obtained previous, we built the optimization model by applying Markov Decision Process (MDP) to seek for the best policy promoting the productivity of production line.


discrete event simulation production line learning and forgetting markov decision process 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kelton, W.D., Law, A.M.: Simulation modeling and analysis. McGraw Hill, Boston (2000)Google Scholar
  2. 2.
    Yeralan, S., Eginhard, J.M.: A general model of a production line with intermediate buffer and station breakdown. IIE Transactions 19(2), 130–139 (1987)CrossRefGoogle Scholar
  3. 3.
    Nembhard, D.A.: The effects of task complexity and experience on learning and forgetting: A field study. Human Factors: The Journal of the Human Factors and Ergonomics Society 42(2), 272–286 (2000)CrossRefGoogle Scholar
  4. 4.
    Brucoli, M., Carnimeo, L., Grassi, G.: Discrete-time cellular neural networks for associative memories with learning and forgetting capabilities. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 42(7), 396–399 (1995)MathSciNetCrossRefzbMATHGoogle Scholar
  5. 5.
    Bailey, C.D.: Forgetting and the learning curve: A laboratory study. Management Science 35(3), 340–352 (1989)CrossRefGoogle Scholar
  6. 6.
    Globerson, S., Levin, N., Shtub, A.: The impact of breaks on forgetting when performing a repetitive task. IIE Transactions 21(4), 376–381 (1989)CrossRefGoogle Scholar
  7. 7.
    Nembhard, D.A., Uzumeri, M.V.: Experiential learning and forgetting for manual and cognitive tasks. International Journal of Industrial Ergonomics 25(4), 315–326 (2000)CrossRefGoogle Scholar
  8. 8.
    Shafer, S.M., Nembhard, D.A., Uzumeri, M.V.: The effects of worker learning, forgetting, and heterogeneity on assembly line productivity. Management Science 47(12), 1639–1653 (2001)CrossRefGoogle Scholar
  9. 9.
    Puterman, M.L.: Markov decision processes: discrete stochastic dynamic programming. Wiley-Interscience (2009)Google Scholar
  10. 10.
    Stratman, J.K., Roth, A.V., Gilland, W.G.: The deployment of temporary production workers in assembly operations: a case study of the hidden costs of learning and forgetting. Journal of Operations Management 21(6), 689–707 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Yuan Feng
    • 1
  • Wenhui Fan
    • 1
  • Yuanhui Qin
    • 2
  1. 1.State CIMS Engineering Research Center, Department of AutomationTsinghua UniversityBeijingP.R. China
  2. 2.System Engineering Research InstituteBeijingP.R. China

Personalised recommendations