Modeling, planning, and scheduling of shop-floor assembly process with dynamic cyber-physical interactions: a case study for CPS-based smart industrial robot production

  • Qingmeng Tan
  • Yifei TongEmail author
  • Shaofeng Wu
  • Dongbo Li


In recent years, the applications of industrial robots are expanding rapidly due to Industry 4.0 oriented evolutions, ranging from automobile industry to almost all manufacturing domains. As demands with rapid product iterations become increasingly fluctuant and customized, the assembly process of industrial robots faces new challenges including dynamic reorganization and reconfiguration, ubiquitous sensing, and communication with time constraints, etc. This paper studies the industrial robot assembly process modeling, planning, and scheduling based on real-time data acquisition and fusion under the framework of advanced shop-floor communication and computing technologies such as wireless sensor, actuator network, and edge computing. Taking the assembly of industrial robots as the specific object, the multi-agent model of industrial robot assemble process is established. Then, the encapsulation, communication, and interaction of agents with real-time data acquisition and fusion are studied. Based on multi-agent reinforcement learning approach, an intelligent planning and scheduling algorithm for industrial robot assembly is proposed, and a simulation case is presented to demonstrate the proposed model and algorithm.


Robotics Cyber-physical system Multi-agent system Reinforcement learning 



  1. 1.
    (2017) IFR forecast: 1.7 million new robots to transform the world’s factories by 2020 - International Federation of Robotics. Accessed 11 March 2018.
  2. 2.
    Monostori L, Kádár B, Bauernhansl T, Kondoh S, Kumara S, Reinhart G, Sauer O, Schuh G, Sihn W, Ueda K (2016) Cyber-physical systems in manufacturing. CIRP Ann Manuf Technol 65:621–641. CrossRefGoogle Scholar
  3. 3.
    Monostori L (2014) Cyber-physical production systems: roots, expectations and R&D challenges. Procedia CIRP 17:9–13. CrossRefGoogle Scholar
  4. 4.
    Bagheri B, Yang S, Kao H, Lee J (2015) Cyber-physical systems architecture for self-aware Machines in Industry 4.0 environment. IFAC-PapersOnLine 48:1622–1627. CrossRefGoogle Scholar
  5. 5.
    Michniewicz J, Reinhart G (2016) Cyber-physical-robotics – modelling of modular robot cells for automated planning and execution of assembly tasks. Mechatronics 34:170–180. CrossRefGoogle Scholar
  6. 6.
    Seiger R, Keller C, Niebling F, Schlegel T (2015) Modelling complex and flexible processes for smart cyber-physical environments. J Comput Sci 10:137–148. CrossRefGoogle Scholar
  7. 7.
    He N, Zhang DZ, Li Q (2014) Agent-based hierarchical production planning and scheduling in make-to-order manufacturing system. Int J Prod Econ 149:117–130. CrossRefGoogle Scholar
  8. 8.
    Kucukkoc I, Zhang DZ (2016) Mixed-model parallel two-sided assembly line balancing problem: a flexible agent-based ant colony optimization approach. Comput Ind Eng 97:58–72. CrossRefGoogle Scholar
  9. 9.
    Park S, Kim J, Fox G (2014) Effective real-time scheduling algorithm for cyber physical systems society. Futur Gener Comput Syst 32:253–259. CrossRefGoogle Scholar
  10. 10.
    Babiceanu RF, Seker R (2016) Big data and virtualization for manufacturing cyber-physical systems: a survey of the current status and future outlook. Comput Ind 81:128–137. CrossRefGoogle Scholar
  11. 11.
    Lee J, Bagheri B, Kao H (2015) A cyber-physical systems architecture for industry 4.0-based manufacturing systems. Manuf Lett 3:18–23. CrossRefGoogle Scholar
  12. 12.
    Wittenberg C (2016) Human-CPS interaction - requirements and human-machine interaction methods for the industry 4.0. IFAC-PapersOnLine 49:420–425. CrossRefGoogle Scholar
  13. 13.
    Pirvu B, Zamfirescu C, Gorecky D (2016) Engineering insights from an anthropocentric cyber-physical system: a case study for an assembly station. Mechatronics 34:147–159. CrossRefGoogle Scholar
  14. 14.
    Dworschak B, Zaiser H (2014) Competences for cyber-physical Systems in Manufacturing – first findings and scenarios. Procedia CIRP 25:345–350. CrossRefGoogle Scholar
  15. 15.
    Shen W, Hao Q, Yoon HJ, Norrie DH (2006) Applications of agent-based systems in intelligent manufacturing: an updated review. Adv Eng Inform 20:415–431. CrossRefGoogle Scholar
  16. 16.
    Manupati VK, Putnik GD, Tiwari MK, Ávila P, Cruz-Cunha MM (2016) Integration of process planning and scheduling using mobile-agent based approach in a networked manufacturing environment. Comput Ind Eng 94:63–73. CrossRefGoogle Scholar
  17. 17.
    Barenji AV, Barenji RV, Hashemipour M (2016) Flexible testing platform for employment of RFID-enabled multi-agent system on flexible assembly line. Adv Eng Softw 91:1–11. CrossRefGoogle Scholar
  18. 18.
    Cupek R, Ziebinski A, Huczala L, Erdogan H (2016) Agent-based manufacturing execution systems for short-series production scheduling. Comput Ind 82:245–258. CrossRefGoogle Scholar
  19. 19.
    Leitao P, Karnouskos S, Ribeiro L, Lee J, Strasser T, Colombo AW (2016) Smart agents in industrial cyber–physical systems. Proc IEEE 104:1086–1101. CrossRefGoogle Scholar
  20. 20.
    Giordani S, Lujak M, Martinelli F (2013) A distributed multi-agent production planning and scheduling framework for mobile robots. Comput Ind Eng 64:19–30. CrossRefGoogle Scholar
  21. 21.
    Nouri HE, Belkahla Driss O, Ghédira K (2016) Simultaneous scheduling of machines and transport robots in flexible job shop environment using hybrid metaheuristics based on clustered holonic multiagent model. Comput Ind Eng 102:488–501. CrossRefGoogle Scholar
  22. 22.
    Wang S, Wan J, Zhang D, Li D, Zhang C (2016) Towards smart factory for industry 4.0: a self-organized multi-agent system with big data based feedback and coordination. Comput Netw 101:158–168. CrossRefGoogle Scholar
  23. 23.
    Pande V, Marlecha C, Kayte S (2016) A review- fog computing and its role in the internet of things. Int J Eng Res Appl 6:7–11Google Scholar
  24. 24.
    Lu F (2012) The ZigBee based wireless sensor and actor network in intelligent space oriented to home service robot. Int J Commun Netw Syst Sci 05:280–285. CrossRefGoogle Scholar
  25. 25.
    Satyanarayanan M (2017) The Emergence of Edge Computing, vol 50, pp 30–39. CrossRefGoogle Scholar
  26. 26.
    Shi W, Cao J, Zhang Q, Li Y, Xu L (2016) Edge computing: vision and challenges. IEEE Internet Things J 3:637–646. CrossRefGoogle Scholar
  27. 27.
    Bumgardner VK (2017) Contributions to edge computing. Dissertation University of KentuckyGoogle Scholar
  28. 28.
    Brucker P, Knust JS.(2006) Complex SchedulingGoogle Scholar
  29. 29.
    Gabel T (2009) Multi-agent reinforcement learning approaches for distributed job-shop scheduling problems. Dissertation Universität OsnabrückGoogle Scholar
  30. 30.
    Jiménez YM (2011) A generic multi-agent reinforcement learning approach for scheduling problems. Dissertation Vrije Universiteit BrusselGoogle Scholar
  31. 31.
    Gomes ER, Kowalczyk R (2009) Dynamic analysis of multiagent Q -learning with ε-greedy exploration: International Conference on Machine LearningGoogle Scholar

Copyright information

© Springer-Verlag London Ltd., part of Springer Nature 2019

Authors and Affiliations

  • Qingmeng Tan
    • 1
  • Yifei Tong
    • 1
    Email author
  • Shaofeng Wu
    • 1
  • Dongbo Li
    • 1
  1. 1.School of Mechanical EngineeringNanjing University of Science & TechnologyNanjingChina

Personalised recommendations