Shop floor data-driven spatial–temporal verification for manual assembly planning

  • Wei FangEmail author
  • Lianyu Zheng


Motivated by the increasing demand and highly customized products, accurate and up-to-date information about the manufacturing process become essential to meet these requirements. In manual assembly activities, performing theoretical planning in simulation environments is a crucial procedure to detect and avoid unreasonable assembly operations. However, the deviations between theoretical and actual assembly actions would result in the failure of the manual assembly planning. Therefore, the verification for the manual assembly planning is significant to ensure the correctness of the actual assembly operations, performing a convergence between the cyber and physical world. The challenges involved in retrieving and utilizing the actual data about the manual activities on a shop floor. In this paper, a self-contained wearable tracking system is proposed and applied to collect the shop-floor data during the manual assembly operations. And then, an unsupervised classification method is applied to empower semantic knowledge to the shop-floor data derived from the workplace. Thus, an automatic spatial–temporal verification for manual assembly planning is carried out, providing indicators to optimize the current manual assembly planning. Experimental results illustrate that the proposed work can perform the spatial–temporal verification for manual assembly task and indicate evidence to improve the manual assembly planning objectively.


Spatial–temporal verification Manual assembly planning Data-driven Shop floor Wearable system 



The authors gratefully acknowledge the supports of the National Key Research and Development Program of China (No. 2018YFB1701602), the Defense Industrial Technology Development Program (JCKY2018601C011), the Fundamental Research Funds for the Central Universities (2019RC26) and Beijing Engineering Research Center of Pose Intelligent Equipment. We also appreciate Xu Jiaxing for preparing the manual assembly experiments.


  1. Agethen, P., Gaisbauer, F., Froehlich, P., Manns, M., & Rukzio, E. (2018). Towards realistic walk path simulation in automotive assembly lines: A probabilistic approach. Procedia Cirp, 67, 464–469.CrossRefGoogle Scholar
  2. Agethen, P., Otto, M., Gaisbauer, F., & Rukzio, E. (2016). Presenting a novel motion capture-based approach for walk path segmentation and drift analysis in manual assembly. In Proceedings of 6th changeable, agile, reconfigurable and virtual production (pp. 286–291).Google Scholar
  3. Baines, T., Hadfield, L., Mason, S., & Ladbrook, J. (2003). Using empirical evidence of variations in worker performance to extend the capabilities of discrete event simulations in manufacturing. In Proceedings of the 2003 winter simulation conference (pp. 1210–1216).Google Scholar
  4. Bauters, K., Cottyn, J., Claeys, D., Slembrouck, M., Veelaert, P., et al. (2018). Automated work cycle classification and performance measurement for manual work stations. Robotics and Computer-Integrated Manufacturing, 51, 139–157.CrossRefGoogle Scholar
  5. Cevikcan, E. (2014). A mathematical programming approach for walking-worker assembly systems. Assembly Automation, 34(1), 56–68.CrossRefGoogle Scholar
  6. Claeys, A., Hoedt, S., Soete, N., Cottyn, J., & Landeghem, H. (2015). Framework for evaluating cognitive support in mixed model assembly systems. In Proceedings of 15th IFAC symposium on information control in manufacturing (pp. 924–929).Google Scholar
  7. Dan, L., Hanson, L., & Ortengren, R. (2009). A comparative study of digital human modelling simulation results and their outcomes in reality: A case study within manual assembly of automobiles. International Journal of Industrial Ergonomics, 39(2), 428–441.CrossRefGoogle Scholar
  8. Du, J., & Duffy, V. (2007). A methodology for assessing industrial workstations using optical motion capture integrated with digital human models. Occupational Ergonomics, 7(1), 11–25.Google Scholar
  9. Fang, W., Zheng, L., & Xu, J. (2017). Self-contained optical-inertial motion capturing for assembly planning in digital factory. The International Journal of Advanced Manufacturing Technology, 93(1–4), 1243–1256.CrossRefGoogle Scholar
  10. Forster, C., Carlone, L., Dellaert, F., & Scaramuzza, D. (2017). On-manifold preintegration for real-time visual-inertial odometry. IEEE Transactions on Robotics, 33(1), 1–21.CrossRefGoogle Scholar
  11. Gao, W., Shao, X., & Liu, H. (2016). Enhancing fidelity of virtual assembly by considering human factors. International Journal of Advanced Manufacturing Technology, 83(5–8), 873–886.CrossRefGoogle Scholar
  12. Hedman, R., & Almstrom, P. (2017). A state of the art system for managing time data in manual assembly. International Journal of Computer Integrated Manufacturing, 30(10), 1060–1071.CrossRefGoogle Scholar
  13. Hu, W., Xiao, X., Fu, Z., Xie, D., & Tan, T. (2006). A system for learning statistical motion patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 28(9), 1450–1464.CrossRefGoogle Scholar
  14. Huang, G., Zhang, Y., Chen, X., & Newman, S. (2008). RFID-enabled real-time wireless manufacturing for adaptive assembly planning and control. Journal of Intelligent Manufacturing, 19(6), 701–713.CrossRefGoogle Scholar
  15. Huikari, V., Koskimaaki, H., Siirtola, P., & Roning, J. (2011). User-independent activity recognition for industrial assembly lines-feature vs. instance selection. In International conference on pervasive computing and applications (pp. 307–312).Google Scholar
  16. INTERACT. (2013–2016). Interactive manual assembly operations for the human-centered workplaces of the future. Retrieved September 22, 2018.
  17. Jayaram, S., Connacher, H., & Lyons, K. (1997). Virtual assembly using virtual reality techniques. Computer-Aided Design, 29(8), 575–584.CrossRefGoogle Scholar
  18. Kanungo, T., Mount, D. M., Netanyahu, N. S., Piatko, C. D., & Silverman, R. (2002). An efficient k-means clustering algorithm: Analysis and implementation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7), 881–892.CrossRefGoogle Scholar
  19. Kong, X., Luo, H., Huang, G., & Yang, X. (2018). Industrial wearable system: the human-centric empowering technology in Industry 4.0. Journal of Intelligent Manufacturing. Scholar
  20. Kusiak, A. (2017). Smart manufacturing must embrace big data. Nature, 544(7648), 23–25.CrossRefGoogle Scholar
  21. Lasi, H., Fettke, P., Feld, T., & Hoffmann, M. (2014). Industry. Business and Information Systems Engineering, 4(4), 239–242.CrossRefGoogle Scholar
  22. Lassalle, S., Wang, Q., Owen, G., & Mileham, A. (2007). A study of in-process waiting time on a linear walking worker assembly line. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 221(12), 1763–1770.CrossRefGoogle Scholar
  23. Liu, M., Ma, J., Lin, L., Ge, M., Wang, Q., et al. (2017). Intelligent assembly system for mechanical products and key technology based on internet of things. Journal of Intelligent Manufacturing, 28(2), 271–299.CrossRefGoogle Scholar
  24. Manns, M., Fischer, K., Du, H., Slusallek, P., & Alexopoulos, K. (2018). A new approach to plan manual assembly. International Journal of Computer Integrated Manufacturing, 31(9), 907–920.CrossRefGoogle Scholar
  25. Manns, M., Otto, M., & Mauer, M. (2016). Measuring motion capture data quality for data driven human motion synthesis. In Proceedings of 48th CIRP conference on manufacturing systems (pp. 945–950).Google Scholar
  26. Meulen, P., & Seidl, A. (2007). Ramsis—The leading cad tool for ergonomic analysis of vehicles. Lecture Notes in Computer Science, 4561, 1008–1017.CrossRefGoogle Scholar
  27. Ming, C. L., Elmaraghy, H. A., Nee, A. Y. C., Ong, S. K., Lanzetta, M., et al. (2013). CAD model based virtual assembly simulation, planning and training. CIRP Annals-Manufacturing Technology, 62(2), 799–822.CrossRefGoogle Scholar
  28. Pan, C. (2005). Integrating CAD files and automatic assembly sequence planning. Ph.D. thesis, Iowa State University.Google Scholar
  29. Prabhu, V., Song, B., Thrower, J., Tiwari, A., & Webb, P. (2015). Digitisation of a moving assembly operation using multiple depth imaging sensors. International Journal of Advanced Manufacturing Technology, 85, 163–184.CrossRefGoogle Scholar
  30. Puthenveetil, S., Daphalapurkar, C., Zhu, W., Leu, M., Liu, X., et al. (2015). Computer-automated ergonomic analysis based on motion capture and assembly simulation. Virtual Real-London, 19(2), 119–128.CrossRefGoogle Scholar
  31. Qiu, S., Fan, X., Wu, D., He, Q., & Zhou, D. (2013). Virtual human modeling for interactive assembly and disassembly operation in virtual reality environment. The International Journal of Advanced Manufacturing Technology, 69(9–12), 2355–2372.CrossRefGoogle Scholar
  32. Rude, D., Adams, S., & Beling, P. (2015). Task recognition from joint tracking data in an operational manufacturing cell. Journal of Intelligent Manufacturing, 29, 1203–1217.CrossRefGoogle Scholar
  33. Sahin, M., & Kellegoz, T. (2019). Balancing multi-manned assembly lines with walking workers: Problem definition, mathematical formulation, and an electromagnetic field optimisation algorithm. International Journal of Production Research. Scholar
  34. Stoessel, C., Wiesbeck, M., Stork, S., Zaeh, M.F., & Schuboe, A. (2008). Towards optimal worker assistance: investigating cognitive processes in manual assembly. In Proceedings of the CIRP conference on manufacturing systems (pp. 245–250).Google Scholar
  35. Tao, F., Qi, Q., Liu, A., & Kusiak, A. (2018). Data-driven smart manufacturing. Journal of Manufacturing Systems, 48, 157–169.CrossRefGoogle Scholar
  36. Wang, X., Ong, S. K., & Nee, A. Y. C. (2016). Real-virtual components interaction for assembly simulation and planning. Robotics and Computer-Integrated Manufacturing, 41, 102–114.CrossRefGoogle Scholar
  37. Wu, D., Zhen, X., Fan, X., Hu, Y., & Zhu, H. (2012). A virtual environment for complex products collaborative assembly operation simulation. Journal of Intelligent Manufacturing, 23(3), 821–833.CrossRefGoogle Scholar
  38. Yang, Q., Wu, D., Zhu, H., Bao, J., & Wei, Z. (2013). Assembly operation process planning by mapping a virtual assembly simulation to real operation. Computers in Industry, 64(7), 869–879.CrossRefGoogle Scholar
  39. Zheng, Y. (2015). Trajectory data mining: An overview. ACM Transactions on Intelligent Systems and Technology, 6(3), 1–41.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of AutomationBeijing University of Posts and TelecommunicationsBeijingPeople’s Republic of China
  2. 2.School of Mechanical Engineering and AutomationBeihang UniversityBeijingPeople’s Republic of China

Personalised recommendations