Automatic Identification of Excavator Activities Using Joystick Signals
- 81 Downloads
Monitoring and analyzing the operations of construction equipment is critical in the construction engineering and management domain. The ability to detect and classify major activities that construction equipment performs can support a project manager in making proper project-related decisions such as resource allocation and scheduling, resulting in improved productivity. Earth-moving activities as performed by an excavator, which is one of the most frequently used pieces of construction equipment, are normally repetitive by nature and possess unique features in terms of their patterns of operation. This study develops an activity identification algorithm capable of automatically classifying predefined earth-moving activities that are currently in progress. Given that the excavator is operated using joysticks, the joystick signals include unique patterns that exhibit the similar overall shapes but may not uniformly line up with time for a specific activity. The proposed study examines a dynamic time warping algorithm that determines similarities between a predefined activity and a measured signal distorted in time. The feasibility of the algorithm is verified through experiments involving activities such as digging, leveling, lifting, and trenching that were easily and accurately identified by the algorithm. The proposed task-identification algorithm could be used to develop an automated system of establishing machine parameters and to calculate the durations of operations and cycle times.
KeywordsEarth-moving tasks Excavator Activity identification Dynamic time warping (DTW) Pattern recognition
This research was supported by a grant (19AUDP-B121595-04) from Architecture & Urban Development Research Program funded by the Ministry of Land, Infrastructure and Transport of the Korean Government.
- 1.Gong, J., & Caldas, C. H. (2010). Computer vision-based video interpretation model for automated productivity analysis of construction operations. Journal of Computing in Civil Engineering,24(3), 252–263. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000027.CrossRefGoogle Scholar
- 2.Golparvar-Fard, M., Heydarian, A., & Niebles, J. C. (2013). Vision-based action recognition of earthmoving equipment using spatio-temporal features and support vector machine classifiers. Advanced Engineering Informatics,27(4), 652–663. https://doi.org/10.1016/j.aei.2013.09.001.CrossRefGoogle Scholar
- 7.Teizer, J., Lao, D., & Sofer, M. (2007). Rapid automated monitoring of construction site activities using ultra-wide band. In The 24th international symposium on automation and robotics in construction (ISARC 2007) (pp. 23–28).Google Scholar
- 8.Zhang, C., Hammad, A., & Rodriguez, S. (2012). Crane pose estimation using UWB real-time location system. Journal of Computing in Civil Engineering,26(5), 625–637. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000172.CrossRefGoogle Scholar
- 10.Zou, J., & Kim, H. (2007). Using hue, saturation, and value color space for hydraulic excavator idle time analysis. Journal of Computing in Civil Engineering,21(4), 238–246. https://doi.org/10.1061/(ASCE)0887-3801(2007)21:4(238).CrossRefGoogle Scholar
- 11.Yuan, C., Li, S., & Cai, H. (2017). Vision-based excavator detection and tracking using hybrid kinematic shapes and key nodes. Journal of Computing in Civil Engineering,31(1), 04016038. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000602.CrossRefGoogle Scholar
- 13.Ahn, C. R., Lee, S., & Peña-Mora, F. (2015). Application of low-cost accelerometers for measuring the operational efficiency of a construction equipment fleet. Journal of Computing in Civil Engineering,29(2), 04014042. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000337.CrossRefGoogle Scholar
- 14.Mathur, N., Aria, S., Adams, T., Ahn, C., & Lee, S. (2015). Automated cycle time measurement and analysis of excavator’s loading operation using smart phone-embedded IMU sensors. International Workshop on Computing in Civil Engineering,2015, 215–222. https://doi.org/10.1061/9780784479247.027.CrossRefGoogle Scholar
- 17.Domingue, B. B. (2016). Coordinated rate control user interface and task identification of an excavator. MSc thesis, Georgia Institute of Technology. Retrieved from http://hdl.handle.net/1853/56373. Accessed 4 Sep 2019.
- 19.Rath, T. M., & Manmatha, R. (2003). Word image matching using dynamic time warping. In 2003 IEEE computer society conference on computer vision and pattern recognition (Vol. 2, pp. II/521–II/527). https://doi.org/10.1109/CVPR.2003.1211511.