Manipulator Point Teaching System Design Integrated with Image Processing and Iterative Learning Control
- 12 Downloads
This study proposes integrating a manipulator point teaching system with an image processing technique and the iterative learning control (ILC) method, which features multiple points teaching and positioning processes that are easily operated, rapid, and accurate. First, a teaching device is used to manipulate the manipulator, which brings the teaching target into the field of view of camera. The speed up robust feature (SURF) is then used to define the target feature. Then random sample consensus (RANSAC) is used to estimate the homography matrix in order to obtain the center position of the target feature. Subsequently, the manipulator position control command is calculated by referring to the center position. In terms of the computational method, this study uses the ILC method and refers to the manipulator position control command and moving error during iterative computation. Finally, the optimum position control command converges to the manipulator teaching point such that the manipulator can execute automatic and accurate continuous motion according to this teaching point. The method was applied to screw holes and the results show that the average convergence in positioning error is 70%, while the average final positioning error value is less than 15 μm. The experimental results show that the manipulator point teaching system proposed in this study is feasible.
KeywordsImage processing Iterative learning control Manipulators Point teaching
Unable to display preview. Download preview PDF.
This research was supported in part by the Ministry of Science and Technology, Taiwan, R.O.C., under Contract MOST104-2221-E-027-132 and MOST103-2218-E-009-027-MY2. The authors would like to thank representatives from the Motorcon Robotic Company for their beneficial discussions with the MOST project team.
- 1.Chen, H., Li, J., Xing, G., Xing, J., Sun, H.: Trajectory tracking control of a macro-micro welding robot based on the vision navigation. In: 2010 IEEE International Conference on Robotics and Biomimetics, ROBIO 2010, pp. 667–672. Tianjin (2010)Google Scholar
- 2.Jagersand, M., Nelson, R.: Visual space task specification, planning and control. In: Proceedings of the International Symposium on Computer Vision, ISCV’95, Piscataway, NJ, USA, pp. 521–526. IEEE (1995)Google Scholar
- 3.Maeda, Y., Moriyama, Y.: View-based teaching/playback for industrial manipulators. In: 2011 IEEE International Conference on Robotics and Automation, ICRA 2011, pp. 4306–4311. Shanghai (2011)Google Scholar
- 4.Maeda, Y., Saito, Y.: Lighting- and occlusion-robust view-based teaching/playback for model-free robot programming. In: Chen, W., Wang, H., Hosoda, K., Menegatti, E., Shimizu, M. (eds.) 14th International Conference on Intelligent Autonomous Systems, IAS 2016, vol. 531. pp. 939–952. Springer (2017)Google Scholar
- 5.Chan, A., Croft, E.A., Little, J.J.: Constrained manipulator visual servoing (CMVS): rapid robot programming in cluttered workspaces. In: 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems: Celebrating 50 Years of Robotics, IROS’11, pp. 2825–2830. San Francisco, CA (2011)Google Scholar
- 7.Zhang, X., Zhou, H., Cheng, H., Huang, Y.: Teaching-playback of robot manipulator based on human gesture recognition and motion tracking. In: IEEE International Conference on Robotics and Biomimetics, IEEE-ROBIO 2015, pp. 1183–1188. Institute of Electrical and Electronics Engineers Inc. (2015)Google Scholar
- 8.Malheiros, P., Costa, P., Moreira, A.P., Ferreira, M.: Robust and real-time teaching of industrial robots for mass customisation manufacturing using stereoscopic vision. In: 35th Annual Conference of the IEEE Industrial Electronics Society, IECON 2009, Porto, pp. 2336–2341 (2009)Google Scholar
- 10.Lee, C. S. G., Ziegler, M.: Geometric approach in solving inverse kinematics of puma robots. IEEE Transactions on Aerospace and Electronic Systems AES-20 (6), pp. 695–706 (1984)Google Scholar
- 12.Borangiu, T., Dumitrache, A., Dogar, A.: Flexible 3D trajectory teaching and following for various robotic applications. In: Hashimoto, H., Kawasaki, H. (eds.) 9th IFAC Symposium on Robot Control, SYROCO 2009, pp. 299–304. IFAC Secretariat (2009)Google Scholar
- 15.Gossow, D., Pellenz, J., Paulus, D.: Danger sign detection using color histograms and SURF matching. In: Proceedings of the 2008 IEEE International Workshop on Safety, Security and Rescue Robotics, SSRR 2008, pp. 13–18 (2008)Google Scholar
- 16.Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3951, pp. 404–417. LNCS (2006)Google Scholar
- 17.Song, K.T., Chang, C.H., Lin, C.H.: Robust feature extraction and control design for autonomous grasping and mobile manipulation. In: 2010 International Conference on System Science and Engineering, ICSSE 2010, pp. 445–450 (2010)Google Scholar
- 18.Mondragón, I.F., Campoy, P., Martínez, C., Olivares-Méndez, M.A.: 3D pose estimation based on planar object tracking for UAVs control. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 35–41 (2010)Google Scholar
- 23.Peuwnuan, K., Woraratpanya, K., Pasupa, K.: Modified adaptive thresholding using integral image. In: 2016 13th International Joint Conference on Computer Science and Software Engineering, JCSSE 2016 (2016)Google Scholar
- 24.Derpanis, K.G., Leung, E.T.H., Sizintsev, M.: Fast scale-space feature representations by generalized integral images. In: Proceedings of the International Conference on Image Processing, ICIP, pp. IV521–IV524 (2007)Google Scholar
- 27.Kim, D.-I., Kim, S.: On iterative learning control algorithm for industrial robots and CNC machine tools. In: IECON Proceedings (Industrial Electronics Conference), pp. 601–606 (1993)Google Scholar
- 29.Arimoto, S., Naniwa, T., Suzuki, H.: Robustness of P-type learning control with a forgetting factor for robotic motions. In: Proceedings of the IEEE Conference on Decision and Control, pp. 2640–2645 (1990)Google Scholar