Abstract
In this paper, an automatic operating system is designed for industrial robot using natural language. Some cutting-edge technologies, such as 3D visual perception, human-robot-environment interaction and auto-programming, are integrated into the design of automatic operating system for industrial robot. In particularly, a new “rule-scene” matching and interaction algorithm is proposed, which can realize the interaction among human, robot and environment, and can guide user to give the correct rule when the user’s rule is wrong or invalid. Automatic operation is achieved through auto-programming and implementation after rules are defined correctly. In the experiment section, our designed system is applied to a fruits sorting platform as a demonstration. Experiment result proves the validity and practicability of our system.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Liu, K., Li, S., Wang, B.: Research of the direct teaching system based on universal robot. Sci. Technol. Eng. 15(28), 22–26 (2015)
Cai, Z.: Robotics, 2nd edn. Tsinghua University Press, Beijing (2009). (in Chinese)
Choi, Y., Chen, T., Jain, A., et al.: Hand it over or set it down: a user study of object delivery with an assistive mobile manipulator. In: 18th International Symposium on Robot and Human Interactive Communication (RO-MAN), pp. 736–743. IEEE Press, New York (2009)
Xing, J., Gan, Y., Dai, X.: Auto-programming system based on the workpiece model for industrial robot. Robot 39(1), 111–118 (2017)
Connell, J., Marcheret, E., Pankanti, S., Kudoh, M., Nishiyama, R.: An extensible language interface for robot manipulation. In: Bach, J., Goertzel, B., Iklé, M. (eds.) AGI 2012. LNCS (LNAI), vol. 7716, pp. 21–30. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-35506-6_3
Fasola, J., Mataric, M.: Interpreting instruction sequences in spatial language discourse with pragmatics towards natural human-robot interaction. In: IEEE International Conference on Robotics and Automation (ICRA), pp. 2720–2727. IEEE Press, New York (2014)
Matuszek, C., Herbst, E., Zettlemoyer, L., Fox, D.: Learning to parse natural language commands to a robot control system. In: Desai, J., Dudek, G., Khatib, O., Kumar, V. (eds.) International Symposium on Experimental Robotics, vol. 8, pp. 403–415. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-319-00065-7_28
Li, X., Zhang, X., Dai, X.: A visual navigation method of mobile robot based on constrained natural language processing. Robot 33(6), 724–749 (2011)
Li, X., Zhang, X.: A route instruction method using natural language processing for indoor intelligent robot navigation. Acta Automatica Sin. 40(2), 289–305 (2014)
Alexandre, L.: 3D descriptors for object and category recognition: a comparative evaluation. In: Workshop on Color-Depth Camera Fusion in Robotics at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1–6. IEEE Press, New York (2012)
Tombari, F., Salti, S., Di Stefano, L.: A combined texture-shape descriptor for enhanced 3D feature matching. In: 18th IEEE International Conference on Image Processing (ICIP), pp. 809–812. IEEE Press, New York (2011)
Rusu, R.: Semantic 3D object maps for everyday manipulation in human living environments. KI-Künstliche Intelligenz 24(4), 345–348 (2010)
Lin, Y., Min, H., Zhou, H., Pei, F.: A human-robot-environment interactive reasoning mechanism for object sorting robot. In: IEEE Transactions on Cognitive and Developmental Systems, pp. 1–13 (2017)
Huggins-Daines, D., Kumar, M., Chan, A., et al.: Pocketsphinx: a free, real-time continuous speech recognition system for hand-held devices. In: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 185–188. IEEE Press, New York (2006)
Ekho Chinese Text-to-Speech Software Homepage. http://www.eguidedog.net/cn/ekho_cn.php. Accessed 16 June 2017
NLPIR/ICTCLAS Chinese word segmentation system. http://ictclas.nlpir.org/. Accessed 25 Mar 2017
Lin, Y., Min, H., Wei, H.: Inertial measurement unit-based iterative pose compensation algorithm for low-cost modular manipulator. Adv. Mech. Eng. 8(1), 1–11 (2016)
Acknowledgements
This work is supported by National Key R&D Program of China (Project No. 2017YFB1300400) and Natural Science Foundation of China (Project No. 61673304).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Lin, Y., Min, H., Zhou, H., Chen, M. (2018). A Natural Language Interaction Based Automatic Operating System for Industrial Robot. In: Huang, DS., Bevilacqua, V., Premaratne, P., Gupta, P. (eds) Intelligent Computing Theories and Application. ICIC 2018. Lecture Notes in Computer Science(), vol 10954. Springer, Cham. https://doi.org/10.1007/978-3-319-95930-6_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-95930-6_12
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-95929-0
Online ISBN: 978-3-319-95930-6
eBook Packages: Computer ScienceComputer Science (R0)