Abstract
When a speaker communicates a message to the listener, it can be expected to be transmitted more accurately by attaching an appropriate gesture to message. That theory is valid, whether the speaker and the listener are near or far away. However, for a speaker to deliver messages and gestures to a remote listener synchronously, it is necessary to have a real-time conversation system using video images. Therefore, in this research, we propose a mechanism for presenting gestures synchronized with gestures at minimal cost when sending messages to remote listeners. To realize that, we develop a method to move the robot near the speaker instead of conveying the gesture of the speaker on the video shot. In this proposed method, motion data of the hand of the speaker is acquired using a motion sensor, the data is processing, converting into information for moving the motor corresponding to the joint of the robot, and the information is transmitting to the remote robot, the robot moves with motion according to the intention of the speaker. To realize the proposed method, we prepared a mechanism to convert the hand gesture of the speaker into the motion data of the robot in real-time and manipulate the robot in a faraway place. In our system, we realize a function to transmit information of extreme urgency such as disaster information all at once to robots installed in each household. Based on these requirements, we developed a prototype of an information presentation system. By utilizing this system, we expect the speaker’s message to communicate with the multiple listeners effectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Shimizu, D., Haramaki, T., Nishino, H.: A mobile wireless network visualizer for assisting administrators. In: Proceedings of the 6th International Conference on Emerging Internet, Data and Web Technologies, pp. 651–662, February 2018
Yatsuda, A., Haramaki, T., Nishino, H.: An unsolicited heat stroke alert system for the elderly. In: Proceedings of the 2017 IEEE International Conference on Consumer Electronics - Taiwan, pp. 347–348, June 2017
Okazaki, S., Haramaki, T., Nishino, H.: A safe driving support method using olfactory stimuli. In: Proceedings of the 12th International Conference on Complex, Intelligent and Software Intensive Systems, pp. 958–967, June 2018
Haramaki, T., Yatsuda, A., Nishino, H.: A robot assistant in an edge-computing-based safe driving support system. In: Proceedings of the 21st International Conference on Network-Based Information Systems, pp. 144–155, September 2018
Haramaki, T., Goto, K., Tsutsumi, H., Yatsuda, A., Nishino, H.: A real-time robot motion generation system based on human gesture. In: Proceedings of the 13th International Conference on Broad-Band Wireless Computing, Communication and Applications, pp. 135–146, October 2018
Matsui, D., Minato, T., Mac Dorman, K., Ishiguro, H.: Generating natural motion in an android by mapping human motion. In: Proceedings of the 18th IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3301–3308, July 2005
Patsadu, O., Nukoolkit, C., Watanapa, B.: Human gesture recognition using Kinect camera. In: Proceedings of the 9th International Conference on Computer Science and Software Engineering, pp. 28–32, May 2012
Cicirelli, G., Attolico, C., Guaragnella, C., D’Orazio, T.: A kinect-based gesture recognition approach for a natural human robot interface. Int. J. Adv. Robot. Syst. 12(3), 22 (2015)
Williams, K., Breazeal, C.: Reducing driver task load and promoting sociability through an affective intelligent driving agent (AIDA). In: Proceedings of IFIP Conference on Human-Computer Interaction, pp. 619–626, September 2013
Zeng, L., Einert, B., Pitkin, A., Weber, G.: HapticRein: design and development of an interactive haptic rein for a guidance robot. In: Proceedings of International Conference on Computers Helping People with Special Needs, pp. 94–101, July 2018
Peng, L., Hou, Z., Peng, L., Luo, L., Wang, W.: Robot assisted rehabilitation of the arm after stroke: prototype design and clinical evaluation. Sci. China Inf. Sci. 60, 073201:1–073201:7 (2017)
Miyachi, T., Iga, S., Furuhata, T.: Human robot communication with facilitators for care robot innovation. In: Proceedings of International Conference on Knowledge Based and Intelligent Information and Engineering Systems, pp. 1254–1262, September 2017
Maimone, A., Fuchs, H.: Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras. In: Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 137–146, October 2011
Adalgeirsson, S.O., Breazeal, C.: MeBot: a robotic platform for socially embodied telepresence. In: Proceedings of the 5th ACM/IEEE International Conference on Human-Robot Interaction, pp. 15–22, March 2010
Wang, J., Tsao, V., Fels, S., Chan, B.: Tippy the telepresence robot. In: Proceedings of International Conference on Entertainment Computing, pp. 358–361, October 2011
Tachi, S.: Real-time remote robotics-toward networked telexistence. IEEE Trans. Comput. Graph. Appl. 18(6), 6–9 (1998)
Tachi, S., Minamizawa, K., Furukawa, M., Fernando, C.L.: Telexistence - from 1980 to 2012. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 5440–5441, October 2012
TELEXISTENCE inc. https://tx-inc.com/. Accessed June 2019
Leap Motion. https://www.leapmotion.com/. Accessed June 2019
Sota. https://sota.vstone.co.jp/home/. Accessed June 2019. (in Japanese)
MQTT. http://mqtt.org/. Accessed June 2019
Mosquitto. https://mosquitto.org/. Accessed June 2019
Eclipse Paho. https://www.eclipse.org/paho/. Accessed June 2019
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Haramaki, T., Nishino, H. (2020). A Remote Puppet Control System for Humanoid Communication Robot. In: Barolli, L., Nishino, H., Miwa, H. (eds) Advances in Intelligent Networking and Collaborative Systems. INCoS 2019. Advances in Intelligent Systems and Computing, vol 1035. Springer, Cham. https://doi.org/10.1007/978-3-030-29035-1_10
Download citation
DOI: https://doi.org/10.1007/978-3-030-29035-1_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-29034-4
Online ISBN: 978-3-030-29035-1
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)