Abstract
This work describes the design, implementation, and preliminary tests of a system that uses a humanoid robot to mimic non-standard upper members gestures of a human body. The final goal is to use the robot as a mediator in motor imitation activities with children with special needs, either cognitive or motor impairments. A Kinect sensor and the humanoid robot ZECA (a Zeno R-50 robot from Hanson RoboKind) are used to identify and mimic upper members gestures. The system allows direct control of the humanoid robot by the user. The proposed system was tested in laboratory environment with adults with typical development. Furthermore, the system was tested with three children between 4 and 12 years old with motor and cognitive difficulties in a clinical-like environment. The main goal of these preliminary tests was to detect the constraints of the system.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Liu, H.Y., Wang, W.J., Wang, R.J., Tung, C.W., Wang, P.J., Chang, I.P.: Image recognition and force measurement application in the humanoid robot imitation. IEEE Trans. Instrum. Meas. 61(1), 149–161 (2012)
Nguyen, V.V., Lee, J.-H.: Full-body imitation of human motions with Kinect and heterogeneous kinematic structure of humanoid robot. In: IEEE/SICE International Symposium on System Integration (SII). Fukuoka, pp. 93−98, 16–18 Dec 2012
Manasrah, A.A.: Human motion tracking for assisting balance. Master Thesis, University of South Florida, Florida (2012)
Billard, B.R., Nadel, J., Dautenhahn, K.: Building Robota, a mini-humanoid robot for the rehabilitation of children with autism. RESNA Assist. Technol. J. 1–5 (2006)
Yihong, C., Qijun, C.: Real-time imitation human upper-body movement with joint and self-collision constraints. In: 2013 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), Manila, 12–15 Nov 2013
Teachasrisaksakul, K., Zhang, Z., Yang, G.-Z.: Demo abstract: upper limb motion imitation module for humanoid robot using biomotion + sensors. In: IEEE International Conference on Body Sensor Networks (BSN), Cambridge, MA, USA, 6–9 May 2013
Guizzo, E.: Humanoid robot Mahru mimics a person’s movements in real time (2010). IEEE Spectrum. http://spectrum.ieee.org/automaton/robotics/humanoids/042710-humanoid-robot-mahru-real-time-teleoperation. Accessed on July 2015
Aldebaran Robotics NAO. (2015). From Active Robots: http://www.active-robots.com/aldebaran-robotics-nao-evol-humanoid-robot. Accessed on July 2015
Mahru Humanoid Robot Real-Time Teleoperation. From Youtube: https://www.youtube.com/watch?v=TJmQqC1Nhtu. Accessed on July 2015
Kinect the technology (2015). http://www.i-programmer.info/babbages-bag/2003-Kinect-the-technology-.html. Accessed on July 2015
Kinect for Windows Sensor Components and Specifications (2015). https://msdn.microsoft.com/en-us/library/jj131033.aspx. Accessed on July 2015
Arngren (2015). http://www.arngren.net/ZENO-2.R50Data.jpg. Accessed on July 2015
Coordinate Spaces (2015). https://msdn.microsoft.com/en-us/library/hh973078.aspx. Accessed on July 2015
Joint Filtering (2015). https://msdn.microsoft.com/en-us/library/jj131024.aspx. Accessed on July 2015
Torres, N.A., Clark, N., Ranatunga, I., Popa, D.: Implementation of interactive arm playback behaviors of social robot zeno for autism spectrum disorder therapy. In: PETRA2012—Proceedings of the 5th International Conference on PErvasive Technologies Related to Assistive Environments, Crete, Greece (2012)
Weisstein, E.W.: Rotation Matrix (2015). http://mathworld.wolfram.com/RotationMatrix.html. Accessed on 05 Jul 2015
R50 Documentation (2015). http://www.robokindrobots.com/support-documentation/r50/. Accessed on July 2015
Acknowledgments
This work has been supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT—Fundação para a Ciência e Tecnologia within the Project Scope: UID/CEC/00319/2013.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Silva, V., Leite, P., Soares, F., Esteves, J.S., Costa, S. (2017). Imitate Me!—Preliminary Tests on an Upper Members Gestures Recognition System. In: Garrido, P., Soares, F., Moreira, A. (eds) CONTROLO 2016. Lecture Notes in Electrical Engineering, vol 402. Springer, Cham. https://doi.org/10.1007/978-3-319-43671-5_32
Download citation
DOI: https://doi.org/10.1007/978-3-319-43671-5_32
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-43670-8
Online ISBN: 978-3-319-43671-5
eBook Packages: EngineeringEngineering (R0)