Remote Control of a Robotic Hand Using a Leap Sensor

  • Felix Dawes
  • Jaques Penders
  • Giuseppe CarboneEmail author
Conference paper
Part of the Mechanisms and Machine Science book series (Mechan. Machine Science, volume 68)


This paper presents a low-cost gesture-based remote control of a robotic hand. The proposed control architecture is based on a commercial leap motion sensor and an Arduino board, which have been chosen due to their low-cost and user-friendly features. A specific Matlab code has been implemented to collect data from the leap motion sensor and to generate proper instructions to control a robotic hand, which has been 3D print at Sheffield Hallam University. Experimental tests have been carried out validate the effectiveness of the proposed remote control for performing various grasping tasks.


Robotic hands Remote control Leap sensor 


  1. 1.
    Carbone, G. (ed.): Grasping in Robotics. Springer, Dordrecht (2013)zbMATHGoogle Scholar
  2. 2.
    Mason, M.T., Salisbury, J.K.: Robots Hands and the Mechanics of Manipulation. MIT Press, Cambridge (1985)Google Scholar
  3. 3.
    Liarokapis, M.V., Artemiadis, P.K., Kyriakopoulos, K.J.: Telemanipulation with the DLR/HIT II robot hand using a dataglove and a low cost force feedback device. In: 21st Mediterranean Conference on Control and Automation, pp. 431–436 (2013)Google Scholar
  4. 4.
    Arns, M., Laliberté, T., Gosselin, C.: Design, control and experimental validation of a haptic robotic hand performing human-robot handshake with human-like agility. In: IEEE/RSJ International Conference on Intelligent Robots and Systems IROS, pp. 4626–4633 (2017)Google Scholar
  5. 5.
    Raparelli, T., Mattiazzo, G., Mauro, S., Velardocchia, M.: Design and development of a pneumatic anthropomorphic hand. J. Robot. Syst. 17(1), 1–15 (2000)CrossRefGoogle Scholar
  6. 6.
    Carbone, G., Iannone, S., Ceccarelli, M.: Regulation and control of LARM Hand III. Robot. Comput. Integr. Manuf. 26(2), 202–211 (2010)CrossRefGoogle Scholar
  7. 7.
    Carbone, G., Ceccarelli, M.: Experimental tests on feasible operation of a finger mechanism in the LARM hand. Mech. Based Des. Struct. Mach. 36(1), 1–13 (2008)CrossRefGoogle Scholar
  8. 8.
    Yao, S., Ceccarelli, M., Carbone, G., Zhan, Q., Lu, Z.: Analysis and optimal design of an underactuated finger mechanism for LARM hand. Front. Mech. Eng. 6(3), 332–343 (2011)Google Scholar
  9. 9.
    Russo, M., Ceccarelli, M., Corves, B., Hüsing, M., Lorenz, M., Cafolla, D., Carbone, G.: Design and test of a gripper prototype for horticulture products. Robot. Comput. Integr. Manuf. 44, 266–275 (2017)CrossRefGoogle Scholar
  10. 10.
    Yao, S., Ceccarelli, M., Carbone, G., Dong, Z.: Grasp configuration planning for a low-cost and easy-operation underactuated three-fingered robot hand. Mech. Mach. Theory 129, 51–69 (2018)CrossRefGoogle Scholar
  11. 11.
    Cheng, H., Yang, L., Liu, Z.: A survey on 3D hand gesture recognitions. IEEE Trans. Circuits Syst. Video Technol. (2015). Scholar
  12. 12.
    Wachs, J.P., Kolsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Commun. ACM 54(2), 60–71 (2011)CrossRefGoogle Scholar
  13. 13.
    Ren, Z., Yuan, J., Meng, J., Zhang, Z.: Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimed. 15(5), 1110–1120 (2013)CrossRefGoogle Scholar
  14. 14.
    Leap Motion: Leap motion sensor. Assessed 1 June 2018
  15. 15.
    Weichert, F., Bachmann, D., Rudak, B., Fisseler, D.: Analysis of the accuracy and robustness of the leap motion controller. Sensors 13(5), 6380–6393 (2013)CrossRefGoogle Scholar
  16. 16.
    Bock, T., Linner, T., Guettler, J., Georgoulas, C., Bassily, D.: Intuitive and adaptive robotic arm manipulation using the leap motion controller. In: IEEE 41st International Symposium on Robotics ISR/Robotik 2014, Munich, pp. 1–7 (2014)Google Scholar
  17. 17.
    Feix, T., Romero, J., Ek, C.H., Schmiedmayer, H.-B., Kragic, D.: A metric for comparing the anthropomorphic motion capability of artificial hands. IEEE Trans. Robot. 29(1), 82–93 (2013)CrossRefGoogle Scholar
  18. 18.
    InMoov Robot webpage: hand-and-forarm. Assessed 1 June 2018
  19. 19.
    Elecrow webpage: HC12 User Manual HC-12 Wireless Serial Port Communication Module User Manual V1. Assessed 1st June 2018

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Engineering and MathematicsSheffield Hallam UniversitySheffieldUK
  2. 2.LARM: Laboratory of Robotics and MechatronicsUniversity of Cassino and South LatiumCassinoItaly

Personalised recommendations