Skip to main content

Hand Gesture Based Control of NAO Robot Using Myo Armband

  • Conference paper
  • First Online:
Book cover Advances in Neuroergonomics and Cognitive Engineering (AHFE 2019)

Abstract

Electromyography (EMG) has become an automation technique and has found its way in disciplines other than medical sciences. EMG based equipment is being used for automation of soft as well as hard robots. NAO is a humanoid robot developed by Aldebaran Robotics currently deployed in the health and education sector. In this paper we have attempted to develop an interface for controlling the NAO robot with an EMG sensor known as Myo Armband, we implemented a TCP client with the C++ Myo arm-band SDK and a corresponding sever with the Python NAO robot SDK. A Finite State Machine (FSM) architecture is incorporated at the client side to manage the network traffic rate as well as to increase efficiency of the system. The scope of this paper is limited to four different gestures instantiating four distinct actions performed by the robot using Myo Armband, this research is currently under development and in its testing phase. This technological aid supports the person who is waist down paralyzed or for an immobile patient on a hospital bed who wants to get the task done through a social robot.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Duiverman, M.L., van Eykern, L.A., Vennik, P.W., Koëter, G.H., Maarsingh, E.J.W., Wijkstra, P.J.: Reproducibility and responsiveness of a noninvasive EMG technique of the respiratory muscles in COPD patients and in healthy subjects. J. Appl. Physiol. 96(5), 1723 (2004)

    Article  Google Scholar 

  2. Aldrich, T.K., Sinderby, C., McKenzie, D.K., Estenne, M., Gandevia, S.C.: Electrophysiologic techniques for the assessment of respiratory muscle function. Am. J. Respir. Crit. Care Med. 166, 548 (2002)

    Google Scholar 

  3. Ruhunage, I., Perera, C.J., Nisal, K., Subodha, J., Lalitharatne, T.D.: EMG signal controlled transhumerai prosthetic with EEG-SSVEP based approch for hand open/close. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics, p. 3169 (2017)

    Google Scholar 

  4. Clarys, J.P., Cabri, J.M.H.: The use of surface electromyography in biomechanics. Presented at the (1997)

    Google Scholar 

  5. Lenzi, T., De Rossi, S.M.M., Vitiello, N., Carrozza, M.C.: Intention-based EMG control for powered exoskeletons. IEEE Trans. Biomed. Eng. 59, 2180 (2012)

    Article  Google Scholar 

  6. Vachirapipop, M., Soymat, S., Tiraronnakul, W., Hnoohom, N.: An integration of Myo Armbands and an android-based mobile application for communication with hearing-impaired persons. In: 2017 13th International Conference on Signal-Image Technology and Internet-Based Systems, p. 413 (2017)

    Google Scholar 

  7. Cacace, J., Finzi, A., Lippiello, V.: Multimodal interaction with multiple co-located drones in search and rescue missions. CoRR. abs/1605.07316 (2016)

  8. Seok, W., Kim, Y., Park, C.: Pattern recognition of human arm movement using deep reinforcement learning. In: 2018 International Conference on Information Networking, p. 917 (2018)

    Google Scholar 

  9. Shamsuddin, S., Ismail, L.I., Yussof, H., Zahari, N.I., Bahari, S., Hashim, H., Jaffar, A.: Humanoid robot NAO: review of control and motion exploration. In: 2011 IEEE International Conference on Control System, Computing and Engineering (ICCSCE) (2011)

    Google Scholar 

  10. Tapus, A., Peca, A., Aly, A., Pop, C., Jisa, L., Pintea, S., Rusu, A.S., David, D.O.: Children with autism social engagement in interaction with NAO, an imitative robot: a series of single case experiments. Interact. Stud. 13, 315 (2012)

    Article  Google Scholar 

  11. Shamsuddin, S., Yussof, H., Ismail, L., Hanapiah, F.A., Mohamed, S., Piah, H.A., Zahari, N.I.: Initial response of autistic children in human-robot interaction therapy with humanoid robot NAO. In: 2012 IEEE 8th International Colloquium on Signal Processing and Its Applications (CSPA) (2012)

    Google Scholar 

  12. NAO - Technical Guide—Aldebaran 2.1.4.13 documentation. Doc.aldebaran.com (2019). http://doc.aldebaran.com/2-1/family/index.html. Accessed 1 Mar 2019

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sara Ali .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ali, S. et al. (2020). Hand Gesture Based Control of NAO Robot Using Myo Armband. In: Ayaz, H. (eds) Advances in Neuroergonomics and Cognitive Engineering. AHFE 2019. Advances in Intelligent Systems and Computing, vol 953. Springer, Cham. https://doi.org/10.1007/978-3-030-20473-0_44

Download citation

Publish with us

Policies and ethics