Skip to main content

Near Real-Time Data Labeling Using a Depth Sensor for EMG Based Prosthetic Arms

  • Conference paper
  • First Online:
Intelligent Systems and Applications (IntelliSys 2018)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 869))

Included in the following conference series:

Abstract

Recognizing sEMG (Surface Electromyography) signals belonging to a particular action (e.g., lateral arm raise) automatically is a challenging task as EMG signals themselves have a lot of variations even for the same action due to several factors. To overcome this issue, there should be a proper separation which indicates similar patterns repetitively for a particular action in raw signals. A repetitive pattern is not always matched because the same action can be carried out with different time duration. Thus, a depth sensor (Kinect) was used for pattern identification where three joint angles were recorded continuously which is clearly separable for a particular action while recording sEMG signals. To segment out a repetitive pattern in angle data, MDTW (Moving Dynamic Time Warping) approach is introduced. This technique is allowed to retrieve suspected motion of interest from raw signals. MDTW based on DTW algorithm, but it will be moving through the whole dataset in a pre-defined manner which is capable of picking up almost all the suspected segments inside a given dataset in an optimal way. Elevated bicep curl and lateral arm raise movements are taken as motions of interest to show how the proposed technique can be employed to achieve auto identification and labelling. The full implementation is available at https://github.com/GPrathap/OpenBCIPython.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://www.openbci.com

References

  1. Frigo, C., Crenna, P.: Multichannel SEMG in clinical gait analysis: a review and state-of-the-art. Clin. Biomech. 24(3), 236–245 (2009)

    Article  Google Scholar 

  2. Solomonow, M., Baratta, R., Bernardi, M., Zhou, B., Lu, Y., Zhu, M., Acierno, S.: Surface and wire EMG crosstalk in neighbouring muscles. J. Electromyogr. Kinesiol. 4(3), 131–142 (1994)

    Article  Google Scholar 

  3. Benatti, S., Farella, E., Gruppioni, E., Benini, L.: Analysis of robust implementation of an emg pattern recognition based control. In: BIOSIGNALS, pp. 45–54 (2014)

    Google Scholar 

  4. Bai, D. Xia, C., Yang, J., Zhang, S., Jiang, Y., Yokoi, H.: Shoulder joint control method for smart prosthetic arm based on surface EMG recognition. In: 2016 IEEE International Conference on Information and Automation (ICIA), pp. 1267–1272. IEEE (2016)

    Google Scholar 

  5. Inc., R.: Lynxmotion - AL5D. http://www.lynxmotion.com/c-130-al5d.aspx (2017)

  6. De Luca, C.J.: The use of surface electromyography in biomechanics. J. Appl. Biomech. 13(2), 135–163 (1997)

    Article  Google Scholar 

  7. Blana, D., Kyriacou, T., Lambrecht, J.M., Chadwick, E.K.: Feasibility of using combined emg and kinematic signals for prosthesis control: a simulation study using a virtual reality environment. J. Electromyogr. Kinesiol. 29, 21–27 (2016)

    Article  Google Scholar 

  8. Microsoft: Kinect setup xbox 360. http://support.xbox.com/en-US/xbox-360/accessories/kinect-sensor-setup (2017)

  9. Scherer, R., Wagner, J., Moitzi, G., Müller-Putz, G.: Kinect-based detection of self-paced hand movements: enhancing functional brain mapping paradigms. In: Engineering in Medicine and Biology Society (EMBC): Annual International Conference of the IEEE, vol. 2012, pp. 4748–4751. IEEE (2012)

    Google Scholar 

  10. Wang, B., Yang, C., Xie, Q.: Human-machine interfaces based on EMG and kinect applied to teleoperation of a mobile humanoid robot. In: 10th World Congress on Intelligent Control and Automation (WCICA), vpl. 2012, pp. 3903–3908. IEEE (2012)

    Google Scholar 

  11. Frey, J.: Comparison of a consumer grade EEG amplifier with medical grade equipment in BCI applications. In: International BCI Meeting, Asilomar, United States, May 2016. https://hal.inria.fr/hal-01278245

  12. Vautard, R., Yiou, P., Ghil, M.: Singular-spectrum analysis: a toolkit for short, noisy chaotic signals. Phys. D: Nonlinear Phenomena 58(1), 95–126 (1992)

    Article  Google Scholar 

  13. Golyandina, N., Zhigljavsky, A.: Singular Spectrum Analysis for Time Series. Springer, Berlin (2013)

    Book  Google Scholar 

  14. Hassani, H.: Singular spectrum analysis: methodology and comparison (2007)

    Google Scholar 

  15. Spyrou, L., Blokland, Y., Farquhar, J., Bruhn, J.: Singular spectrum analysis as a preprocessing filtering step for fnirs brain computer interfaces. In: Signal Processing Conference (EUSIPCO): Proceedings of the 22nd European, vol. 2014, pp. 46–50. IEEE (2014)

    Google Scholar 

  16. Berndt, D.J., Clifford, J.: Using dynamic time warping to find patterns in time series. KDD Workshop. 10(16), pp. 359–370. Seattle, WA (1994)

    Google Scholar 

  17. Chowdhury, R.H., Reaz, M.B., Ali, M.A.B.M., Bakar, A.A., Chellappan, K., Chang, T.G.: Surface electromyography signal processing and classification techniques. Sensors 13(9), 12431–12466 (2013)

    Article  Google Scholar 

  18. Daud, W.M.B.W., Yahya, A.B., Horng, C.S., Sulaima, M.F., Sudirman, R.: Features extraction of electromyography signals in time domain on biceps brachii muscle. Int. J. Model. Optim. 3(6), 515 (2013)

    Article  Google Scholar 

  19. Al-Angari, H.M., Kanitz, G., Tarantino, S., Cipriani, C.: Distance and mutual information methods for EMG feature and channel subset selection for classification of hand movements. Biomed. Sig. Process. Control 27, 24–31 (2016)

    Article  Google Scholar 

  20. Hermens, H., Bruggen, T., Baten, C., Rutten, W., Boom, H.: The median frequency of the surface EMG power spectrum in relation to motor unit firing and action potential properties. J. Electromyogr. Kinesiol. 2(1), 15–25 (1992)

    Article  Google Scholar 

  21. Mahaphonchaikul, K., Sueaseenak, D., Pintavirooj, C., Sangworasil, M., Tungjitkusolmun, S.: EMG signal feature extraction based on wavelet transform. In: 2010 International Conference on Electrical Engineering/Electronics Computer Telecommunications and Information Technology (ECTI-CON), pp. 327–331. IEEE (2010)

    Google Scholar 

  22. Vakkuri, A., Yli-Hankala, A., Talja, P., Mustola, S., Tolvanen-Laakso, H., Sampson, T., Viertiö-Oja, H.: Time-frequency balanced spectral entropy as a measure of anesthetic drug effect in central nervous system during sevoflurane, propofol, and thiopental anesthesia. Acta Anaesthesiologica Scandinavica 48(2), 145–153 (2004)

    Article  Google Scholar 

  23. Zhao, J., Xie, Z., Jiang, L., Cai, H., Liu, H., Hirzinger, G.: EMG control for a five-fingered underactuated prosthetic hand based on wavelet transform and sample entropy. In: 2006 IEEE/RSJ International Conference on2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3215–3220. IEEE (2006)

    Google Scholar 

  24. Izenman, A.J.: Linear discriminant analysis. In: Modern Multivariate Statistical Techniques, pp. 237–280. Springer (2013)

    Google Scholar 

  25. Hsu, C.-W., Chang, C.-C., Lin, C.-J., et al.: A Practical Guide to Support Vector Classification (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Geesara Prathap .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Prathap, G., Nanda Kumara, T., Ragel, R. (2019). Near Real-Time Data Labeling Using a Depth Sensor for EMG Based Prosthetic Arms. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Systems and Applications. IntelliSys 2018. Advances in Intelligent Systems and Computing, vol 869. Springer, Cham. https://doi.org/10.1007/978-3-030-01057-7_25

Download citation

Publish with us

Policies and ethics