A Subunit-Based Dynamic Time Warping Approach for Hand Movement Recognition

  • Yanrung Wang
  • Atsushi Shimada
  • Takayoshi Yamashita
  • Rin-ichiro Taniguchi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8156)


A subunit-based Dynamic Time Warping (DTW) approach is proposed for hand movement recognition. Two major contributions distinguish the proposed approach from conventional DTW. (1) A set of hand movement subunits is constructed using a data-driven method. The common sub-movements (subunits) are shared across hand gestures to obtain a smaller training data size and search space to improve recognition performance. (2) A similarity measure robust to variability is offered using subunit-to-subunit matching to absorb the difference between two similar sub-sequences belonging to the same subunit, and only keeping the distances between sub-sequences that relate to different subunits. Our experimental results demonstrate the efficiency and accuracy of the proposed approach.


hand movement gesture recognition subunit 


  1. 1.
    Wachs, J.P., Kolsch, M., Stern, H., Edan, Y.: Vision-based hand-gesture applications. Commun. ACM 54(2), 60–71 (2011)CrossRefGoogle Scholar
  2. 2.
    Okada, S., Hasegawa, O.: Motion recognition based on dynamic-time warping method with self-organizing incremental neural network. In: 19th International Conference on Pattern Recognition, pp. 1–4 (2008)Google Scholar
  3. 3.
    Roussos, A., Theodorakis, S., Pitsikalis, V., Maragos, P.: Hand tracking and affine shape-appearance handshape subunits in continuous sign language recognition. In: Int. Conf. ECCV Wkshp: SGA (2010)Google Scholar
  4. 4.
    Bauer, B., Kraiss, K.-F.: Towards an automatic sign language recognition system using subunits. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 64–75. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  5. 5.
    Elmezain, M., Al-Hamadi, A., Michaelis, B.: Real-time capable system for hand gesture recognition using hidden markov models in stereo color image sequences. Journal of WSCG, 65–72 (2008)Google Scholar
  6. 6.
    Liddell, S.K., Johnson, R.E.: American sign language: the phonological base. Sign Language Studies 64, 197–277 (1989)CrossRefGoogle Scholar
  7. 7.
    Stokoe, W.: Sign language structure: an outline of the visual communication systems of the American deaf. Studies in Linguistics: Occasional Papers 8 (1960)Google Scholar
  8. 8.
    Han, J., Awad, G., Sutherland, A.: Modelling and segmenting subunits for sign language recognition based on hand motion analysis. Pattern Recognition Letters, 623–633 (2009)Google Scholar
  9. 9.
    Niennattrakul, V., Ratanamahatana, C.A.: On clustering multimedia time series data using k-means and dynamic time warping. In: International Conference on Multimedia and Ubiquitous Engineering, pp. 733–738 (2007)Google Scholar
  10. 10.
    Park, H.S., Jun, C.H.: A simple and fast algorithm for k-medoids clustering. Expert Systems with Applications: An International Journal, 3336–3341 (2009)Google Scholar
  11. 11.
    Oszust, M., Wysocki, M.: Modelling and Recognition of Signed Expressions Using Subunits Obtained by Data-Driven Approach. In: Ramsay, A., Agre, G. (eds.) AIMSA 2012. LNCS (LNAI), vol. 7557, pp. 315–324. Springer, Heidelberg (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Yanrung Wang
    • 1
  • Atsushi Shimada
    • 1
  • Takayoshi Yamashita
    • 2
  • Rin-ichiro Taniguchi
    • 1
  1. 1.Graduate School of Information Science and Electrical EngineeringKyushu UniversityJapan
  2. 2.OMRON CorporationJapan

Personalised recommendations