Skip to main content

Using HMMs and Depth Information for Signer-Independent Sign Language Recognition

  • Conference paper
Multi-disciplinary Trends in Artificial Intelligence (MIWAI 2013)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8271))

Abstract

In this paper, we add the depth information to effectively locate the 3D position of the hands in the sign language recognition system. But, the information will be changed by the different testers and we can’t do the recognition well. So, we use the incremental changes of the three-dimensional coordinates on a unit time as the feature parameter to fix the above problem. We record the changes of the three-dimensional coordinates in time, then using the hidden Markov models to recognize the variety of sign language movement changing on the time domain. Experiment verifies the proposed method is superior to traditional ones.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Kelly, D., McDonald, J., Markham, C.: Recognizing Spatiotemporal Gestures and Movement Epenthesis in Sign Language. In: IMVIP 2009. IEEE Computer Society, Washington, DC (2009) ISBN: 978-0-76953-769-2

    Google Scholar 

  2. Stokoe Jr., W.C.: Sign Language Structure:An Outline of the Visual Communication Systems of the American Deaf. Journal of Deaf Studies and Deaf Education 10(1), 3–37 (2005)

    Article  Google Scholar 

  3. Ariga, K., Sako, S., Kitamura, T.: HMM-based Sign Recognition in Consideration of Motion Diversity. In: IUCS 2010 (2010)

    Google Scholar 

  4. Mohandes, M., Deriche, M., Johar, U., Ilyas, S.: A signer-independent Arabic Sign Language recognition system using face detection, geometric features, and a Hidden Markov Model. Computers and Electrical Engineering 38, 422–433 (2012)

    Article  Google Scholar 

  5. Lang, S., Block, M., Rojas, R.: Sign Language Recognition Using Kinect. In: Rutkowski, L., Korytkowski, M., Scherer, R., Tadeusiewicz, R., Zadeh, L.A., Zurada, J.M. (eds.) ICAISC 2012, Part I. LNCS, vol. 7267, pp. 394–402. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  6. Fang, G., Gao, W.: A SRN/HMM System for Signer-independent Continuous Sign Language Recognition. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2002) (2002)

    Google Scholar 

  7. Wang, C., Gao, W., Shan, S.: An Approach Based on Phonemes to Large Vocabulary Chinese Sign Language Recognition. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (FGR 2002) (2002)

    Google Scholar 

  8. Fang, G., Gao, W., Ma, J.: Signer-Independent Sign Language Recognition Based on SOFM/HMM. In: Proceedings of the IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems, p. 90 (2001)

    Google Scholar 

  9. Rabiner, L.R.: A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE 77(2), 257–286 (1989)

    Article  Google Scholar 

  10. Rahimi, A.: “An Erratum for ’A Tutorial on Hidden Markov Modelsand Selected Applications in Speech Recognition”, website of Ali Rahimiat MIT. MediaLaboratory (2000), http://xenia.media.mit.edu/~rahimi/rabiner/rabinererrata/rabiner-errata.html

  11. Hsieh, C.-T., Chung, R.-C.: Physical rehabilitation assistant system based on Kinect. In: Proceedings of 2012 National Symposium on System Science and Engineering National Taiwan Ocean University, Keelung (2012)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wu, YK., Wang, HC., Chang, LC., Li, KC. (2013). Using HMMs and Depth Information for Signer-Independent Sign Language Recognition. In: Ramanna, S., Lingras, P., Sombattheera, C., Krishna, A. (eds) Multi-disciplinary Trends in Artificial Intelligence. MIWAI 2013. Lecture Notes in Computer Science(), vol 8271. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-44949-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-44949-9_8

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-44948-2

  • Online ISBN: 978-3-642-44949-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics