Hand Tracking Using Optical-Flow Embedded Particle Filter in Sign Language Scenes

  • Selma Belgacem
  • Clément Chatelain
  • Achraf Ben-Hamadou
  • Thierry Paquet
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7594)


In this paper we present a method dedicated to hand tracking in sign language scenes using particle filtering. A a new penalisation method based on the optical flow mechanism is introduced. Generally, particle filters require the use of a reference model. In this paper we have introduced a new method based on a dictionary of visual references of hand to constitute the reference model. The evaluation of our method is performed on the SignStream-ASLLRP database on which we have provided ground truth annotations for this purpose. The obtained results show the accuracy of our method.


hand tracking particle filtering optical flow hand vocabulary sign language scene 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bhandarkar, S.M., Luo, X.: Integrated detection and tracking of multiple faces using particle filtering and optical flow-based elastic matching. CVIU 113(6), 708–725 (2009)Google Scholar
  2. 2.
    Bradski, G.R.: Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal Q2 (1998)Google Scholar
  3. 3.
    Gordon, N.J., Salmond, D.J., Smith, A.F.M.: Novel approach to nonlinear/non-gaussian bayesian state estimation. IEE Proceedings F Radar and Signal Processing 140(2), 107–113 (1993)CrossRefGoogle Scholar
  4. 4.
    Isard, M., Blake, A.: Condensation - conditional density propagation for visual tracking. Int. J. Comput Vison 29, 5–28 (1998)CrossRefGoogle Scholar
  5. 5.
    Klein, J., Lecomte, C., Miche, P.: Preceding car tracking using belief functions and a particle filter. In: IEEE ICPR - International Conference on Pattern Recognition, pp. 1–4 (2008)Google Scholar
  6. 6.
    Lu, W.-L., Okuma, K., Little, J.J.: Tracking and recognizing actions of multiple hockey players using the boosted particle filter. Image Vision Comput. 27(1-2), 189–205 (2009)CrossRefGoogle Scholar
  7. 7.
    Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Int. Joint Conf. Artif. Intel., IJCAI 1981, vol. 2, pp. 674–679. Morgan Kaufmann Publishers Inc., San Francisco (1981)Google Scholar
  8. 8.
    Neidle, C., Sclaroff, S., Athitsos, V.: Signstream: A tool for linguistic and computer vision research on visual-gestural language data. Behav. Res. Meth. Ins. C 33(3), 311–320 (2001)CrossRefGoogle Scholar
  9. 9.
    Perez, P., Vermaak, J., Blake, A.: Data fusion for visual tracking with particles. Proceedings of the IEEE, 495–513 (2004)Google Scholar
  10. 10.
    Ristic, B., Arulampalam, S., Gordon, N.: Beyond the Kalman Filter: Particle Filters for Tracking Applications. Artech House (2004)Google Scholar
  11. 11.
    Shan, C., Tan, T., Wei, Y.: Real-time hand tracking using a mean shift embedded particle filter. PR 40(7), 1958–1970 (2007)zbMATHGoogle Scholar
  12. 12.
    Sigal, L., Sclaroff, S., Athitsos, V.: Skin color-based video segmentation under time-varying illumination. PAMI 26, 862–877 (2003)CrossRefGoogle Scholar
  13. 13.
    Stokoe, W.C.: Sign language structure: An outline of the visual communication systems of the american deaf. Journal of Deaf Studies and Deaf Education 10(1) (2005)Google Scholar
  14. 14.
    Viola, P., Jones, M.J.: Robust Real-Time face detection. Int. J. Comput Vison 57(2), 137–154 (2004)CrossRefGoogle Scholar
  15. 15.
    Yang, S., Ge, W., Cheng, Z.: Detecting and tracking moving targets on omnidirectional vision. Transactions of Tianjin University 15(1), 13–18 (2009)CrossRefGoogle Scholar
  16. 16.
    Yao, A., Uebersax, D., Gall, J., Van Gool, L.: Tracking People in Broadcast Sports. In: Goesele, M., Roth, S., Kuijper, A., Schiele, B., Schindler, K. (eds.) DAGM 2010. LNCS, vol. 6376, pp. 151–161. Springer, Heidelberg (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Selma Belgacem
    • 1
  • Clément Chatelain
    • 1
  • Achraf Ben-Hamadou
    • 2
  • Thierry Paquet
    • 1
  1. 1.LITIS EA 4108University of RouenSaint-Etienne du RouvrayFrance
  2. 2.Center for Visual Computing, ENPCUniversity of Paris-Est, LIGM (UMR CNRS)Marne-la-ValléeFrance

Personalised recommendations