Abstract
In this paper, we propose to incorporate prior knowledge from sign language linguistic models about the motion of the hands within a multiple hypothesis tracking framework. A critical component for automated visual sign language recognition is the tracking of the signer’s hands, especially when faced with frequent and persistent occlusions and complex hand interactions. Hand motion constraints identified by sign language phonological models, such as the hand symmetry condition, are used as part of the data association process. Initial experimental results show the validity of the proposed approach.
Keywords
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
von Agris, et al.: Recent developments in visual sign language recognition. Universal Access in the Information Society 6(4), 323–362 (2007)
Sandler, W., Lillo-Martin, D.: Sign Language and Linguistic Universals. Cambridge Univ. Press (2006)
Bar-shalom, Y., Daum, F., Huang, J.: The Probabilistic Data Association Filter. IEEE Control Syst. Mag., 82–100 (2009)
Blackman, S.: Multiple Hypothesis Tracking For Multiple Target Tracking. IEEE Aerosp. Electron. Syst. Mag. 19(1), 5–18 (2004)
Roshtkhar, M., et al.: Multiple Object Tracking Using Local Motion Patterns. BMVC (2014)
Amer, A.: Voting-based simultaneous tracking of multiple video objects. IEEE Trans. Circuits Syst. Video Technol. 15(11), 1448–1462 (2005)
Shafique, K., Shah, M.: A Non-Iterative Greedy Algorithm for Multi-frame Point Correspondence. IEEE Proc. Int. Conf. Comp. Vision, 110–115 (2003)
Klinger, A., et al.: A Dynamic Bayes Network for Visual Pedestrian Tracking. ISPRS 40(3), 145–150 (2014)
Reid, D.: An algorithm for tracking multiple targets. IEEE Trans. Automat. Contr. 24(6), 843–854 (1979)
Yilmaz, A.: Object Tracking: A Survey. ACM Comput. Surv. 38(4), 1–45 (2006)
Ragland, K., Tharcis, P.: A Survey on Object Detection, Classification and Tracking Methods. IJERT 3(11), 622–628 (2014)
Thirde, D., et al.: Robust Real-Time Tracking for Visual Surveillance. EURASIP J. Advances in Signal Proc 2007(1), 1–23 (2007)
Ying, L., Xu, C., Guo, W.: Extended MHT algorithm for multiple object tracking. In: Proc. Int. Conf. Internet Multimedia Computing and Service (2012)
Lao, Y., Zheng, Y.: Tracking highly correlated targets through statistical multiplexing. Image and Vision Computing 29(12), 803–817 (2011)
Veenman, C., Reinders, M., Backer, E.: Resolving motion correspondence for densely moving points. Trans. PAMI 23(1), 54–72 (2001)
Antunes, D., et al.: A Library for Implementing the Multiple Hypothesis Tracking Algorithm. CoRR 23(1), 54–72 (2011)
Cox, I.: Miller, M: On Finding Ranked Assignments With Application to Multi-Target Tracking & Motion Correspondence. Trans. Aerosp. Electron. Syst. (1996)
Wimmer, M.: Adaptive skin color classificator. In: Proc. GVIP, pp. 324–327 (2005)
Tomasi, C., Shi, J.: Good Features to Track. In: Proc. CVPR, pp. 593–600 (1994)
Doermann, D: Tools and Techniques for Video Performances Evaluation (2000)
Crasborn, O., et al.: ECHO Data Set for Sign Language of the Netherlands (NGT) (2004)
Arras, K., et al.: Efficient People Tracking in Laser Range Data using a Multi-Hypothesis Leg-Tracker with Adaptive Occlusion Probabilities. Int. Conf. on Robotics and Automation (2008)
Kasturi, R., et al.: Framework for performance evaluation of face, text, and vehicle detection and tracking in video. IEEE PAMI 31(2), 319–336 (2009)
Amditis, A., et al.: Multiple Hypothesis Tracking Implementation, 199–220 (2012)
Wu, S., Hong, L.: Hand tracking in a natural conversational environment by the interacting multiple model and probabilistic data association (IMM-PDA) algorithm. Pattern Recognition 38(11), 199–220 (2005)
Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proc. Int. Conf. Image Processing (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Borg, M., Camilleri, K.P. (2015). Multiple Hypothesis Tracking with Sign Language Hand Motion Constraints. In: Azzopardi, G., Petkov, N. (eds) Computer Analysis of Images and Patterns. CAIP 2015. Lecture Notes in Computer Science(), vol 9257. Springer, Cham. https://doi.org/10.1007/978-3-319-23117-4_18
Download citation
DOI: https://doi.org/10.1007/978-3-319-23117-4_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23116-7
Online ISBN: 978-3-319-23117-4
eBook Packages: Computer ScienceComputer Science (R0)