Tracking of Multi-state Hand Models Using Particle Filtering and a Hierarchy of Multi-scale Image Features⋆
This paper presents an approach for simultaneous tracking and recognition of hierarchical object representations in terms of multiscale image features. A scale-invariant dissimilarity measure is proposed for comparing scale-space features at different positions and scales. Based on this measure, the likelihood of hierarchical, parameterized models can be evaluated in such a way that maximization of the measure over different models and their parameters allows for both model selection and parameter estimation. Then, within the framework of particle filtering, we consider the area of hand gesture analysis, and present a method for simultaneous tracking and recognition of hand models under variations in the position, orientation, size and posture of the hand. In this way, qualitative hand states and quantitative hand motions can be captured, and be used for controlling different types of computerised equipment.
KeywordsFeature Detection Hand Posture Hand Gesture Dissimilarity Measure Hand Tracking
Unable to display preview. Download preview PDF.
- Black, M. and Jepson, A. (1998). A probabilistic framework for matching temporal trajectories: Condensation-based recognition of gestures and expressions, ECCV’98, Freiburg, Germany, 909–924.Google Scholar
- Bretzner, L. and Lindeberg, T. (1998). Use your hand as a 3-D mouse or relative orientation from extended sequences of sparse point and line correspondences using the afine trifocal tensor, ECCV’96, Freiburg, Germany, 141–157.Google Scholar
- Bretzner, L. and Lindeberg, T. (1999). Qualitative multi-scale feature hierarchies for object tracking, Scale-Space’99, Corfu, Greece, 117–128.Google Scholar
- Bretzner, L., Laptev, I. and Lindeberg, T. (2001). Tracking and recognition of hand postures for visually guided control. In preparation.Google Scholar
- Cipolla, R., Okamoto, Y. and Kuno, Y. (1993). Robust structure from motion using motion parallax, ICCV’93, Berlin, Germany, 374–382.Google Scholar
- Cui, Y. and Weng, J. (1996). View-based hand segmentation and hand-sequence recognition with complex backgrounds, ICPR’96, Vienna, Austria, 617–621.Google Scholar
- Deutscher, J., Blake, A. and Reid, I. (2000). Articulated body motion capture by annealed particle filtering, CVPR’00, Hilton Head, SC, II:126–133.Google Scholar
- Freeman, W.T. and Weissman, C.D. (1995), Television control by hand gestures, Face and Gesture’95, Zurich, Switzerland.Google Scholar
- Heap, T. and Hogg, D. (1998). Wormholes in shape space: Tracking through discontinuous changes in shape, ICCV’98, Bombay, India, 344–349.Google Scholar
- Isard, M. and Blake, A. (1996). Contour tracking by stochastic propagation of conditional density, ECCV’96, Cambridge, UK, I:343–356.Google Scholar
- Laptev, I and Lindeberg, T. (2000) Tracking of multi-state hand models using particle filtering and a hierarchy of multi-scale image features, Technical report ISRN KTH/NA/P00/12-SE. http://www.nada.kth.se/cvap/abstracts/cvap245.html.
- Lindeberg, T. (1998). Feature detection with automatic scale selection, IJCV, 30(2): 77–116.Google Scholar
- Lindeberg, T. and Niemenmaa, J. (2001). Scale selection in hybrid multi-scale representations, in preparation.Google Scholar
- MacCormick, J. and Isard, M. (2000). Partitioned sampling, articulated objects, and interface-quality hand tracking, ECCV’00, Dublin, Ireland, II:3–19.Google Scholar
- Regh, J.M. and Kanade, T. (1995). Model-based tracking of self-occluding articulated objects, ICCV’95, Cambridge, MA, 612–617.Google Scholar
- Sidenbladh, H., Black, M. and Fleet, D. (2000). Stochastic tracking of 3-D human figures using 2-D image motion, ECCV’00, Dublin, Ireland, II:702–718.Google Scholar
- Sjöbergh, J. and Lindeberg, T. (2001). In preparation.Google Scholar
- Sullivan, J., Blake, A., Isard, M. and MacCormick, J. (1999). Object localization by Bayesian correlation, ICCV’99, Corfu, Greece, 1068–1075.Google Scholar
- Triesch, J. and von der Malsburg, C. (1996). Robust classification of hand postures against complex background, Face and Gesture’96, Killington, Vermont, 170–175.Google Scholar