Abstract
This paper presents a method for incorporating temporal information in a video sequence for the task of human recognition. A time series state space model, parameterized by a tracking state vector and a recognizing identity variable, is proposed to simultaneously characterize the kinematics and identity. Two sequential importance sampling (SIS) methods, a brute-force version and an efficient version, are developed to provide numerical solutions to the model. The joint distribution of both state vector and identity variable is estimated at each time instant and then propagated to the next time instant. Marginalization over the state vector yields a robust estimate of the posterior distribution of the identity variable. Due to the propagation of identity and kinematics, a degeneracy in posterior probability of the identity variable is achieved to give improved recognition. This evolving behavior is characterized using changes in entropy. The effectiveness of this approach is illustrated using experimental results on low resolution face data and upper body data.
This work was completed with the support of the DARPA HumanID Grant N00014-00-1-0908. All correspondences are addressed to shaohua@cfar.umd.edu.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
M. J. Black and A. D. Jepson. A probabilistic frameworkfor matching temporal trajectories. Proc. of ICCV, pages 176–181, 1999.
T. Choudhury, B. Clarkson, T. Jebara, and A. Pentland. Multimodal person recognition using unconstrained audio and video. Proc. of Intl. Conf. on Audio-and Video-Based Person Authentication, pages 176–181, 1999.
T. M. Cover and J. A. Thomas. Elements of Information Theory. Wiley, 1991.
A. Doucet, S. J. Godsill, and C. Andrieu. On sequential monte carlo sampling methods for bayesian filtering. Statistics and Computing, 10(3):197–209, 2000.
T. J. Edwards, C. J. Taylor, and T. F. Cootes. Improving identification performance by intergrating evidence from sequences. Proc. of CVPR, pages 486–491, 1999.
M. Isard and A. Blake. Contour tracking by stochatic propagation of conditional density. Proc. of ECCV, 1996.
A. K. Jain, R. Duin, and J. Mao. Statistical pattern recognition: A review. IEEE Trans. PAMI, 22:4–37, 2000.
G. Kitagawa. Monte carlo filter and smoother for non-gaussian nonlinear state space models. J. Computational and Graphical Statistics, 5:1–25, 1996.
Baoxin Li and R. Chellappa. Simultaneous tracking and verification via sequential posterior estimation. Proc. of CVPR, pages 110–117, 2000.
Yongmin Li, Shaogang Gong, and H. Liddell. Constucting structures of facial identities on the view sphere using kernel discriminant analysis. Proc. of the 2rd Intl. Workshop on SCTV, 2001.
J. S. Liu and R. Chen. Sequential monte carlo for dynamic systems. Journal of the American Statistical Association, 93:1031–1041, 1998.
P. J. Philipps, H. Moon, S. Rivzi, and P. Ross. The feret testing protocol. Face Recognition: From Theory to Applications, 83:244–261, 1998.
L. Rabiner. A tutorial on hidden markov models and selected applications in speech recognition. Proc. of IEEE, 77(2), 1989.
De la Torre, F. Y. Yacoob, and L. Davis. A probabilistic framework for rigid and non-rigid appearance-based tracking and recognition. Proc. of 4th Intl. Conf. on Auto. Face and Gesture Recognition, 2000.
M. Turk and A. Pentland. Eigenfaces for recognition. Journal of Cognitive Neutoscience, 3:72–86, 1991.
W. Y. Zhao, R. Chellappa, A. Rosenfeld, and P. J. Phillips. Face recognition: A literature survey. UMD CfAR Technical Report CAR-TR-948, 2000.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, S., Chellappa, R. (2002). Probabilistic Human Recognition from Video. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds) Computer Vision — ECCV 2002. ECCV 2002. Lecture Notes in Computer Science, vol 2352. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47977-5_45
Download citation
DOI: https://doi.org/10.1007/3-540-47977-5_45
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43746-8
Online ISBN: 978-3-540-47977-2
eBook Packages: Springer Book Archive