Abstract
Silhouette recognition can reconstruct the three-dimensional pose of a human subject in monocular video so long as the camera’s view remains unoccluded by other objects. This paper develops a shape representation that can describe and compare partial shapes, extending the silhouette recognition technique to apply to video with occlusions. The new method operates without human intervention, and experiments demonstrate that it can reconstruct accurate three-dimensional articulated pose tracks from single-camera walking video despite occlusion of one-third to one-half of the subject.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Moeslund, T.B., Granum, E.: A survey of computer vision-based human motion capture. Computer Vision and Image Understanding 81, 231–268 (2001)
Sigal, L., Bhatia, S., Roth, S., Black, M., Isard, M.: Tracking loose-limbed people. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. I, pp. 421–428 (2004)
Sminchisescu, C., Kanaujia, A., Li, Z., Metaxas, D.: Learning to reconstruct 3d human motion from bayesian mixtures of experts: A probabilistic discriminative approach, Technical Report CSRG-502, University of Toronto (October 2004)
Howe, N.: Silhouette lookup for monocular 3d pose tracking. Image and Vision Computing (to appear, 2006)
Mori, G., Malik, J.: Estimating human body configurations using shape context matching. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 666–680. Springer, Heidelberg (2002)
Fablet, R., Black, M.J.: Automatic detection and tracking of human motion with a view-based representation. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2350, pp. 476–491. Springer, Heidelberg (2002)
Ramanan, D., Forsyth, D.A., Zisserman, A.: Strike a pose: Tracking people by finding stylized poses. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 271–278 (2005)
Gabriel, P., Verly, J., Piater, J., Genon, A.: The state of the art in multiple object tracking under occlusion in video sequences. In: Advanced Concepts for Intelligent Vision Systems, pp. 166–173 (2003)
Lanz, O., Manduchi, R.: Hybrid joint-separable multibody tracking. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 413–420 (2005)
Rathi, Y., Vaswani, N., Tannenbaum, A., Yezzi, A.: Particle filtering for geometric active contours with application to tracking moving and deforming objects. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 2–9 (2005)
Urtasun, R., Fleet, D., Fua, P.: 3d people tracking with gaussian process dynamical models. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition (2006)
Saber, E., Xu, Y., Tekalp, A.M.: Partial shape recognition by sub-matrix matching for partial matching guided image labeling. Pattern Recognition 38, 1560–1573 (2005)
Salari, E., Balaji, S.: Recognition of partially occluded objects using b-spline representation. In: Proc. SPIE, High-Speed Inspection Architectures, Barcoding, and Character Recognition, vol. 1384, pp. 115–123 (1991)
Mokhtarian, F.: Silhouette-based object recognition with occlusion through curvature scale space. In: Proceedings of the European Conference on Computer Vision, pp. 566–578 (1996)
Mokhtarian, F., Abbasi, S., Kittler, J.: Robust and efficient shape indexing through curvature scale space. In: Proceedings of the British Machine Vision Conference, pp. 53–62 (1996)
Adamek, T., O’Connor, N.: Efficient contour-based shape representation and matching. In: Multimedia Information Retrieval, pp. 138–143 (2003)
Grauman, K., Darrell, T.: Fast contour matching using approximate earth mover’s distance. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. I, pp. 220–227 (2004)
Grauman, K., Darrell, T.: Efficient image matching with distributions of local invariant features. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. II, pp. 627–634 (2005)
Belongie, M., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 509–522 (2002)
Latecki, L.J., Lakämper, R., Eckhardt, U.: Shape descriptors for non-rigid shapes with a single closed contour. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 424–429 (2000)
Howe, N., Deschamps, A.: Better foreground segmentation through graph cuts, Technical report, Smith College (2004), http://arxiv.org/abs/cs.CV/0401017
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Howe, N.R. (2006). Boundary Fragment Matching and Articulated Pose Under Occlusion. In: Perales, F.J., Fisher, R.B. (eds) Articulated Motion and Deformable Objects. AMDO 2006. Lecture Notes in Computer Science, vol 4069. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11789239_28
Download citation
DOI: https://doi.org/10.1007/11789239_28
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-36031-5
Online ISBN: 978-3-540-36032-2
eBook Packages: Computer ScienceComputer Science (R0)