Abstract
This paper proposes a method for detecting shapes of variable structure in images with clutter. The term “variable structure” means that some shape parts can be repeated an arbitrary number of times, some parts can be optional, and some parts can have several alternative appearances. The particular variation of the shape structure that occurs in a given image is not known a priori. Existing computer vision methods, including deformable model methods, were not designed to detect shapes of variable structure; they may only be used to detect shapes that can be decomposed into a fixed, a priori known, number of parts. The proposed method can handle both variations in shape structure and variations in the appearance of individual shape parts. A new class of shape models is introduced, called Hidden State Shape Models, that can naturally represent shapes of variable structure. A detection algorithm is described that finds instances of such shapes in images with large amounts of clutter by finding globally optimal correspondences between image features and shape models. Experiments with real images demonstrate that our method can localize plant branches that consist of an a priori unknown number of leaves and can detect hands more accurately than a hand detector based on the chamfer distance.
Chapter PDF
References
Rabiner, L.R.: A tutorial on hidden markov models and selected applications in speech recognition. Proc. of the IEEE 77(2), 257–286 (1989)
Sebastian, T.B., Klein, P.N., Kimia, B.B.: Recognition of shapes by editing shock graphs. In: ICCV, pp. 755–762 (2001)
Zhu, S.C., Yuille, A.L.: FORMS: a flexible object recognition and modeling system. IJCV 20, 187–212 (1996)
Kass, M., Witkin, A., Terzopoulos, D.: Snakes: Active contour models. IJCV 1, 321–331 (1988)
Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models - their training and application. CVIU 61, 38–59 (1995)
Coughlan, J.M., Ferreira, S.J.: Finding deformable shapes using loopy belief propagation. In: Heyden, A., Sparr, G., Nielsen, M., Johansen, P. (eds.) ECCV 2002. LNCS, vol. 2352, pp. 453–468. Springer, Heidelberg (2002)
Sigal, L., Isard, M., Sigelman, B.H., Black, M.J.: Attractive people: Assembling loose-limbed models using non-parametric belief propagation. In: NIPS (2003)
Zhang, J., Collins, R., Liu, Y.: Representation and matching of articulated shapes. In: CVPR, vol. 2, pp. 342–349 (2004)
Amini, A.A., Weymouth, T.E., Jain, R.C.: Using dynamic programming for solving variational problems in vision. PAMI 12, 855–867 (1990)
Felzenszwalb, P.F., Huttenlocher, D.P.: Pictorial structures for object recognition. IJCV 61, 55–79 (2005)
Felzenszwalb, P.F.: Representation and Detection of Shapes in Images. PhD thesis, MIT (2003)
Geiger, D., Gupta, A., Costa, L.A., Vlontzos, J.: Dynamic programming for detecting, tracking, and matching deformable contours. PAMI 17, 294–302 (1995)
Ioffe, S., Forsyth, D.A.: Probabilistic methods for finding people. IJCV 43, 45–68 (2001)
He, Y., Kundu, A.: 2-D shape classification using Hidden Markov Model. PAMI 13, 1172–1184 (1991)
Arica, N., Yarman-Vural, F.T.: A shape descriptor based on circular Hidden Markov Model. In: ICPR, pp. 1924–1927 (2000)
Bicego, M., Murino, V.: Investigating Hidden Markov Models’ capabilities in 2D shape classification. PAMI 26, 281–286 (2004)
Prusinkiewicz, P., Lindenmayer, A.: The algorithmic beauty of plants. Springer, New York (1990)
Han, F., Zhu, S.C.: Bottom-up/top-down image parsing by attribute graph grammar. In: ICCV, pp. 1778–1785 (2005)
Belongie, S., Malik, J., Puzicha, J.: Shape matching and object recognition using shape contexts. PAMI 24, 509–522 (2002)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60, 91–110 (2004)
Barrow, H.G., Tenenbaum, J.M., Bolles, R.C., Wolf, H.C.: Parametric correspondence and chamfer matching: Two new techniques for image matching. In: IJCAI, pp. 659–663 (1977)
Thayananthan, A., Stenger, B., Torr, P.H.S., Cipolla, R.: Shape context and chamfer matching in cluttered scenes. In: CVPR, pp. 127–133 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Athitsos, V., Wang, J., Sclaroff, S., Betke, M. (2006). Detecting Instances of Shape Classes That Exhibit Variable Structure. In: Leonardis, A., Bischof, H., Pinz, A. (eds) Computer Vision – ECCV 2006. ECCV 2006. Lecture Notes in Computer Science, vol 3951. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11744023_10
Download citation
DOI: https://doi.org/10.1007/11744023_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-33832-1
Online ISBN: 978-3-540-33833-8
eBook Packages: Computer ScienceComputer Science (R0)