A 2D Human Body Model Dressed in Eigen Clothing

  • Peng Guan
  • Oren Freifeld
  • Michael J. Black
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6311)


Detection, tracking, segmentation and pose estimation of people in monocular images are widely studied. Two-dimensional models of the human body are extensively used, however, they are typically fairly crude, representing the body either as a rough outline or in terms of articulated geometric primitives. We describe a new 2D model of the human body contour that combines an underlying naked body with a low-dimensional clothing model. The naked body is represented as a Contour Person that can take on a wide variety of poses and body shapes. Clothing is represented as a deformation from the underlying body contour. This deformation is learned from training examples using principal component analysis to produce eigen clothing. We find that the statistics of clothing deformations are skewed and we model the a priori probability of these deformations using a Beta distribution. The resulting generative model captures realistic human forms in monocular images and is used to infer 2D body shape and pose under clothing. We also use the coefficients of the eigen clothing to recognize different categories of clothing on dressed people. The method is evaluated quantitatively on synthetic and real images and achieves better accuracy than previous methods for estimating body shape under clothing.


Body Shape Beta Distribution Camera View Body Contour Active Shape Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Mori, G., Ren, X., Efros, A., Malik, J.: Finding and tracking people from the bottom up. In: CVPR, vol. 2, pp. 467–474 (2003)Google Scholar
  2. 2.
    Felzenszwalb, P.F.: Representation and detection of deformable shapes. PAMI 27, 208–220 (2004)Google Scholar
  3. 3.
    Hinton, G.E.: Using relaxation to find a puppet. In: Proc. of the A.I.S.B. Summer Conference, pp. 148–157 (1976)Google Scholar
  4. 4.
    Ju, S.X., Black, M.J., Yacoob, Y.: Cardboard people: A parameterized model of articulated motion. Face and Gesture, 38–44 (1996)Google Scholar
  5. 5.
    Freifeld, O., Weiss, A., Zuffi, S., Black, M.J.: Contour people: A parameterized model of 2D articulated human shape. In: CVPR (2010)Google Scholar
  6. 6.
    Balan, A., Black, M.: The naked truth: Estimating body shape under clothing. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 15–29. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  7. 7.
    Hasler, N., Stoll, C., Rosenhahn, B., Thormählen, T., Seidel, H.: Estimating body shape of dressed humans. Computers & Graphics 33, 211–216 (2009)CrossRefGoogle Scholar
  8. 8.
    Anguelov, D., Srinivasan, P., Koller, D., Thrun, S., Rodgers, J., Davis, J.: SCAPE: shape completion and animation of people. ACM TOG (SIGGRAPH) 24, 408–416 (2005)CrossRefGoogle Scholar
  9. 9.
    Rosenhahn, B., Kersting, U., Powell, K., Klette, R., Klette, G., Seidel, H.: A system for articulated tracking incorporating a clothing model. Mach. Vis. App. 18, 25–40 (2007)CrossRefGoogle Scholar
  10. 10.
    White, R., Crane, K., Forsyth, D.: Capturing and animating occluded cloth. ACM TOG (SIGGRAPH) 26, 34 (2007)CrossRefGoogle Scholar
  11. 11.
    Fleck, M., Forsyth, D., Bregler, C.: Finding naked people. In: ECCV, vol. 2, pp. 592–602 (1996)Google Scholar
  12. 12.
    Sprague, N., Luo, J.: Clothed people detection in still images. In: ICPR, vol. 3, pp. 585–589 (2002)Google Scholar
  13. 13.
    Bourdev, L., Malik, J.: Poselets: Body part detectors trained using 3D human pose annotations. In: ICCV (2009)Google Scholar
  14. 14.
    Tseng, C.H., Hung, S.S., Tsay, J.J., Tsaih, D.: An efficient garment visual search based on shape context. W. Trans. on Comp. (WSEAS) 8, 1195–1204 (2009)Google Scholar
  15. 15.
    Cootes, T., Taylor, C.: Active shape models–smart snakes. In: BMVC, pp. 266–275 (1992)Google Scholar
  16. 16.
    Balan, A., Sigal, L., Black, M., Davis, J., Haussecker, H.: Detailed human shape and pose from images. In: CVPR, pp. 1–8 (2007)Google Scholar
  17. 17.
    Baumberg, A., Hogg, D.: Learning flexible models from image sequences. In: ECCV, pp. 299–308 (1994)Google Scholar
  18. 18.
    Oliveira, F., Tavares, J.: Algorithm of dynamic programming for optimization of the global matching between two contours defined by ordered points. Computer Modeling in Eng. & Sciences 31, 1–11 (2008)zbMATHMathSciNetGoogle Scholar
  19. 19.
    Sigal, L., Balan, A., Black, M.: Combined discriminative and generative articulated pose and non-rigid shape estimation. In: Advances in Neural Information Processing Systems (NIPS), vol. 20, pp. 1337–1344. MIT Press, Cambridge (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Peng Guan
    • 1
  • Oren Freifeld
    • 2
  • Michael J. Black
    • 1
  1. 1.Department of Computer Science 
  2. 2.Division of Applied MathematicsBrown UniversityProvidenceUSA

Personalised recommendations