Advertisement

Real-Time and Markerless 3D Human Motion Capture Using Multiple Views

  • Brice Michoud
  • Erwan Guillou
  • Saïda Bouakaz
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4814)

Abstract

We present a fully automated system for real-time markerless 3D human motion capture. Our approach, based on fast algorithms, uses simple techniques and requires low-cost devices. Using input from multiple calibrated webcams, an extended Shape-From-Silhouette algorithm reconstructs the person in real-time. Fast 3D shape and 3D skin parts analysis provide a robust and real-time system for human full-body tracking. Animation skeleton and simple morphological constraints make easier the motion capture process. Thanks to fast and simple algorithms and low-cost cameras, our system is perfectly apt for home entertainment device.

Results on real video sequences with complicated motions demonstrate the robustness of the approach.

Keywords

Motion Capture Multiple View Temporal Coherence Visual Hull Voxel Grid 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Moeslund, T.B., Hilton, A., Krüger, V.: A survey of advances in vision-based human motion capture and analysis. Comput. Vis. Image Underst. 104(2), 90–126 (2006)CrossRefGoogle Scholar
  2. 2.
    Agarwal, A., Triggs, B.: Monocular human motion capture with a mixture of regressors. In: CVPR 2005, vol. 72, IEEE Computer Society, Los Alamitos (2005)Google Scholar
  3. 3.
    Chen, Y., Lee, J., Parent, R., Machiraju, R.: Markerless monocular motion capture using image features and physical constraints. In: CGI 2005. Proceedings of the Computer Graphics International 2005, pp. 36–43. IEEE Computer Society Press, Los Alamitos (2005)Google Scholar
  4. 4.
    Micilotta, A., Ong, E., Bowden, R.: Real-time upper body detection and 3D pose estimation in monoscopic images. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3953, pp. 139–150. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    de Aguiar, E., Theobalt, C., Magnor, M., Theisel, H., Seidel, H.P.: M3: Marker-free model reconstruction and motion tracking from 3d voxel data. In: Cohen-Or, D., Ko, H.S., Terzopoulos, D., Warren, J. (eds.) PG 2004. 12th Pacific Conference on Computer Graphics and Applications, pp. 101–110. IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
  6. 6.
    Mikic, I., Trivedi, M., Hunter, E., Cosman, P.: Human body model acquisition and tracking using voxel data. Int. J. Comput. Vision 53(3), 199–223 (2003)CrossRefGoogle Scholar
  7. 7.
    Tangkuampien, T., Suter, D.: Real-Time Human Pose Inference using Kernel Principal Component Pre-image Approximations. In: Proceedings BMVC 2006, pp. 599–608 (2006)Google Scholar
  8. 8.
    Okada, R., Stenger, B., Ike, T., Kondoh, N.: Virtual Fashion Show Using Real-Time Markerless Motion Capture. In: Narayanan, P.J., Nayar, S.K., Shum, H.-Y. (eds.) ACCV 2006. LNCS, pp. 801–810. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  9. 9.
    Caillette, F., Galata, A., Howard, T.: Real-Time 3-D Human Body Tracking using Variable Length Markov Models. In: Proceedings BMVC 2005, vol. 1 (September 2005)Google Scholar
  10. 10.
    Caillette, F., Howard, T.: Real-Time Markerless Human Body Tracking Using Colored Voxels and 3-D Blobs. In: ISMAR. Proceedings of the 3rd IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 266–267. IEEE Computer Society Press, Los Alamitos (2004)Google Scholar
  11. 11.
    Fua, P., Gruen, A., D’Apuzzo, N., Plankers, R.: Markerless Full Body Shape and Motion Capture from Video Sequences. In: Symposium on Close Range Imaging, International Society for Photogrammetry and Remote Sensing, Corfu, Greece (2002)Google Scholar
  12. 12.
    Ménier, C., Boyer, E., Raffin, B.: 3d skeleton-based body pose recovery. In: Proceedings of the 3rd International Symposium on 3D Data Processing, Visualization and Transmission, Chapel Hill (USA) (June 2006)Google Scholar
  13. 13.
    Laurentini, A.: The visual hull concept for silhouette-based image understanding. IEEE Trans. Pattern Anal. Mach. Intell. 16(2), 150–162 (1994)CrossRefGoogle Scholar
  14. 14.
    Franco, J.S., Boyer, E.: Exact polyhedral visual hulls. In: Proceedings BMVC 2003, Norwich, UK, pp. 329–338 (September 2003)Google Scholar
  15. 15.
    Hasenfratz, J.M., Lapierre, M., Sillion, F.: A real-time system for full body interaction with virtual worlds. In: Eurographics Symposium on Virtual Environments, pp. 147–156 (2004)Google Scholar
  16. 16.
    Cheung, K.M., Kanade, T., Bouguet, J.Y., Holler, M.: A real time system for robust 3d voxel reconstruction of human motions. In: CVPR 2000. Proceedings of the 2000 IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 714–720. IEEE Computer Society Press, Los Alamitos (2000)Google Scholar
  17. 17.
    Michoud, B., Guillou, E., Bouakaz, S.: Shape from silhouette: Towards a solution for partial visibility problem. In: Eurographics 2006 Short Papers Preceedings, pp. 13–16 (September 2006)Google Scholar
  18. 18.
    Zhang, Z.: Flexible camera calibration by viewing a plane from unknown orientations. In: ICCV, pp. 666–673 (1999)Google Scholar
  19. 19.
    Joshi, N.: Color calibration for arrays of inexpensive image sensors. Technical report, Stanford University (2004)Google Scholar
  20. 20.
    Toyama, K., Krumm, J., Brumitt, B., Meyers, B.: Wallflower: Principles and practice of background maintenance. In: ICCV (1), pp.255–261 (1999)Google Scholar
  21. 21.
    Vezhnevets, V., Sazonov, V., Andreeva, A.: A survey on pixel-based skin color detection techniques. In: Proceedings of Graphicon-2003 (2003)Google Scholar
  22. 22.
    Segal, M., Korobkin, C., van Widenfelt, R., Foran, J., Haeberli, P.: Fast shadows and lighting effects using texture mapping. In: Proceedings of SIGGRAPH (1992)Google Scholar
  23. 23.
    Culbertson, W.B., Malzbender, T., Slabaugh, G.G.: Generalized voxel coloring. In: Workshop on Vision Algorithms, pp. 100–115 (1999)Google Scholar
  24. 24.
    Sun, W., Hilton, A., Smith, R., Illingworth, J.: Layered animation of captured data. The Visual Computer 17(8), 457–474 (2001)Google Scholar
  25. 25.
    Dreyfuss, H., Tilley, A.R.: The Measure of Man and Woman: Human Factors in Design. John Wiley & Sons, Chichester (2001)Google Scholar
  26. 26.
    Motmans, R., Ceriez, E.: Anthropometry table, Ergonomie RC, Leuven, Belgium (2005)Google Scholar
  27. 27.
    Anthropometric source book. Vol. 1, Anthropometry for designers, NASA Report Number: NASA-RP-1024, S-479-VOL-1 (1978)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Brice Michoud
    • 1
  • Erwan Guillou
    • 1
  • Saïda Bouakaz
    • 1
  1. 1.Laboratory LIRIS - CNRS, UMR 5205, University of LyonFrance

Personalised recommendations