Real-Time 3D Motion Capture by Monocular Vision and Virtual Rendering

  • David Antonio Gómez Jáuregui
  • Patrick Horain
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7585)


Avatars in networked 3D virtual environments allow users to interact over the Internet and to get some feeling of virtual telepresence. However, avatar control may be tedious. Motion capture systems based on 3D sensors have recently reached the consumer market, but webcams and camera-phones are more widespread and cheaper. The proposed demonstration aims at animating a user’s avatar from real time 3D motion capture by monoscopic computer vision, thus allowing virtual telepresence to anyone using a personal computer with a webcam or a camera-phone. This kind of immersion allows new gesture-based communication channels to be opened in a virtual inhabited 3D space.


3D motion capture monocular vision 3D/2D registration particle filtering real-time computer vision 


  1. 1.
    Horain, P., Marques Soares, J., Rai, P.K., Bideau, A.: Virtually enhancing the perception of user actions. In: 15th International Conference on Artificial Reality and Telexistence (ICAT 2005), Christchurch, New Zealand, pp. 245–246 (2005)Google Scholar
  2. 2.
    Moeslund, T., Hilton, A., Kruger, V.: A survey of advances in vision-based human motion capture and analysis. Computer Vision and Image Understanding 104, 90–126 (2006)CrossRefGoogle Scholar
  3. 3.
    Poppe, R.W.: Vision-based human motion analysis: An overview. Computer Vision and Image Understanding 108, 4–18 (2007)CrossRefGoogle Scholar
  4. 4.
    Lindner, M., Schiller, I., Kolb, A., Koch, R.: Time-of-flight sensor calibration for accurate range sensing. Computer Vision and Image Understanding 114, 1318–1328 (2010)CrossRefGoogle Scholar
  5. 5.
    Microsoft: Kinect - (2011)Google Scholar
  6. 6.
    Gomez Jáuregui, D.A., Horain, P.: Region-Based vs. Edge-Based Registration for 3D Motion Capture by Real Time Monoscopic Vision. In: Gagalowicz, A., Philips, W. (eds.) MIRAGE 2009. LNCS, vol. 5496, pp. 344–355. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  7. 7.
    Gomez Jáuregui, D.A., Horain, P., Rajagopal, M.K., Karri, S.S.K.: Real-time particle filtering with heuristics for 3D motion capture by monocular vision. In: Proceedings of the 2010 IEEE International Workshop on Multimedia Signal Processing (MMSP 2010), Saint-Malo, France, pp. 139–144 (2010)Google Scholar
  8. 8.
    Isard, M., Blake, A.: Condensation - conditional density propagation for visual tracking. IJCV: International Journal of Computer Vision 29, 5–28 (1998)CrossRefGoogle Scholar
  9. 9.
    Sminchisescu, C., Triggs, B.: Kinematic jump processes for monocular 3D human tracking. In: International Conference on Computer Vision and Pattern Recognition, Madison, WI, pp. 69–76 (2003)Google Scholar
  10. 10.
    ISO/IEC 14996-2: Information technology-coding of audio-visual objects-part 2: visual (2001)Google Scholar
  11. 11.
    I-Maginer: Open source platform for 3D environments (2010),

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • David Antonio Gómez Jáuregui
    • 1
  • Patrick Horain
    • 1
  1. 1.Institut Mines-TélécomTélécom SudParisEvry CedexFrance

Personalised recommendations