An Active Multi-camera Motion Capture for Face, Fingers and Whole Body

  • Eng Hui Loke
  • Masanobu Yamamoto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4843)


This paper explores a novel endeavor of deploying only four active-tracking cameras and fundamental vision-based technologies for 3D motion capture of a full human body figure, which includes facial expression, motion of fingers of both hands and a whole body. The proposed methods suggest alternatives to extract motion parameters of the mentioned body parts from four single-view image sequences. The proposed ellipsoidal model- and flow-based facial expression motion capture solution tackles both 3D head pose and non-rigid facial motion effectively and we observe that a set of 22 self-defined feature points suffice the expression representation. The body figure and fingers motion capture is solved with a combination of articulated model and flow-based methods.


Facial Expression Feature Point Facial Feature Motion Capture World Coordinate System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Black, M.J., Yacoob, Y.: Recognizing Facial Expressions In Image Sequences Using Local Parameterized Models Of Image Motion. IJCV 25(1), 23–48 (1997)CrossRefGoogle Scholar
  2. 2.
    Brunelli, R., Poggio, T.: Face Recognition: Features versus Templates. IEEE PAMI 15(10), 1042–1052 (1993)Google Scholar
  3. 3.
    Chuang, M.M., Chang, R.F., Huang, Y.L.: Automatic Facial Feature Extraction In Model-Based Coding. Journal of Information Science And Engineering 16, 447–458 (2000)Google Scholar
  4. 4.
    Feris, R.S., De Campos, T.E., Junior, R.M.C.: Detection and Tracking Of Facial Features In Video Sequences. In: Cairó, O., Cantú, F.J. (eds.) MICAI 2000. LNCS, vol. 1793, pp. 197–206. Springer, Heidelberg (2000)Google Scholar
  5. 5.
    Gu, H., Su, G.: Feature Points Extraction From Faces. Image and Vision Computing NZ  (2003)Google Scholar
  6. 6.
    Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. Imaging Understanding Workshop, pp. 121–130 (1981)Google Scholar
  7. 7.
    Mori, G., Malik, J.: Recovering 3D human body configurations using shape contexts. IEEE PAMI 7(28), 1052–1062 (2006)Google Scholar
  8. 8.
    Wang, J.J., Singh, S.: Video analysis of human dynamics - a survey. Real-Time Imaging 9(5), 321–346 (2003)CrossRefGoogle Scholar
  9. 9.
    Yamamoto, M., Ohta, Y., Yamagiwa, T., Yagishita, K., Yamanaka, H., Ohkubo, H.: Human Action Tracking Guided by Key-Frames. FG2000, 354–361 (2000)Google Scholar
  10. 10.
    Zhao, W., Chellappa, R., Phillips, P.J., Rosenfeld, A.: Face recognition: A literature survey. ACM Computiong Surveys 35(4), 299–458 (2003)Google Scholar
  11. 11.
  12. 12.
    Evaluation of RGB and HSV models in Human Faces Detection [Online] Available,,/web/Sedlacek-Marian/

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Eng Hui Loke
    • 1
  • Masanobu Yamamoto
    • 1
  1. 1.Graduate School of Science & Technology, and Department of Information Engineering, Niigata University, Ikarashi 2-nocho 8050, Nishi-ku, Niigata-city 950-2181Japan

Personalised recommendations