Skip to main content
SpringerLink
Log in
Book cover

Confluence of Computer Vision and Computer Graphics pp 143–160Cite as

Facial Motion Capturing Using an Explanation-Based Approach

  • Chapter

  • 172 Accesses

Part of the book series: NATO Science Series ((ASHT,volume 84))

Abstract

Building deformation models using the motions captured from real video sequences is becoming a popular method in facial animation. In this paper, we propose an explanation-based facial motion tracking algorithm based on a piecewise Bézier volume deformation model (PBVD). The PBVD is a suitable model both for the synthesis and the analysis of facial images. It is linear and independent of the facial mesh structure. With this model, basic facial movements, or action units, are interactively defined. By changing the magnitudes of these action units, animated facial images are generated. The magnitudes of these action units can also be computed from real video sequences using a model-based tracking algorithm. However, in order to customize the articulation model for a particular face, the predefined PBVD action units need to be adaptively modified. In this paper, we first briefly introduce the PBVD model and its application in facial animation. Then a multi-resolution PBVD-based motion tracking algorithm is presented. Finally, we describe an explanation-based tracking algorithm that takes the predefined action units as the initial articulation model and adaptively improves them during the tracking process to obtain a more realistic articulation model. Experimental results on PBVD-based animation, model-based tracking, and explanation-based tracking are shown in this paper.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD   54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. C. S. Choi, K. Aizawa, H. Harashima, and T. Takebe. Analysis and synthesis of facial image sequences in model-based image coding. IEEE Trans. Circuit Sys. Video Technol., 4(3):257–275, 1994.

    Article  Google Scholar 

  2. D. DeCarlo and D. Metaxas. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In CVPR’96, pages 231–238, 1996.

    Google Scholar 

  3. I. Essa and A. Pentland. Coding, analysis, interpretation and recognition of facial expressions. IEEE Trans. Pattern Analysis and Machine Intelligence, 19(7):757–763, 1997.

    Article  Google Scholar 

  4. B. Guenter, C. Grimm, D. Wood, H. Malvar, and F. Pighin. Making faces. In SIGGRAPH 98, pages 55–66, 1998.

    Chapter  Google Scholar 

  5. P. Kalra, A. Mangili, N. M. Thalmann, and D. Thalmann. Simulation of facial muscle actions based on rational free form deformations. In Proc. EUROGRAPHICS’92, pages 59–69, 1992.

    Google Scholar 

  6. C. Kambhamettu, D. B. Goldgof, D. Terzopoulos, and T. S. Huang. Nonrigid motion analysis. In Handbook of PRIP: Computer Vision, pages 405–430. Academic Press, 1994.

    Google Scholar 

  7. Y. Lee, D. Terzopoulos, and K. Waters. Realistic modeling for facial animation. In Proc. SIGGRAPH 95, pages 55–62, 1995.

    Chapter  Google Scholar 

  8. H. Li, P. Roivainen, and R. Forchheimer. 3-D motion estimation in model-based facial image coding. IEEE Trans. Pattern Analysis and Machine Intelligence, 15(6):545–555, 1993.

    Article  Google Scholar 

  9. D. W. Massaro and M. M. Cohen. Modeling coarticulation in synthetic visual speech. In N. M. Thalmann and D. Thalmann (Eds.) Models and Techniques in Computer Animation, pages 139–156. Springer-Verlag, 1993.

    Google Scholar 

  10. F. I. Parke. Parameterized models for facial animation. IEEE Cornput. Graph, and Appl., 2(9):61–68, 1982.

    Article  Google Scholar 

  11. T. W. Sederberg and S. R. Parry. Free-form deformation of solid geometric models. In SIGGRAPH 86, pages 151–160, 1986.

    Chapter  Google Scholar 

  12. L. Williams. Performance-driven facial animation. In SIGGRAPH 90, pages 235–242, 1990.

    Chapter  Google Scholar 

Download references

Authors
  1. Hai Tao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas S. Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Computer and Information Science, University of Ljubljana, Tržaška 25, SI-1000, Ljubljana, Slovenia

    Aleš Leonardis Dipl.Ing. (1985), M.Sc. (1988) and Ph.D. (1993) (Associate Professor of computer and information science) & Franc Solina Dipl.Ing. (1979), M.Sc. (1982) and Ph.D. (1987) (Professor of computer and information science) (Associate Professor of computer and information science) &  (Professor of computer and information science)

  2. GRASP Laboratory, Department of Computer and Information Science, University of Pennsylvania, 19104-6389, Philadelphia, PA, USA

    Ruzena Bajcsy Ph.D. in 1967, Ph.D. in 1972 (Director of the Directorate for Computer and Information Science and Engineering (CISE) (Director of the Directorate for Computer and Information Science and Engineering (CISE)

  3. National Science Foundation, Washington, USA

    Ruzena Bajcsy Ph.D. in 1967, Ph.D. in 1972 (Director of the Directorate for Computer and Information Science and Engineering (CISE) (Director of the Directorate for Computer and Information Science and Engineering (CISE)

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Tao, H., Huang, T.S. (2000). Facial Motion Capturing Using an Explanation-Based Approach. In: Leonardis, A., Solina, F., Bajcsy, R. (eds) Confluence of Computer Vision and Computer Graphics. NATO Science Series, vol 84. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-4321-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-4321-9_8

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-0-7923-6612-6

  • Online ISBN: 978-94-011-4321-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation