Advertisement

Modeling and Rendering for Realistic Facial Animation

  • Stephen R. Marschner
  • Brian Guenter
  • Sashi Raghupathy
Part of the Eurographics book series (EUROGRAPH)

Abstract

Rendering realistic faces and facial expressions requires good models for the reflectance of skin and the motion of the face. We describe a system for modeling, animating, and rendering a face using measured data for geometry, motion, and reflectance, which realistically reproduces the appearance of a particular person’s face and facial expressions. Because we build a complete model that includes geometry and bidirectional reflectance, the face can be rendered under any illumination and viewing conditions. Our face modeling system creates structured face models with correspondences across different faces, which provide a foundation for a variety of facial animation operations.

Keywords

Facial Expression Computer Graphic Face Model Bidirectional Reflectance Distribution Function Subdivision Surface 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Volker Blanz and Thomas Vetter. A morphable model for the synthesis of 3D faces. In Computer Graphics (SIGGRAPH 1999 Proceedings), pages 187–194, 1999.Google Scholar
  2. 2.
    Justine Cassell, C. Pelachaud, N. Badler, M. Steedman, B. Achorn, T. Becket, B. Douville, S. Prevost, and M. Stone. Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. In Computer Graphics (SIGGRAPH 1994 Proceedings), pages 413–420, August 1994.Google Scholar
  3. 3.
    R. L. Cook, T. Porter, and L. Carpenter. Distribution ray tracing. In Computer Graphics (SIGGRAPH 1984 Proceedings), pages 165–174, July 1984.Google Scholar
  4. 4.
    Paul Debevec and Jitendra Malik. Recovering high dynamic range radiance maps from photographs. In Computer Graphics (SIGGRAPH 1997 Proceedings), pages 369–378, August 1997.Google Scholar
  5. 5.
    Douglas DeCarlo and Dimitris Metaxas. The integration of optical flow and deformable models with applications to human face shape and motion estimation. In Proceedings CVPR, pages 231–238, 1996.Google Scholar
  6. 6.
    I. Essa and A. Pentland. Coding, analysis, interpretation and recognition of facial expressions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 19(7):757–763, 1997.CrossRefGoogle Scholar
  7. 7.
    Andrew S. Glassner. Principles of Digital Image Synthesis. Morgan Kaufmann, San Francisco, 1995.Google Scholar
  8. 8.
    Brian Guenter, Cindy Grimm, Daniel Wood, Henrique Mal var, and Frédéric Pighin. Making faces. In Computer Graphics (SIGGRAPH 1998 Proceedings), pages 55–67, July 1998.Google Scholar
  9. 9.
    Hugues Hoppe, Tony DeRose, Tom Duchamp, Mark Halstead, Hubert Jin, John McDonald, Jean Schweitzer, and Werner Stuetzle. Piecewise smooth surface reconstruction. In Computer Graphics (SIGGRAPH 1994 Proceedings), pages 295–302, July 1994.Google Scholar
  10. 10.
    Eric P. F. Lafortune, Sing-Choong Foo, Kenneth E. Torrance, and Donald P. Greenberg. Nonlinear approximation of reflectance functions. In Computer Graphics (SIGGRAPH 1997 Proceedings), pages 117–126, August 1997.Google Scholar
  11. 11.
    Aaron Lee, Henry Moreton, and Hugues Hoppe. Displaced subdivision surfaces. In Computer Graphics (SIGGRAPH 2000 Proceedings), July 2000. (Forthcoming).Google Scholar
  12. 12.
    Yuencheng Lee, D. Terzopoulos, and K. Waters. Realistic modeling for facial animation. In Computer Graphics (SIGGRAPH 1995 Proceedings), pages 55–62, July 1995.Google Scholar
  13. 13.
    Charles Loop. Smooth Subdivision Surfaces Based on Triangles. PhD thesis, University of Utah, August 1987.Google Scholar
  14. 14.
    Stephen R. Marschner. Inverse Rendering for Computer Graphics. PhD thesis, Cornell University, August 1998.Google Scholar
  15. 15.
    Stephen R. Marschner, Stephen H. Westin, Eric P. F. Lafortune, Kenneth E. Torrance, and Donald P. Greenberg. Image-based BRDF measurement including human skin. In Rendering Techniques ’99 (Proceedings of the Eurographics Workshop on Rendering), pages 131–144, June 1999.Google Scholar
  16. 16.
    Frédéric Pighin, Jamie Hecker, Dani Lischinski, Richard Szeliski, and David H. Salesin. Synthesizing realistic facial expressions from photographs. In Computer Graphics (SIGGRAPH 1998 Proceedings), pages 75–84, July 1998.Google Scholar
  17. 17.
    C. Rocchini, P. Cignoni, C. Montani, and R. Scopigno. Multiple textures stitching and blending on 3D objects. In Rendering Techniques ’99 (Proceedings of the Eurographics Workshop on Rendering), pages 119–130, June 1999.Google Scholar
  18. 18.
    Holly Rushmeier and Fausto Bernardini. Computing consistent normals and colors from photometric data. In Proceedings of the Second International Conference on 3D Digital Imaging and Modeling (3DIM ’99), October 1999.Google Scholar
  19. 19.
    Holly Rushmeier, Fausto Bernardini, Joshua Mittleman, and Gabriel Täubin. Acquiring input for rendering at appropriate level of detail: Digitizing a Pietà. In Rendering Techniques ’98 (Proceedings of the Eurographics Workshop on Rendering), pages 81–92, June 1998.CrossRefGoogle Scholar
  20. 20.
    Peter Shirley, Changyaw Wang, and Kurt Zimmerman. Monte carlo techniques for direct lighting calculations. Transactions on Graphics, 15(1): 1–36, 1996.CrossRefGoogle Scholar
  21. 21.
    Keith Waters. A muscle model for animating three-dimensional facial expression. In Computer Graphics (SIGGRAPH 1987 Proceedings), pages 17–24, July 1987.Google Scholar
  22. 22.
    Lance Williams. Performance-driven facial animation. In Computer Graphics (SIGGRAPH 1990 Proceedings), pages 235–242, August 1990.Google Scholar
  23. 23.
    Yizhou Yu, Paul Debevec, Jitendra Malik, and Tim Hawkins. Inverse global illumination: Recovering reflectance models of real scenes from photographs. In Computer Graphics (SIGGRAPH 1999 Proceedings), pages 215–224, August 1999.Google Scholar
  24. 24.
    Zhengyou Zhang. A flexible new technique for camera calibration. Technical Report MSR-TR-98–71, Microsoft Research, 1998.Google Scholar

Copyright information

© Springer-Verlag Wien 2000

Authors and Affiliations

  • Stephen R. Marschner
    • 1
  • Brian Guenter
    • 1
  • Sashi Raghupathy
    • 1
  1. 1.Microsoft CorporationUSA

Personalised recommendations