Advertisement

Cyberworlds pp 193-206 | Cite as

Performance Facial Animation Cloning

  • Philippe Limantour

Summary

This paper describes a method for cloning someone’s face for performance facial animation by interpolation among various canonical expressions.

The proposed procedure allows the automatic real-time animation of both facial expressions and lipsynch of a textured 3D synthetic face. Moreover, as a video chromakey analysis is computed, the lipsynch is accurate and language independent.

Finally, the differential interpolation methodused is geometry independent as long as all the canonical faceshave the same topology. This allows the animation parameters to be directly applied to faces built the same way. We apply this property on testing the animation with a model that suits real-time constraints and afterwards using the same parameters on a more complex version for better rendering results.

Keywords

Facial Expression Computer Animation Neutral Face Facial Animation Facial Action Code System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    T. Akimoto, Y. Suenaga, and R. Wallace. Automatic creation of 3d facial models. IEEE Computer Graphics and Applications, 13(5): 16–22, septembre 1993.CrossRefGoogle Scholar
  2. 2.
    Benoit C. The intrinsic bimodality of speech communication and the synthesis of talking faces. Journal on Communications, 43: 32–40, July–Sept 1992.Google Scholar
  3. 3.
    Benoit C., Adjoudani A., Angola O., Guiard-Marigny T., and B. Le Goff. Perception, analyse et synthese de levres parlantes. In Proceedings of Imagina ′93, fevrier 1994.Google Scholar
  4. 4.
    Benoit C., Mohamadi T., and Kandel S. The effects ofphonetic context on audio-visual intelligibility in french. Journal of Speech & Hearing Research, (to appear).Google Scholar
  5. 5.
    B. deGraf, M. Elson, F. Parke, B. Reevesand K. Waters, L. Williams, and B. Wivill. State of the art in facial animation. In ACM SIGGRAPH′90 Course Notes, volume 26, aout 1990.Google Scholar
  6. 6.
    S. DiPaola. Implementation and use of a 3d parameterized facial modeling and animation system. In ACM SIGGRAPH’89 Course Notes, volume 22, pages 20–33, 1989.Google Scholar
  7. 7.
    G. B. Duchenne. Mécanismes de la physionomie humaine. Baillère, 1876.Google Scholar
  8. 8.
    G. Dumont, M. P. Gascuel, and A. Verroust. Animation controlée par la dynamique — état de l’art-. Technical report, Rapport de Recherche INRIA 1405, avril 1991.Google Scholar
  9. 9.
    P. Ekman and W. E. Friesen. Facial Action Coding System. Consulting Psychologist Press, 1977.Google Scholar
  10. 10.
    P. Ekman and W. E. Friesen. Investigators Guide for the Facial Action Coding System. Consulting Psychologist Press, 1978.Google Scholar
  11. 11.
    P. Ekman and H. Oster. Facial expressions of emotion. Annual Review of Psychology, 1979.Google Scholar
  12. 12.
    H. Gray. Anatomy, Descriptive and Surgical. Bounty Books. Crown Publishers Inc., NY, 1977.Google Scholar
  13. 13.
    F. Parke J. Lewis. Automated lipsynch and speech synthesis for character animation. In Proc. CHI′87 and Graphics Interface′87, Toronto, pages 143-147, 1987.Google Scholar
  14. 14.
    J. Lasseter and S. Rafael. Principles of traditional animation applied to 3d computer animation. In Proceedings of SIGGRAPH, volume 21(4), pages 35–44, juillet 1987.CrossRefGoogle Scholar
  15. 15.
    G. Levner. Computer art: a technique for animation. In Annecy 93, festival international du film d’animation, June 1993.Google Scholar
  16. 16.
    G. Levner. Is vr technology really useful? In Proceedings of Imagina ′93, pages 173-178, juin 1993.Google Scholar
  17. 17.
    J. Lewis. Automated lip-sinc: Background and techniques. The Journal of Visualization and Computer Animation, 2 (4), octobre–décembre. 1991.Google Scholar
  18. 18.
    Ph. Limantour. Virtual reality simulation. In Proceedings of Imagina ′93, pages 123-133, février 1993.Google Scholar
  19. 19.
    Ph. Limantour. Real Time Facial Cloning. In Proceedings of Imagina ′94, février 1994.Google Scholar
  20. 20.
    Ph. Limantour. Performance Facial Animation. Fifth Eurographics ′94 Workshop on Animation and Simulation, Oslo Norway, Sep. 1994.Google Scholar
  21. 21.
    F. I. Parke. Parameterized models for facial animation. IEEE Computer Graphics and Applications, 2(9): 61–68, novembre 1982.CrossRefGoogle Scholar
  22. 22.
    F. I. Parke, K. Waters. Computer Facial Animation. A. K. Peters, Wellesley, Massachusetts, 1996.Google Scholar
  23. 23.
    S. Pieper, J. Rosen, and D. Zelter. Interactive graphics for plastic surgery: A task-level analysis and implementation. In 1992 Symposium on Interactive 3D Graphics, pages 127-134. Special issue of Computer Graphics, ACM SIGGRAPH, 1992.Google Scholar
  24. 24.
    S. M. Platt and N. I. Badler. Animating facial expressions. Computer Graphics, 15(3): 245–252, 1981.CrossRefGoogle Scholar
  25. 25.
    W. T. Reeves. Inbetweening for computer animation utilizing moving point constraints. Computer Graphics, 15(3): 263–269, aout 1981.MathSciNetCrossRefGoogle Scholar
  26. 26.
    G. Stern. GAS-A System for Computed-Aided Keyframe Animation. PhD thesis, University of Utah, 1978.Google Scholar
  27. 27.
    H. Tardif. Character animation in real time. In panel Proceedings of Siggraph′91, 1991.Google Scholar
  28. 28.
    H. Tardif. Televirtuality link between paris and monaco by numeris. In Proceedings of Imagina ′93, fevrier 1993.Google Scholar
  29. 29.
    D. Terzopoulos and K. Waters. Analysis of facial images using physical and anatomical models. In IEEE Proceedings of ICCV Conference, pages 727-732, 1990.Google Scholar
  30. 30.
    D. Terzopoulos and K. Waters. Techniques for realistic facial modelling and animation, pages 45-58. Springer-Verlag, 1991.Google Scholar
  31. 31.
    K. Waters. A dynamic of facial tissue. In ACM SIGGRAPH′89 Course Notes, volume 22, pages 145–152, 1989.Google Scholar
  32. 32.
    K. Waters and D. Terzopoulos. Modeling and animating faces using scanned data. The Journal of Visualization and Computer Animation, 2(4): 123–128, octobre–décembre. 1991.CrossRefGoogle Scholar
  33. 33.
    L. Williams. Performance-driven facial animation. In Proceedings of SIGGRAPH, volume 19(4), pages 235–242, aout 1990.CrossRefGoogle Scholar

Copyright information

© Springer Japan 1998

Authors and Affiliations

  • Philippe Limantour
    • 1
    • 2
  1. 1.MedialabParisFrance
  2. 2.iMAGIS / IMAG — INRIAGrenoble cedex 09France

Personalised recommendations