Realistic Facial Animation by Automatic Individual Head Modeling and Facial Muscle Adjustment

  • Akinobu Maejima
  • Hiroyuki Kubo
  • Shigeo Morishima
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6774)


We propose a technique for automatically generating a realistic facial animation with precise individual facial geometry and characteristic facial expressions. Our method is divided into two key methods: the head modeling process automatically generates a whole head model only from facial range scan data, the facial animation setup process automatically generates key shapes which represent individual facial expressions based on physics-based facial muscle simulation with an individual muscle layout estimated from facial expression videos. Facial animations considering individual characteristics can be synthesized using the generated head model and key shapes. Experimental results show that the proposed method can generate facial animations where 84% of subjects can identify themselves. Therefore, we conclude that our head modeling techniques are effective to entertainment system like a Future Cast.


Individual Head Model Automatic Mesh Completion Facial Muscle Layout Estimation Key Shape Generation Facial Animation Synthesis 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alexander, O., Rogers, M., Lambeth, W., Chiang, N., Devebec, P.: Creating a Photoreal Digital Actor: The Digital Emily Project. In: SIGGRAPH 2009: ACM SIGGRAPH 2009, Course Notes (2009)Google Scholar
  2. 2.
    Allen, B., Curless, B., Popović, Z.: The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans. In: SIGGRAPH 2003: ACM SIGGRAPH 2003, Papers, pp. 587–594 (2003)Google Scholar
  3. 3.
    Choe, B., Lee, H., Ko, H.: Performance-driven Muscle-based Facial Animation. In: Proc. of Computer Animation, vol. 12, pp. 67–79 (2001)Google Scholar
  4. 4.
    Blanz, V., Basso, C., Poggio, T., Vetter, T.: Reanimating Faces in Images and Video. Computer Graphics Forum 22(3), 641–650 (2003)CrossRefGoogle Scholar
  5. 5.
    Bouguet, J.-Y.: Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the Algorithm (2000)Google Scholar
  6. 6.
    De Carlo, D., Metaxas, D., Stone, M.: An Anthropometric Face Model using Variational Techniques. In: SIGGRAPH 1998: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 67–74 (1998)Google Scholar
  7. 7.
    Kähler, K., Haber, J., Yamauchi, H., Seidel, H.-P.: Head Shop: Generating Animated Head Models with Anatomical Structure. In: SCA 2002: Proceedings of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 55–63 (2002)Google Scholar
  8. 8.
    Kraevoy, V., Sheffer, A.: Template Based Mesh Completion. In: SGP 2005: Proceedings of the third Eurographics Symposium on Geometry Processing, pp. 13–22 (2005)Google Scholar
  9. 9.
    Maejima, A., Wemler, S., Machida, T., Takebayashi, M., Morishima, S.: Instant Casting Movie Theater: The Future Cast System. IEICE Transactions on Information and Systems E91-D(4), 1135–1148 (2008)CrossRefGoogle Scholar
  10. 10.
    Mukai, T., Kuriyama, S.: Geostatistical Motion Interpolation. In. In: SIGGRAPH 2005: ACM SIGGRAPH 2005, Papers, pp. 1062–1070 (2005)Google Scholar
  11. 11.
    Pighin, F., Hecker, J., Lischinski, D., Szeliski, R., Salesin, D.H.: Synthesizing Realistic Facial Expressions from Photographs. In: SIGGRAPH 1998: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 75–84 (1998)Google Scholar
  12. 12.
    Joshi, P., Tien, W.C., Desbrun, M., Pighin, F.: Learning Controls for Blend Shape based Realistic Facial Animation. In: SCA 2003: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 187–192 (2003)Google Scholar
  13. 13.
    Sifakis, E., Neverov, I., Fedkiw, R.: Automatic Determination of Facial Muscle Activations from Sparse Motion Capture Marker Data. In: SIGGRAPH 2005: ACM SIGGRAPH 2005 Papers, pp. 417–425 (2005)Google Scholar
  14. 14.
    Vlasic, D., Brand, M., Pfister, H., Popović, J.: Face Transfer with Multilinear Models 24, 426–433 (2005)Google Scholar
  15. 15.
    Lee, Y., Terzopulus, D., Waters, K.: Realistic Modeling for Facial Animation. In: Proceedings of SIGGRAPH 1995, pp. 55–62 (1995)Google Scholar
  16. 16.
    Yotsukura, T., Morishima, S., Nakamura, S.: Face Expression Synthesis based on a Facial Motion Distribution Chart. In: SIGGRAPH 2004: ACM SIGGRAPH 2004, Posters, p. 85 (2004)Google Scholar
  17. 17.
    Zhu, C., Byrd, R.H., Lu, P., Nocedal, J.: Algorithm 778: L-bfgs-b: Fortran subroutines for large-scale bound-constrained optimization. ACM Trans. Math. Softw. 23(4), 550–560 (1997)CrossRefzbMATHMathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Akinobu Maejima
    • 1
  • Hiroyuki Kubo
    • 1
  • Shigeo Morishima
    • 1
  1. 1.Waseda UniversityShinjuku-kuJapan

Personalised recommendations