From regular images to animated heads: A least squares approach

  • P. Fua
  • C. Miccio
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1406)


We show that we can effectively fit arbitrarily complex animation models to noisy image data. Our approach is based on leastsquares adjustment using of a set of progressively finer control triangulations and takes advantage of three complementary sources of information: stereo data, silhouette edges and 2-D feature points.

In this way, complete head models—including ears and hair—can be acquired with a cheap and entirely passive sensor, such as an ordinary video camera. They can then be fed to existing animation software to produce synthetic sequences.


Feature Point Stereo Pair Facial Animation Surface Triangulation Control Mesh 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    A. E. Beaton and J.W. Turkey. The Fitting of Power Series, Meaning Polynomials, Illustrated on Band-Spectroscopic Data. Technometrics, 16:147–185, 1974.zbMATHCrossRefGoogle Scholar
  2. 2.
    A. Blake and M. Isard. 3D Position Attitude and Shape Input Using Video Tracking of Hands and Lips. In Computer Graphics, SIGGRAPH Proceedings, pages 71–8, July 1994.Google Scholar
  3. 3.
    T.F. Cootes and C.J. Taylor. Locating Objects of Varying Shape Using Statistical Feature Detectors. In European Conference on Computer Vision, Cambridge, England, April 1996.Google Scholar
  4. 4.
    D. DeCarlo and D. Metaxas. The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation. In Conference on Computer Vision and Pattern Recognition, pages 231–38, 1996.Google Scholar
  5. 5.
    F. Devernay and O. D. Faugeras. Computing Differential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models. In Conference on Computer Vision and Pattern Recognition, pages 208–13, Seattle, WA, June 1994.Google Scholar
  6. 6.
    O.D. Faugeras, Q.-T. Luong, and S.J. Maybank. Camera self-calibration: theory and experiments. In European Conference on Computer Vision, pages 321–334, Santa-Margerita, Italy, 1992.Google Scholar
  7. 7.
    P. Fua. A Parallel Stereo Algorithm that Produces Dense Depth Maps and Preserves Image Features. Machine Vision and Applications, 6(1):35–49, Winter 1993.CrossRefGoogle Scholar
  8. 8.
    P. Fua. From Multiple Stereo Views to Multiple 3-D Surfaces. International Journal of Computer Vision, 24(1):19–35, 1997.CrossRefGoogle Scholar
  9. 9.
    P. Fua and C. Brechbühler. Imposing Hard Constraints on Deformable Models Through Optimization in Orthogonal Subspaces. Computer Vision and Image Understanding, 24(1):19–35, February 1997.Google Scholar
  10. 10.
    P.E. Gill, W. Murray, and M.H. Wright. Practical Optimization. Academic Press, London a.o., 1981.Google Scholar
  11. 11.
    T.S. Jebara and A. Pentland. Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces. In Conference on Computer Vision and Pattern Recognition, pages 144–150, Porto Rico, June 1997.Google Scholar
  12. 12.
    P. Kalra, A. Mangili, N. Magnenat Thalmann, and D. Thalmann. Simulation of Facial Muscle Actions Based on Rational Free Form Deformations. In Eurographics, 1992.Google Scholar
  13. 13.
    M. Kass, A. Witkin, and D. Terzopoulos. Snakes: Active Contour Models. International Journal of Computer Vision, 1(4):321–331, 1988.CrossRefGoogle Scholar
  14. 14.
    Y. G. Leclerc and A. F. Bobick. The Direct Computation of Height from Shading. In Conference on Computer Vision and Pattern Recognition, Lahaina, Maui, Hawaii, June 1991.Google Scholar
  15. 15.
    Y. Lee, D. Terzopoulos, and K. Waters. Realistic Modeling for Facial Animation. In Computer Graphics, SIGGRAPH Proceedings, pages 191–198, Los Angeles, CA, August 1995.Google Scholar
  16. 16.
    B. Murtagh and M.A. Saunders. Minos 5.4 User's Guide. Technical Report SOL 83-20R, Department of Operations Research, Stanford University, 1983.Google Scholar
  17. 17.
    M. Pollefeys, R. Koch, and L. VanGool. Self-Calibration and Metric Reconstruction In Spite of Varying and Unknown Internal Camera Parameters. In International Conference on Computer Vision, 1998.Google Scholar
  18. 18.
    W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling. Numerical Recipes, the Art of Scientific Computing. Cambridge U. Press, Cambridge, MA, 1986.Google Scholar
  19. 19.
    M. Proesmans, L. Van Gool, and A. Oosterlinck. Active acquisition of 3D shape for Moving Objects. In International Conference on Image Processing, Lausanne, Switzerland, September 1996.Google Scholar
  20. 20.
    L. Tang and T.S. Huang. Analysis-based facial expression synthesis. ICIP-III, 94:98–102.Google Scholar
  21. 21.
    B. Triggs. Autocalibration and the Absolute Quadric. In Conference on Computer Vision and Pattern Recognition, pages 609–614, 1997.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1998

Authors and Affiliations

  • P. Fua
    • 1
  • C. Miccio
    • 1
  1. 1.Computer Graphics Lab (LIG)EPFLLausanneSwitzerland

Personalised recommendations