From regular images to animated heads: A least squares approach
We show that we can effectively fit arbitrarily complex animation models to noisy image data. Our approach is based on leastsquares adjustment using of a set of progressively finer control triangulations and takes advantage of three complementary sources of information: stereo data, silhouette edges and 2-D feature points.
In this way, complete head models—including ears and hair—can be acquired with a cheap and entirely passive sensor, such as an ordinary video camera. They can then be fed to existing animation software to produce synthetic sequences.
KeywordsFeature Point Stereo Pair Facial Animation Surface Triangulation Control Mesh
Unable to display preview. Download preview PDF.
- 2.A. Blake and M. Isard. 3D Position Attitude and Shape Input Using Video Tracking of Hands and Lips. In Computer Graphics, SIGGRAPH Proceedings, pages 71–8, July 1994.Google Scholar
- 3.T.F. Cootes and C.J. Taylor. Locating Objects of Varying Shape Using Statistical Feature Detectors. In European Conference on Computer Vision, Cambridge, England, April 1996.Google Scholar
- 4.D. DeCarlo and D. Metaxas. The Integration of Optical Flow and Deformable Models with Applications to Human Face Shape and Motion Estimation. In Conference on Computer Vision and Pattern Recognition, pages 231–38, 1996.Google Scholar
- 5.F. Devernay and O. D. Faugeras. Computing Differential Properties of 3-D Shapes from Stereoscopic Images without 3-D Models. In Conference on Computer Vision and Pattern Recognition, pages 208–13, Seattle, WA, June 1994.Google Scholar
- 6.O.D. Faugeras, Q.-T. Luong, and S.J. Maybank. Camera self-calibration: theory and experiments. In European Conference on Computer Vision, pages 321–334, Santa-Margerita, Italy, 1992.Google Scholar
- 9.P. Fua and C. Brechbühler. Imposing Hard Constraints on Deformable Models Through Optimization in Orthogonal Subspaces. Computer Vision and Image Understanding, 24(1):19–35, February 1997.Google Scholar
- 10.P.E. Gill, W. Murray, and M.H. Wright. Practical Optimization. Academic Press, London a.o., 1981.Google Scholar
- 11.T.S. Jebara and A. Pentland. Parametrized Structure from Motion for 3D Adaptive Feedback Tracking of Faces. In Conference on Computer Vision and Pattern Recognition, pages 144–150, Porto Rico, June 1997.Google Scholar
- 12.P. Kalra, A. Mangili, N. Magnenat Thalmann, and D. Thalmann. Simulation of Facial Muscle Actions Based on Rational Free Form Deformations. In Eurographics, 1992.Google Scholar
- 14.Y. G. Leclerc and A. F. Bobick. The Direct Computation of Height from Shading. In Conference on Computer Vision and Pattern Recognition, Lahaina, Maui, Hawaii, June 1991.Google Scholar
- 15.Y. Lee, D. Terzopoulos, and K. Waters. Realistic Modeling for Facial Animation. In Computer Graphics, SIGGRAPH Proceedings, pages 191–198, Los Angeles, CA, August 1995.Google Scholar
- 16.B. Murtagh and M.A. Saunders. Minos 5.4 User's Guide. Technical Report SOL 83-20R, Department of Operations Research, Stanford University, 1983.Google Scholar
- 17.M. Pollefeys, R. Koch, and L. VanGool. Self-Calibration and Metric Reconstruction In Spite of Varying and Unknown Internal Camera Parameters. In International Conference on Computer Vision, 1998.Google Scholar
- 18.W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling. Numerical Recipes, the Art of Scientific Computing. Cambridge U. Press, Cambridge, MA, 1986.Google Scholar
- 19.M. Proesmans, L. Van Gool, and A. Oosterlinck. Active acquisition of 3D shape for Moving Objects. In International Conference on Image Processing, Lausanne, Switzerland, September 1996.Google Scholar
- 20.L. Tang and T.S. Huang. Analysis-based facial expression synthesis. ICIP-III, 94:98–102.Google Scholar
- 21.B. Triggs. Autocalibration and the Absolute Quadric. In Conference on Computer Vision and Pattern Recognition, pages 609–614, 1997.Google Scholar