Abstract
In this paper, an efficient technique is developed to construct textured 3D face model from video containing a face rotating from frontal to profile. After two manual clicks on a profile to tell the system where the eye corner and bottom of the chin are, the system automatically generates a realistic looking 3D face model. The proposed method consists of three components. Firstly, based on the facial feature points extracted from frontal and profile images, an individual 3D geometric face model is generated by deforming the generic model with improved Radial basis function. Then the model is refined by using improved √3-Subdivision. Secondly, the multi-resolution technique and weighted smoothing algorithm are combined to synthesize individual facial texture image. Finally, a realistic 3D face model is built by mapping the individual texture to the individual 3D geometric model. The accuracy and robustness of the method are demonstrated with a set of experiments.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Parke, F.I.: Computer generated animation of faces. In: Proceedings of the ACM Annual Conference, pp. 451–457 (1972)
Guenter, B., Grimm, C., Wood, D., et al.: Making faces. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 55–66. ACM (1998)
Park, S.W., Heo, J., Savvides, M.: 3D face reconstruction from a single 2D face image. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2008, pp. 1–8 (2008)
Fan, X., Peng, Q., Zhong, M.: 3D face reconstruction from single 2D image based on robust facial feature points extraction and generic wire frame model. In: International Conference on Communications and Mobile Computing, pp. 396–400 (2010)
Lin, Y., Lin, Q., Tang, F., et al.: Creating 3D realistic head: from two orthogonal photos to multiview face contents. In: International Society for Optics and Photonics (2011)
Beeler, T., Bickel, B., Beardsley, P., et al.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. (TOG) 29, 40 (2010)
Xin, L., Wang, Q., Tao, J., Tang, X., et al.: Automatic 3D face modeling from video. In: Tenth IEEE International Conference on Computer Vision, ICCV, vol. 2, pp. 1193–1199 (2005)
Song, H., Huang, X., Wang, S.: Automatic generation of portraits with multiple expressions. Acta Electronica Sin. 41(8), 1494–1499 (2013). Chinese
Yin, L., Basu, A.: Integrating active face tracking with model based coding. Pattern Recogn. Lett. 20(6), 651–657 (1999)
Huang, J., Su, Z., Wang, R.: 3D Face Reconstruction based on Improved CANDIDE-3 model. In: 2012 Fourth International Conference on Digital Home (ICDH), pp. 438–442. IEEE (2012)
Liu, S., Wang, C.C.L.: Quasi-interpolation for surface reconstruction from scattered data with radial basis function. Comput. Aided Geom. Des. 29(7), 435–447 (2012)
Du, P., Xu, D., Liu, C.: Research of individual 3D face model and its application. J. Shanghai Jiaotong Univ. 37(3), 435–439 (2003)
Huang, J., Schröder, P.: √3-Based 1-form subdivision. In: Boissonnat, J.-D., Chenin, P., Cohen, A., Gout, C., Lyche, T., Mazure, M.-L., Schumaker, L. (eds.) Curves and Surfaces 2011. LNCS, vol. 6920, pp. 351–368. Springer, Heidelberg (2012)
Zhang, H., Wang, G.: Semi-stationary push-back subdivision schemes. J. Softw. 13(9), 1830–1839 (2002)
Zhang, C., Burt, P.J., van der Wal, G.S.: Multi-scale multi-camera adaptive fusion with constrast normalization: U. S. Patent. 8,411, 938 (2013)
Lee, W.-S., Thalmann, N.M.: Head modeling from pictures and morphing in 3d with image metamorphosis based on triangulation. In: Magnenat-Thalmann, N., Thalmann, D. (eds.) CAPTECH 1998. LNCS (LNAI), vol. 1537, pp. 254–267. Springer, Heidelberg (1998)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Song, H., Lv, J., Wang, Y. (2015). Rapid 3D Face Modeling from Video. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9315. Springer, Cham. https://doi.org/10.1007/978-3-319-24078-7_20
Download citation
DOI: https://doi.org/10.1007/978-3-319-24078-7_20
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24077-0
Online ISBN: 978-3-319-24078-7
eBook Packages: Computer ScienceComputer Science (R0)