Abstract
We present a 3D face modeling approach under uncontrolled conditions. In the heart of this work is an efficient and accurate facial landmark depth estimation algorithm. The objective function is formulated by similarity transformation among face images. In this method, pose parameters and depth values are optimized iteratively. The estimated 3D landmarks then are taken as control points to deform a generic 3D face shape into a specific face shape. Test results on synthesized images show that the proposed methods can obtain landmarks depth both effectively and efficiently. Whats’ more, the 3D faces generated from real-world photos are rather realistic based on a set of landmarks.
Keywords
This is a preview of subscription content, log in via an institution.
References
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: The 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194. ACM Press/Addison-Wesley Publishing Co., Los Angeles (1999)
Torresani, L., Hertzmann, A., Bregler, C.: Non-rigid structure-from-motion: estimating shape and motion with hierarchical priors. IEEE Trans. Pattern Anal. Mach. Intell. 30(5), 878–892 (2008)
Shu, L., Linda, S., Ira, K.: Internet-based morphable model. In: IEEE International Conference on Computer Vision, pp. 3256–3263. IEEE Computer Society (2015)
Liang, S., Shapiro, L.G., Kemelmacher-Shlizerman, I.: Head reconstruction from internet photos. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 360–374. Springer, Cham (2016). doi:10.1007/978-3-319-46475-6_23
Roth, J., Tong, Y., Liu, X.: Unconstrained 3D face reconstruction. In: IEEE Computer Vision and Pattern Recognition, pp. 2606–2615. IEEE Computer Society (2015)
Koo, H., Lam, K.: Recovering the 3D shape and poses of face images based on the similarity transform. Pattern Recogn. Lett. 29(6), 712–723 (2008)
Sun, Z., Lam, K., Gao, Q.: Depth estimation of face images using the nonlinear least-squares model. IEEE Trans. Image Process. 22(1), 17–30 (2013)
Yang, C., Chen, J., Xia, C., et al.: A SFM-based sparse to dense 3D face reconstruction method robust to feature tracking errors. In: 20th IEEE International Conference on Image Processing (ICIP 2013), pp. 3617–3621 (2013)
Gong, X., Wang, G., Li, X., et al.: A statistical two-step method for 3D face reconstruction from single image. Chin. J. Electron. 20(4), 671–675 (2011)
Le, V., Tang, H., Cao, L., et al.: Accurate and efficient reconstruction of 3D faces from stereo images. In: 17th IEEE International Conference on Image Processing (ICIP 2010), pp. 4265–4268 (2010)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: IEEE International Conference on Neural Networks, Perth, WA, pp. 1942–1948 (1995)
Gong, X., Wang, G.: Example-based learning for depth estimation of facial landmarks and its application in face modeling. Chin. J. Electron. 19(4), 676–680 (2010)
Gong, X., Wang, G.: Realistic face modeling based on multiple deformations. J. Chin. Univ. Posts Telecommun. 14(4), 110–117 (2007)
Savran, A., Alyüz, N., Dibeklioğlu, H., Çeliktutan, O., Gökberk, B., Sankur, B., Akarun, L.: Bosphorus database for 3D face analysis. In: Schouten, B., Juul, N.C., Drygajlo, A., Tistarelli, M. (eds.) BioID 2008. LNCS, vol. 5372, pp. 47–56. Springer, Heidelberg (2008). doi:10.1007/978-3-540-89991-4_6
Gong, X., Luo, J., Fu, Z.: Normalization for unconstrained pose-invariant 3D face recognition. In: Sun, Z., Shan, S., Yang, G., Zhou, J., Wang, Y., Yin, Y.L. (eds.) CCBR 2013. LNCS, vol. 8232, pp. 1–8. Springer, Cham (2013). doi:10.1007/978-3-319-02961-0_1
Blanz, V., Mehl, A., Vetter, T., et al.: A statistical method for robust 3D surface reconstruction from sparse data. In: Proceeding of the 2nd International Symposium on 3D Data Processing, Visualization, Thessaloniki, Greece, pp. 293–300. IEEE Computer Society (2004)
Nordstrom, M.M., Larsen, M., Sierakowski, J., et al.: The IMM face database - an annotated dataset of 240 face images. Technical Richard Petersens Plads, Building 321 (2004)
Acknowledgment
This work is partially supported by the National Natural Science Foundation of China (No. 61202191), State’s Key Project of Research and Development Plan (No. 2016YFC0802209) and Chongqing Key Laboratory of Computational Intelligence (CQ-LCI-2013-06).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Gong, X., Li, X., Du, S., Zhao, Y. (2017). iPDO: An Effective Feature Depth Estimation Method for 3D Face Reconstruction. In: Polkowski, L., et al. Rough Sets. IJCRS 2017. Lecture Notes in Computer Science(), vol 10313. Springer, Cham. https://doi.org/10.1007/978-3-319-60837-2_34
Download citation
DOI: https://doi.org/10.1007/978-3-319-60837-2_34
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-60836-5
Online ISBN: 978-3-319-60837-2
eBook Packages: Computer ScienceComputer Science (R0)