Advertisement

A Brief Survey: 3D Face Reconstruction

  • Tianhan GaoEmail author
  • Hui AnEmail author
Conference paper
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 97)

Abstract

3D reconstruction technology is an important branch in the field of computer vision. Due to the large proportion of face information when people browsing pictures and the rapid development of virtual reality applications, face reconstruction technology has attracted more attention from researchers over many years. In terms of the special structure of human face, 3D faces reconstruction is quite different from ordinary object 3D reconstruction. This paper summaries the approaches of obtaining face data and the expression of 3d face. The reconstruction effect of each method is analyzed, including the advantages and disadvantages, the issues that can be improved, as well as the prospect of the future work.

Keywords

Computer vision 3D face reconstruction Expression of 3D face 

Notes

Acknowledgements

This paper is supported by China Fundamental Research Funds for the Central Universities under Grant No. N180716019 and Grant No. N182808003.

References

  1. 1.
    Baillard, C., Zisserman, A.: A plane sweep strategy for the 3D reconstruction of buildings from multiple images. Int. Arch. Photogram. Remote Sens. 33(2), 56–62 (2000)Google Scholar
  2. 2.
    Beeler, T., Bickel, B., Beardsley, P.: High-quality single-shot capture of facial geometry. ACM Trans. Graph. 29(4), 1–9 (2010)CrossRefGoogle Scholar
  3. 3.
    Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)Google Scholar
  4. 4.
    Richardson, E., Sela, M., Kimmel, R.: 3D face reconstruction by learning from synthetic data. In: 3DV, 460–469 (2016)Google Scholar
  5. 5.
    Richardson, E., Sela, M., Or-El, R., Kimmel, R.: Learning detailed face reconstruction from a single image. In: CVPR, pp. 1259–1268 (2017)Google Scholar
  6. 6.
    Liu, F., Zeng, D., Zhao, Q., Liu, X.: Joint face alignment and 3D face reconstruction. In: ECCV, pp. 545–560 (2016)Google Scholar
  7. 7.
    Jackson, A.S., Bulat, A., Argyriou, V., Tzimiropoulos, G.: Large pose 3D face reconstruction from a single image via direct volumetric CNN regression. In: 2017 ICCV, pp. 1031–1039 (2017)Google Scholar
  8. 8.
    Jia, Z., Chang, Y.J., Lin, T.H.: Dense interpolation of 3D points based on surface and color. IEEE (2011)Google Scholar
  9. 9.
    May, S., Droeschel, D., Holz, D.: 3D pose estimation and mapping with time-of-flight cameras. In: Proceedings of IEEE/RSJ, France, pp. 120–125 (2008)Google Scholar
  10. 10.
    May, S., Droeschel, D., Fuchs, S.: Robust 3D-mapping with time-of-fight cameras. In: Proceedings of IEEE/RSJ, pp. 1673–1678 (2009)Google Scholar
  11. 11.
    Song, M., Tao, D., Huang, X., Chen, C., Bu, J.: Three dimensional face reconstruction from a single image by a coupled RBF network. IEEE Trans. Image Process. 21(5), 2887–2897 (2012)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Dou, P., Shah, S.K.: End-to end 3D face reconstruction with deep neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE Computer Society (2017)Google Scholar
  13. 13.
    Dou, P., Wu, Y., Shah, S.K., Kakadiaris, I.A.: Robust 3D facial shape reconstruction from single images via two fold coupled structure learning. In: Proceedings of the British Machine Vision Conference, 1–5 September (2014)Google Scholar
  14. 14.
    Zhang, R., Tsai, P.S., Cryer, J.E., Shah, M.: Shape-from-shading: a survey. Trans. Pattern Anal. Mach. Intell. (S0162-8828) 21(8), 690–706 (1999)CrossRefGoogle Scholar
  15. 15.
    Saito, K., Miyoshi, T., Yoshikawa, H.: Noncontact 3D digitizing and machining system for free-form surfaces. CIRP Ann. Manufact. Technol. 40(1), 483–486 (1991)CrossRefGoogle Scholar
  16. 16.
    Tu, X., Zhao, J., Jiang, Z., Luo, Y., Xie, M., Zhao, Y., et al.: Joint 3D face reconstruction and dense face alignment from a single image with 2D-assisted self-supervised learning (2019, unpublished)Google Scholar
  17. 17.
    Feng, Y., Wu, F., Shao, X.: Joint 3D face reconstruction and dense alignment with position map regression network. In: European Conference on Computer Vision. Springer, Cham (2018)CrossRefGoogle Scholar
  18. 18.
    Lee, Y.J., Lee, S.J., Park, K.R., Jo, J., Kim, J.: Single view-based 3D face reconstruction robust to self-occlusion. EURASIP 176 (2012)Google Scholar
  19. 19.
    Zhang, L., Snavely, N., Curless, B.: Spacetime faces: high resolution capture for modeling and animation. 23(3), 548–558 (2004)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Engineering Research Center of Scurity Technology of Complex Network System, Ministry of Education; Liaoning Research Center of Safety Engineering Technology in Industrial ControlNorthEastern UniversityShenyangChina
  2. 2.NorthEastern UniversityShenyangChina

Personalised recommendations