Abstract
Believable, detailed digital faces are desired for both film and game production as well as research applications. A high-resolution mesh of a face is acquired often with structured light and stereo computer-vision methods. In production for visual effects or games, the acquired mesh is “re-topologized” by an artist using software to draw a new edge layout in order to simplify and prepare a mesh for animation. For building models of facial population and expression for research, meshes often undergo a similar process to find correspondence among face models, although in the past the desired layout has not been designed for effective facial animation. We propose a process using images accompanying a 3D scan to locate dense 2D facial landmarks automatically to re-topologize meshes with the particular goal of creating models that deform well for facial animation. The technique also allows real-time editing of the re-topology relationship if modifications are desired.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Amberg, B., Knothe, R., Vetter, T.: Optimal step nonrigid ICP algorithms for surface registration. In: IEEE International Conference on Computer Vision and Pattern Recognition (2007)
Antonakos, E., Alabort-i-Medina, J., Tzimiropoulos, G., Zafeiriou, S.: Hog appearance models (2014)
Blanz, V., Vetter, T.: A morphable model for the synthesis of 3D faces. In: SIGGRAPH International Conference on Computer Graphics and Interactive Techniques, pp. 187–194 (1999)
Bookstein, F.: Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans. Pattern Anal. Mach. Intell. 11, 567–585 (1989)
Booth, J., Roussos, A., Zafeiriou, S., Ponniahy, A., Dunaway, D.: A 3D morphable model learnt from 10,000 faces. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 5543–5552 (2016)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. In: Burkhardt, H., Neumann, B. (eds.) ECCV 1998. LNCS, vol. 1407, pp. 484–498. Springer, Heidelberg (1998). https://doi.org/10.1007/BFb0054760
Cootes, T.F., Kittipanya-ngam, P.: Comparing variations on the active appearance model algorithm. In: British Machine Vision Conference, pp. 837–842 (2002)
Cosker, D., Krumhuber, E., Hilton, A.: A FACS valid 3D dynamic action unit database with applications to 3D dynamic morphable facial modeling. In: Proceedings of the IEEE International Conference on Computer Vision (2011)
Debevec, P.: The light stages and their applications to photoreal digital actors. In: SIGGRAPH Asia, Singapore (2012)
Ekman, P., Friesen, W., Hager, J.: Facial Action Coding System: Second Edition. Paul Ekman Group (2002)
Enstice, T.: The curious case of Benjamin Button. In: ACM SIGGRAPH 2009 Computer Animation Festival, SIGGRAPH 2009, pp. 36–37. ACM, New York (2009)
Ichikari, R., Alexander, O., Debevec, P.: Vuvuzela: a facial scan correspondence tool. In: ACM SIGGRAPH 2013 Posters, SIGGRAPH 2013, p. 89:1. ACM, New York (2013)
Jo, J., Choi, H., Kim, I.J., Kim, J.: Single-view-based 3D facial reconstruction method robust against pose variations. Pattern Recognit. 48(1), 73–85 (2015)
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2014, pp. 1867–1874. IEEE Computer Society, Washington, DC (2014)
King, D.E.: Dlib-ml: a machine learning toolkit. J. Mach. Learn. Res. 10, 1755–1758 (2009). http://dl.acm.org/citation.cfm?id=1577069.1755843
Lambert, T.: From 2D to 3D painting with mesh colors. In: ACM SIGGRAPH 2015 Talks, SIGGRAPH 2015, p. 72:1. ACM, New York (2015)
Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T.S.: Interactive facial feature localization. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012. LNCS, vol. 7574, pp. 679–692. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-33712-3_49
Li, H., Adams, B., Guibas, L.J., Pauly, M.: Robust single-view geometry and motion reconstruction. ACM Trans. Graph. 28(5) (2009). Proceedings SIGGRAPH Asia 2009
Ma, M., Peng, S., Hu, X.: A lighting robust fitting approach of 3D morphable model for face reconstruction. Vis. Comput. 32(10), 1223–1238 (2016)
Marcias, G., et al.: Data-driven interactive quadrangulation. ACM Trans. Graph. 34(4), 65:1–65:10 (2015)
Matthews, I., Baker, S.: Active appearance models revisited. Int. J. Comput. Vis. 60(2), 135–164 (2004)
Alabort-i-Medina, J., Antonakos, E., Booth, J., Snape, P., Zafeiriou, S.: Menpo: a comprehensive platform for parametric image alignment and visual deformable models. In: Proceedings of the ACM International Conference on Multimedia (2014)
OpenStax: OpenStax Anatomy and Physiology. Rice University (2017). https://cnx.org/contents/FPtK1zmh@8.25:fEI3C8Ot@10/Preface
Patel, A., Smith, W.: 3D morphable face models revisited. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1327–1334 (2009)
Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3D face model for pose and illumination invariant face recognition. In: IEEE International Conference on Advanced Video and Signal-Based Surveilance (2009)
Peng, C.H., Zhang, E., Kobayashi, Y., Wonka, P.: Connectivity editing for quadrilateral meshes. In: Proceedings of the 2011 SIGGRAPH Asia Conference, SA 2011, pp. 141:1–141:12. ACM, New York (2011)
Weise, T., Bouaziz, S., Li, H., Pauly, M.: Realtime performance-based facial animation. ACM Trans. Graph. 30(4) (2011). Proceedings SIGGRAPH 2011
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Patterson, E., Baron, J., Simpson, D. (2018). Landmark-Based Re-topology of Stereo-Pair Acquired Face Meshes. In: Chmielewski, L., Kozera, R., Orłowski, A., Wojciechowski, K., Bruckstein, A., Petkov, N. (eds) Computer Vision and Graphics. ICCVG 2018. Lecture Notes in Computer Science(), vol 11114. Springer, Cham. https://doi.org/10.1007/978-3-030-00692-1_37
Download citation
DOI: https://doi.org/10.1007/978-3-030-00692-1_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-00691-4
Online ISBN: 978-3-030-00692-1
eBook Packages: Computer ScienceComputer Science (R0)