Abstract
We present a novel approach to resolve the problem of face alignment with a two-layer shape regression framework. Traditional regression-based methods [4, 6, 7] regress all landmarks in a single shape without consideration of the difference between various landmarks in biologic property and texture, which would lead to a suboptimal prediction. Unlike previous regression-based approach, we do not regress the entire landmarks in a holistic manner without any discrimination. We categorize the geometric constraints into two types, inter-component constraints and intra-component constraints. Corresponding to these two shape constraints, we design a two-layer shape regression framework which can be integrated with regression-based methods. We define a term of “key points” of components to describe inter-component constraints and then determine the sub-shapes. We verify our two-layer shape regression framework on two widely used datasets (LFPW [10] and Helen [11]) for face alignment and experimental results prove its improvements in accuracy.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Cootes, T., Taylor, C., Cooper, D., Graham, J., et al.: Active shape models-their training and application. Comput. Vis. Image Underst. 61(1), 38–59 (1995)
Cootes, T., Edwards, G., Taylor, C.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)
Cristinacce, D., Cootes, T.: Feature detection and tracking with constrained local models. In: British Machine Vision Conference (BMVC) (2006)
Cristinacce, D., Cootes, T.: Boosted regression active shape models. In: British Machine Vision Conference (BMVC) (2007)
Dollar, P., Welinder, P., Perona, P.: Cascaded pose regression. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2010)
Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
Burgos-Artizzu., X.P., Perona, P., Dollar, P.: Robust face landmark estimation under occlusion. In: IEEE International Conference on Computer Vision (ICCV) (2013)
Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regression local binary features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)
Kazemi, V., Sullivan, J.: One millisecond face alignment with an ensemble of regression trees. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2014)
Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N.: Localizing parts of faces using a consensus of exemplars. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2011)
Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T.S.: Interactive facial feature localization. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 679–692. Springer, Heidelberg (2012)
Duffy, N., Helmbold, D.P.: Boosting methods for regression. Mach. Learn. 47(2–3), 153–200 (2002)
Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29(5), 1189–1232 (2001)
Bingham, E., Mannila, H.: Random projection in dimensionality reduction: applications to image and text data. In: ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) (2001)
Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T.: Interactive facial feature localization. In: European Conference on Computer Vision (2012)
Liang, L., Xiao, R., Wen, F., Sun, J.: Face alignment via component-based discriminative search. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 72–85. Springer, Heidelberg (2008)
Acknowledgments
This work was partially supported by the National High-tech Research and Development Program of China (2015AA015901).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Zhang, Q., Zhang, L. (2015). Face Alignment with Two-Layer Shape Regression. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9314. Springer, Cham. https://doi.org/10.1007/978-3-319-24075-6_13
Download citation
DOI: https://doi.org/10.1007/978-3-319-24075-6_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-24074-9
Online ISBN: 978-3-319-24075-6
eBook Packages: Computer ScienceComputer Science (R0)