Facial Landmarks Localization Estimation by Cascaded Boosted Regression
Accurate detection of facial landmarks is very important for many applications like face recognition or analysis. In this paper we describe an efficient detector of facial landmarks based on a cascade of boosted regressors of arbitrary number of levels. We define as many regressors as landmarks and we train them separately. We describe how the training is conducted for the series of regressors by supplying training samples centered on the predictions of the previous levels. We employ gradient boosted regression and evaluate three different kinds of weak elementary regressors, each one based on Haar features: non parametric regressors, simple linear regressors and gradient boosted trees. We discuss trade-offs between the number of levels and the number of weak regressors for optimal detection speed. Experiments performed on three datasets suggest that our approach is competitive compared to state-of-the art systems regarding precision, speed as well as stability of the prediction on video streams.
KeywordsFace landmarks localization Boosted regression
This work was partially funded by the QUAERO project supported by OSEO and by the European integrated project AXES.
- 1.Everingham, M., Sivic, J., Zisserman, A.: Hello! my name is...Buffy – Automatic naming of characters in TV video. In: Proceedings of the British Machine Vision Conference, vol. 2 (2006)Google Scholar
- 3.Uřičář, M., Franc, V., Hlaváč, V.: Detector of facial landmarks learned by the structured output svm. In: Proceedings of the 7th International Conference on Computer Vision Theory and Applications, VISAPP ’12 (2012)Google Scholar
- 4.Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignement by explicit shape regression - to appear. In: Proceedings of CVPR’12 (2012)Google Scholar
- 5.Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests. In: Computer Vision and Pattern Recognition (CVPR) (2012)Google Scholar
- 6.Vukadinovic, D., Pantic, M.: Fully automatic facial feature point detection using gabor feature based boosted classifiers. In: Proceedings of IEEE International Conference Systems, Man and Cybernetics (SMC’05), Waikoloa, Hawaii, pp. 1692–1698, October 2005Google Scholar
- 8.Valstar, M., Martinez, B., Binefa, X., Pantic, M.: Facial point detection using boosted regression and graph models. In: Proceedings of IEEE International Conference Computer Vision and Pattern Recognition (CVPR’10), San Francisco, USA, pp. 2729–2736, June 2010Google Scholar
- 11.Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition (CVPR), pp. 511–518 (2001)Google Scholar
- 14.Dollár, P., Welinder, P., Perona, P.: Cascaded pose regression. In: Computer Vision and Pattern Recognition (CVPR), pp. 1078–1085 (2010)Google Scholar
- 16.Kasiński, A., Florek, A., Schmidt, A.: The PUT face database. Image Process. Commun. 13, 59–64 (2008)Google Scholar
- 17.Milborrow, S., Morkel, J., Nicolls, F.: The MUCT landmarked face database. Pattern Recognition Association of South Africa (2010)Google Scholar
- 18.Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N.: Localizing parts of faces using a consensus of exemplars. In: The 24th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2011Google Scholar