Facial Landmarks Localization Estimation by Cascaded Boosted Regression

  • Louis ChevallierEmail author
  • Jean-Ronan Vigouroux
  • Alix Goguey
  • Alexey Ozerov
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 458)


Accurate detection of facial landmarks is very important for many applications like face recognition or analysis. In this paper we describe an efficient detector of facial landmarks based on a cascade of boosted regressors of arbitrary number of levels. We define as many regressors as landmarks and we train them separately. We describe how the training is conducted for the series of regressors by supplying training samples centered on the predictions of the previous levels. We employ gradient boosted regression and evaluate three different kinds of weak elementary regressors, each one based on Haar features: non parametric regressors, simple linear regressors and gradient boosted trees. We discuss trade-offs between the number of levels and the number of weak regressors for optimal detection speed. Experiments performed on three datasets suggest that our approach is competitive compared to state-of-the art systems regarding precision, speed as well as stability of the prediction on video streams.


Face landmarks localization Boosted regression 



This work was partially funded by the QUAERO project supported by OSEO and by the European integrated project AXES.


  1. 1.
    Everingham, M., Sivic, J., Zisserman, A.: Hello! my name is...Buffy – Automatic naming of characters in TV video. In: Proceedings of the British Machine Vision Conference, vol. 2 (2006)Google Scholar
  2. 2.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 681–685 (2001)CrossRefGoogle Scholar
  3. 3.
    Uřičář, M., Franc, V., Hlaváč, V.: Detector of facial landmarks learned by the structured output svm. In: Proceedings of the 7th International Conference on Computer Vision Theory and Applications, VISAPP ’12 (2012)Google Scholar
  4. 4.
    Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignement by explicit shape regression - to appear. In: Proceedings of CVPR’12 (2012)Google Scholar
  5. 5.
    Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests. In: Computer Vision and Pattern Recognition (CVPR) (2012)Google Scholar
  6. 6.
    Vukadinovic, D., Pantic, M.: Fully automatic facial feature point detection using gabor feature based boosted classifiers. In: Proceedings of IEEE International Conference Systems, Man and Cybernetics (SMC’05), Waikoloa, Hawaii, pp. 1692–1698, October 2005Google Scholar
  7. 7.
    Cristinacce, D., Cootes, T.: Automatic feature localisation with constrained local models. Pattern Recogn. 41, 3054–3067 (2008)CrossRefzbMATHGoogle Scholar
  8. 8.
    Valstar, M., Martinez, B., Binefa, X., Pantic, M.: Facial point detection using boosted regression and graph models. In: Proceedings of IEEE International Conference Computer Vision and Pattern Recognition (CVPR’10), San Francisco, USA, pp. 2729–2736, June 2010Google Scholar
  9. 9.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models - their training and application. Comput. Vis. Image Underst. 61, 38–59 (1995)CrossRefGoogle Scholar
  10. 10.
    Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vision 1, 321–331 (1988)CrossRefGoogle Scholar
  11. 11.
    Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition (CVPR), pp. 511–518 (2001)Google Scholar
  12. 12.
    Lanitis, A., Taylor, C.J., Cootes, T.F.: Automatic interpretation and coding of face images using flexible models. IEEE Trans. Pattern Anal. Mach. Intell. 19, 743–756 (1997)CrossRefGoogle Scholar
  13. 13.
    Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189–1232 (2001)CrossRefzbMATHGoogle Scholar
  14. 14.
    Dollár, P., Welinder, P., Perona, P.: Cascaded pose regression. In: Computer Vision and Pattern Recognition (CVPR), pp. 1078–1085 (2010)Google Scholar
  15. 15.
    Jesorsky, O., Kirchberg, K.J., Frischholz, R.W.: Robust face detection using the hausdorff distance. In: Bigun, J., Smeraldi, F. (eds.) AVBPA 2001. LNCS, vol. 2091, pp. 90–95. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  16. 16.
    Kasiński, A., Florek, A., Schmidt, A.: The PUT face database. Image Process. Commun. 13, 59–64 (2008)Google Scholar
  17. 17.
    Milborrow, S., Morkel, J., Nicolls, F.: The MUCT landmarked face database. Pattern Recognition Association of South Africa (2010)Google Scholar
  18. 18.
    Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N.: Localizing parts of faces using a consensus of exemplars. In: The 24th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2011Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  • Louis Chevallier
    • 1
    Email author
  • Jean-Ronan Vigouroux
    • 1
  • Alix Goguey
    • 1
    • 2
  • Alexey Ozerov
    • 1
  1. 1.TechnicolorCesson-SévignéFrance
  2. 2.EnsimagSaint-Martin d’HèresFrance

Personalised recommendations