Skip to main content

Facial Landmarks Localization Estimation by Cascaded Boosted Regression

  • Conference paper
  • First Online:
Computer Vision, Imaging and Computer Graphics -- Theory and Applications (VISIGRAPP 2013)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 458))

  • 746 Accesses

Abstract

Accurate detection of facial landmarks is very important for many applications like face recognition or analysis. In this paper we describe an efficient detector of facial landmarks based on a cascade of boosted regressors of arbitrary number of levels. We define as many regressors as landmarks and we train them separately. We describe how the training is conducted for the series of regressors by supplying training samples centered on the predictions of the previous levels. We employ gradient boosted regression and evaluate three different kinds of weak elementary regressors, each one based on Haar features: non parametric regressors, simple linear regressors and gradient boosted trees. We discuss trade-offs between the number of levels and the number of weak regressors for optimal detection speed. Experiments performed on three datasets suggest that our approach is competitive compared to state-of-the art systems regarding precision, speed as well as stability of the prediction on video streams.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    We did some tests with an implementation of [8], but it gave results very different to what was reported in the paper, thus we do not present them.

  2. 2.

    http://www-prima.inrialpes.fr/FGnet/data/01-TalkingFace/talking_face.html

References

  1. Everingham, M., Sivic, J., Zisserman, A.: Hello! my name is...Buffy – Automatic naming of characters in TV video. In: Proceedings of the British Machine Vision Conference, vol. 2 (2006)

    Google Scholar 

  2. Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 681–685 (2001)

    Article  Google Scholar 

  3. Uřičář, M., Franc, V., Hlaváč, V.: Detector of facial landmarks learned by the structured output svm. In: Proceedings of the 7th International Conference on Computer Vision Theory and Applications, VISAPP ’12 (2012)

    Google Scholar 

  4. Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignement by explicit shape regression - to appear. In: Proceedings of CVPR’12 (2012)

    Google Scholar 

  5. Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests. In: Computer Vision and Pattern Recognition (CVPR) (2012)

    Google Scholar 

  6. Vukadinovic, D., Pantic, M.: Fully automatic facial feature point detection using gabor feature based boosted classifiers. In: Proceedings of IEEE International Conference Systems, Man and Cybernetics (SMC’05), Waikoloa, Hawaii, pp. 1692–1698, October 2005

    Google Scholar 

  7. Cristinacce, D., Cootes, T.: Automatic feature localisation with constrained local models. Pattern Recogn. 41, 3054–3067 (2008)

    Article  MATH  Google Scholar 

  8. Valstar, M., Martinez, B., Binefa, X., Pantic, M.: Facial point detection using boosted regression and graph models. In: Proceedings of IEEE International Conference Computer Vision and Pattern Recognition (CVPR’10), San Francisco, USA, pp. 2729–2736, June 2010

    Google Scholar 

  9. Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models - their training and application. Comput. Vis. Image Underst. 61, 38–59 (1995)

    Article  Google Scholar 

  10. Kass, M., Witkin, A., Terzopoulos, D.: Snakes: active contour models. Int. J. Comput. Vision 1, 321–331 (1988)

    Article  Google Scholar 

  11. Viola, P.A., Jones, M.J.: Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition (CVPR), pp. 511–518 (2001)

    Google Scholar 

  12. Lanitis, A., Taylor, C.J., Cootes, T.F.: Automatic interpretation and coding of face images using flexible models. IEEE Trans. Pattern Anal. Mach. Intell. 19, 743–756 (1997)

    Article  Google Scholar 

  13. Friedman, J.H.: Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189–1232 (2001)

    Article  MATH  Google Scholar 

  14. Dollár, P., Welinder, P., Perona, P.: Cascaded pose regression. In: Computer Vision and Pattern Recognition (CVPR), pp. 1078–1085 (2010)

    Google Scholar 

  15. Jesorsky, O., Kirchberg, K.J., Frischholz, R.W.: Robust face detection using the hausdorff distance. In: Bigun, J., Smeraldi, F. (eds.) AVBPA 2001. LNCS, vol. 2091, pp. 90–95. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  16. Kasiński, A., Florek, A., Schmidt, A.: The PUT face database. Image Process. Commun. 13, 59–64 (2008)

    Google Scholar 

  17. Milborrow, S., Morkel, J., Nicolls, F.: The MUCT landmarked face database. Pattern Recognition Association of South Africa (2010)

    Google Scholar 

  18. Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N.: Localizing parts of faces using a consensus of exemplars. In: The 24th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2011

    Google Scholar 

Download references

Acknowledgements

This work was partially funded by the QUAERO project supported by OSEO and by the European integrated project AXES.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Louis Chevallier .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Chevallier, L., Vigouroux, JR., Goguey, A., Ozerov, A. (2014). Facial Landmarks Localization Estimation by Cascaded Boosted Regression. In: Battiato, S., Coquillart, S., Laramee, R., Kerren, A., Braz, J. (eds) Computer Vision, Imaging and Computer Graphics -- Theory and Applications. VISIGRAPP 2013. Communications in Computer and Information Science, vol 458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44911-0_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-44911-0_7

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-44910-3

  • Online ISBN: 978-3-662-44911-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics