Multi-template Supervised Descent Method for Face Alignment

  • Chao GengEmail author
  • Zhong-Qiu Zhao
  • Qinmu Peng
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10956)


Supervised Descent Method (SDM) is a highly efficient and accurate approach for facial landmark locating and face alignment. In the training phase, it learns a sequence of descent directions to minimize the difference between the estimated shape and the ground truth in feature space. Then in the testing phase, it utilizes these descent directions to predict shape increment iteratively. However, when the face expression or direction changes too much, the general SDM cannot obtain good performance due to the large variations between the initial shape and the target shape. In this paper, we propose a multi-template SDM (MtSDM) which can maintain high accuracy on training data and meanwhile improve the accuracy on testing data. Instead of only one model is constructed in the training phase, several different models are constructed to deal with large variations on expressions or head poses. And in the testing phase, the distances between some specific landmarks are calculated to select an optimal model to update the point location. The experimental results show that our proposed method can improve the performance of traditional SDM and performs better than several existing state-of-the-art methods.


Multi-template Face alignment SDM 


  1. 1.
    Belhumeur, P.N., Jacobs, D.W., Kriegman, D., Kumar, N.: Localizing parts of faces using a consensus of exemplars. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 545–552 (2011)Google Scholar
  2. 2.
    Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by explicit shape regression. Int. J. Comput. Vis. 107(2), 177–190 (2014)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Chen, C., Dantcheva, A., Ross, A.: Automatic facial makeup detection with application in face recognition. In: International Conference on Biometrics, pp. 1–8 (2013)Google Scholar
  4. 4.
    Dantone, M., Gall, J., Fanelli, G., Van Gool, L.: Real-time facial feature detection using conditional regression forests, pp. 2578–2585 (2012)Google Scholar
  5. 5.
    Datta, A., Feris, R., Vaquero, D.: Hierarchical ranking of facial attributes. In: IEEE International Conference on Automatic Face & Gesture Recognition and Workshops, pp. 36–42 (2011)Google Scholar
  6. 6.
    Deng, W., Hu, J., Guo, J.: Extended SRC: undersampled face recognition via intraclass variant dictionary. IEEE Trans. Pattern Anal. Mach. Intell. 34(9), 1864–1870 (2012)CrossRefGoogle Scholar
  7. 7.
    Deng, W., Hu, J., Lu, J., Guo, J.: Transform-invariant PCA: a unified approach to fully automatic face alignment, representation, and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 36(6), 1275–1284 (2014)CrossRefGoogle Scholar
  8. 8.
    Deng, W., Hu, J., Zhou, X., Guo, J.: Equidistant prototypes embedding for single sample based face recognition with generic learning and incremental learning. Pattern Recogn. 47(12), 3738–3749 (2014)CrossRefGoogle Scholar
  9. 9.
    Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 fps via regressing local binary features. IEEE Trans. Image Process. 25(3), 1685–1692 (2014)Google Scholar
  10. 10.
    Smith, B.M., Brandt, J., Lin, Z., Zhang, L.: Nonparametric context modeling of local appearance for pose- and expression-robust facial landmark localization. In: Computer Vision and Pattern Recognition, pp. 1741–1748 (2014)Google Scholar
  11. 11.
    Thies, J., Zollhöfer, M., Stamminger, M., Theobalt, C., Nießner, M.: Face2face: real-time face capture and reenactment of RGB videos. In: Proceedings of Computer Vision and Pattern Recognition (CVPR), p. 1. IEEE (2016)Google Scholar
  12. 12.
    Trigeorgis, G., Snape, P., Nicolaou, M.A., Antonakos, E., Zafeiriou, S.: Mnemonic descent method: a recurrent process applied for end-to-end face alignment. In: IEEE International Conference on Computer Vision and Pattern Recognition (2016)Google Scholar
  13. 13.
    Tzimiropoulos, G., Pantic, M.: Optimization problems for fast AAM fitting in-the-wild. In: IEEE International Conference on Computer Vision, pp. 593–600 (2013)Google Scholar
  14. 14.
    Wu, Y., Ji, Q.: Robust facial landmark detection under significant head poses and occlusion. In: IEEE International Conference on Computer Vision, pp. 3658–3666 (2015)Google Scholar
  15. 15.
    Xiong, X., De la Torre, F.: Global supervised descent method. In: Computer Vision and Pattern Recognition, pp. 2664–2673 (2015)Google Scholar
  16. 16.
    Xiong, X., Torre, F.D.L.: Supervised descent method and its applications to face alignment, vol. 9(4), pp. 532–539 (2013)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  1. 1.College of Computer and InformationHefei University of TechnologyHefeiChina
  2. 2.Perelman School of MedicineUniversity of PennsylvaniaPhiladelphiaUSA

Personalised recommendations