Face Alignment Based on K-Means

  • Yunhong LiEmail author
  • Qiaoning Yuan
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 891)


In order to address the generalization problem when Active Appearance Model (AAM) is applied to unseen subjects and images. In this paper, an accurate face alignment algorithm based on K-means is proposed to tackle the generalization problem of AAM. Firstly, the original AAM is reformulated as a sparsity-regularized problem. Then, for an input facial image, we learn a strong localized shape and appearance prior through exploiting its K-similar patterns to further approximate sparse representation problem. Finally, learning many localized linear face model instead of a global non-linear face model. Through numerical experiments, this approach is shown to outperform some common existing methods on the task of generic face fitting.


Face alignment K-means K-nearest neighbors 


  1. 1.
    Chrysos, G.G., Antonakos, E., Snape, P., Asthana, A., Zafeiriou, S.: A comprehensive performance evaluation of deformable face tracking “In-the-Wild”. Int. J. Comput. Vision 126(2–4), 198–232 (2018). Scholar
  2. 2.
    Chen, J., Chen, Z., Chi, Z., Fu, H.: Facial expression recognition in video with multiple feature fusion. IEEE Trans. Affect. Comput. 9(1), 38–50 (2018). Scholar
  3. 3.
    Li, H., Ding, H., Huang, D., Wang, Y., Zhao, X., Morvan, J.M., Chen, L.: An efficient multimodal 2D + 3D feature-based approach to automatic facial expression recognition. Comput. Vis. Image Underst. 140, 83–92 (2015). Scholar
  4. 4.
    Jung, H., Lee, S., Yim, J., Park, S., Kim,J.: Joint fine-tuning in deep neural networks for facial expression recognition. In: IEEE ICCV, pp. 2983–2991. Santiago, Chile (2015).
  5. 5.
    Liu, F., Zeng, D., Zhao, Q., Liu, X.: Joint face alignment and 3D face reconstruction. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) Computer Vision – ECCV 2016. Lecture Notes in Computer Science, vol 9909, pp. 545–560. Springer, Cham (2016). Scholar
  6. 6.
    Dou, P., Shah, S.K., Kakadiaris, I.A.: End-to-end 3D face reconstruction with deep neural networks. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, Hawaii, USA, pp. 1503–1512 (2017).
  7. 7.
    Roth, J., Tong, Y., Liu, X.: Adaptive 3D face reconstruction from unconstrained photo collections. In: IEEE CVPR, 2017. Las Vegas, NV, USA, pp. 2127–2141 (2016).
  8. 8.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models-their training and application. Comput. Vis. Underst. 61(1), 38–59 (1995). Scholar
  9. 9.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001). Scholar
  10. 10.
    Xiong, X., Torre, F.D.L.: Supervised descent method and its applications to face alignment. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition, pp. 532–539. IEEE, Portland (2013).
  11. 11.
    Cao, X., Wei, Y., Wen, F., Sun, J.: Face alignment by Explicit Shape Regression. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 177–190. IEEE, Providence (2012).
  12. 12.
    Jin, X., Tan, X.: Face alignment in-the-wild: a survey. Comput. Vis. Image Underst. 162, 1–22 (2017). Scholar
  13. 13.
    Bulat, A., Tzimiropoulos, G.: Two-stage convolutional part heatmap regression for the 1st 3D Face Alignment in the Wild (3DFAW) challenge. In: Hua G., Jégou H. (eds.) Computer Vision – ECCV 2016 Workshops, ECCV 2016. Lecture Notes in Computer Science, vol 9914, pp. 616–624. Springer, Cham (2016). Scholar
  14. 14.
    Jourabloo, A., Ye, M., Liu, X., Ren, L.: Pose-invariant face alignment with a single CNN. In: ICCV, pp. 3219–3228. IEEE, Venice (2017).
  15. 15.
    Zhu, X., Zhu, L., Liu, X., Shi, H., Li, S.: Face alignment across large poses: a 3D solution. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 146–155. IEEE, Las Vegas (2016).
  16. 16.
    Zhao, X., Shan, S., Chai, X., Chen, X.: Locality-constrained active appearance model. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds) Computer Vision – ACCV 2012. Lecture Notes in Computer Science, vol 7724, pp. 636–647. Springer, Heidelberg (2012). Scholar
  17. 17.
    Kanungo, T., Mount, D.M., Netanyahu, N.S., Piatko, C.D., Silverman, R., Wu, A.Y.: An efficient k-means clustering algorithm: analysis and implementation. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 881–892 (2002). Scholar
  18. 18.
    Coates, A., Ng, A.Y. Learning feature representations with K-Means. In: Montavon, G., Orr, G.B., Müller, KR. (eds) Neural Networks: Tricks of the Trade. Lecture Notes in Computer Science, vol 7700, pp. 561–580. Springer, Heidelberg (2012). Scholar
  19. 19.
    Sim, T., Baker, S., Bsat, M.: The CMU Pose, Illumination, and Expression (PIE) database. In: Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition, p. 0053. IEEE, Washington, DC (2002).
  20. 20.
    Phillips, P.J., Flynn, P.J., Scruggs, T., Bowyer, K.W., Chang, J., Hoffman, K., Marques, J. Min, J., Worek, W.: Overview of the face recognition grand challenge. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), (CVPR), pp. 947–954. IEEE, San Diego (2005).
  21. 21.
    Phillips, P.J., Wechsler, H., Huang, J., Raussa, P.J.: The FERET database and evaluation procedure for face-recognition algorithms. Image Vis. Comput. 16(5), 295–306 (1998). Scholar
  22. 22.
    Gao, W., Cao, B., Shan, S.: The CAS-PEAL large-scale chinese face database and baseline evaluations. IEEE Trans. Syst., Man, Cybern. Part A Syst. Hum. 38(1), 149–161 (2008). Scholar
  23. 23.
    Kumar, N., Berg, A., Belhumeur, P., Nayar, S.K.: Attribute and simile classifiers for face verification. In: Proceedings/ IEEE International Conference on Computer Vision, pp. 365–372. IEEE, Kyoto (2009).
  24. 24.
    Sagonas, C., Antonakos, E., Tzimiropoulos, G., Zafeiriou, S., Panticac, M.: 300 Faces In-The-Wild Challenge: database and results * **. Image Vis. Comput. 47, 3–18 (2016). Scholar
  25. 25.
    Cao, C., Weng, Y., Lin, S., Zhou, K.: 3D shape regression for real-time facial animation. ACM Trans. Graph. 32(4), 1–10 (2013). Scholar
  26. 26.
    Belhumeur, P.N., Jacobs, D.W., Kriegman, D.J., Kumar, N.: Localizing parts of faces using a consensus of exemplars. IEEE Trans. Pattern Anal. Mach. Intell. 35(12), 545–552 (2011). Scholar
  27. 27.
    Burgos-Artizzu, X.P., Perona, P., Dollár, P.: Robust face landmark estimation under occlusion. In: 2013 IEEE International Conference on Computer Vision, pp. 1513–1520. IEEE, Sydney (2013).
  28. 28.
    Ren, S., Cao, X., Wei, Y., Sun, J.: Face alignment at 3000 FPS via regressing local binary features. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1685–1692. IEEE, Columbus (2014).
  29. 29.
    Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2879–2886. IEEE, Providence (2012).

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Xi’an Polytechnic UniversityXi’anChina

Personalised recommendations