Statistically Learned Deformable Eye Models

  • Joan Alabort-i-MedinaEmail author
  • Bingqing Qu
  • Stefanos Zafeiriou
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8925)


In this paper we study the feasibility of using standard deformable model fitting techniques to accurately track the deformation and motion of the human eye. To this end, we propose two highly detailed shape annotation schemes (open and close eyes), with \(+30\) feature landmark points, high resolution eye images. We build extremely detailed Active Appearance Models (AAM), Constrained Local Models (CLM) and Supervised Descent Method (SDM) models of the human eye and report preliminary experiments comparing the relative performance of the previous techniques on the problem of eye alignment.


Eye alignment Eye tracking Active appearance models Constrained local models Supervised descent method 


  1. 1.
    Amberg, B., Blake, A., Vetter, T.: On compositional image alignment, with an application to active appearance models. In: CVPR (2009)Google Scholar
  2. 2.
    Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequences: Temporal and static modeling. CVIU (2003)Google Scholar
  3. 3.
    Cootes, T.F., Taylor, C.J., Cooper, D.H., Graham, J.: Active shape models—their training and application. Computer Vision and Image Understanding (1995)Google Scholar
  4. 4.
    Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Transactions on Pattern Analysis and Machine Intelligence (2001)Google Scholar
  5. 5.
    Fukuda, K.: Eye blinks: new indices for the detection of deception. International Journal of Psychophysiology (2001)Google Scholar
  6. 6.
    Stern, J.A., Walrath, L.C., Goldstein, R.: The endogenous eyeblink. Psychophysiology (1984)Google Scholar
  7. 7.
    Le, V., Brandt, J., Lin, Z., Bourdev, L., Huang, T.S.: Interactive facial feature localization. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds.) ECCV 2012, Part III. LNCS, vol. 7574, pp. 679–692. Springer, Heidelberg (2012) Google Scholar
  8. 8.
    Matthews, I., Baker, S.: Active appearance models revisited. International Journal of Computer Vision (2004)Google Scholar
  9. 9.
    i Medina, J.A., Zafeiriou, S.: Bayesian active appearance models. In: CVPR (2014)Google Scholar
  10. 10.
    Moriyama, T., Kanade, T., Xiao, J., Cohn, J.F.: Meticulously detailed eye region model and its application to analysis of facial images. TPAMI (2006)Google Scholar
  11. 11.
    Orozco, J., Roca, X., Gonzlez, J.: Real-time gaze tracking with appearance-based models. Machine Vision and Applications (2009)Google Scholar
  12. 12.
    Papandreou, G., Maragos, P.: Adaptive and constrained algorithms for inverse compositional active appearance model fitting. In: CVPR (2008)Google Scholar
  13. 13.
    Saragih, J.M., Lucey, S., Cohn, J.F.: Deformable model fitting by regularized landmark mean-shift. International Journal of Computer Vision (2011)Google Scholar
  14. 14.
    Sirohey, S., Rosenfeld, A., Duric, Z.: A method of detecting and tracking irises and eyelids in video. Pattern Recognition (2002)Google Scholar
  15. 15.
    Tan, H., Zhang, Y.J.: Detecting eye blink states by tracking iris and eyelids (2006)Google Scholar
  16. 16.
    Wu, Y., Liu, H., Zha, H.: A new method of detecting human eyelids based on deformable templates. In: SMC (2004)Google Scholar
  17. 17.
    Xiong, X., De la Torre, F.: Supervised descent method and its application to face alignment. In: CVPR (2013)Google Scholar
  18. 18.
    Zeng, Z., Pantic, M., Roisman, G., Huang, T.: A survey of affect recognition methods: Audio, visual, and spontaneous expressions. TPAMI (2009)Google Scholar
  19. 19.
    Zhu, X., Ramanan, D.: Face detection, pose estimation, and landmark localization in the wild. In: CVPR (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Joan Alabort-i-Medina
    • 1
    Email author
  • Bingqing Qu
    • 1
  • Stefanos Zafeiriou
    • 1
  1. 1.Imperial College LondonLondonUK

Personalised recommendations