Enhancing Facial Impression for Video Conference

  • Sungyeon Park
  • Heeseung Choi
  • Ig-Jae KimEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9189)


Most people have their preferred impression to be seen by others. Our face warping method can make this real. In this paper, we propose a new technique for automatic transformation of facial impression, for example, look more attractive or baby-face from the original. We build an impression score function, trained by scores from human raters, and the function is used to get displacement vectors for a given face. To preserve the facial identity as much as possible, we constrain the facial deformation range with facial classification. In case of real time application, such as video conference, there are frequent facial expressions variation and position changes. Face tracker is used to cope with this changing situation. Through our experiments, our proposed method can be one of the promising methods for future video conference system.


Transformation of facial impression Face warping Face tracker Machine learning Deformation of face 



This work was supported by the KIST Institutional Program (Project No. 2E25660).


  1. 1.
    Jain, A., Nandakumar, K., Ross, A.: Score normalization in multimodal biometric systems. Pattern Recogn. 38, 2270–2285 (2005)CrossRefGoogle Scholar
  2. 2.
    Press, W.H., Flannery, B.P., Teukolasky, S.A., Vetterling, W.T.: Numerical Recipes: The Art of Scientific Computing, 2nd edn. Cambridge University Press, Cambridge (1992)Google Scholar
  3. 3.
    Eisenthal, Y., Dror, G., Ruppin, E.: Facial attractiveness: beauty and the machine. Neural Comput. 18(1), 119–142 (2006)CrossRefGoogle Scholar
  4. 4.
    Joachims, T.: Making Large-scale SVM Learning Practical. In: Schölkopf, B., Burges, C.J.C., Smola, A.J. (eds.) Advances in Kernel Methods: Support Vector Learning, pp. 169–184. MIT Press, Cambridge (1999)Google Scholar
  5. 5.
    Levenberg, K.: A method for the solution of certain problems in least squares. Quart. Appl. Math. 2, 164–168 (1944)MathSciNetzbMATHGoogle Scholar
  6. 6.
    Marquardt, D.: An algorithm for least-squares estimation of nonlinear parameters. SIAM J. Appl. Math. 11(2), 431–441 (1963)CrossRefMathSciNetzbMATHGoogle Scholar
  7. 7.
    Leyvand, T., Cohen-Or, D., Dror, G., Lischinski, D.: Data-driven enhancement of facial attractiveness. ACM Trans. Graph. SIGGRAPH 27(3), 38 (2008)Google Scholar
  8. 8.
    Wagstaff, K., Rogers, S.: Constrained K-means cluastering with background knowledge. In: Proceedings of the 18th International Conference on Machine Learning, pp. 577–584 (2001)Google Scholar
  9. 9.
    Milborrow, S., Nicolls, F.: Locating facial features with an extended active shape model. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part IV. LNCS, vol. 5305, pp. 504–513. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  10. 10.
    Asthana, A., Zafeiriou, S., Cheng, S., Pantic, M.: Incremental face alignment in the wild. In: CVPR (2014)Google Scholar
  11. 11.
    Cristinacce, D., Cootes, T.F.: Feature detection and tracking with constrained local models. In: Proceeding of British Machine Vision Conference, vol. 3, pp. 929–938 (2006)Google Scholar
  12. 12.
    Bruce, V.: Recognizing Faces. Lawrence Erlbaum Associates, London (1988)Google Scholar
  13. 13.
    Hashimoto, S.: KANSEI as the third target of information processing and related topics in Japan. In: Proceeding of KANSEI – The Technology of Emotion, AIMI International Workshop, pp. 101–104, October 1997Google Scholar
  14. 14.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.HCI RoboticsUniversity of Science and TechnologySeoulRepublic of Korea
  2. 2.Imaging Media Research CenterKorea Institute of Science and TechnologySeoulRepublic of Korea

Personalised recommendations