Automatic User-Specific Avatar Parametrisation and Emotion Mapping
In this paper an approach for automatic user-specific 3D model generation and expression classification is proposed. User performance-driven avatar animation is recently in the focus of research due to the increasing amount of low-cost acquisition devices with integrated depth map computation. Thereby challenging is the user-specific emotion classification without a complex manual initial step. Correct classification and emotion intensity identification can only be done with known expression specific facial feature displacement which differs from user to user. The use of facial feature tracking on predefined 3D model expression animations is presented here as solution statement for automatic emotion classification and intensity calculation. Consequently with this approach partial occlusions of a presented emotion do not hamper expression identification based on the symmetrical structure of human faces. Thus, a markerless, automatic and easy to use performance-driven avatar animation approach is presented.
KeywordsAvatar animation face normalisation automatic facial feature extraction facial expression analysis blendshape animation
Unable to display preview. Download preview PDF.
- 1.Bassili, J.N.: Facial motion in the perception of faces and of emotional expression. Journal of Experimental Psychology: Human Perception and Performance 4(3), 373–379 (1978)Google Scholar
- 2.Bouguet, J.-Y.: Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corporation (2001)Google Scholar
- 3.Chai, J.-X., Xiao, J., Hodgins, J.: Vision-based control of 3d facial animation. In: Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 193–206. Eurographics Association (2003)Google Scholar
- 5.Facegen modeller (April 2013), http://facegen.com/modeller.htm
- 7.Joshi, P., Tien, W.C., Desbrun, M., Pighin, F.: Learning controls for blend shape based realistic facial animation. In: ACM SIGGRAPH 2005 Courses, p. 8. ACM (2005)Google Scholar
- 10.Liu, X., Xia, S., Fan, Y., Wang, Z.: Exploring non-linear relationship of blendshape facial animation. In: Computer Graphics Forum., vol. 30, pp. 1655–1666. Wiley Online Library (2011)Google Scholar
- 13.Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1, pp. I–511. IEEE (2001)Google Scholar