Abstract
Advances in facial animation technology have been extended into various creative applications such as computer games, 3D animations and interactive multimedia. In this work, we explore performance-driven facial animations using a rigged bone approach. A 3D face model is rigged with bones positioned at the desired control points. The performance information for controlling these control points are extracted using the marker-based technique where color dots are painted on a performer’s face at desired positions. Facial expression performances are recorded using a low cost camera. The information from the recorded performances is extracted and mapped onto a targeted face. Hence facial expression performances of the actor can be applied to different 3D model faces, provided that they share the same control points. This approach affords reusability of the facial performances without expensive equipment. We present the creative process of our approach, discuss the outcome and the prospect of future works.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The three facial models (see Fig. 1) used in this study are obtained from http://tf3dm.com/.
References
Hjorztsjo, C.H.: Man’s face and mimic language. Accessed from Carl-Herman Hjortsjö, Man’s face and mimic language on June 2016 diglib.uibk.at.at/ (1969)
Phon-Amnuaisuk, S.: Exploring particle-based caricature generations. In: Abd Manaf, A., Zeki, A., Zamani, M., Chuprat, S., El-Qawasmeh, E. (eds.) ICIEIS 2011. CCIS, vol. 252, pp. 37–46. Springer, Heidelberg (2011). doi:10.1007/978-3-642-25453-6_4
Arya, A., DiPaola, S.: Multispace behavioural model for face-based affective social agents. EURASIP J. Image Video Process. Spec. Issue Facial Image Process. 2007, 048757 (2007)
Byun, M., Badler, N.: FacEMOTE: qualitative parametric modifiers for facial animations. In: Proceedings of the 2002 SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2002), pp. 65–71 (2002)
Parke, F.I.: Computer generated animation of faces. In: Proceedings of the ACM Annual Conference (ACM 1972), vol. 1, pp. 451–457 (1972)
Waller, B.M., Lembeck, M., Kuchenbuch, P., Burrows, A.M., Liebal, K.: GibbonFACS: a muscle-based facial movement coding system for hylobatids. Int. J. Primatol. 33(4), 809. doi:10.1007/s10764-012-9611-6
Chuang, E., Bregler, C.: Performance driven facial animation using blendshape interpolation. Technical report CS-TR-2002-02. Stanford University (2002)
Deng, Z., Bulut, M., Neumann, U., Narayanan, S.S.: Automatic dynamic expression synthesis for speech animation. In: Proceedings of IEEE Computer Animation and Social Agents (CASA 2004), pp. 267–274 (2004)
Pighin, F., Hecker, J.: Synthesizing realistic facial expression from photographs. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1998), pp. 75–84. ACM, New York (1998)
Ekman, P., Friesen, W.V.: Measuring facial movement. Environ. Psychol. Nonverbal Behav. 1(1), 56–75 (1976)
Magnenat-Thalmann, N., Laperriêre, R., Thalmann, D.: Joint-dependent local deformations for hand animation and object grasping. In: Proceedings of Graphics Interface 1988, Edmonton, pp. 26–33 (1988)
Schleifer, J.: Character setup from rig mechanics to skin deformations: a practical approach. In: Proceedings of the 29th International Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 2002). A note from short course (2002)
Willaims, L.: Performance-driven facial animation. In: Proceedings of the 17th Annual Conference on Computer Graphics and Interactive Techniques SIGGRAPH 1990, pp. 235–242 (1990)
Pandzic, I.S., Forchheimer, R.: MPEG-4: Facial Animation: The Standard, Implementation and Applications. Wiley, New York (2002)
Bouguet, J.Y.: Pyramidal implementation of the affine Lucas Kanade feature tracker: description of the algorithm. Technical report Intel Corporation. robots.standford.edu/cs223b04/algo_affine_tracking.pdf. Accessed June 2016
Mori, M.: The uncanny valley. IEEE Robot. Autom. 19(2), 98–100 (2012)
Acknowledgments
We wish to thank anonymous reviewers for their comments that have helped improve this paper. We would like to thank the GSR office for their partial financial support given to this research.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Hamdan, F., Matussin, H., Serjuddin, S., Phon-Amnuaisuk, S., Shannon, P.D. (2017). 3D Facial Expressions from Performance Data. In: Phon-Amnuaisuk, S., Au, TW., Omar, S. (eds) Computational Intelligence in Information Systems. CIIS 2016. Advances in Intelligent Systems and Computing, vol 532. Springer, Cham. https://doi.org/10.1007/978-3-319-48517-1_24
Download citation
DOI: https://doi.org/10.1007/978-3-319-48517-1_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48516-4
Online ISBN: 978-3-319-48517-1
eBook Packages: EngineeringEngineering (R0)