Abstract
This chapter describes the mathematical model that will be used to animate a virtual face in a project called SPEEP, a project that makes use of this virtual face to teach the pronunciation of foreign languages to students. The mathematical model is based on the well-known Skeleton Subspace Deformation, but an elastic layer is inserted in the generation of bone’s transformations. Besides, the whole process that will be followed in the project is described, from the definition of the skeleton structure and the training of the parameters of the model to its application in a WebGL environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hodgins, J., Jörg, S., O’Sullivan, C., Park, S.I., Mahler, M.: The saliency of anomalies in animated human characters. ACM Trans. Appl. Percept. 7(4), 22 (2010)
Leung, C., Salga, A.: Enabling WebGL. In: Proceedings of the 19th International Conference on World Wide Web, pp. 1369–1370 (2010)
Radovan, M., Pretorius, L.: Facial animation in a nutshell: past, present and future. In: Proceedings of the 2006 Annual Research Conference of the South African institute of Computer Scientists and Information Technologists on IT Research in Developing Countries (2006)
Parke, F.I.: Computer generated animation of faces. In: Proceedings of the ACM Annual Conference, vol. 1 (1972)
DeRose, T., Kass, M., Truong, T.: Subdivision surfaces in character animation. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 85–94, ACM (1998)
Yarimizu, H., Ishibashi, Y., Kubo, H., Maejima, A., Morishima, S.: Muscle-based facial animation considering fat layer structure captured by MRI. In: SIGGRAPH’09: Posters, p. 9, ACM (2009)
Su, M.-C., Liu, I.-C.: Application of the self-organizing feature map algorithm in facial image morphing. Neural Process. Lett. 14, 35–47 (2001)
Fei, K.: Expressive textures. In: Proceedings of the 1st International Conference on Computer Graphics, Virtual Reality and Visualisation, pp. 137–141, ACM (2001)
Huang, H., Chai, J., Tong, X., Wu, H.-T.: Leveraging motion capture and 3D scanning for high-fidelity facial performance acquisition. ACM Trans. Graph. 30, 74 (2011)
Beeler, T., Hahn, F., Bradley, D., Bickel, B., Beardsley, P., Gotsman, C., Sumner, R.W., Gross, M.: High-quality passive facial performance capture using anchor frames. ACM Trans. Graph 30, 75 (2011)
Arghinenti, A.: Animation workflow in KILLZONE3: a fast facial retargeting system for game characters. In: ACM SIGGRAPH 2011 Talks, p. 37, ACM (2011)
Deng, Z., Chiang, P.-Y., Fox, P., Neumann, U.: Animating blendshape faces by cross-mapping motion capture data. In: Proceedings of the 2006 Symposium on Interactive 3D Graphics and Games, p. 43–48, ACM (2006)
Fathom Studios for Deldo.: http://www.creativecrash.com/maya/tutorials/character/c/facial-animation-rig-for-delgo
Talking Heads.: http://www.gamasutra.com/view/feature/3089/talking_heads_facial_animation_in_.php
Andy Van Straten.: http://andy-van-straten.com/
Cohen, M.M., Massaro, D.W.: Modeling coarticulation in synthetic visual speech. In: Thalmann, N.M. (ed.) Models and Techniques in Computer, Animation, pp. 139–156. Springer, Berlin (1993)
Yamamoto, E., Nakamura, S., Shikano, K.: Lip movement synthesis from speech based on hidden Markov models. Speech Commun. 26, 105–115 (1998)
Massaro, D.W., Beskow, J., Cohen, M.M., Fry, C.L., Rodriguez, T. : Picture my voice: audio to visual speech synthesis using artificial neural networks. In: Massaro, D.W. (ed.) Proceedings of AVSP’99: International Conference on Auditory-Visual Speech Processing, pp. 133–138 (1999)
Benin, A, Leone, G.R., Cosi P.: Web3D’2012, a 3D talking head for mobile devices based on unofficial iOS WebGl Support. In: Proceedings of the 17th International Conference on 3D Web Technology, pp. 117–120 (2012)
Gachery, S., Magnenat-Thalmann, N.: Designing MPEG-4 facial animation tables for web applications. In: Multimedia Modeling Conference, pp. 39–56, Amsterdam, Holanda
Cantor D, Jones Br.: WebGL Beginner’s Guide. Packt Publishing (2012)
Lavagetto, F., Pockaj, R.: The Facial animation engine: towards a high-level interface for the design of MPEG-4 compliant animated faces. IEEE Trans. Circuits Syst. Video Technol. 9(2), 277–289 (1999)
Contreras, V.: Artnatomy. http://www.artnatomia.net/uk/artnatomiaIng.html (2005). Accessed 27 Nov 2012
Lewis, J.P., Cordner, M., Fong, N.: Pose space deformation: a unified approach to shape interpolation and skeleton-driven deformation. In: Proceedings of the 27th Annual Conference on Computer Graphics and interactive techniques, pp. 165–172 (2000)
Dornaika, F., Davoine, F.: On appearance based face and facial action tracking. IEEE Trans. Circuits Syst Video Technol. 16(9), 1107–1124 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this paper
Cite this paper
Mujika, A., Barrena, N., García, S., Oyarzun, D. (2014). Elastic Bone Transformation for Realistic Facial Animation in WebGL. In: De Amicis, R., Conti, G. (eds) Future Vision and Trends on Shapes, Geometry and Algebra. Springer Proceedings in Mathematics & Statistics, vol 84. Springer, London. https://doi.org/10.1007/978-1-4471-6461-6_7
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6461-6_7
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6460-9
Online ISBN: 978-1-4471-6461-6
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)