Abstract
In this paper we introduce an approach to high-level parameterisation of captured mesh sequences of actor performance for real-time interactive animation control. High-level parametric control is achieved by non-linear blending between multiple mesh sequences exhibiting variation in a particular movement. For example walking speed is parameterised by blending fast and slow walk sequences. A hybrid non-linear mesh sequence blending approach is introduced to approximate the natural deformation of non-linear interpolation techniques whilst maintaining the real-time performance of linear mesh blending. Quantitative results show that the hybrid approach gives an accurate real-time approximation of offline non-linear deformation. Results are presented for single and multi-dimensional parametric control of walking (speed/direction), jumping (heigh/distance) and reaching (height) from captured mesh sequences. This approach allows continuous real-time control of high-level parameters such as speed and direction whilst maintaining the natural surface dynamics of captured movement.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Baran, I., Vlasic, D., Grinspun, E., Popović, J.: Semantic deformation transfer. In: Proceedings of ACM SIGGRAPH (2009)
Botsch, M., Sorkine, O.: On linear variational surface deformation methods. IEEE TVCG 14(1), 213–230 (2008)
Bregler, C., Covell, M., Slaney, M.: Video rewrite: Driving visual speech with audio. In: Proceedings of ACM SIGGRAPH, pp. 1–8 (1997)
Brundelin, A., Williams, L.: Motion signal processing. In: Proceedings of ACM SIGGRAPH, pp. 97–104 (1995)
Budd, C., Huang, P., Hilton, A.: Hierarchical shape matching for temporally consistent 3d video. In: Proc. International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT 2011), Hangzhou, China (May 2011)
Cagniart, C., Boyer, E., Ilic, S.: Free-Form Mesh Tracking: a Patch-Based Approach. In: Conference on Computer Vision and Pattern Recognition, CVPR (2010)
Carranza, J., Theobalt, C., Magnor, M., Seidel, H.P.: Free-viewpoint video of human actors. In: Proceedings of ACM SIGGRAPH, pp. 565–577 (2003)
Chong, K., Han, Y., Lam, T.: Concurrent threads and optimal parallel minimum spanning trees algorithm. J.ACM 48(2), 297–323 (2001)
de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.P., Thrun, S.: Performance Capture from Sparse Multi-view Video. ACM SIGGRAPHÂ 27(3) (2008)
Flagg, M., Nakazawa, A., Zhang, Q., Kang, S.B., Ryu, Y., Essa, I., Rehg, J.: Human Video Textures. In: ACM Symposium on Interactive 3D Graphics (2009)
Gleicher, M.: Motion Editing with Spacetime Constraints. In: ACM Symposium on Interactive 3D Graphics (1997)
Huang, P., Budd, C., Hilton, A.: Global temporal registration of multiple non-rigid surface sequences. In: CVPR (2011)
Huang, P., Hilton, A., Starck, J.: Human Motion Synthesis from 3D Video. In: IEEE Int.Conf. on Computer Vision and Pattern Recognition, CVPR (2009)
Huang, P., Hilton, A., Starck, J.: Shape similarity for 3d video sequences of people. International Journal of Computer Vision 89, 362–381 (2010)
Kanade, T., Rander, P.: Virtualized reality: Constructing virtual worlds from real scenes. IEEE MultiMedia 4(2), 34–47 (1997)
Kircher, S., Garland, M.: Free-Form Motion Processing. ACM Transactions on Graphics 27(2), 1–13 (2008)
Kovar, L., Gleicher, M.: Automated extraction and parameterization of motions in large date sets. In: Proceedings of ACM SIGGRAPH, vol. 23(3), pp. 559–568 (2004)
Lee, J., Shin, S.: A Hierarchical Approach to Interactive Motion Editing for Human-Like Figures. In: Proceedings of ACM SIGGRAPH, pp. 39–48 (1999)
Lowe, D.: Distinctive image features for scale invariant keypoints. Int. J. of Computer Vision 60(2), 91–110 (2004)
Mukai, T., Kuriyama, S.: Geostatistical Motion Interpolation. In: Proceedings of ACM SIGGRAPH (2005)
Popović, Z., Witkin, A.: Physically Based Motion Transformation. In: Proceedings of ACM SIGGRAPH (1999)
Rose, C., Cohen, M., Bodenheimer, B.: Verbs and adverbs: multidimensional motion interpolation. IEEE Computer Graphics and Applications 18(5), 32–40 (1998)
Schodl, A., Szeliski, R., amd Salesin, D., Essa, I.: Video textures. In: Proceedings of ACM SIGGRAPH, pp. 489–498 (2000)
Seitz, S., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. In: Conference on Computer Vision and Pattern Recognition (CVPR), pp. 519–528 (2006)
Sorkine, O.: Differential Representations for Mesh Processing. Computer Graphics Forum 25(4) (2006)
Starck, J., Hilton, A.: Surface capture for performance based animation. IEEE Computer Graphics and Applications 27(3), 21–31 (2007)
Starck, J., Miller, G., Hilton, A.: Video-Based Character Animation. In: ACM SIGGRAPH/Eurographics Symposium on Computer Animation. pp. 49—58 (2005)
Stoll, C., Gall, J., de Aguiar, E., Thrun, S., Theobalt, C.: Video-based Reconstruction of Animatable Human Characters. In: ACM SIGGRAPH ASIA (2010)
Sumner, R., Popović, J.: Deformation Transfer for Triangle Meshes. In: Proceedings of ACM SIGGRAPH (2004)
Tung, T., Matsuyama, T.: Dynamic Surface Matching by Geodesic Mapping for Animation Transfer. In: Conference on Computer Vision and Pattern Recognition, CVPR (2010)
Vedula, S., Baker, S., Rander, P., Collins, R., Kanade, T.: Three-Dimensional Scene Flow 27(3) (2005)
Vlasic, D., Baran, I., Matusik, W., Popović, J.: Articulated mesh animation from multi-view silhouettes. In: Proceedings of ACM SIGGRAPH (2008)
Wand, M., Adams, B., Ovsianikov, M., Berner, A., Bokeloh, M., Jenke, P., Guibas, L., Seidel, H.P., Schilling, A.: Efficient Reconstruction of Non-rigid Shape and Motion from Real-Time 3D Scanner Data. ACM Trans.Graphics 28(2) (2009)
Wiley, D., Hahn, J.: Interpolation synthesis for articulated figure motion. In: IEEE Virtual Reality International Symposium, pp. 157–160 (1997)
Witkin, A., Popović, Z.: Motion Warping. In: Proceedings of ACM SIGGRAPH (1995)
Xu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H.P., Kautz, J., Theobalt, C.: Video-based Characters - Creating New Human Performances from a Multi-view Video Database. In: Proceedings of ACM SIGGRAPH (2011)
Xu, W., Zhou, K., Yu, Y., Peng, Q., Guo, B.: Gradient domain editing of deforming mesh sequences. Proceedings of ACM SIGGRAPHÂ 26(3) (2007)
Zitnick, C., Kang, S., Uyttendaele, M., Winder, S., Szeliski, R.: High-quality video view interpolation using a layered representation, pp. 600–608 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Casas, D., Tejera, M., Guillemaut, JY., Hilton, A. (2011). Parametric Control of Captured Mesh Sequences for Real-Time Animation. In: Allbeck, J.M., Faloutsos, P. (eds) Motion in Games. MIG 2011. Lecture Notes in Computer Science, vol 7060. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-25090-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-25090-3_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-25089-7
Online ISBN: 978-3-642-25090-3
eBook Packages: Computer ScienceComputer Science (R0)