Abstract
We propose a technique for quickly and easily choreographing a video of an amateur performer by comparing it with a video of a corresponding professional performance. Our method allows the user to interactively edit the amateur performance in order to synchronize it with the professional performance in terms of timings and poses. In our system, the user first extracts the amateur and professional poses from every frame via semi-automatic video tracking. The system synchronizes the timings by computing dynamic time warping (DTW) between the two sets of video-tracking data, and then synchronizes the poses by applying image deformation to every frame. To eliminate unnatural vibrations, which often result from inaccurate video tracking, we apply an automatic motion-smoothing algorithm to the synthesized animation. We demonstrate that our method allows the user to successfully edit an amateur’s performance into a more polished one, utilizing the Japanese sumo wrestling squat, the karate kick, and the moonwalk as examples.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Jain, A., Thormählen, T., Seidel, H.-P., Theobalt, C.: Moviereshape: Tracking and reshaping of humans in videos. ACM Trans. Graph. 29(5) (2010)
Xu, F., Liu, Y., Stoll, C., Tompkin, J., Bharaj, G., Dai, Q., Seidel, H.-P., Kautz, J., Theobalt, C.: Video-based characters: creating new human performances from a multi-view video database. In: ACM SIGGRAPH 2011 Papers, pp. 32:1–32:10 (2011)
Schödl, A., Szeliski, R., Salesin, D., Essa, I.: Video textures. In: Proceedings of ACM SIGGRAPH 2000. Annual Conference Series, pp. 489–498. ACM SIGGRAPH (2000)
Schödl, A., Essa, I.: Controlled animation of video sprites. In: Proc. of the 2002 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, pp. 121–127 (2002)
Scholz, V., El-Abed, S., Seidel, H.-P., Magnor, M.A.: Editing object behavior in video sequences. CGF 28(6), 1632–1643 (2009)
Weng, Y., Xu, W., Hu, S., Zhang, J., Guo, B.: Keyframe based video object deformation. In: Proc. International Conference on Cyberworlds 2008, pp. 142–149 (2008)
Sand, P., Teller, S.: Particle video: Long-range motion estimation using point trajectories. In: Proc. of CVPR 2006, pp. 2195–2202 (2006)
Agarwala, A., Hertzmann, A., Salesin, D.H., Seitz, S.M.: Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graph. 23(3), 584–591 (2004)
Zach, C., Pock, T., Bischof, H.: A Duality Based Approach for Realtime TV-L 1 Optical Flow. In: Hamprecht, F.A., Schnörr, C., Jähne, B. (eds.) DAGM 2007. LNCS, vol. 4713, pp. 214–223. Springer, Heidelberg (2007)
Rao, C., Gritai, A., Shan, M., Syeda-mahmood, T.: View-invariant alignment and matching of video sequences. In: Proc. of ICCV 2003, pp. 939–945 (2003)
Beier, T., Neely, S.: Feature-based image metamorphosis. In: Proc. of SIGGRAPH 1992, pp. 35–42 (1992)
Igarashi, T., Moscovich, T., Hughes, J.F.: As-rigid-as-possible shape manipulation. In: ACM SIGGRAPH 2005 Papers, pp. 1134–1141 (2005)
Schaefer, S., Mcphail, T., Warren, J.: Image deformation using moving least squares. ACM TOG 25(3), 533–540 (2006)
Sun, J., Jia, J., Ang, C.-K., Shum, H.-Y.: Poisson matting. In: ACM SIGGRAPH 2004 Papers, pp. 315–321 (2004)
Wei, X., Chai, J.: Videomocap: Modeling physically realistic human motion from monocular video sequences. ACM Transactions on Graphics 29(4) (2010)
Vondrak, M., Sigal, L., Hodgins, J.K., Jenkins, O.: Video-based 3D Motion Capture through Biped Control. ACM Transactions on Graphics (Proc. SIGGRAPH 2012) (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mizui, K., Okabe, M., Onai, R. (2013). Choreographing Amateur Performers Based on Motion Transfer between Videos. In: Li, S., et al. Advances in Multimedia Modeling. MMM 2013. Lecture Notes in Computer Science, vol 7732. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35725-1_46
Download citation
DOI: https://doi.org/10.1007/978-3-642-35725-1_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-35724-4
Online ISBN: 978-3-642-35725-1
eBook Packages: Computer ScienceComputer Science (R0)