Skip to main content
SpringerLink
Log in

Reusing Performance Capture Data

  • Chapter
  • First Online:
Cage-based Performance Capture

Part of the book series: Studies in Computational Intelligence ((SCI,volume 509))

  • 556 Accesses

Abstract

This chapter describes a novel approach, where Laplacian Cages enhanced by harmonic weights are used for reparametrization of non-rigid dynamic surface, already acquired by multiple view techniques. We finally provide a series of results with a video-based evaluation to measure the accuracy our Cage-based Animation Reparametrization technique applied on captured mesh sequences. Finally, we propose an Animation Cartoonization algorithm dealing with the exaggeration of dynamic surface in the cage-space with additional video-based appearance stylization.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. R. Poppe, Vision-based human motion analysis: an overview. Comput. Vis. Image Underst. 108, 4–18 (2007)

    Google Scholar 

  2. S.I. Park, J.K. Hodgins, Capturing and animating skin deformation in human motion, in SIGGRAPH ’06, pp. 881–889 (2006)

    Google Scholar 

  3. S.I. Park, J.K. Hodgins, Data-driven modeling of skin and muscle deformation. ACM Trans. Graph. 25, 881–889 (2008)

    Google Scholar 

  4. P. Sand, L. McMillan, J. Popović, Continuous capture of skin deformation. ACM Trans. Graph. 22, 578–586 (2003)

    Google Scholar 

  5. B. Allen, B. Curless, Z. Popović, The space of human body shapes: reconstruction and parameterization from range scans. ACM SIGGRAPH 2003, 587–594 (2003)

    Google Scholar 

  6. D. Anguelov, P. Srinivasan, D. Koller, S. Thrun, J. Rodgers, J. Davis, Scape: shape completion and animation of people. ACM Trans. Graph. 24, 408–416 (2005)

    Google Scholar 

  7. D. Anguelov, Learning models of shape from three-dimensional range data. PhD thesis (2006)

    Google Scholar 

  8. J. Starck, A. Hilton, Surface capture for performance-based, animation. IEEE CGAA 27, 21–31 (2007)

    Google Scholar 

  9. J. Starck, G. Miller, A. Hilton, Volumetric stereo with silhouette and feature constraints. Br. Mach. Vis. Conf. (BMVC) 3, 1189–1198 (2006)

    Google Scholar 

  10. D. Vlasic, I. Baran, W. Matusik, J. Popović, Articulated mesh animation from multi-view silhouettes. ACM Trans. Graph., 27, 1–9 (2008)

    Google Scholar 

  11. D. Vlasic, P. Peers, I. Baran, P. Debevec, J. Popović, S. Rusinkiewicz, W. Matusik, Dynamic shape capture using multi-view photometric stereo, in ACM Trans. Graphics (Proc. SIGGRAPH Asia) (2009)

    Google Scholar 

  12. E. de Aguiar, C. Stoll, C. Theobalt, N. Ahmed, H.-P. Seidel, S. Thrun, Performance capture from sparse multi-view video, in SIGGRAPH’08, pp. 1–10 (2008)

    Google Scholar 

  13. J. Gall, C. Stoll, E. de Aguiar, C. Theobalt, B. Rosenhahn, H.-P. Seidel, Motion capture using joint skeleton tracking and surface estimation, in CVPR (2009)

    Google Scholar 

  14. C. Stoll, J. Gall, E. de Aguiar, S. Thrun, C. Theobalt, Video-based reconstruction of animatable human characters, in ACM SIGGRAPH Asia 2010 (2010)

    Google Scholar 

  15. L. Ballan, G. Maria Cortelazzo, Marker-less motion capture of skinned models in a four camera set-up using optical flow and silhouettes, in 3DPVT (2008)

    Google Scholar 

  16. G. Ye, Y. Liu, N. Hasler, X. Ji, Q. Dai, C. Theobalt, Performance capture of interacting characters with handheld kinetics, in ECCV (2012)

    Google Scholar 

  17. Y. Liu, C. Stoll, J. Gall, H.-P. Seidel, C. Theobalt, Markerless motion capture of interacting characters using multi-view image segmentation, in CVPR (2011)

    Google Scholar 

  18. L. Onural, T. Sikora, J. Ostermann, A. Smolic, M.R. Civanlar, J. Watson, An assessment of 3dtv technologies, in NAB Broadcast Engineering Conference Proceedings 2006, 456–467 (2006)

    Google Scholar 

  19. T. Takai, S.Nobuhara, H.Yoshimoto, T. Matsuyama, 3d video technologies: capturing high fidelity full 3d shape, motion, and texture, in ISMAR (2006)

    Google Scholar 

  20. T. Tung, T. Matsuyama, Minimal 3d video, in ACM SIGGRAPH ASIA 2009 Sketches (2009)

    Google Scholar 

  21. P. Huang, A. Hilton, J. Starck, Automatic 3d video summarization: key frame extraction from self-similarity, in 3DPVT (2008)

    Google Scholar 

  22. T. Tung, T. Matsuyama, Dynamic surface matching by geodesic mapping for 3d animation transfer, in CVPR (2010)

    Google Scholar 

  23. P. Huang, A. Hilton, J. Starck, Shape similarity for 3d video sequences of people. Int. J. Comput. Vis. 89, 362–381 (2010)

    Google Scholar 

  24. S. Nobuhara A. Hilton P. Huang, T. Tung, T. Matsuyama, Comparison of skeleton and non-skeleton shape descriptors for 3d video, in 3DPVT (2010)

    Google Scholar 

  25. J. Starck, G. Miller, A. Hilton, Video-based character animation, in SCA’05, pp. 49–58 (2005)

    Google Scholar 

  26. P. Huang, A. Hilton, J. Starck, Human motion synthesis from 3d video, in CVPR’09, pp. 1478–1485 (2009)

    Google Scholar 

  27. J.-Y. Guillemaut, D. Casas, M. Tejera, A. Hilton, 4d parametric motion graph for interactive animation, in Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games 2012 (I3D’12) (2011)

    Google Scholar 

  28. P. Huang, A. Hilton, Surface motion graphs for character animation from 3d video, in SIGGRAPH 2009: Talks, pp. 56:1–56:1 (2009)

    Google Scholar 

  29. J.-Y. Guillemaut, D. Casas, A. Hilton, Interactive parametric control of mesh sequences, in SCA’10: poster (2010)

    Google Scholar 

  30. J.-Y. Guillemaut, D. Casas, M. Tejera, A. Hilton, Parametric control of captured mesh sequences for real-time animation, in Proceedings of the 4th International Conference on Motion in Games (MIG), pp. 242–253 (2011)

    Google Scholar 

  31. M. Tejera, A. Hilton, Space-time editing of 3d video sequences. Conference on Visual Media Production, pp. 148–157 (2011)

    Google Scholar 

  32. W. Geng, G. Yu, Reuse of motion capture data in animation: a review, in ICCSA’03, pp. 620–629 (2003)

    Google Scholar 

  33. S. Kircher, M. Garland, Editing arbitrarily deforming surface animations, in SIGGRAPH ’06, pp. 1098–1107 (2006)

    Google Scholar 

  34. E. de Aguiar, C. Theobalt, S. Thrun, H.-P. Seidel, Automatic conversion of mesh animations into skeleton-based animations. Comput. Graph. Forum Computer Graphics Forum (Proc. Eurographics EG’08), pp. 389–397 (2008)

    Google Scholar 

  35. D.L. James, C.D. Twigg, Skinning mesh animations. ACM Trans. Graph. 24, 399–407 (2005)

    Google Scholar 

  36. L. Kavan, P.-P. Sloan, C. O’Sullivan, Fast and efficient skinning of animated meshes. Computer Graphics Forum (Eurographics 2010) (2010)

    Google Scholar 

  37. D.T.P. Quynh, Y. He, X. Chen, J. Xia, Q. Sun, S.C.H. Hoi, Modeling 3d articulated motions with conformal geometry videos (cgvs), in MM ’11, pp. 383–392 (2011)

    Google Scholar 

  38. I. Baran, D. Vlasic, E. Grinspun, J. Popović, Semantic deformation transfer. ACM Trans. Graph. 28, 1–36 (2009)

    Google Scholar 

  39. F. Xu, Y. Liu, C. Stoll, J. Tompkin, G. Bharaj, Q. Dai, H.-P. Seidel, J. Kautz, C. Theobalt, Video-based characters: creating new human performances from a multi-view video database, in SIGGRAPH (2011)

    Google Scholar 

  40. J. Tierny, J.-P. Vandeborre, M. Daoudi, Fast and precise kinematic skeleton extraction of 3d dynamic meshes, in ICPR (2008)

    Google Scholar 

  41. O. Sorkine, D. Cohen-Or, Least-squares meshes, in Shape Modeling International 2004, 191–199 (2004)

    Google Scholar 

  42. P. Joshi, M. Meyer, T. DeRose, B. Green, T. Sanocki, Harmonic coordinates for character articulation. ACM Trans. Graph. 26, 1–71, (2007)

    Google Scholar 

  43. E. de Aguiar, C. Theobalt, M. Magnor, H.-P. Seidel, Reconstructing human shape and motion from multi-view video, in CVMP, pp. 42–49 (2005)

    Google Scholar 

  44. J. Kwon, I.-K. Lee, The squash-and-stretch stylization for character motions. IEEE Trans. Vis. Comput. Graph. 18, 488–500 (2011)

    Google Scholar 

  45. C. de Juan, B. Bodenheimer, Cartoon textures, in Proceedings of SCA’04, pp. 267–276 (2004)

    Google Scholar 

  46. D. Sýkora, M. Ben-Chen, M. Čadík, B. Whited, M. Simmons, Textoons: practical texture mapping for hand-drawn cartoon animations, in Proceedings of NPAR’11 (2011)

    Google Scholar 

  47. D. Kang, J.-M. Chung, S.-H. Seo, J.-S. Choi, K.-H. Yoon, Detail-adaptive toon shading using saliency, in VIZ ’09, pp. 16–20 (2009)

    Google Scholar 

  48. P. Barla, J. Thollot, L. Markosian, X-toon: an extended toon shader, in Proceedings of NPAR’06, pp. 127–132 (2006)

    Google Scholar 

  49. S. Rusinkiewicz, M. Burns, D. DeCarlo, Exaggerated shading for depicting shape and detail. ACM Transactions on Graphics (Proc. SIGGRAPH) (2006)

    Google Scholar 

  50. M. Eisemann, B. De Decker, M. Magnor, P. Bekaert, E. de Aguiar, N. Ahmed, C. Theobalt, A. Sellent, Floating textures. Computer Graphics Forum (Proc. of Eurographics) (2008)

    Google Scholar 

  51. J. Wang, S. Drucker, M. Agrawala, M.F. Cohen, The cartoon animation filter, in ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006), pp. 1169–1173 (2006)

    Google Scholar 

  52. M. Gross, S. Würmlin, M. Naef, E. Lamboray, C. Spagno, A. Kunz, E. Koller-Meier, T. Svoboda, L. Van Gool, S. Lang, K. Strehlke, A. Vande Moere, O. Staadt, blue-c: a spatially immersive display and 3d video portal for telepresence. ACM Trans. Graph. 22, 819–827 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Rue Garibaldi 61, Lyon, 69006, France

    Yann Savoye

Authors
  1. Yann Savoye
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yann Savoye .

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Savoye, Y. (2014). Reusing Performance Capture Data. In: Cage-based Performance Capture. Studies in Computational Intelligence, vol 509. Springer, Cham. https://doi.org/10.1007/978-3-319-01538-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-01538-5_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-01537-8

  • Online ISBN: 978-3-319-01538-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation