Motion Capture and Estimation of Dynamic Properties for Realistic Tree Animation

  • Shaojun Hu
  • Peng He
  • Dongjian HeEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10582)


The realistic animation of real-world trees is a challenging task because natural trees have various morphology and internal dynamic properties. In this paper, we present an approach to model and animate a specific tree by capturing the motion of its branches. We chose Kinect V2 to record both the RGB and depth of motion of branches with markers. To obtain the three-dimensional (3D) trajectory of branches, we used the mean-shift algorithm to track the markers from color images generated by projecting a textured point cloud onto the image plane, and then inversely mapped the tracking results in the image to 3D coordinates. Next, we performed a fast Fourier transform on the tracked 3D positions to estimate the dynamic properties (i.e., the natural frequency) of the branches. We constructed static tree models using a space colonization algorithm. Given the dynamic properties and static tree models, we demonstrated that our approach can produce realistic animation of trees in wind fields.


Motion capture Kinect Dynamic property Tree 



We thank Dr. Maxine Garcia and Shujie Deng for editing the English text of a draft of this manuscript. The work is supported by the NSFC (61303124) and the Fundamental Research Funds for the Central Universities (Z109021708).


  1. 1.
    Adelin, B., Julien, D., Pascal, H., Boris, A., Nicolas, D., Lionel, R., Bruno, M.: A robust videogrametric method for the velocimetry of wind-induced motion in trees. Agric. For. Meteorol. 184, 220–229 (2014)CrossRefGoogle Scholar
  2. 2.
    Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–577 (2003)CrossRefGoogle Scholar
  3. 3.
    Diener, J., Reveret, L., Fiume, E.: Hierarchical retargetting of 2d motion fields to the animation of 3d plant models. In: Proceedings of the 2006 ACM SCA, Switzerland, pp. 187–195 (2006)Google Scholar
  4. 4.
    Hu, S., Chiba, N., He, D.: Realistic animation of interactive trees. Vis. Comput. 28(6–8), 859–868 (2012)CrossRefGoogle Scholar
  5. 5.
    Hu, S., Fujimoto, T., Chiba, N.: Pseudo-dynamics model of a cantilever beam for animating flexible leaves and branches in wind field. Comput. Animation Virtual Worlds 20(2–3), 279–287 (2009)CrossRefGoogle Scholar
  6. 6.
    Hu, S., Zhang, Z., Xie, H., Igarashi, T.: Data-driven modeling and animation of outdoor trees through interactive approach. Vis. Comput. 33(6), 1017–1027 (2017)CrossRefGoogle Scholar
  7. 7.
    James, K.R.: A dynamic structural analysis of trees subject to wind loading. In: Phd’s dissertation. The University of Melbourne, Victoria, Australia (2010)Google Scholar
  8. 8.
    James, K.R., Haritos, N., Ades, P.K.: Mechanical stability of trees under dynamic loads. Am. J. Bot. 93(10), 1522–1530 (2006)CrossRefGoogle Scholar
  9. 9.
    Khorloo, O., Gunjee, Z., Sosorbaram, B., Chiba, N.: Wind field synthesis for animating wind-induced vibration. Int. J. Virtual Reality 10(1), 53–60 (2011)Google Scholar
  10. 10.
    Long, J., Porter, B., Jones, M.: Animation of trees in wind using sparse motion capture data. Vis. Comput. 31(3), 325–339 (2015)CrossRefGoogle Scholar
  11. 11.
    Moore, J.R., Maguire, D.A.: Natural sway frequencies and damping ratios of trees: concepts, review and synthesis of previous studies. Trees 18(2), 195–203 (2004)CrossRefGoogle Scholar
  12. 12.
    Moore, J.R., Maguire, D.A.: Natural sway frequencies and damping ratios of trees: influence of crown structure. Trees 19(4), 363–373 (2005)CrossRefGoogle Scholar
  13. 13.
    Runions, A., Lane, B., Prusinkiewicz, P.: Modeling trees with a space colonization algorithm. In: Proceedings of the Third Eurographics Conference on Natural Phenomena, NPH 2007, pp. 63–70. Eurographics Association, Aire-la-Ville, Switzerland (2007)Google Scholar
  14. 14.
    Shinya, M., Fournier, A.: Stochastic motion-motion under the influence of wind. Comput. Graph. Forum 11(3), 119–128 (1992)CrossRefzbMATHGoogle Scholar
  15. 15.
    Sun, M., Jepson, D.A., Fiume, E.: Video input driven animation (vida). In: 9th IEEE International Conference on Computer Vision, Nice, France, pp. 96–103. IEEE (2003)Google Scholar
  16. 16.
    Wang, B., Wu, L., Yin, K., Ascher, U., Liu, L., Huang, H.: Deformation capture and modeling of soft objects. ACM Trans. Graph. 34(4), 1–12 (2015)Google Scholar
  17. 17.
    Xiao, B., Guo, X., Zhao, C.: An approach of mocap data-driven animation for virtual plant. IETE J. Res. 59(3), 258–263 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.College of Information EngineeringNorthwest A&F UniversityXianyangChina
  2. 2.College of Mechanical and Electronic EngineeringNorthwest A&F UniversityXianyangChina

Personalised recommendations