Abstract
Plants are essential elements of virtual worlds to get pleasant and realistic 3D environments. Even if mature computer vision techniques allow the reconstruction of challenging 3D objects from images, due to high complexity of plant topology, dedicated methods for generating 3D plant models must be devised. We propose an analysis-by-synthesis method which generates 3D models of a plant from both images and a priori knowledge of the plant species.
Our method is based on a skeletonisation algorithm which allows to generate a possible skeleton from a foliage segmentation. Then, we build a 3D generative model, based on a parametric model of branching systems that takes into account botanical knowledge. This method extends previous works by constraining the resulting skeleton to follow a natural branching structure. A first instance of a 3D model is generated. A reprojection of this model is compared with the original image. Then, we show that selecting the model from multiple proposals for the main branching structure of the plant and for the foliage improves the quality of the generated 3D model. Varying parameter values of the generative model, we produce a series of candidate models. A criterion based on comparing 3D virtual plant reprojection with the original image selects the best model. Finally, results on different species of plants illustrate the performance of the proposed method.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Prusinkiewicz, P., Lindenmayer, A.: The algorithmic beauty of plants. Springer (1990)
Lindenmayer, A.: Mathematical models for cellular interaction in development: Parts i and ii. Journal of Theoretical Biology 18 (1968)
Weber, J., Penn, J.: Creation and rendering of realistic trees. In: Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1995, pp. 119–128. ACM, New York (1995)
Deussen, O., Lintermann, B.: Digital Design of Nature: Computer Generated Plants and Organics. Springer (2005)
de Reffye, P., Edelin, C., Françon, J., Jaeger, M., Puech, C.: Plant models faithful to botanical structure and development. In: Proceedings of the 15th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1988, pp. 151–158. ACM, New York (1988)
Markov and semi-markov switching linear mixed models used to identify forest tree growth components. Biometrics (2009)
Palubicki, W., Horel, K., Longay, S., Runions, A., Lane, B., Měch, R., Prusinkiewicz, P.: Self-organizing tree models for image synthesis. SIGGRAPH, 1–10 (2009)
Quan, L.: Image-based Plant Modeling. Springer (2010)
Shlyakhter, I., Rozenoer, M., Dorsey, J., Teller, S.: Reconstructing 3d tree models from instrumented photographs. IEEE Comput. Graph. Appl., 53–61 (2001)
Quan, L., Tan, P., Zeng, G., Yuan, L., Wang, J., Kang, S.B.: Image-based plant modeling. ACM TOG, 599–604 (2006)
Quan, L., Wang, J., Tan, P., Yuan, L.: Image-based modeling by joint segmentation. IJCV, 135–150 (2007)
Tan, P., Zeng, G., Wang, J., Kang, S.B., Quan, L.: Image-based tree modeling. ACM TOG 87 (2007)
Reche-Martinez, A., Martin, I., Drettakis, G.: Volumetric reconstruction and interactive rendering of trees from photographs. ACM TOG, 720–727 (2004)
Neubert, B., Franken, T., Deussen, O.: Approximate image-based tree-modeling using particle flows. ACM TOG (Proc. of SIGGRAPH) (2007)
Wang, R., Hua, W., Dong, Z., Peng, Q., Bao, H.: Synthesizing trees by plantons. Vis. Comput. 22(4), 238–248 (2006)
Li, C., Deussen, O., Song, Y.Z., Willis, P., Hall, P.: Modeling and generating moving trees from video. ACM Trans. Graph. 30(6), 127:1–127:12 (2011)
Talton, J.O., Lou, Y., Lesser, S., Duke, J., Měch, R., Koltun, V.: Metropolis procedural modeling. ACM Trans. Graph. 30(2), 11:1–11:14 (2011)
Tan, P., Fang, T., Xiao, J., Zhao, P., Quan, L.: Single image tree modeling. ACM SIGGRAPH, 1–7 (2008)
Zeng, J., Zhang, Y., Zhan, S.: 3d tree models reconstruction from a single image. In: ISDA, pp. 445–450 (2006)
Cornea, N.D., Silver, D., Min, P.: Curve-skeleton properties, applications, and algorithms. TVCG, 530–548 (May 2007)
Cornea, N.D., Silver, D., Yuan, X., Balasubramanian, R.: Computing hierarchical curve-skeletons of 3d objects. The Visual Computer (2005)
Yang, X., Bai, X., Yang, X., Liu, W.: An efficient quick thinning algorithm. In: Proceedings of the 2008 Congress on Image and Signal Processing, CISP, vol. 3, pp. 475–478. IEEE Computer Society, Washington, DC (2008)
Bai, X., Latecki, L.J., Society, I.C., Yu Liu, W.: Skeleton pruning by contour partitioning with discrete curve evolution. IEEE Trans. Pattern Anal. Mach. Intell. 29, 449–462 (2007)
Latecki, L.J., Lakämper, R.: Shape similarity measure based on correspondence of visual parts. PAMI, 1185–1190 (2000)
Okabe, M., Owada, S., Igarashi, T.: Interactive design of botanical trees using freehand sketches and example-based editing. Computer Graphics Forum 24(3), 487–496 (2005)
Boudon, F., Pradal, C., Cokelaer, T., Prusinkiewicz, P., Godin, C.: L-py: an l-system simulation framework for modeling plant development based on a dynamic language. Frontiers in Plant Science 3(76) (2012)
Piegl, L., Tiller, W.: The NURBS book, 2nd edn. Springer-Verlag New York, Inc. (1997)
Tu, Z., Chen, X., Yuille, A.L., Zhu, S.C.: Image parsing: Unifying segmentation, detection, and recognition. In: Ponce, J., Hebert, M., Schmid, C., Zisserman, A. (eds.) Toward Category-Level Object Recognition. LNCS, vol. 4170, pp. 545–576. Springer, Heidelberg (2006)
Yuille, A., Kersten, D.: Vision as bayesian inference: Analysis by synthesis? introduction: Perception as inference. Psychology, 1–15 (2006)
Gupta, A., Efros, A.A., Hebert, M.: Blocks world revisited: Image understanding using qualitative geometry and mechanics. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part IV. LNCS, vol. 6314, pp. 482–496. Springer, Heidelberg (2010)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guénard, J., Morin, G., Boudon, F., Charvillat, V. (2014). Realistic Plant Modeling from Images Based on Analysis-by-Synthesis. In: Floater, M., Lyche, T., Mazure, ML., Mørken, K., Schumaker, L.L. (eds) Mathematical Methods for Curves and Surfaces. MMCS 2012. Lecture Notes in Computer Science, vol 8177. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54382-1_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-54382-1_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-54381-4
Online ISBN: 978-3-642-54382-1
eBook Packages: Computer ScienceComputer Science (R0)