Abstract
Mature computer vision techniques allow the reconstruction of challenging 3D objects from images. However, due to high complexity of plant topology, dedicated methods for generating 3D plant models must be devised. We propose to generate a 3D model of a plant, using an analysis-by-synthesis method mixing information from a single image and a priori knowledge of the plant species.
First, our dedicated skeletonisation algorithm generates a possible branching structure from the foliage segmentation. Then, a 3D generative model, based on a parametric model of branching systems that takes into account botanical knowledge is built. The resulting skeleton follows the hierarchical organisation of natural branching structures. An instance of a 3D model can be generated. Moreover, varying parameter values of the generative model (main branching structure of the plant and foliage), we produce a series of candidate models. The reconstruction is improved by selecting the model among these proposals based on a matching criterion with the image. Realistic results obtained on different species of plants illustrate the performance of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Prusinkiewicz, P., Lindenmayer, A.: The algorithmic beauty of plants. Springer (1990)
Lindenmayer, A.: Mathematical models for cellular interaction in development: Parts i and ii. Journal of Theoretical Biology 18 (1968)
Weber, J., Penn, J.: Creation and rendering of realistic trees. In: SIGGRAPH, pp. 119–128. ACM (1995)
Deussen, O., Lintermann, B.: Digital Design of Nature: Computer Generated Plants and Organics. Springer (2005)
de Reffye, P., Edelin, C., Françon, J., Jaeger, M., Puech, C.: Plant models faithful to botanical structure and development. In: SIGGRAPH, pp. 151–158. ACM (1988)
Chaubert-Pereira, F., Guédon, Y., Lavergne, C., Trottier, C.: Markov and semi-markov switching linear mixed models used to identify forest tree growth components. Biometrics (2009)
Palubicki, W., Horel, K., Longay, S., Runions, A., Lane, B., Měch, R., Prusinkiewicz, P.: Self-organizing tree models for image synthesis. In: SIGGRAPH, pp. 1–10 (2009)
Quan, L.: Image-based Plant Modeling. Springer (2010)
Shlyakhter, I., Rozenoer, M., Dorsey, J., Teller, S.: Reconstructing 3d tree models from instrumented photographs. IEEE Comput. Graph. Appl., 53–61 (2001)
Quan, L., Tan, P., Zeng, G., Yuan, L., Wang, J., Kang, S.B.: Image-based plant modeling. ACM TOG, 599–604 (2006)
Quan, L., Wang, J., Tan, P., Yuan, L.: Image-based modeling by joint segmentation. IJCV, 135–150 (2007)
Tan, P., Zeng, G., Wang, J., Kang, S.B., Quan, L.: Image-based tree modeling. ACM TOG, 87 (2007)
Reche-Martinez, A., Martin, I., Drettakis, G.: Volumetric reconstruction and interactive rendering of trees from photographs. ACM TOG, 720–727 (2004)
Neubert, B., Franken, T., Deussen, O.: Approximate image-based tree-modeling using particle flows. ACM TOG (Proc. of SIGGRAPH) (2007)
Wang, R., Hua, W., Dong, Z., Peng, Q., Bao, H.: Synthesizing trees by plantons. Vis. Comput. 22, 238–248 (2006)
Li, C., Deussen, O., Song, Y.Z., Willis, P., Hall, P.: Modeling and generating moving trees from video. ACM Trans. Graph. 30, 127:1–127:12 (2011)
Talton, J.O., Lou, Y., Lesser, S., Duke, J., Měch, R., Koltun, V.: Metropolis procedural modeling. ACM Trans. Graph. 30, 11:1–11:14 (2011)
Tan, P., Fang, T., Xiao, J., Zhao, P., Quan, L.: Single image tree modeling. ACM SIGGRAPH, 1–7 (2008)
Zeng, J., Zhang, Y., Zhan, S.: 3d tree models reconstruction from a single image. In: ISDA, pp. 445–450 (2006)
Cornea, N.D., Silver, D., Min, P.: Curve-skeleton properties, applications, and algorithms. In: TVCG, pp. 530–548 (2007)
Cornea, N.D., Silver, D., Yuan, X., Balasubramanian, R.: Computing hierarchical curve-skeletons of 3d objects. The Visual Computer (2005)
Latecki, L.J., Lakmper, R.: Shape similarity measure based on correspondence of visual parts. PAMI, 1185–1190 (2000)
Okabe, M., Owada, S., Igarashi, T.: Interactive design of botanical trees using freehand sketches and example-based editing. Comp. Graph. Forum, 487–496 (2005)
Boudon, F., Pradal, C., Cokelaer, T., Prusinkiewicz, P., Godin, C.: L-py: an l-system simulation framework for modeling plant development based on a dynamic language. Frontiers in Plant Science 3 (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Guénard, J., Morin, G., Boudon, F., Charvillat, V. (2013). Reconstructing Plants in 3D from a Single Image Using Analysis-by-Synthesis. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2013. Lecture Notes in Computer Science, vol 8033. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41914-0_32
Download citation
DOI: https://doi.org/10.1007/978-3-642-41914-0_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41913-3
Online ISBN: 978-3-642-41914-0
eBook Packages: Computer ScienceComputer Science (R0)