Multimedia Tools and Applications

, Volume 75, Issue 18, pp 11555–11576 | Cite as

Integrated model/scene construction through context-based search, data-driven suggestion and component replacement

  • Po-An Chen
  • Chuan-Kai Yang


In recent years, 3D scene construction has become increasingly popular in movies and games. However, it is without doubt that the involved effort is significant, and therefore how to simplify such a process has drawn the attentions from many researchers. More specifically, the construction of a 3D scene consists of two parts: the creation of 3D objects, and their deployment. In general, one possible and popular solution is to reuse previous 3D scene construction results. In this regard, there are least two types of approaches. The first type of approaches places more emphasis on the spatial relationships. In particular, by placing a query box in the current scene and comparing its relationships with other objects under the current scene, a desired object in a previous scene can be retrieved if it shares a similar configuration. However, inappropriate representations of previous spatial relationships may lead to ambiguous or superfluous retrieval results. The second type of approaches focuses on the generation of a single object. A method of such could either start from an initial model and gradually evolve into a more complex/specific one by selecting a similar model in the database, or directly synthesize a new model by a combination of more than one model from the database. This paper proposes a framework that not only integrates the two types of approaches just mentioned, but also unifies the previous two different ways for model construction. In addition, the representation of spatial relationships is further refined so that more desired retrieval results can be obtained, together with a meaningful object class scheme to facilitate the involved interaction for model construction.


Scene construction Context-based search Data-driven suggestions Component replacement Model segmentation 



This work was supported in part by the National Science Council of Taiwan under the grant NSC 101-2221-E-011-150-MY3.


  1. 1.
    Bentley JL (1975) Multidimensional binary search trees used for associative searching. Commun ACM 18(9):509–517MathSciNetCrossRefMATHGoogle Scholar
  2. 2.
    Chaudhuri S, Koltun V (2010) Data-driven suggestions for creativity support in 3d modeling. ACM Trans Graph 29(6):183:1–183:10CrossRefGoogle Scholar
  3. 3.
    Chen D-Y, Tian X-P, Shen Y-T, Ouhyoung M (2003) On visual similarity based 3d model retrieval. Computer Graphics Forum (EUROGRAPHICS) 22(3):223–232CrossRefGoogle Scholar
  4. 4.
    Chen X, Golovinskiy A, Funkhouser T (2009) A benchmark for 3D mesh segmentation. ACM Trans Graph (Proc SIGGRAPH) 28(3)Google Scholar
  5. 5.
    Eitz M, Richter R, Boubekeur T, Hildebrand K, Alexa M (2012) Sketch-based shape retrieval. ACM Trans Graph 31(4):31:1–31:10Google Scholar
  6. 6.
    Fisher M, Hanrahan P (2010) Context-based search for 3d models. ACM Trans Graph 29(6):182:10–182:10CrossRefGoogle Scholar
  7. 7.
    Fisher M, Savva M, Hanrahan P (2011) Characterizing structural relationships in scenes using graph kernels. ACM Trans Graph 30(4):34:1–34:12CrossRefGoogle Scholar
  8. 8.
    Fu H, Cohen-Or D, Dror G, Sheffer A (2008) Upright orientation of man-made objects. ACM Trans Graph 27(3):42:1–42:7CrossRefGoogle Scholar
  9. 9.
    Funkhouser T, Kazhdan M, Shilane P, Min P, Kiefer W, Tal A, Rusinkiewicz S, Dobkin D (2004) Modeling by example. ACM Trans Graph 23 (3):652–663CrossRefGoogle Scholar
  10. 10.
    Huang S-S, Shamir A, Shen C-H, Zhang H, Sheffer A, Hu S-M, Cohen-Or D (2013) Qualitative organization of collections of shapes via quartet analysis. ACM Trans Graph (Proceedings of SIGGRAPH 2013) 32(4)Google Scholar
  11. 11.
    Jain A, Thormählen T, Ritschel T, Seidel H-P (2012) Exploring shape variations by 3d-model decomposition and part-based recombination. Comp Graph Forum 31(2pt3):631–640Google Scholar
  12. 12.
    Jeannin S, Cieplinski L, Ohim JR, Kim M (2000) Mpeg-7 visual part of experimentation model version 7.0. In: ISO/IEC JTC1/SC29/WG11/N3521, Beijing, ChinaGoogle Scholar
  13. 13.
    Kalogerakis E, Chaudhuri S, Koller D, Koltun V (2012) A probabilistic model for component-based shape synthesis. ACM Trans Graph 31(4):55:1–55:11CrossRefGoogle Scholar
  14. 14.
    Kim VG, Li W, Mitra NJ, DiVerdi S, Funkhouser T (2012) Exploring collections of 3d models using fuzzy correspondences. ACM Trans Graph 31(4):54:1–54:11Google Scholar
  15. 15.
    Li C, Ben Hamza A (2013) A multiresolution descriptor for deformable 3d shape retrieval. Vis Comput 29(6-8):513–524CrossRefGoogle Scholar
  16. 16.
    Lian Z, Godil A, Sun X (2010) Visual similarity based 3d shape retrieval using bag-of-features. In: Proceedings of the 2010 Shape Modeling International Conference, SMI ’10. IEEE Computer Society, Washington, pp 25–36Google Scholar
  17. 17.
    Lien J-M, Amato NM (2007) Approximate convex decomposition of polyhedra. In: Proceedings of the 2007 ACM symposium on Solid and physical modeling, SPM ’07. ACM, New York, pp 121–131Google Scholar
  18. 18.
    Liu Y-J, Zheng Y-F, Lv L, Xuan Y-M, Fu X-L (2012) 3d model retrieval based on color + geometry signatures. Vis Comput 28(1):75–86CrossRefGoogle Scholar
  19. 19.
    Mohamed W, Hamza AB (2012) Reeb graph path dissimilarity for 3d object matching and retrieval. Vis Comput 28(3):305–318CrossRefGoogle Scholar
  20. 20.
    Shalom S, Shapira L, Shamir A, Cohen-Or D (2008) Part analogies in sets of objects. In: Proceedings of the 1st Eurographics conference on 3D Object Retrieval, EG 3DOR’08. Eurographics Association, Aire-la-Ville, pp 33–40Google Scholar
  21. 21.
    Shapira L, Shalom S, Shamir A, Cohen-Or D, Zhang H (2010) Contextual part analogies in 3d objects. Int J Comput Vision 89(2-3):309–326CrossRefGoogle Scholar
  22. 22.
    Shapira L, Shamir A, Cohen-Or D (2008) Consistent mesh partitioning and skeletonisation using the shape diameter function. Vis Comput 24(4):249–259CrossRefGoogle Scholar
  23. 23.
    Shen C-H, Fu H, Chen K, Hu S-M (2012) Structure recovery by part assembly. ACM Trans Graph 31(6):180:1–180:11CrossRefGoogle Scholar
  24. 24.
    Tangelder JW, Veltkamp RC (2008) A survey of content based 3d shape retrieval methods. Multimedia Tools Appl 39(3):441–471CrossRefGoogle Scholar
  25. 25.
    Xu K, Chen K, Fu H, Sun W-L, Hu S-M (2013) Sketch2scene: sketch-based co-retrieval and co-placement of 3d models. ACM Trans Graph 32(4):123:1–123:15CrossRefGoogle Scholar
  26. 26.
    Zhang Z (1994) Iterative point matching for registration of free-form curves and surfaces. Int J Comput Vision 13(2):119–152CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  1. 1.Department of Information ManagementNational Taiwan University of Science and TechnologyTaipeiTaiwan

Personalised recommendations