Skip to main content
SpringerLink
Log in

Integrated model/scene construction through context-based search, data-driven suggestion and component replacement

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years, 3D scene construction has become increasingly popular in movies and games. However, it is without doubt that the involved effort is significant, and therefore how to simplify such a process has drawn the attentions from many researchers. More specifically, the construction of a 3D scene consists of two parts: the creation of 3D objects, and their deployment. In general, one possible and popular solution is to reuse previous 3D scene construction results. In this regard, there are least two types of approaches. The first type of approaches places more emphasis on the spatial relationships. In particular, by placing a query box in the current scene and comparing its relationships with other objects under the current scene, a desired object in a previous scene can be retrieved if it shares a similar configuration. However, inappropriate representations of previous spatial relationships may lead to ambiguous or superfluous retrieval results. The second type of approaches focuses on the generation of a single object. A method of such could either start from an initial model and gradually evolve into a more complex/specific one by selecting a similar model in the database, or directly synthesize a new model by a combination of more than one model from the database. This paper proposes a framework that not only integrates the two types of approaches just mentioned, but also unifies the previous two different ways for model construction. In addition, the representation of spatial relationships is further refined so that more desired retrieval results can be obtained, together with a meaningful object class scheme to facilitate the involved interaction for model construction.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Bentley JL (1975) Multidimensional binary search trees used for associative searching. Commun ACM 18(9):509–517

    Article  MathSciNet  MATH  Google Scholar 

  2. Chaudhuri S, Koltun V (2010) Data-driven suggestions for creativity support in 3d modeling. ACM Trans Graph 29(6):183:1–183:10

    Article  Google Scholar 

  3. Chen D-Y, Tian X-P, Shen Y-T, Ouhyoung M (2003) On visual similarity based 3d model retrieval. Computer Graphics Forum (EUROGRAPHICS) 22(3):223–232

    Article  Google Scholar 

  4. Chen X, Golovinskiy A, Funkhouser T (2009) A benchmark for 3D mesh segmentation. ACM Trans Graph (Proc SIGGRAPH) 28(3)

  5. Eitz M, Richter R, Boubekeur T, Hildebrand K, Alexa M (2012) Sketch-based shape retrieval. ACM Trans Graph 31(4):31:1–31:10

    Google Scholar 

  6. Fisher M, Hanrahan P (2010) Context-based search for 3d models. ACM Trans Graph 29(6):182:10–182:10

    Article  Google Scholar 

  7. Fisher M, Savva M, Hanrahan P (2011) Characterizing structural relationships in scenes using graph kernels. ACM Trans Graph 30(4):34:1–34:12

    Article  Google Scholar 

  8. Fu H, Cohen-Or D, Dror G, Sheffer A (2008) Upright orientation of man-made objects. ACM Trans Graph 27(3):42:1–42:7

    Article  Google Scholar 

  9. Funkhouser T, Kazhdan M, Shilane P, Min P, Kiefer W, Tal A, Rusinkiewicz S, Dobkin D (2004) Modeling by example. ACM Trans Graph 23 (3):652–663

    Article  Google Scholar 

  10. Huang S-S, Shamir A, Shen C-H, Zhang H, Sheffer A, Hu S-M, Cohen-Or D (2013) Qualitative organization of collections of shapes via quartet analysis. ACM Trans Graph (Proceedings of SIGGRAPH 2013) 32(4)

  11. Jain A, Thormählen T, Ritschel T, Seidel H-P (2012) Exploring shape variations by 3d-model decomposition and part-based recombination. Comp Graph Forum 31(2pt3):631–640

  12. Jeannin S, Cieplinski L, Ohim JR, Kim M (2000) Mpeg-7 visual part of experimentation model version 7.0. In: ISO/IEC JTC1/SC29/WG11/N3521, Beijing, China

  13. Kalogerakis E, Chaudhuri S, Koller D, Koltun V (2012) A probabilistic model for component-based shape synthesis. ACM Trans Graph 31(4):55:1–55:11

    Article  Google Scholar 

  14. Kim VG, Li W, Mitra NJ, DiVerdi S, Funkhouser T (2012) Exploring collections of 3d models using fuzzy correspondences. ACM Trans Graph 31(4):54:1–54:11

    Google Scholar 

  15. Li C, Ben Hamza A (2013) A multiresolution descriptor for deformable 3d shape retrieval. Vis Comput 29(6-8):513–524

    Article  Google Scholar 

  16. Lian Z, Godil A, Sun X (2010) Visual similarity based 3d shape retrieval using bag-of-features. In: Proceedings of the 2010 Shape Modeling International Conference, SMI ’10. IEEE Computer Society, Washington, pp 25–36

  17. Lien J-M, Amato NM (2007) Approximate convex decomposition of polyhedra. In: Proceedings of the 2007 ACM symposium on Solid and physical modeling, SPM ’07. ACM, New York, pp 121–131

  18. Liu Y-J, Zheng Y-F, Lv L, Xuan Y-M, Fu X-L (2012) 3d model retrieval based on color + geometry signatures. Vis Comput 28(1):75–86

    Article  Google Scholar 

  19. Mohamed W, Hamza AB (2012) Reeb graph path dissimilarity for 3d object matching and retrieval. Vis Comput 28(3):305–318

    Article  Google Scholar 

  20. Shalom S, Shapira L, Shamir A, Cohen-Or D (2008) Part analogies in sets of objects. In: Proceedings of the 1st Eurographics conference on 3D Object Retrieval, EG 3DOR’08. Eurographics Association, Aire-la-Ville, pp 33–40

  21. Shapira L, Shalom S, Shamir A, Cohen-Or D, Zhang H (2010) Contextual part analogies in 3d objects. Int J Comput Vision 89(2-3):309–326

    Article  Google Scholar 

  22. Shapira L, Shamir A, Cohen-Or D (2008) Consistent mesh partitioning and skeletonisation using the shape diameter function. Vis Comput 24(4):249–259

    Article  Google Scholar 

  23. Shen C-H, Fu H, Chen K, Hu S-M (2012) Structure recovery by part assembly. ACM Trans Graph 31(6):180:1–180:11

    Article  Google Scholar 

  24. Tangelder JW, Veltkamp RC (2008) A survey of content based 3d shape retrieval methods. Multimedia Tools Appl 39(3):441–471

    Article  Google Scholar 

  25. Xu K, Chen K, Fu H, Sun W-L, Hu S-M (2013) Sketch2scene: sketch-based co-retrieval and co-placement of 3d models. ACM Trans Graph 32(4):123:1–123:15

    Article  Google Scholar 

  26. Zhang Z (1994) Iterative point matching for registration of free-form curves and surfaces. Int J Comput Vision 13(2):119–152

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported in part by the National Science Council of Taiwan under the grant NSC 101-2221-E-011-150-MY3.

Author information

Authors and Affiliations

  1. Department of Information Management, National Taiwan University of Science and Technology, No. 43, Sec. 4, Keelung Road, Taipei, 106, Taiwan

    Po-An Chen & Chuan-Kai Yang

Authors
  1. Po-An Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chuan-Kai Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chuan-Kai Yang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, PA., Yang, CK. Integrated model/scene construction through context-based search, data-driven suggestion and component replacement. Multimed Tools Appl 75, 11555–11576 (2016). https://doi.org/10.1007/s11042-015-2884-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2884-y

Keywords

Search

Navigation