Skip to main content
SpringerLink
Log in

Fast Spatially Controllable Multi-dimensional Exemplar-Based Texture Synthesis and Morphing

  • Conference paper
Computer Vision, Imaging and Computer Graphics. Theory and Applications (VISIGRAPP 2009)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 68))

Abstract

Texture synthesis and morphing are important techniques for efficiently creating realistic textures used in scientific and entertainment applications. In this paper we present a novel fast algorithm for multi-dimensional texture synthesis and morphing that is especially suitable for parallel architectures such as GPUs or direct volume rendering (DVR) hardware. Our proposed solution generalizes the synthesis process to support higher than three-dimensional synthesis and morphing.

We introduce several improvements to previous 2D synthesis algorithms, such as new appearance space attributes and an improved jitter function. We then modify the synthesis algorithm to use it for texture morphing which can be applied to arbitrary many 2D input textures and can be spatially controlled using weight maps. Our results suggest that the algorithm produces higher quality textures than alternative algorithms with similar speed. Compared to higher quality texture synthesis algorithms, our solution is considerably faster and allows the synthesis of additional channels, such as transparencies and displacement maps, without affecting the running time of the synthesis at all. The method is easily extended to allow fast 3D synthesis and we show several novel examples and applications for morphed solid 3D textures.

Overall the presented technique provides an excellent trade-off between speed and quality, is highly flexible, allows the use of arbitrary channels, can be extended to arbitrary dimensions, is suitable for a GPU-implementation, and can be effectively integrated into rendering frameworks such as DVR tools.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Ashikhmin, M.: Synthesizing natural textures. In: Proceedings of I3D 2001, pp. 217–226. ACM Press, New York (2001)

    Google Scholar 

  2. Bar-Joseph, Z., El-Yaniv, R., Lischinski, D., Werman, M.: Texture mixing and texture movie synthesis using statistical learning. IEEE Transactions on Visualization and Computer Graphics 7(2), 120–135 (2001)

    Article  Google Scholar 

  3. De Bonet, J.S.: Multiresolution sampling procedure for analysis and synthesis of texture images. In: Proceedings of SIGGRAPH 1997, pp. 361–368. ACM Press, New York (1997)

    Chapter  Google Scholar 

  4. Dischler, J.-M., Ghazanfarpour, D., Freydier, R.: Anisotropic solid texture synthesis using orthogonal 2d views. Computer Graphics Forum 17(3), 87–95 (1998)

    Article  Google Scholar 

  5. Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: Proceedings of SIGGRAPH 2001, pp. 341–346. ACM Press, New York (2001)

    Chapter  Google Scholar 

  6. Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: Proceedings of ICCV 1999, pp. 1033–1038. IEEE Computer Society, Los Alamitos (1999)

    Google Scholar 

  7. Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: Proceedings of SIGGRAPH 1995, pp. 229–238. ACM Press, New York (1995)

    Chapter  Google Scholar 

  8. Intel® Corporation. Open Source Computer Vision Library, http://sourceforge.net/projects/opencvlibrary/ [checked: 07/24/2009]

  9. Jagnow, R., Dorsey, J., Rushmeier, H.: Stereological techniques for solid textures. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2004) 23(3), 329–335 (2004)

    Article  Google Scholar 

  10. Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., Wong, T.-T.: Solid texture synthesis from 2d exemplars. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26(3), 2.1–2.9 (2007)

    Google Scholar 

  11. Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. ACM Transactions on Graphics (SIGGRAPH 2005) 24(3), 795–802 (2005)

    Article  Google Scholar 

  12. Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2003) 22(3), 277–286 (2003)

    Google Scholar 

  13. Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2005) 24(3), 777–786 (2005)

    Google Scholar 

  14. Lefebvre, S., Hoppe, H.: Appearance-space texture synthesis. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006) 25(3), 541–548 (2006)

    Google Scholar 

  15. Liu, Z., Liu, C., Shum, H.-Y., Yu, Y.: Pattern-based texture metamorphosis. In: Proceedings of Pacific Graphics 2002, p. 184. IEEE Computer Society, Los Alamitos (2002)

    Google Scholar 

  16. Manke, F.: Texture-enhanced direct volume rendering, MSc thesis, Dept. of Computer Science, University of Auckland, New Zealand (July 2008)

    Google Scholar 

  17. Manke, F., Wünsche, B.: Texture-enhanced direct volume rendering. In: Proceedings of GRAPP 2009, Lisbon, Portugal, pp. 185–190 (2009)

    Google Scholar 

  18. Matusik, W., Zwicker, M., Durand, F.: Texture design using a simplicial complex of morphable textures. ACM Trans. on Graphics (SIGGRAPH 2005) 24(3), 787–794 (2005)

    Article  Google Scholar 

  19. Perlin, K.: An image synthesizer. In: Proc. of SIGGRAPH 1985, pp. 287–296. ACM Press, New York (1985)

    Chapter  Google Scholar 

  20. Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. Journal of Computer Vision 40(1), 49–70 (2000)

    Article  MATH  Google Scholar 

  21. Praun, E., Finkelstein, A., Hoppe, H.: Lapped textures. In: Proceedings of SIGGRAPH 2000, pp. 465–470. ACM Press, New York (2000)

    Chapter  Google Scholar 

  22. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., Shum, H.-Y.: Synthesis of bidirectional texture functions on arbitrary surfaces. In: Proceedings of SIGGRAPH 2002, pp. 665–672. ACM Press, New York (2002)

    Chapter  Google Scholar 

  23. Tonietto, L., Walter, M.: Texture metamorphosis driven by texton masks. Computers & Graphics 29(5), 697–703 (2005)

    Article  Google Scholar 

  24. Turk, G.: Generating textures on arbitrary surfaces using reaction-diffusion. In: Proceedings of SIGGRAPH 1991, pp. 289–298. ACM Press, New York (1991)

    Chapter  Google Scholar 

  25. Wei, L.-Y.: Texture Synthesis by Fixed Neighborhood Searching. PhD thesis, Stanford University (2002)

    Google Scholar 

  26. Wei, L.-Y.: Texture synthesis from multiple sources. In: SIGGRAPH 2003: ACM SIGGRAPH 2003 Sketches & Applications, p. 1. ACM Press, New York (2003)

    Google Scholar 

  27. Wei, L.-Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: Proceedings of SIGGRAPH 2000, pp. 479–488. ACM Press, New York (2000)

    Chapter  Google Scholar 

  28. Witkin, A., Kass, M.: Reaction-diffusion textures. SIGGRAPH Computer Graphics 25(4), 299–308 (1991)

    Article  Google Scholar 

  29. Worley, S.: A cellular texture basis function. In: Proceedings of SIGGRAPH 1996, pp. 291–294. ACM Press, New York (1996)

    Chapter  Google Scholar 

  30. Zhang, J., Zhou, K., Velho, L., Guo, B., Shum, H.-Y.: Synthesis of progressively-variant textures on arbitrary surfaces. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2003) 22(3), 295–302 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept. of Computer Science, Graphics Group, University of Auckland, Private Bag 92019, Auckland, New Zealand

    Felix Manke & Burkhard Wünsche

Authors
  1. Felix Manke
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Burkhard Wünsche
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. INSTICC, Avenida D. Manuel I, 2910, Setúbal, Portugal

    AlpeshKumar Ranchordas

  2. Departamento de Engenharia Informática, Instituto Superior Técnico, Av. Rovisco Pais, 1049-001, Lisboa, Portugal,

    João Madeiras Pereira

  3. Institute for Systems and Robotics, Department of Electrical and Computer Engineering Polo II, University of Coimbra, 3030-290, Coimbra, Portugal

    Hélder J. Araújo

  4. Departamento de Engenharia Mecânica e Gestão Industrial, Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal

    João Manuel R. S. Tavares

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Manke, F., Wünsche, B. (2010). Fast Spatially Controllable Multi-dimensional Exemplar-Based Texture Synthesis and Morphing. In: Ranchordas, A., Pereira, J.M., Araújo, H.J., Tavares, J.M.R.S. (eds) Computer Vision, Imaging and Computer Graphics. Theory and Applications. VISIGRAPP 2009. Communications in Computer and Information Science, vol 68. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11840-1_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-11840-1_2

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-11839-5

  • Online ISBN: 978-3-642-11840-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation