Abstract
This article introduces a new model for patch-based texture synthesis that controls the distribution of patches in the synthesized texture. The proposed approach relies on an optimal assignment of patches over decimated pixel grids. This assignment problem formulates the synthesis as the minimization of a discrepancy measure between input’s and output’s patches through their optimal permutation. The resulting non-convex optimization problem is addressed with an iterative algorithm alternating between a patch assignment step and a patch aggregation step. We show that this model statistically constrains the output texture content, while inheriting the structure-preserving property of patch-based methods. We also propose a relaxed patch assignment extension that increases the robustness to non-stationnary textures.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Aguerrebere, C., Gousseau, Y., Tartavel, G.: Exemplar-based texture synthesis: the Efros-Leung algorithm. IPOL 3, 223–241 (2013)
Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B., Patchmatch: A randomized correspondence algorithm for structural image editing. In: SIGGRAPH, pp. 24:1–24:11. ACM (2009)
Bougleux, S., Brun, L.: Linear sum assignment with edition. preprint, arXiv:1603.04380 (2016)
Burkard, R., Dell’Amico, M., Martello, S.: Assignment Problems. Society for Industrial and Applied Mathematics, Philadelphia (2012)
Combettes, P.L., Pesquet, J.C.: A Douglas rachford splitting approach to nonsmooth convex variational signal recovery. IEEE J. Sel. Top. Signal Process. 1(4), 564–574 (2007)
De Bonet, J.S.: Multiresolution sampling procedure for analysis and synthesis of texture images. In: SIGGRAPH, pp. 361–368. ACM (1997)
Efros, A.A., Freeman, W.T.: Image quilting for texture synthesis and transfer. In: SIGGRAPH, pp. 341–346. ACM (2001)
Efros, A.A., Leung, T.K.: Texture synthesis by non-parametric sampling. In: IEEE International Conference on Computer Vision, pp. 1033–1038 (1999)
Ferradans, S., Papadakis, N., Rabin, J., Peyré, G., Aujol, J.-F.: Regularized discrete optimal transport. In: Kuijper, A., Bredies, K., Pock, T., Bischof, H. (eds.) SSVM 2013. LNCS, vol. 7893, pp. 428–439. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38267-3_36
Galerne, B., Gousseau, Y., Morel, J.-M.: Random phase textures: theory and synthesis. IEEE Trans. Image Process. 20(1), 257–267 (2011)
Gatys, L., Ecker, A.S., Bethge, M.: Texture synthesis using convolutional neural networks. In: NIPS, pp. 262–270 (2015)
G’MIC: Greyc’s magic for image computing (2016). http://gmic.eu/
Han, J., Zhou, K., Wei, L.-Y., Gong, M., Bao, H., Zhang, X., Guo, B.: Fast example-based surface texture synthesis via discrete optimization. Vis. Comput. 22(9), 918–925 (2006)
Heeger, D.J., Bergen, J.R.: Pyramid-based texture analysis/synthesis. In: SIGGRAPH, pp. 229–238. ACM (1995)
Julesz, B.: Textons, the elements of texture perception, and their interactions. Nature 290(5802), 91–97 (1981)
Julesz, B., Gilbert, E.N., Victor, J.D.: Visual discrimination of textures with identical third-order statistics. Biol. Cybern. 31(3), 137–140 (1978)
Kopf, J., Fu, C.-W., Cohen-Or, D., Deussen, O., Lischinski, D., Wong, T.-T.: Solid texture synthesis from 2d exemplars. In: SIGGRAPH. ACM (2007)
Kwatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: image and video synthesis using graph cuts. In: SIGGRAPH, pp. 277–286. ACM (2003)
Kwatra, V., Essa, I., Bobick, A., Kwatra, N.: Texture optimization for example-based synthesis. In: SIGGRAPH, pp. 795–802. ACM (2005)
Lefebvre, S., Hoppe, H.: Parallel controllable texture synthesis. In: SIGGRAPH, pp. 777–786. ACM (2005)
Liang, L., Liu, C., Xu, Y.-Q., Guo, B., Shum, H.-Y.: Real-time texture synthesis by patch-based sampling. ACM Trans. Graph. 20(3), 127–150 (2001)
Portilla, J., Simoncelli, E.P.: A parametric texture model based on joint statistics of complex wavelet coefficients. Int. J. Comput. Vision 40(1), 49–71 (2000)
Raad, L., Galerne, B.: Efros and Freeman image quilting algorithm for texture synthesis. In: IPOL (2016)
Rabin, J., Ferradans, S., Papadakis, N.: Adaptive color transfer with relaxed optimal transport. In: IEEE ICIP, pp. 4852–4856 (2014)
Rabin, J., Peyré, G.: Wasserstein regularization of imaging problem. In: IEEE ICIP, pp. 1541–1544 (2011)
Rabin, J., Peyré, G., Delon, J., Bernot, M.: Wasserstein barycenter and its application to texture mixing. In: Bruckstein, A.M., Haar Romeny, B.M., Bronstein, A.M., Bronstein, M.M. (eds.) SSVM 2011. LNCS, vol. 6667, pp. 435–446. Springer, Heidelberg (2012). doi:10.1007/978-3-642-24785-9_37
Tartavel, G., Gousseau, Y., Peyré, G.: Constrained sparse texture synthesis. In: Kuijper, A., Bredies, K., Pock, T., Bischof, H. (eds.) SSVM 2013. LNCS, vol. 7893, pp. 186–197. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38267-3_16
Tartavel, G., Gousseau, Y., Peyré, G.: Variational texture synthesis with sparsity and spectrum constraints. JMIV 52(1), 124–144 (2015)
Vasconcelos, C.N., Rosenhahn, B.: Bipartite graph matching computation on GPU. In: Cremers, D., Boykov, Y., Blake, A., Schmidt, F.R. (eds.) EMMCVPR 2009. LNCS, vol. 5681, pp. 42–55. Springer, Heidelberg (2009). doi:10.1007/978-3-642-03641-5_4
Wei, L.-Y., Lefebvre, S., Kwatra, V., Turk, G.: State of the art in example-based texture synthesis. In: Eurographics - State of the Art Reports (2009)
Wei, L.Y., Levoy, M.: Fast texture synthesis using tree-structured vector quantization. In: SIGGRAPH, pp. 479–488. ACM (2000)
Xia, G.-S., Ferradans, S., Peyré, G., Aujol, J.-F.: Synthesizing and mixing stationary Gaussian texture models. SIAM J. Imaging Sci. 8(1), 476–508 (2014)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Gutierrez, J., Rabin, J., Galerne, B., Hurtut, T. (2017). Optimal Patch Assignment for Statistically Constrained Texture Synthesis. In: Lauze, F., Dong, Y., Dahl, A. (eds) Scale Space and Variational Methods in Computer Vision. SSVM 2017. Lecture Notes in Computer Science(), vol 10302. Springer, Cham. https://doi.org/10.1007/978-3-319-58771-4_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-58771-4_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-58770-7
Online ISBN: 978-3-319-58771-4
eBook Packages: Computer ScienceComputer Science (R0)