Abstract
Texture transfer is a method that copies the texture of a reference image to a target image. This technique has an advantage in that various styles can be expressed according to the reference image, in a single framework. However, in this technique, it is not easy to control the effect of each style. In addition, when this technique is extended to processing video images, maintaining temporal coherence is very difficult. In this paper, we propose an algorithm that transfers the texture of a reference image to a target video while retaining the directionality of the target video. The algorithm maintains the temporal coherency of the transferred texture, and controls the style of the texture transfer.
Similar content being viewed by others
References
Ashikhmin M (2003) Fast texture transfer. IEEE Comput Graph Appl 23(4):38–43. doi:10.1109/MCG.2003.1210863
Bousseau A, Neyret F, Thollot J, Salesin D (2007) Video watercolorization using bidirectional texture advection. ACM Trans Graph 26(3). doi:10.1145/1276377.1276507
De Bonet JS (1997) Multiresolution sampling procedure for analysis and synthesis of texture images. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, SIGGRAPH ’97. ACM Press/Addison-Wesley Publishing Co., New York, pp 361–368. doi:10.1145/258734.258882
Efros AA, Freeman WT (2001) Image quilting for texture synthesis and transfer. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, SIGGRAPH ’01. ACM, New York, pp 341–346. doi:10.1145/383259.383296
Eisenacher C, Lefebvre S, Stamminger M (2008) Texture synthesis from photographs. In: Proceedings of the Eurographics conference. http://www-sop.inria.fr/reves/Basilic/2008/ELS08
Gooch B, Coombe G, Shirley P (2002) Artistic vision: painterly rendering using computer vision techniques. In: NPAR, pp 83–90
Haeberli P (1990) Paint by numbers: abstract image representations. In: Proceedings of the 17th annual conference on computer graphics and interactive techniques, SIGGRAPH ’90. ACM, New York, pp 207–214. doi:10.1145/97879.97902
Hays J, Essa I (2004) Image and video based painterly animation. In: Proceedings of the 3rd international symposium on non-photorealistic animation and rendering, NPAR ’04. ACM, New York, pp 113–120. doi:10.1145/987657.987676
Hertzmann A (1998) Painterly rendering with curved brush strokes of multiple sizes. In: Proceedings of the 25th annual conference on computer graphics and interactive techniques, SIGGRAPH ’98. ACM, New York, pp 453–460. doi:10.1145/280814.280951
Hertzmann A (2003) A survey of stroke based rendering. IEEE Comput Graph Appl 23:70–81
Hertzmann A, Jacobs CE, Oliver N, Curless B, Salesin DH (2001) Image analogies. In: Proceedings of the 28th annual conference on computer graphics and interactive techniques, SIGGRAPH ’01. ACM, New York, pp 327–340. doi:10.1145/383259.383295
Hertzmann A, Perlin K (2000) Painterly rendering for video and interaction. In: Proceedings of the 1st international symposium on non-photorealistic animation and rendering, NPAR ’00. ACM, New York, pp 7–12. doi:10.1145/340916.340917
Kang H, Lee S, Chui CK (2007) Coherent line drawing. In: Proceedings of the 5th international symposium on non-photorealistic animation and rendering, NPAR ’07. ACM, New York, pp 43–50. doi:10.1145/1274871.1274878
Kyprianidis JE, Kang H, Döllner J (2009) Image and video abstraction by anisotropic Kuwahara filtering. Comput Graph Forum 28(7):1955–1963. Special issue on Pacific Graphics 2009
Lee H, Lee C, Yoon K (2009) Motion based painterly rendering. Comput Graph Forum 28(4):1207–1215. http://doi.wiley.com/10.1111/j.1467-8659.2009.01498.x
Lee H, Seo S, Ryoo S, Yoon K (2010) Directional texture transfer. In: Proceedings of the 8th international symposium on non-photorealistic animation and rendering, NPAR ’10. ACM, New York, pp 43–48. doi:10.1145/1809939.1809945
Lefebvre S, Hoppe H (2006) Appearance-space texture synthesis. ACM Trans Graph 25(3):541–548. doi:10.1145/1141911.1141921
Liang L, Liu C, Xu YQ, Guo B, Shum HY (2001) Real-time texture synthesis by patch-based sampling. ACM Trans Graph 20(3):127–150. doi:10.1145/501786.501787
Litwinowicz P (1997) Processing images and video for an impressionist effect. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, SIGGRAPH ’97. ACM Press/Addison-Wesley Publishing Co., New York, pp 407–414. doi:10.1145/258734.258893
Salisbury MP, Wong MT, Hughes JF, Salesin DH (1997) Orientable textures for image-based pen-and-ink illustration. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, SIGGRAPH ’97. ACM Press/Addison-Wesley Publishing Co., New York, pp 401–406. doi:10.1145/258734.258890
Sand P, Teller S (2008) Particle video: long-range motion estimation using point trajectories. Int J Comput Vision 80(1):72–91. doi:10.1007/s11263-008-0136-6
Wang B, Wang W, Yang H, Sun J (2004) Efficient example-based painting and synthesis of 2d directional texture. IEEE Trans Vis Comput Graph 10(3):266–277. doi:10.1109/TVCG.2004.1272726
Wang J, Bhat P, Colburn RA, Agrawala M, Cohen MF (2005) Interactive video cutout. ACM Trans Graph 24(3):585–594. doi:10.1145/1073204.1073233
Wang J, Xu Y, Shum HY, Cohen MF (2004) Video tooning. ACM Trans Graph 23(3):574–583. doi:10.1145/1015706.1015763
Ye N, Sim T, Miao X (2010) Video stylization by single image example. In: Proceedings of ICIP’10, pp 3993–3996
Acknowledgments
This work (Grants No. C0004960) was supported by Business for Cooperative R & D between Industry, Academy, and Research Institute funded Korea Small and Medium Business Administration in 2013.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kang, D., Kong, P., Yoon, K. et al. Directional texture transfer for video. Multimed Tools Appl 74, 245–258 (2015). https://doi.org/10.1007/s11042-013-1759-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1759-3