Abstract
In contrast to photorealistic rendering, where richer colours are likely to be preferred, non-photorealistic rendering can often benefit from some abstraction, and colour palette reduction is one direction. By using a small number of carefully selected colours the overall tonal distribution can be well expressed with less visual clutter. This is also essential to simulate certain art forms, such as cartoons, comics, paper-cuts, woodblock printing, etc. that naturally prefer or require reduced palettes. In this chapter we will summarise major techniques used in colour palette reduction, such as region segmentation, thresholding and colour palette selection. Most approaches consider images as input and generate stylised image renderings while some work also considers video stylisation, in which case temporal coherence is essential. We finish this chapter with some discussions of potential future directions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Many cartoon effect filters are available for GIMP—we have used CarTOONize by Joe1GK.
References
Agarwala, A., Hertzmann, A., Salesin, D., Seitz, S.M.: Keyframe-based tracking for rotoscoping and animation. ACM Trans. Graph. 23(3), 584–591 (2004)
Barash, D., Comaniciu, D.: A common framework for nonlinear diffusion, adaptive smoothing, bilateral filtering and mean shift. Image Vis. Comput. 22(1), 73–81 (2004)
Boykov, Y., Kolmogorov, V.: An experimental comparison of min-cut/max-flow algorithms for energy minimisation in vision. IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)
Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8, 679–698 (1986)
Cohen-Or, D., Sorkine, O., Gal, R., Leyvand, T., Xu, Y.Q.: Color harmonization. ACM Trans. Graph. 25(3), 624–630 (2006)
Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)
DeCarlo, D., Santella, A.: Stylization and abstraction of photographs. ACM Trans. Graph. 21(3), 769–776 (2002)
Felzenszwalb, P.F., Huttenlocher, D.P.: Efficient graph-based image segmentation. Int. J. Comput. Vis. 59(2), 167–181 (2004)
Gooch, B., Reinhard, E., Gooch, A.: Human facial illustrations: creation and psychophysical evaluation. ACM Trans. Graph. 23(1), 27–44 (2004)
Gooch, A.A., Olsen, S.C., Tumblin, J., Gooch, B.: Color2Gray: salience-preserving color removal. ACM Trans. Graph. 24(3), 634–639 (2005)
Heckbert, P.: Color image quantization for frame buffer display. In: Proc. ACM SIGGRAPH, pp. 297–307 (1982)
Kang, H., Lee, S., Chui, C.K.: Coherent line drawing. In: ACM Symp. Non-photorealistic Animation and Rendering, pp. 43–50 (2007)
Kang, H., Lee, S., Chui, C.K.: Flow-based image abstraction. IEEE Trans. Vis. Comput. Graph. 15(1), 62–76 (2009)
Kyprianidis, J.E.: Image and video abstraction by multi-scale anisotropic Kuwahara filtering. In: Proceedings of the ACM SIGGRAPH/Eurographics Symposium on Non-Photorealistic Animation and Rendering, pp. 55–64 (2011)
Kyprianidis, J.E., Döllner, J.: Image abstraction by structure adaptive filtering. In: EG UK Theory and Practice of Computer Graphics, pp. 51–58 (2008)
Kyprianidis, J.E., Kang, H., Döllner, J.: Image and video abstraction by anisotropic Kuwahara filtering. Comput. Graph. Forum 28(7), 1955–1963 (2009)
Lopez-Moreno, J., Jimenez, J., Hadap, S., Reinhard, E., Anjyo, K., Gutierrez, D.: Stylized depiction of images based on depth perception. In: ACM Symp. Non-photorealistic Animation and Rendering, pp. 109–118. ACM, New York (2010)
Maharik, R., Bessmeltsev, M., Sheffer, A., Shamir, A., Carr, N.: Digital micrography. ACM Trans. Graph. 30(4), 100 (2011)
Meng, M., Zhao, M., Zhu, S.C.: Artistic paper-cut of human portraits. In: 18th Int. Conf. on Multimedia, pp. 931–934 (2010)
Mould, D.: A stained glass image filter. In: Eurographics Workshop on Rendering Techniques, pp. 20–25 (2003)
Olsen, S.C., Gooch, B.: Image simplification and vectorization. In: ACM Symp. Non-photorealistic Animation and Rendering, pp. 65–74 (2011)
Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9, 62–66 (1979)
Quinlan, J.: C4.5: Programs for Machine Learning. Morgan Kaufmann, San Mateo (1993)
Rosin, P.L., Lai, Y.K.: Towards artistic minimal rendering. In: ACM Symp. Non-photorealistic Animation and Rendering, pp. 119–127 (2010)
Rother, C., Kolmogorov, V., Blake, A.: “GrabCut”: interactive foreground extraction using iterated graph cuts. ACM Trans. Graph. 23(3), 309–314 (2004)
Song, Y., Hall, P., Rosin, P.L., Collomosse, J.: Arty shapes. In: Proc. Comp. Aesthetics, pp. 65–73 (2008)
Tomasi, C., Manduchi, R.: Bilateral filtering for gray and color images. In: ICCV, pp. 839–846 (1998)
Wang, J., Xu, Y., Shum, H.Y., Cohen, M.F.: Video tooning. ACM Trans. Graph. 23(3), 574–583 (2004)
Weickert, J., ter Haar Romeny, B.M., Viergever, M.A.: Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Trans. Image Process. 7(3), 398–410 (1998)
Wen, F., Luan, Q., Liang, L., Xu, Y.Q., Shum, H.Y.: Color sketch generation. In: ACM Symp. Non-photorealistic Animation and Rendering, pp. 47–54 (2006)
Winnemöller, H., Olsen, S., Gooch, B.: Real-time video abstraction. ACM Trans. Graph. 25(3), 1221–1226 (2006)
Winnemöller, H., Kyprianidis, J.E., Olsen, S.C.: XDoG: an extended difference-of-Gaussians compendium including advanced image stylization. Comput. Graph. 36(6), 740–753 (2012)
Xu, J., Kaplan, C.S.: Calligraphic packing. In: Graphics Interface 2007, pp. 43–50 (2007)
Xu, J., Kaplan, C.S.: Artistic thresholding. In: ACM Symp. Non-photorealistic Animation and Rendering, pp. 39–47 (2008)
Xu, Z., Chen, H., Zhu, S.C., Luo, J.: A hierarchical compositional model for face representation and sketching. IEEE Trans. Pattern Anal. Mach. Intell. 30(6), 955–969 (2008)
Xu, X., Zhang, L., Wong, T.T.: Structure-based ASCII art. ACM Trans. Graph. 29(4), 52:1–52:9 (2010)
Xu, L., Lu, C., Xu, Y., Jia, J.: Image smoothing via L 0 gradient minimization. ACM Trans. Graph. 30(6), 174 (2011)
Zhang, S.H., Li, X.Y., Hu, S.M., Martin, R.R.: Online video stream abstraction and stylization. IEEE Trans. Multimed. 13(6), 1286–1294 (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Lai, YK., Rosin, P.L. (2013). Non-photorealistic Rendering with Reduced Colour Palettes. In: Rosin, P., Collomosse, J. (eds) Image and Video-Based Artistic Stylisation. Computational Imaging and Vision, vol 42. Springer, London. https://doi.org/10.1007/978-1-4471-4519-6_11
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4519-6_11
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4518-9
Online ISBN: 978-1-4471-4519-6
eBook Packages: Computer ScienceComputer Science (R0)