Abstract
This paper introduces a new procedure to handle color in single image super resolution (SR). Most existing SR techniques focus primarily on enforcing image priors or synthesizing image details; less attention is paid to the final color assignment. As a result, many existing SR techniques exhibit some form of color aberration in the final upsampled image. In this paper, we outline a procedure based on image colorization and back-projection to perform color assignment guided by the super-resolution luminance channel. We have found that our procedure produces better results both quantitatively and qualitatively than existing approaches. In addition, our approach is generic and can be incorporated into any existing SR techniques.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Allebach, J., Wong, P.: Edge-directed interpolation. In: Proc. IEEE International Conf. on Image Processing, pp. 707–710 (1996)
Li, X., Orchard, M.T.: New edge-directed interpolation. In: Proc. IEEE International Conf. on Image Processing, pp. 311–314 (2000)
Caselles, V., Morel, J.M., Sbert, C.: An axiomatic approach to image interpolation. IEEE Trans. on Image Processing 7, 376–386 (1998)
Thevenaz, P., Blu, T., Unser, M.: Image Interpolation and Resampling. Academic Press, USA (2000)
Irani, M., Peleg, S.: Motion analysis for image enhancement: Resolution, occlusion, and transparency. Journal of Visual Communication and Image Representation 4, 324–335 (1993)
Morse, B., Schwartzwald, D.: Image magnification using level-set reconstruction. In: Proc. IEEE International Conf. Computer Vision, pp. 333–341 (2001)
Tappen, M.F., Russell, B.C., Freeman, W.T.: Exploiting the sparse derivative prior for super-resolution and image demosaicing. In: IEEE Workshop on Statistical and Computational Theories of Vision, pp. 2074–2081 (2003)
Lin, Z., Shum, H.: Fundamental limits of reconstruction-based superresolution algorithms under local translation. IEEE Trans. on Pattern Analysis and Machine Intelligence 26, 83–97 (2004)
Tai, Y.W., Tong, W.S., Tang, C.K.: Perceptually-inspired and edge directed color image super-resolution. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1948–1955 (2006)
Dai, S., Han, M., Xu, W., Wu, Y., Gong, Y.: Soft edge smoothness prior for alpha channel super resolution. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Ben-Ezra, M., Lin, Z., Wilburn, B.: Penrose pixels: Super-resolution in the detector layout domain. In: Proc. IEEE International Conf. Computer Vision, pp. 1–8 (2007)
Sun, J., Sun, J., Xu, Z., Shum, H.: Image super-resolution using gradient profile prior. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Shan, Q., Li, Z., Jia, J., Tang, C.K.: Fast image/video upsampling. ACM Trans. Graph. (Proc. of SIGGRAPH ASIA) 27, 1–7 (2008)
Freeman, W.T., Pasztor, E.C., Carmichael, O.T.: Learning low-level vision. International Journal of Computer Vision 40, 25–47 (2000)
Liu, C., Shum, H.Y., Zhang, C.S.: Two-step approach to hallucinating faces: global parametric model and local nonparametric model. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 192–198 (2001)
Freeman, W.T., Jones, T., Pasztor, E.C.: Example-based super-resolution. IEEE Computer Graphics and Applications 22, 56–65 (2002)
Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Trans. on Pattern Analysis and Machine Intelligence 24, 1167–1183 (2002)
Sun, J., Zheng, N.N., Tao, H., Shum, H.Y.: Image hallucination with primal sketch prior. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 729–736 (2003)
Yeung, D., Chang, H., Xiong, Y.: Super resolution through neighbor embedding. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 275–282 (2004)
Wang, Q., Tang, X., Shum, H.Y.: Patch based blind image super resolution. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 709–716 (2005)
Liu, C., Shum, H.Y., Freeman, W.T.: Face hallucination: Theory and practice. International Journal of Computer Vision 75, 115–134 (2007)
Tai, Y.W., Liu, S., Brown, M.S., Lin, S.: Super resolution using edge prior and single image detail synthesis. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2010)
Glasner, D., Bagon, S., Irani, M.: Super-resolution from a single image. In: Proc. IEEE International Conf. Computer Vision, pp. 349–356 (2009)
Jianchao, Y., John, W., Thomas, H., Yi, M.: Image super-resolution as sparse representation of raw image patches. In: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Kopf, J., Cohen, M., Lischinski, D., Uyttendaele, M.: Joint bilateral upsampling. ACM Transactions on Graphics (Proc. of SIGGRAPH) 26 (2007)
Johnson, G.M., Fairchild, M.D.: A top down description of S-CIELAB and CIEDE2000. Color Research and Application 28, 425–435 (2002)
Sharma, G., Wu, W., Dalal, E.D.: The CIEDE2000 color difference formula: Implementations notes, supplementary test data and mathematical observations. Color Research and Application 30, 21–30 (2005)
Fattal, R.: Upsampling via imposed edges statistics. ACM Trans. Graph. (Proc. of SIGGRAPH) 26 (2007)
Levin, A., Lischinski, D., Weiss, Y.: Colorization using optimization. ACM Trans. Graph. (Proc. of SIGGRAPH) 23, 689–694 (2004)
Liu, X., Wan, L., Qu, Y., Wong, T.T., Lin, S., Leung, C.S., Heng, P.A.: Intrinsic colorization. ACM Transactions on Graphics (Proc. of SIGGRAPH Asia) 27, 152:1–152:9 (2008)
Tappen, M.F., Freeman, W.T.: Comparison of graph cuts with belief propagation for stereo, using identical mrf parameters. In: Proc. IEEE International Conf. Computer Vision, pp. 900–907 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Liu, S., Brown, M.S., Kim, S.J., Tai, YW. (2010). Colorization for Single Image Super Resolution. In: Daniilidis, K., Maragos, P., Paragios, N. (eds) Computer Vision – ECCV 2010. ECCV 2010. Lecture Notes in Computer Science, vol 6316. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-15567-3_24
Download citation
DOI: https://doi.org/10.1007/978-3-642-15567-3_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-15566-6
Online ISBN: 978-3-642-15567-3
eBook Packages: Computer ScienceComputer Science (R0)