Abstract
From a visual point of view, the shape of an image is mainly determined by the edges. Conventional polynomial interpolation of image enlarging methods would produce blurred edges, while edge-directed interpolation based methods would cause distortion in the non-edge areas. A new method for image enlarging is presented. The image is enlarged in two steps. In the first step, a fitting surface is constructed to interpolate the image data. To remove the zigzagging artifact, for each pixel, a fitting patch is constructed using edge information as constraints. The combination of all the patches forms the fitting surface which has the shape suggested by image data. Each point on the fitting surface can be regarded as a sampling point taken from a unit square domain, which means that when the fitting surface is used to enlarge the image, each sampling domain of the enlarged pixels is also a unit square, causing the enlarged image to lose some details. To make the enlarged image keep the details as many as possible, the sampling domain of the enlarged pixels should be less than a unit square. Then, in the second step, using the points taken from the fitting surface, new pixels are computed using constrained optimization technique to form the enlarged image, and the size of the sampling domain of the enlarged pixels is inversely proportional to the size of the enlarged image. The image enlarged by the new method has a quadratic polynomial precision. Comparison results show that the new method produces resized image with better quality.
Similar content being viewed by others
References
Gonzalez R C, Woods R E. Digital Image Processing (2nd edition). Prentice Hall, 2002.
Park S K, Schowengerdt R A. Image reconstruction by parametric cubic convolution. Computer Vision, Graphics, and Image Processing, 1983, 23(3): 258-272.
Meijering E H W, Niessen W J, Viergever M A. Piecewise polynomial kernels for image interpolation: A generalization of cubic convolution. In Proc. IEEE Int. Conf. Image Processing, Vol. 3, Oct. 1999, pp.647-651.
Shi J Z, Reichenbach S E. Image interpolation by two-dimensional parametric cubic convolution. IEEE Transactions on Image Processing, 2006, 15(7): 1857-1870.
Munoz A, Blu T, Unser M. Least-squares image resizing using finite differences. IEEE Transactions on Image Processing, 2001, 10(9): 1365-1378.
Li X, Orchard M T. New edge-directed interpolation. IEEE Transactions on Image Processing, 2001, 10(10): 1521-1527.
Li M, Nguyen T. Markov random field model-based edge-directed image interpolation. IEEE Transactions on Image Processing, 2008, 17(7): 1121-1128.
Zhang X J, Wu X L. Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. IEEE Transactions on Image Processing, 2008, 17(6): 887-896.
Sun J, Sun J, Xu Z, Shum H. Image super-resolution using gradient profile prior. In Proc. CVPR, June 2008.
Babacan S D, Molina R, Katsaggelos A K. Total variation super resolution using a variational approach. In Proc. the 15th ICIP, Oct. 2008, pp.641-644.
Oliveira J, Bioucas-Dia J M, Figueiredo M A T. Adaptive total variation image deblurring: A majorization-minimization approach. Signal Process, 2009, 89: 1683-1693
Beck A, Teboulle M. Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Transactions on Image Processing, 2009, 18(11): 2419-2434.
Chantas G, Galatsanos N P, Molina R, Katsaggelos A K. Variational Bayesian image restoration with a product of spatially weighted total variation image priors. IEEE Transactions on Image Processing, 2010, 19(2): 351-362.
Avidan S, Shamir A. Seam carving for content-aware image resizing. ACM Trans. Graph., 2007, 26(3): Article No. 10.
Rubinstein M, Shamir A, Avidan S. Improved seam carving for video retargeting. ACM Transactions on Graphics, 2008, 27(3): Atricle No. 16.
Zhang Y F, Hu S M, Martin R R. Shrinkability maps for content-aware video resizing. Computer Graphics Forum, 2008, 27(7): 1797-1804.
Huang H, Fu T N, Rosin P L, Qi C. Real-time content-aware image resizing. Science in China Series F: Information Sciences, 2009, 52(2): 172-182.
Zhang G X, Cheng M M, Hu S M, Martin R R. A shape-preserving approach to image resizing. Computer Graphics Forum, 2009, 28(7): 1897-1906.
Hu S M, Chen T, Xu K, Cheng M M, Martin R R. Internet visual media processing: A survey with graphics and vision applications. The Visual Computer, 2013, 29(5): 393-405.
Luong H, Ledda A, Philips W. An image interpolation scheme for repetitive structures. Image Analysis and Recognition, 2006, 4141: 104-115.
Dong W S, Zhang L, Lukac R, Shi G M. Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Transactions on Image Processing, 2013, 22(4): 1382-1394.
Baker S, Kanade T. Limits on super-resolution and how to break them. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, June 2000, pp.372-379.
Yang J, Wright J, Huang T, Ma Y. Image super-resolution as sparse representation of raw image patches. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, June 2008.
Fattal R. Image upsampling via imposed edge statistics. ACM Transactions on Graphics, 2007, 26(3): Article No. 95.
Shan Q, Li Z, Jia J, Tang C K. Fast image/video upsampling. ACM Transactions on Graphics, 2008, 27(5): Article No. 153.
Freedman G, Fattal R. Image and video upscaling from local self-examples. ACM Transactions on Graphics, 2011, 30(2): Article No. 12.
Li X M, Zhang C M, Yue Y Z, Wang K P. Cubic surface fitting to image by combination. Science China Information Sciences, 2010, 53(7): 1287-1295.
Galić I, Weickert J, Welk M, Bruhn A, Belyaev A, Seidel H P. Towards PDE-based image compression. In Proc. the 3rd VLSM, Oct. 2005, pp.37-48.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by the National Natural Science Foundation of China under Grant Nos. 61020106001, 61332015, 61272430, and 61373078.
Rights and permissions
About this article
Cite this article
Zhang, F., Zhang, X., Qin, XY. et al. Enlarging Image by Constrained Least Square Approach with Shape Preserving. J. Comput. Sci. Technol. 30, 489–498 (2015). https://doi.org/10.1007/s11390-015-1539-9
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11390-015-1539-9