Skip to main content
Log in

Enlarging Image by Constrained Least Square Approach with Shape Preserving

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

From a visual point of view, the shape of an image is mainly determined by the edges. Conventional polynomial interpolation of image enlarging methods would produce blurred edges, while edge-directed interpolation based methods would cause distortion in the non-edge areas. A new method for image enlarging is presented. The image is enlarged in two steps. In the first step, a fitting surface is constructed to interpolate the image data. To remove the zigzagging artifact, for each pixel, a fitting patch is constructed using edge information as constraints. The combination of all the patches forms the fitting surface which has the shape suggested by image data. Each point on the fitting surface can be regarded as a sampling point taken from a unit square domain, which means that when the fitting surface is used to enlarge the image, each sampling domain of the enlarged pixels is also a unit square, causing the enlarged image to lose some details. To make the enlarged image keep the details as many as possible, the sampling domain of the enlarged pixels should be less than a unit square. Then, in the second step, using the points taken from the fitting surface, new pixels are computed using constrained optimization technique to form the enlarged image, and the size of the sampling domain of the enlarged pixels is inversely proportional to the size of the enlarged image. The image enlarged by the new method has a quadratic polynomial precision. Comparison results show that the new method produces resized image with better quality.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Gonzalez R C, Woods R E. Digital Image Processing (2nd edition). Prentice Hall, 2002.

  2. Park S K, Schowengerdt R A. Image reconstruction by parametric cubic convolution. Computer Vision, Graphics, and Image Processing, 1983, 23(3): 258-272.

    Article  Google Scholar 

  3. Meijering E H W, Niessen W J, Viergever M A. Piecewise polynomial kernels for image interpolation: A generalization of cubic convolution. In Proc. IEEE Int. Conf. Image Processing, Vol. 3, Oct. 1999, pp.647-651.

  4. Shi J Z, Reichenbach S E. Image interpolation by two-dimensional parametric cubic convolution. IEEE Transactions on Image Processing, 2006, 15(7): 1857-1870.

    Article  Google Scholar 

  5. Munoz A, Blu T, Unser M. Least-squares image resizing using finite differences. IEEE Transactions on Image Processing, 2001, 10(9): 1365-1378.

    Article  MATH  MathSciNet  Google Scholar 

  6. Li X, Orchard M T. New edge-directed interpolation. IEEE Transactions on Image Processing, 2001, 10(10): 1521-1527.

    Article  Google Scholar 

  7. Li M, Nguyen T. Markov random field model-based edge-directed image interpolation. IEEE Transactions on Image Processing, 2008, 17(7): 1121-1128.

    Article  MathSciNet  Google Scholar 

  8. Zhang X J, Wu X L. Image interpolation by adaptive 2-D autoregressive modeling and soft-decision estimation. IEEE Transactions on Image Processing, 2008, 17(6): 887-896.

    Article  MathSciNet  Google Scholar 

  9. Sun J, Sun J, Xu Z, Shum H. Image super-resolution using gradient profile prior. In Proc. CVPR, June 2008.

  10. Babacan S D, Molina R, Katsaggelos A K. Total variation super resolution using a variational approach. In Proc. the 15th ICIP, Oct. 2008, pp.641-644.

  11. Oliveira J, Bioucas-Dia J M, Figueiredo M A T. Adaptive total variation image deblurring: A majorization-minimization approach. Signal Process, 2009, 89: 1683-1693

    Article  MATH  Google Scholar 

  12. Beck A, Teboulle M. Fast gradient-based algorithms for constrained total variation image denoising and deblurring problems. IEEE Transactions on Image Processing, 2009, 18(11): 2419-2434.

    Article  MathSciNet  Google Scholar 

  13. Chantas G, Galatsanos N P, Molina R, Katsaggelos A K. Variational Bayesian image restoration with a product of spatially weighted total variation image priors. IEEE Transactions on Image Processing, 2010, 19(2): 351-362.

    Article  MathSciNet  Google Scholar 

  14. Avidan S, Shamir A. Seam carving for content-aware image resizing. ACM Trans. Graph., 2007, 26(3): Article No. 10.

    Article  Google Scholar 

  15. Rubinstein M, Shamir A, Avidan S. Improved seam carving for video retargeting. ACM Transactions on Graphics, 2008, 27(3): Atricle No. 16.

    Article  Google Scholar 

  16. Zhang Y F, Hu S M, Martin R R. Shrinkability maps for content-aware video resizing. Computer Graphics Forum, 2008, 27(7): 1797-1804.

    Article  Google Scholar 

  17. Huang H, Fu T N, Rosin P L, Qi C. Real-time content-aware image resizing. Science in China Series F: Information Sciences, 2009, 52(2): 172-182.

    Article  MATH  MathSciNet  Google Scholar 

  18. Zhang G X, Cheng M M, Hu S M, Martin R R. A shape-preserving approach to image resizing. Computer Graphics Forum, 2009, 28(7): 1897-1906.

    Article  Google Scholar 

  19. Hu S M, Chen T, Xu K, Cheng M M, Martin R R. Internet visual media processing: A survey with graphics and vision applications. The Visual Computer, 2013, 29(5): 393-405.

    Article  Google Scholar 

  20. Luong H, Ledda A, Philips W. An image interpolation scheme for repetitive structures. Image Analysis and Recognition, 2006, 4141: 104-115.

    Google Scholar 

  21. Dong W S, Zhang L, Lukac R, Shi G M. Sparse representation based image interpolation with nonlocal autoregressive modeling. IEEE Transactions on Image Processing, 2013, 22(4): 1382-1394.

    Article  MathSciNet  Google Scholar 

  22. Baker S, Kanade T. Limits on super-resolution and how to break them. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, June 2000, pp.372-379.

  23. Yang J, Wright J, Huang T, Ma Y. Image super-resolution as sparse representation of raw image patches. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, June 2008.

  24. Fattal R. Image upsampling via imposed edge statistics. ACM Transactions on Graphics, 2007, 26(3): Article No. 95.

    Article  Google Scholar 

  25. Shan Q, Li Z, Jia J, Tang C K. Fast image/video upsampling. ACM Transactions on Graphics, 2008, 27(5): Article No. 153.

    Article  Google Scholar 

  26. Freedman G, Fattal R. Image and video upscaling from local self-examples. ACM Transactions on Graphics, 2011, 30(2): Article No. 12.

    Article  Google Scholar 

  27. Li X M, Zhang C M, Yue Y Z, Wang K P. Cubic surface fitting to image by combination. Science China Information Sciences, 2010, 53(7): 1287-1295.

    Article  MathSciNet  Google Scholar 

  28. Galić I, Weickert J, Welk M, Bruhn A, Belyaev A, Seidel H P. Towards PDE-based image compression. In Proc. the 3rd VLSM, Oct. 2005, pp.37-48.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cai-Ming Zhang.

Additional information

This work was supported by the National Natural Science Foundation of China under Grant Nos. 61020106001, 61332015, 61272430, and 61373078.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, F., Zhang, X., Qin, XY. et al. Enlarging Image by Constrained Least Square Approach with Shape Preserving. J. Comput. Sci. Technol. 30, 489–498 (2015). https://doi.org/10.1007/s11390-015-1539-9

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-015-1539-9

Keywords

Navigation