Skip to main content
SpringerLink
Log in

Fast Multi-Operator Image Resizing and Evaluation

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

Current multi-operator image resizing methods succeed in generating impressive results by using image similarity measure to guide the resizing process. An optimal operation path is found in the resizing space. However, their slow resizing speed caused by inefficient computation strategy of the bidirectional patch matching becomes a drawback in practical use. In this paper, we present a novel method to address this problem. By combining seam carving with scaling and cropping, our method can realize content-aware image resizing very fast. We define cost functions combing image energy and dominant color descriptor for all the operators to evaluate the damage to both local image content and global visual effect. Therefore our algorithm can automatically find an optimal sequence of operations to resize the image by using dynamic programming or greedy algorithm. We also extend our algorithm to indirect image resizing which can protect the aspect ratio of the dominant object in an image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Rubinstein M, Shamir A, Avidan S. Multi-operator media retargeting. ACM Trans. Graph., 2009, 28(3), Article No. 23.

  2. Dong W, Zhou N, Paul J C, Zhang X. Optimized image resizing using seam carving and scaling. ACM Trans. Graph., 2009, 28(5), Article No. 125.

  3. Chen L, Xie X, Fan X, Ma W, Zhang H, Zhou H. A visual attention model for adapting images on small displays. ACM Multimedia Systems Journal, 2003, 9(4): 353–364.

    Article  Google Scholar 

  4. Liu H, Xie X, Ma W Y, Zhang H J. Automatic browsing of large pictures on mobile devices. In Proc. the 11th MULTI-MEDIA, Nov. 2003, pp.148–155.

  5. Suh B, Ling H, Bederson B B, Jacobs D W. Automatic thumbnail cropping and its effectiveness. In Proc. the 16th UIST, Nov. 2003, pp.95–104.

  6. Santella A, Agrawala M, DeCarlo D, Salesin D, Cohen M. Gaze-based interaction for semi-automatic photo cropping. In Proc. CHI, April 2006, pp.771–780.

  7. Viola P, Jones M J. Robust real-time face detection. Int. J. Comput. Vision, 2004, 57(2): 137–154.

    Article  Google Scholar 

  8. Itti L, Koch C, Niebur E. A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Analysis and Machine Intelligence, 1998, 20(11): 1254–1259.

    Article  Google Scholar 

  9. DeCarlo D, Santella A. Stylization and abstraction of photographs. ACM Trans. Graph., 2002, 21(3): 769–776.

    Article  Google Scholar 

  10. Walthera D, Koch C. Modeling attention to salient proto-objects. Neural Networks, 2006, 19(9): 1395–1407.

    Article  Google Scholar 

  11. El-Alfy H, Jacobs D, Davis L. Multi-scale video cropping. In Proc. the 15th MULTIMEDIA, Sept. 2007, pp.97–106.

  12. Avidan S, Shamir A. Seam carving for content-aware image resizing. ACM Trans. Graph., 2007, 26(3), Article No. 10.

  13. Rubinstein M, Shamir A, Avidan S. Improved seam carving for video retargeting. ACM Trans. Graph., 2008, 27(3), Article No. 16.

  14. Gal R, Sorkine O, Cohen-Or D. Feature-aware texturing. In Proc. Eurographics Symposium on Rendering, June 2006, pp.297–303.

  15. Wolf L, Guttmann M, Cohen-Or D. Non-homogeneous content-driven video-retargeting. In Proc. the 11th ICCV, Oct. 2007, pp.1–6.

  16. Zhang Y F, Hu S M, Martin R R. Shrinkability maps for content-aware video resizing. Computer Graphics Forum, 2008, 27(7): 1797–1804.

    Article  Google Scholar 

  17. Wang Y S, Tai C L, Sorkine O, Lee T Y. Optimized scale-and-stretch for image resizing. ACM Trans. Graph., 2008, 27(5), Article No. 118.

  18. Guo Y, Liu F, Shi J, Zhou Z H, Gleicher M. Image retargeting using mesh parametrization. IEEE Trans. Multi., 2009, 11(5): 856–867.

    Article  Google Scholar 

  19. Krähenbühl P, Lang M, Hornung A, Gross M. A system for retargeting of streaming video. ACM Trans. Graph., 2009, 28(5), Article No. 126.

  20. Wang Y S, Fu H, Sorkine O, Lee T Y, Seidel H P. Motion-aware temporal coherence for video resizing. ACM Trans. Graph., 2009, 28(5), Article No. 127.

  21. Kim J S, Kim J H, Kim C S. Adaptive image and video retargeting technique based on fourier analysis. In Proc. CVPR, June 2009, pp.1730–1737.

  22. Zhang G X, Cheng M M, Hu S M, Martin R R. A shape-preserving approach to image resizing. Computer Graphics Forum, 2009, 28(7): 1897–1906.

    Article  Google Scholar 

  23. Huang Q X, Mech R, Carr N. Optimizing structure preserving embedded deformation for resizing images and vector art. Computer Graphics Forum, 2009, 28(7): 1887–1896.

    Article  Google Scholar 

  24. Wu H, Wang Y S, Feng K C, Wong T T, Lee T Y, Heng P A. Resizing by symmetry-summarization. ACM Trans. Graph., 2010, 29(6), Article No. 159.

  25. Cho T S, Butman M, Avidan S, Freeman W T. The patch transform and its applications to image editing. In Proc. CVPR, June 2008.

  26. Pritch Y, Kav-Venaki E, Peleg S. Shift-map image editing. In Proc. the 12th ICCV, Setp. 29-Oct. 2, 2009, pp.151–158.

  27. Barnes C, Shechtman E, Finkelstein A, Goldman D B. Patch-match: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph., 2009, 28(3), Article No. 24.

    Google Scholar 

  28. Simakov D, Caspi Y, Shechtman E, Irani M. Summarizing visual data using bidirectional similarity. In Proc. CVPR, June 2008.

  29. Wei L Y, Han J, Zhou K et al. Inverse texture synthesis. ACM Trans. Graph., 2008, 27(3), Article No. 52.

  30. Manjunath B, Salembier P, Sikora T. Introduction to MPEG-7: Multimedia Content Description Interface. Chichester: Wiley, 2002.

    Google Scholar 

  31. Tao L, Yuan L, Sun J. SkyfInder: Attribute-based sky image search. ACM Trans. Graph., 2009, 28(3), Article No. 68.

  32. Ilea D, Whelan P. CTex-an adaptive unsupervised segmentation algorithm based on color-texture coherence. IEEE Transactions on Image Processing, 2008, 17(10): 1926–1939.

    Article  MathSciNet  Google Scholar 

  33. Casella G, George E I. Explaining the gibbs sampler. The American Statistician, 1992, 46(3): 167–174.

    Article  MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Sino-French Laboratory for Computer Science, Automation and Applied Mathematics/National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190, China

    Wei-Ming Dong (Member, CCF, ACM, IEEE), Guan-Bo Bao & Xiao-Peng Zhang (Member, ACM)

  2. National Institute for Research in Computer Science and Control, Domaine de Voluceau Rocquencourt, Le Chesnay, 78153, France

    Wei-Ming Dong (Member, CCF, ACM, IEEE) & Jean-Claude Paul

Authors
  1. Wei-Ming Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guan-Bo Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiao-Peng Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jean-Claude Paul
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei-Ming Dong.

Additional information

This work is supported by the National Natural Science Foundation of China (NSFC) under Grant Nos. 60872120, 60902078, 61172104, the Natural Science Foundation of Beijing under Grant No. 4112061, the Scientific Research Foundation for the Returned Overseas Chinese Scholars of State Education Ministry of China, the French System@tic Paris-Region (CSDL Project), and the National Agency for Research of French (ANR)-NSFC under Grant No. 60911130368.

Electronic supplementary material

Below is the link to the electronic supplementary material.

(PDF 111 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dong, WM., Bao, GB., Zhang, XP. et al. Fast Multi-Operator Image Resizing and Evaluation. J. Comput. Sci. Technol. 27, 121–134 (2012). https://doi.org/10.1007/s11390-012-1211-6

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-012-1211-6

Keywords

Search

Navigation