Skip to main content
SpringerLink
Log in

Object Proposals-Based Significance Map for Image Retargeting

  • Conference paper
  • First Online:
Book cover Proceedings of 2nd International Conference on Computer Vision & Image Processing

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 704))

Abstract

Diverse aspect ratios of display devices require adaptation of the image content to be displayed on them. Image retargeting pertains to changing the size of an image to adapt to the aspect ratio and spatial resolution of the display device. This is achieved while preserving the salient or important information and thereby reducing visible artifacts in the retargeted image. Seam carving techniques remove or insert least energy seams, one pixel wide paths from top to bottom or left to right of an image, iteratively in order to achieve the target display size. These techniques highly depend on an energy measure of a pixel in an image. Here, we propose a novel technique of defining energy of a pixel, also known as significance map, using object proposal boxes with the probability of objects being present. Object proposal boxes are modeled using the Gaussian kernels. The generation of significance map can be executed on an average in just over a second for a given image. We show that the proposed significance map is able to capture salient region(s) of an image having different textured background and different noise levels. The significance map can be used with an image retargeting algorithm such as seam carving to achieve desired results. Quantitative assessment and comparison with the other state-of-the-art image retargeting techniques show that the proposed energy measure yields the best results for image retargeting using seam carving.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Y.-S. Wang, C.-L. Tai, O. Sorkine, and T.-Y. Lee, Optimized scale-and-stretch for image resizing, ACM Transactions on Graphics (TOG), vol. 27, no. 5, p. 118, 2008.

    Google Scholar 

  2. J. Yan, S. Lin, S. Kang, and X. Tang, “Learning the change for automatic image cropping,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 971–978. 2013.

    Google Scholar 

  3. L. Zhang, M. Song, Q. Zhao, X. Liu, J. Bu, and C. Chen, “Probabilistic graphlet transfer for photo cropping,” Image Processing, IEEE Transactions on, vol. 22, no. 2, pp. 802–815, 2013.

    Google Scholar 

  4. L. Zhang, M. Song, Y. Yang, Q. Zhao, C. Zhao, and N. Sebe, “Weakly supervised photo cropping,” Multimedia, IEEE Transactions on, vol. 16, no. 1, pp. 94–107, 2014.

    Google Scholar 

  5. Y. Guo, F. Liu, J. Shi, Z.-H. Zhou, and M. Glei, “Image retargeting using mesh parametrization,” Multimedia, IEEE Transactions on, vol. 11, no. 5, pp. 856–867, 2009.

    Google Scholar 

  6. S.-S. Lin, I.-C. Yeh, C.-H. Lin, and T.-Y. Lee, “Patch-based image warping for content-aware retargeting,” Multimedia, IEEE Transactions on, vol. 15, no. 2, pp. 359–368, 2013.

    Google Scholar 

  7. S.-S. Lin, C.-H. Lin, S.-H. Chang, and T.-Y. Lee, “Object-coherence warping for stereoscopic image retargeting,” Circuits and Systems for Video Technology, IEEE Transactions on, vol. 24, no. 5, pp. 759–768, 2014.

    Google Scholar 

  8. L. Bi and C. Li, “Content-aware image retargeting based on visual effect assessment,” International Journal of Signal Processing, Image Processing and Pattern Recognition, vol. 8, no. 5, pp. 201–210, 2015.

    Google Scholar 

  9. S. Avidan and A. Shamir, “Seam carving for content-aware image resizing,” in ACM Transactions on graphics (TOG), vol. 26, no. 3. ACM, p. 10. 2007.

    Google Scholar 

  10. T. D. Basha, Y. Moses, and S. Avidan, “Stereo seam carving a geometrically consistent approach,” Pattern Analysis and Machine Intelligence, IEEE Transactions on, vol. 35, no. 10, pp. 2513–2525, 2013.

    Google Scholar 

  11. W. Dong, N. Zhou, T.-Y. Lee, F. Wu, Y. Kong, and X. Zhang, “Summarization-based image resizing by intelligent object carving,” Visualization and Computer Graphics, IEEE Transactions on, vol. 20, no. 1, p. 1, 2014.

    Google Scholar 

  12. A. Mansfield, P. Gehler, L. Van Gool, and C. Rother, “Scene carving: Scene consistent image retargeting,” in Computer Vision-ECCV 2010. Springer, pp. 143–156. 2010.

    Google Scholar 

  13. A. Hati, S. Chaudhuri, and R. Velmurugan, “Salient object carving,” in Image Processing (ICIP), 2015 IEEE International Conference on. IEEE, pp. 1767–1771. 2015.

    Google Scholar 

  14. W. Dong, F. Wu, Y. Kong, X. Mei, T.-Y. Lee, and X. Zhang, “Image retargeting by texture-aware synthesis,” 2016.

    Google Scholar 

  15. W. Kim and C. Kim, “A texture-aware salient edge model for image retargeting,” IEEE Signal Processing Letters, vol. 18, no. 11, pp. 631–634, 2011.

    Google Scholar 

  16. M. Rubinstein, A. Shamir, and S. Avidan, “Multi-operator media retargeting,” in ACM Transactions on Graphics (TOG), vol. 28, no. 3. ACM, p. 23. 2009.

    Google Scholar 

  17. W. Dong, N. Zhou, J.-C. Paul, and X. Zhang, “Optimized image resizing using seam carving and scaling,” in ACM Transactions on Graphics (TOG), vol. 28, no. 5. ACM, p. 125. 2009.

    Google Scholar 

  18. C. L. Zitnick and P. Dollár, “Edge boxes: Locating object proposals from edges,” in Computer Vision-ECCV 2014. Springer, pp. 391–405. 2014.

    Google Scholar 

  19. Y. Li, X. Hou, C. Koch, J. M. Rehg, and A. L. Yuille, “The secrets of salient object segmentation,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 280–287. 2014.

    Google Scholar 

  20. T. Liu, Z. Yuan, J. Sun, J. Wang, N. Zheng, X. Tang, and H.-Y. Shum, “Learning to detect a salient object,” IEEE Transactions on Pattern analysis and machine intelligence, vol. 33, no. 2, pp. 353–367, 2011.

    Google Scholar 

  21. L. Itti, C. Koch, E. Niebur et al., “A model of saliency-based visual attention for rapid scene analysis,” IEEE Transactions on pattern analysis and machine intelligence, vol. 20, no. 11, pp. 1254–1259, 1998.

    Google Scholar 

  22. R. Achanta, S. Hemami, F. Estrada, and S. Susstrunk, “Frequency-tuned salient region detection,” in Computer vision and pattern recognition, 2009. cvpr 2009. IEEE conference on. IEEE, pp. 1597–1604. 2009.

    Google Scholar 

  23. S. Goferman, L. Zelnik-Manor, and A. Tal, “Context-aware saliency detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 10, pp. 1915–1926, 2012.

    Google Scholar 

  24. L. Duan, C. Wu, J. Miao, L. Qing, and Y. Fu, “Visual saliency detection by spatially weighted dissimilarity,” in Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, pp. 473–480. 2011.

    Google Scholar 

  25. N. Murray, M. Vanrell, X. Otazu, and C. A. Parraga, “Saliency estimation using a non-parametric low-level vision model,” in Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on. IEEE, pp. 433–440. 2011.

    Google Scholar 

  26. Y. Zhang, Y. Fang, W. Lin, X. Zhang, and L. Li, “Backward registration-based aspect ratio similarity for image retargeting quality assessment,” IEEE Transactions on Image Processing, vol. 25, no. 9, pp. 4286–4297, 2016.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering, Indian Institute of Technology Gandhinagar, Gandhinagar, 382355, Gujarat, India

    Diptiben Patel & Shanmuganathan Raman

Authors
  1. Diptiben Patel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shanmuganathan Raman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Diptiben Patel .

Editor information

Editors and Affiliations

  1. Computer Vision and Pattern Recognition Unit, Indian Statistical Institute, Kolkata, India

    Bidyut B. Chaudhuri

  2. School of Computing, National University of Singapore, Singapore, Singapore

    Mohan S. Kankanhalli

  3. Department of Computer Science and Engineering, Indian Institute of Technology Roorkee, Roorkee, Uttarakhand, India

    Balasubramanian Raman

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Patel, D., Raman, S. (2018). Object Proposals-Based Significance Map for Image Retargeting. In: Chaudhuri, B., Kankanhalli, M., Raman, B. (eds) Proceedings of 2nd International Conference on Computer Vision & Image Processing . Advances in Intelligent Systems and Computing, vol 704. Springer, Singapore. https://doi.org/10.1007/978-981-10-7898-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-7898-9_8

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-7897-2

  • Online ISBN: 978-981-10-7898-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation