Retargeting Framework Based on Monte-carlo Sampling

  • Roberto Gallea
  • Edoardo Ardizzone
  • Roberto Pirrone
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 550)

Abstract

Advance in image technology and proliferation of acquisition devices like smartphones, digital cameras, etc., made the display of digital images ubiquitous. Many displays exist in the market, spanning within a large variety of resolutions and shapes. Thus, displaying content optimizing the available number of pixels has become a very important issue in the multimedia community, and the image retargeting problem is being widely faced. In this work, we propose an image retargeting framework based on monte-carlo sampling. We operate the non-homogeneous resizing as the composition of several simple atomic resizing functions. The shape of such atomic operator can be chosen within a set of tested functions or the user could design additional ones. Using independent atomic operators allows parallelizing the retargeting procedure. Additionally, since the algorithm does not require any optimization, it could be executed in real-time, which is a key aspect for on-line visualization of multimedia content.

Keywords

Retargeting Monte-carlo Saliency Image resizing 

References

  1. 1.
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20, 1254–1259 (1998)CrossRefGoogle Scholar
  2. 2.
    Hou, X., Harel, J., Koch, C.: Image signature: Highlighting sparse salient regions. IEEE Trans. Pattern Anal. Mach. Intell. 34, 194–201 (2012)CrossRefGoogle Scholar
  3. 3.
    Harris, C., Stephens, M.: A combined corner and edge detection. In: Proceedings of the Fourth Alvey Vision Conference, pp. 147–151 (1988)Google Scholar
  4. 4.
    Santella, A., Agrawala, M., Decarlo, D., Salesin, D., Cohen, M.: Gaze-based interaction for semi-automatic photo cropping. In. In CHI 2006, pp. 771–780 (2006)Google Scholar
  5. 5.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 1, pp. 886–893 (2005)Google Scholar
  6. 6.
    Viola, P., Jones, M.: Robust real-time object detection. Int. J. Comput. Vis. (2001)Google Scholar
  7. 7.
    Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W.: Automatic thumbnail cropping and its effectiveness. In: UIST 2003: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, pp. 95–104. ACM, New York (2003)Google Scholar
  8. 8.
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26, 10 (2007)CrossRefGoogle Scholar
  9. 9.
    Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Trans. Graph. 27, 1–9 (2008)CrossRefGoogle Scholar
  10. 10.
    Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content-driven video-retargeting. In: Proceedings of the Eleventh IEEE International Conference on Computer Vision (ICCV-07) (2007)Google Scholar
  11. 11.
    Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized scale-and-stretch for image resizing. In: ACM Transactions on Graphics, Proceedings of ACM SIGGRAPH ASIA, vol. 27 (2008)Google Scholar
  12. 12.
    Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. In: ACM Transactions on Graphics, Proceedings SIGGRAPH 2009, vol. 28, pp. 1–11 (2009)Google Scholar
  13. 13.
    Rubinstein, M., Gutierrez, D., Sorkine, O., Shamir, A.: A comparative study of image retargeting. ACM Transactions on Graphics, Proceedings SIGGRAPH Asia, vol. 29 (2010)Google Scholar
  14. 14.
    Wang, Z., Bovik, A.C., Sheikh, H.R., Member, S., Simoncelli, E.P.: Image quality assessment: from error measurement to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)CrossRefGoogle Scholar
  15. 15.
    NVIDIA CUDA Compute Unified Device Architecture - Programming Guide (2007)Google Scholar
  16. 16.
    Pele, O., Werman, M.: Fast and robust earth mover’s distances. In: ICCV (2009)Google Scholar
  17. 17.
    Liu, C., Yuen, J., Torralba, A., Sivic, J., Freeman, W.T.: SIFT Flow: Dense Correspondence across Different Scenes. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 28–42. Springer, Heidelberg (2008) CrossRefGoogle Scholar
  18. 18.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Open Access This chapter is distributed under the terms of the Creative Commons Attribution Noncommercial License, which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.

Authors and Affiliations

  • Roberto Gallea
    • 1
  • Edoardo Ardizzone
    • 1
  • Roberto Pirrone
    • 1
  1. 1.DICGIMUniversita’ degli Studi di PalermoPalermoItaly

Personalised recommendations