Saliency Based Aesthetic Cut of Digital Images

  • Luca Greco
  • Marco La Cascia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8157)

Abstract

Aesthetic cut of photos is a process well known to professional photographers. It consists of cutting the original photo to remove less relevant parts close to the borders leaving in this way the interesting subjects in a position that is perceived by the observer as more pleasant. In this paper we propose a saliency based technique to automatically perform aesthetic cut in images. We use a standard method to estimate the saliency map and propose some post processing on the map to make it more suitable for our scope. We then apply a greedy algorithm to determine the cut (i.e. the most important part of the original image) both in the cases of free and fixed aspect ratio. Experimental results are reported showing how the cut resulting from our technique compares to some state of the art retargeting and cropping techniques.

Keywords

Aesthetic cut image editing saliency 

References

  1. 1.
    Harel, J., Koch, C., Perona, P.: Graph-Based Visual Saliency. In: Proceedings of Neural Information Processing Systems, NIPS (2006)Google Scholar
  2. 2.
    Joshi, D., Datta, R., Fedorovskaya, E., Luong, Q.-T., Wang, J.Z., Li, J., Luo, J.: Aesthetics and emotions in images, a computational perspective. IEEE Signal Processing Magazine, 94–115 (2011)Google Scholar
  3. 3.
    Bhattacharya, S., Sukthankar, R., Shah, M.: A Holistic Approach to Aesthetic Enhancement of Photographs. ACM Transactions on Multimedia Computing, Communications and Applications 7S(1), Article 21 (2011)Google Scholar
  4. 4.
    Liu, L., Chen, R., Wolf, L., Cohen-Or, D.: Optimizing Photo Composition. Technical Report (2010)Google Scholar
  5. 5.
    Zhang, M., Zhang, L., Sun, Y., Feng, L., Ma, W.: Auto Cropping for Digital Photographs. Microsoft Research Asia (2005)Google Scholar
  6. 6.
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. In: Proceedings. SIGGRAPH Conference, vol. 26 (2007)Google Scholar
  7. 7.
    Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W.: Automatic Thumbnail Cropping and its Effectiveness. Department of Computer Science, University of Maryland (2003)Google Scholar
  8. 8.
    Marchesotti, L., Cifarelli, C., Csurka, G.: A framework for visual saliency detection with applications to image thumbnailing. Xerox Research Centre Europe (XRCE), France (2009)Google Scholar
  9. 9.
    Liu, L., Jin, Y., Wu, Q.: Realtime aesthetic image retargeting. In: Deussen, O., Jepp, P. (eds.) International Symposium on Computational Aesthetics in Graphics, Visualization and Imaging, pp. 1–8. Eurographics Association, London (2010)Google Scholar
  10. 10.
    Santella, A., Agrawala, M., Decarlo, D., Salesin, D.H., Cohen, M.: Gaze-based interaction for semiautomatic photo cropping. In: ACM Human Factors in Computing Systems (CHI), pp. 771–780. ACM Press (2006)Google Scholar
  11. 11.
    Byers, Z., Dixon, M., Smart, W.D., Grimm, C.: Say cheese! experiences with a robot photographer, pp. 25-37–46 (2004)Google Scholar
  12. 12.
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. (1998)Google Scholar
  13. 13.
    Jin, Y., Wun, Q., Liu, L.: Aesthetic photo composition by optimal crop-and-warp. Department of Mathematics, Zhejiang UniversityGoogle Scholar
  14. 14.
    Gooch, B., Reinhard, E., Moulding, C., Shirley, P.: Artistic composition for image creation. In: Eurographics Workshop on Rendering Technique, pp. 83–88. Eurographics Association (2011)Google Scholar
  15. 15.
    Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W.: Automatic Thumbnail Cropping and its Effectiveness. Department of Computer Science, University of MarylandGoogle Scholar
  16. 16.
    Liu, T., Yuan, Z., Sun, J., Wang, J., Zheng, N., Tang, X., Shum, H.-Y.: Learning to detect a salient object. IEEE Transactions on Pattern Analysis and Machine Intelligence 33(2), 353–367 (2011)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Luca Greco
    • 1
  • Marco La Cascia
    • 1
  1. 1.DICGIMUniversità degli Studi di PalermoItaly

Personalised recommendations