Optimizing Aesthetic-Based Photo Retargeting

  • Damon Shing-Min LiuEmail author
  • Chi-Cheng Huang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9317)


Photography is an art based on light. Modern cameras have auto exposure and auto focus functions, so that we can easily take photos with right exposure and focus setting. However, a nice photo depends not only on light used, its composition is also an important factor. We therefore exploit the state-of-the-art retargeting technique to automatically adjust photos for conforming the aesthetic composition. Our approach can use suitable retargeting techniques, and coordinate the composition of original photos to make photos conform the aesthetic rules. The photo types in our system particularly apply to group photo. To the best of our knowledge, this part has not been explored in existing literature. We analyze the common rules of composition, and propose the rules applied to suit group photos. Besides, the photos are adjusted based on the human face. We believe that using the development of our research, everyone can take an ideal photo.


Computational aesthetics Photography Composition Photo editing Photo retargeting 


  1. 1.
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. (TOG) 26, 10 (2007)CrossRefGoogle Scholar
  2. 2.
    Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Trans. Graph. (TOG) 28, 23 (2009)CrossRefGoogle Scholar
  3. 3.
    Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content-driven video-retargeting. In: IEEE Conference on Computer Vision, pp. 1–6 (2007)Google Scholar
  4. 4.
    Santella, A., Agrawala, M., DeCarlo, D., Salesin, D., Cohen, M.: Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, pp. 771–780 (2006)Google Scholar
  5. 5.
    Yan, J., Lin, S., Bing Kang, S., Tang, X.: Learning the change for automatic image cropping. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 971–978 (2013)Google Scholar
  6. 6.
    Liu, L., Chen, R., Wolf, L., Cohen-Or, D.: Optimizing photo composition. Comput. Graph. Forum 29, 469–478 (2010)CrossRefGoogle Scholar
  7. 7.
    Jin, Y., Qingbiao, W., Liu, L.: Aesthetic photo composition by optimal crop-and-warp. Comput. Graph. 36(8), 955–965 (2012)CrossRefGoogle Scholar
  8. 8.
    Guo, Y.W., Liu, M., Gu, T.T., Wang, W.P.: Improving photo composition elegantly: considering image similarity during composition optimization. Comput. Graph. Forum 31, 2193–2202 (2012)CrossRefGoogle Scholar
  9. 9.
    Zhang, F.-L., Wang, M., Hu, S.-M.: Aesthetic image enhancement by dependence-aware object re-composition. IEEE Trans. Multimedia 15(7), 1480–1490 (2013)CrossRefGoogle Scholar
  10. 10.
    Freeman, M.: The Photographer’s Eye: Composition and Design for Better Digital Photos, vol. 1. Focal Press, Waltham (2007)Google Scholar
  11. 11.
    Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRefGoogle Scholar
  12. 12.
    Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1915–1926 (2012)CrossRefGoogle Scholar
  13. 13.
    Yang, A.Y., Wright, J., Ma, Y., Sastry, S.S.: Unsupervised segmentation of natural images via lossy data compression. Comput. Vis. Image Underst. 110(2), 121–225 (2008)CrossRefGoogle Scholar
  14. 14.
    Wing-man. Flickr wing-man kenting (2014).
  15. 15.
    Li, C., Gallagher, A., Loui, A.C., Chen, T.: Aesthetic quality assessment of consumer photos with faces. In: IEEE International Conference on Image Processing (ICIP), pp. 3221–3224 (2010)Google Scholar
  16. 16.
    Sampat, M.P., Wang, Z., Gupta, S., Bovik, A.C., Markey, M.K.: Complex wavelet structural similarity: a new image similarity index. IEEE Trans. Image Process. 18(11), 2385–2401 (2009)MathSciNetCrossRefGoogle Scholar
  17. 17.
  18. 18.
    Zheng, Y., Kambhamettu, C.: Learning based digital matting. In: IEEE International Conference on Computer Vision, pp. 889–896 (2009)Google Scholar
  19. 19.
    Korman, S., Avidan, S.: Coherency sensitive hashing. In: IEEE International Conference on Computer Vision (ICCV), pp. 1607–1614 (2011)Google Scholar
  20. 20.
    Criminisi, A., Perez, P., Toyama, K.: Object removal by exemplar-based inpainting. In: Proceedings of the IEEE Computer Vision and Pattern Recognition (CVPR) (2003)Google Scholar
  21. 21.
  22. 22.
    Rubinstein, M., Gutierrez, D., Sorkine, O., Shamir, A.: A comparative study of image retargeting. ACM Trans. Graph. (TOG) 29, 160 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.Department of Computer ScienceNational Chung Cheng UniversityChiayiTaiwan

Personalised recommendations