Automatic Aesthetic Photo Composition

  • Roberto Gallea
  • Edoardo Ardizzone
  • Roberto Pirrone
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8157)

Abstract

A proper aesthetic composition of photographic content does result in an actual emotional response from the watcher. In this work we propose a fully automatic computational approach to photo composition. This method takes into account well-known and widely adopted aesthetic guidelines relative to picture content as a mean for guiding an optimization framework. The resulting composition is produced as the optimal combination of cropping and retargeting.

The effectiveness of the results achieved by the method are tested and evaluated with several of experiments.

Keywords

photo composition retargeting visual saliency 

References

  1. 1.
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. In: ACM SIGGRAPH 2007 Papers. SIGGRAPH 2007. ACM, New York (2007)Google Scholar
  2. 2.
    Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Transactions on Graphics (Proc. SIGGRAPH) 28(3) (2009)Google Scholar
  3. 3.
    Battiato, S., Moltisanti, M., Ravì, F., Bruna, A.R., Naccari, F.: Aesthetic scoring of digital portraits for consumer applications, pp. 866008–866008-10 (2013), http://dx.doi.org/10.1117/12.2005211
  4. 4.
    Battiato, S., Farinella, G.M., Puglisi, G., Ravì, D.: Content-aware image resizing with seam selection based on gradient vector flow. In: ICIP, pp. 2117–2120 (2012)Google Scholar
  5. 5.
    Cho, T.S., Butman, M., Avidan, S., Freeman, W.T.: The patch transform and its applications to image editing. In: CVPR (2008)Google Scholar
  6. 6.
    Gal, R., Sorkine, O., Cohen-Or, D.: Feature-aware texturing. In: Proceedings of Eurographics Symposium on Rendering, pp. 297–303 (2006)Google Scholar
  7. 7.
    Gallea, R., Ardizzone, E., Pirrone, R.: Real-time content-aware image resizing using reduced linear model. In: ICIP 2010, IEEE International Conference on Image Processing. IEEE Computer Society, Washington, DC (2010)Google Scholar
  8. 8.
    Gooch, B., Reinhard, E., Moulding, C., Shirley, P.: Artistic composition for image creation. In: Proceedings of the 12th Eurographics Workshop on Rendering Techniques, pp. 83–88. Springer, London (2001)Google Scholar
  9. 9.
    Grill, T., Scanlon, M.: Photographic Composition: Guidelines for Total Image Control Through Effective Design. Watson-Guptill Publications (1983)Google Scholar
  10. 10.
    Guo, Y.W., Liu, M., Gu, T.T., Wang, W.P.: Improving photo composition elegantly: Considering image similarity during composition optimization. Comp. Graph. Forum 31(7 pt. 2), 2193–2202 (2012)Google Scholar
  11. 11.
    Itti, L., Koch, C., Niebur, E.: A model of saliency-based visual attention for rapid scene analysis. IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)CrossRefGoogle Scholar
  12. 12.
    Krages, B.: Photography: The Art of Composition. Allworth Press (2005)Google Scholar
  13. 13.
    Krähenbühl, P., Lang, M., Hornung, A., Gross, M.: A system for retargeting of streaming video. In: ACM SIGGRAPH Asia 2009 Papers, SIGGRAPH Asia 2009, pp.126:1–126:10. ACM, New York (2009)Google Scholar
  14. 14.
    Liu, L., Chen, R., Wolf, L., Cohen-Or, D.: Optimizing photo composition. Computer Graphic Forum (Proceedings of Eurographics) 29(2), 469–478 (2010)CrossRefGoogle Scholar
  15. 15.
    Lok, S., Feiner, S., Ngai, G.: Evaluation of visual balance for automated layout. In: Proceedings of the 9th International Conference on Intelligent User Interfaces, UI 2004, pp. 101–108. ACM Press, New York (2004)Google Scholar
  16. 16.
    Martinez, B., Block, J.: Visual forces: an introduction to design. Prentice Hall (1988)Google Scholar
  17. 17.
    Peters, G.: Aesthetic primitives of images for visualization. In: 11th Int’l Conference on Information Visualization 2007, pp. 316–325 (July 2007)Google Scholar
  18. 18.
    Pritch, Y., Kav-Venaki, E., Peleg, S.: Shift-map image editing. In: ICCV 2009, Kyoto, pp. 151–158 (September 2009)Google Scholar
  19. 19.
    Rivotti, V., Proenì, J., Jorge, J.A., Sousa, M.C.: Composition principles for quality depiction and aesthetics. In: Cunningham, D.W., Meyer, G.W., Neumann, L., Dunning, A., Paricio, R. (eds.) Computational Aesthetics: Eurographics Workshop on Computational Aesthetics in Graphics, Visualization and Imaging, Banff, Alberta, Canada, June 20-22, pp. 37–44. Eurographics Association (2007)Google Scholar
  20. 20.
    Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. ACM Transactions on Graphics (SIGGRAPH) 27(3), 1–9 (2008)CrossRefGoogle Scholar
  21. 21.
    Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. ACM Transactions on Graphics (Proceedings SIGGRAPH 2009) 28(3), 1–11 (2009)CrossRefGoogle Scholar
  22. 22.
    Santella, A., Agrawala, M., DeCarlo, D., Salesin, D., Cohen, M.: Gaze-based interaction for semi-automatic photo cropping. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2006, pp. 771–780. ACM, New York (2006)Google Scholar
  23. 23.
    Shamir, A., Sorkine, O.: Visual media retargeting. In: ACM SIGGRAPH ASIA 2009 Courses, SIGGRAPH ASIA 2009, pp. 11:1–11:13. ACM, New York (2009)Google Scholar
  24. 24.
    Simakov, D., Caspi, Y., Shechtman, E., Irani, M.: Summarizing visual data using bidirectional similarity. In: CVPR (2008)Google Scholar
  25. 25.
    Suh, B., Ling, H., Bederson, B.B., Jacobs, D.W.: Automatic thumbnail cropping and its effectiveness. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, UIST 2003, pp. 95–104. ACM, New York (2003)Google Scholar
  26. 26.
    Wang, Y.S., Lin, H.C., Sorkine, O., Lee, T.Y.: Motion-based video retargeting with optimized crop-and-warp. ACM Trans. Graph. 90, 90:1–90:9 (2010)Google Scholar
  27. 27.
    Wang, Y.S., Tai, C.L., Sorkine, O., Lee, T.Y.: Optimized scale-and-stretch for image resizing. In: ACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia 2008, pp. 118:1–118:8. ACM, New York (2008)Google Scholar
  28. 28.
    Zhang, M.: W.: Auto cropping for digital photographs. In: IEEE Conf. on Multimedia and Expo (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Roberto Gallea
    • 1
  • Edoardo Ardizzone
    • 1
  • Roberto Pirrone
    • 1
  1. 1.DICGIMUniversity of PalermoItaly

Personalised recommendations