The Visual Computer

, Volume 34, Issue 3, pp 431–442 | Cite as

Content-aware image resizing using quasi-conformal mapping

Original Article
  • 228 Downloads

Abstract

Content-aware image resizing is resizing an image such that the prominent feature of the image is intact and the homogenous content of the image is distorted as little as possible. There is a lot of research on this topic, and various approaches have been proposed so far. One problem with previous methods is the lack of a theoretical guarantee of a rigorous bijective map between an image and the target image, which may cause artifacts in the target image. In this paper, we present a new approach to solve the image resizing problem based on quasi-conformal mapping. We apply quasi-conformal mapping to set up a bijective map between an image and the target image such that the salient feature of the image is uniformly scaled, while the homogenous content of the image is distorted as little as possible. The distortion is characterized by a function defined by the Beltrami coefficient of the quasi-conformal mapping, which is minimized by solving a nonconvex optimization problem. Solving the optimization problem is reduced to solving two convex optimization problems alternatingly. We implemented our algorithm with many examples and made comparisons with previous approaches. The examples suggest that our method is comparable with previous approaches while guaranteeing that there are no foldovers. Furthermore, our method can easily preserve line features and handle large changes in the aspect ratios of images.

Keywords

Content-aware image resizing Quasi-conformal mapping Beltrami coefficient 

Notes

Acknowledgements

The work is supported by the Open Project Program of the State Key Lab of CAD&CG (Grant No. A1602), Zhejiang University.

References

  1. 1.
    Gal, R., Sorkine, O., Cohen, D.: Feature-aware texturing, In: Proc. Symp. Rendering, Volume, 297–303 (2006)Google Scholar
  2. 2.
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing, ACM TOG(Proc. SIGGRAPH), 26(3), 267–276 (2007)Google Scholar
  3. 3.
    Wang, Y. S., Tai, C. L., Sorkine, O., Lee, T. Y.: Optimized scale-and-stretch for image resizing, ACM TOG(Proc. SIGGRAPH Asia), 27(5), 1–8(2008)Google Scholar
  4. 4.
    Karni, Z., Freedman, D., Gotsman, C.: Energy-based image deformation, SGP’09 Proceedings of the Symposium on Geometry Processing, 28(5), 1257–1268(2009)Google Scholar
  5. 5.
    Zhang, G.X., Cheng, M.M., Hu, S.M., Martin, R.R.: A shape preserving approach to image resizing. Comput. Graph. Forum 28(7), 1897–1906 (2009)CrossRefGoogle Scholar
  6. 6.
    Guo, Y., Liu, F., Shi, J., Zhou, Z., Gleicher, M.: Image retargeting using mesh parameterization. IEEE Trans. Multimedia 11(5), 856–867 (2009)CrossRefGoogle Scholar
  7. 7.
    Jin, Y., Liu, L.G., Wu, Q.B.: Nonhomogeneous scaling optimization for realtime image resizing. The visual Computer 26(6–8), 769–778 (2010)CrossRefGoogle Scholar
  8. 8.
    Chen, R. J., Freedman, D., Karni, Z., et al.: Content-aware image resizing by quadratic programming, Proceedings of the 2010 IEEE CVPR WorkShop on NORDIA. Florida, USA: IEEE, 1–8(2010)Google Scholar
  9. 9.
    Panozzo, D., Weber, O., Sorking, O.: Robust image retargeting via axis-aligned deformation. Eurographics 31(2), 229–236 (2012)Google Scholar
  10. 10.
    Lin, S.S., Yeh, I.C., Lin, C.H.: Patch-based image warping for content-aware retargeting. IEEE Trans. Multimed. 15(2), 359–368 (2013)CrossRefGoogle Scholar
  11. 11.
    Ahlfors, L.: Conformality with respect to riemannian matrices. Ann. Acad. Sci. Fenn. Ser. 206, 1–22 (1955)MATHGoogle Scholar
  12. 12.
    Shi, M.L., Peng, G.Q., Yang, L., Xu, D.: Optimal Bi-directional Seam Carving for Content-Aware Image Resizing. Digital Techniques and Systems, Lecture Notes in Computer Science 6249, 456–467 (2010)Google Scholar
  13. 13.
    Ahlfors, L.: Lectures on Quasiconformal Mappings(Second edition). Amer. Mathematical Sorciety, Rhode Island (2006)Google Scholar
  14. 14.
    Gardiner, F., Lakic, N.: Quasiconformal Teichmüller Theory. Amer. Mathematical Sorciety, New York (2000)MATHGoogle Scholar
  15. 15.
    Zeng, W., Luo, F., Yau, S.T., Gu, X.D.: Surface quasi-conformal mapping by solving beltrami equations, IMA Conference on the Mathematics of Surfaces, pp. 391–408 (2009)Google Scholar
  16. 16.
    Lui, L.M., Wong, T.W., Gu, X.F., Thompson, P.M., Chan, T.F., Yau, S.T.: Hippocampal Shape Registration using Beltrami Holomorphic flow, Medical Image Computing and Computer Assisted Intervention(MICCAI). Part II, LNCS 6362, pp. 323–330 (2010)Google Scholar
  17. 17.
    Zeng, W., Gu, X.F.: Registration for 3d surfaces with large deformations using quasi-conformal curvature flow, In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2457C2464 (2011)Google Scholar
  18. 18.
    Lipman, Y.: Bounded distortion mapping spaces for triangular meshes. ACM TOG 31(4), 108 (2012)CrossRefGoogle Scholar
  19. 19.
    Zeng, W., Lui, L.M., Luo, F., Chan, T.F., Yau, S.T., Gu, X.F.: Computing quasiconformal maps using an auxiliary metric and discrete curvature flow. Numer. Math. 121, 671–703 (2012)MathSciNetCrossRefMATHGoogle Scholar
  20. 20.
    Lui, L.M., Wong, T.W., Zeng, W., Gu, X., Thompson, P.M., Chan, T.F., Yau, S.-T.: Optimization of surface registrations using beltrami holomorphic flow. J. Sci. Comput. (JSC) 50(3), 557–585 (2012)MathSciNetCrossRefMATHGoogle Scholar
  21. 21.
    Lam, K.C., Lui, L.M.: Landmark- and intensity-based registration with large deformations via quasi-conformal maps. Siam J. Imagin. Sci. 7(4), 2364–2392 (2014)MathSciNetCrossRefMATHGoogle Scholar
  22. 22.
    Lui, L.M., Lam, K.C., Yau, S.T., Gu, X.F.: Teichmüller Mapping(T-Map) and its application to landmark matching registration. Siam J. Imagin. Sci. 7(1), 391–426 (2014)CrossRefMATHGoogle Scholar
  23. 23.
    Lui, L.M., Ng, T.C.: A splitting method for diffeomorphism optimization problem using beltrami coefficients. J. Sci. Comput. 63, 573–611 (2015)MathSciNetCrossRefMATHGoogle Scholar
  24. 24.
    Lee, Y.T., Lam, K.C., Lui, L.M.: Landmark-matching transformation with large deformation via n-dimensional quasi-conformal maps. J. Sci. Comput. 67, 926–954 (2016)MathSciNetCrossRefMATHGoogle Scholar
  25. 25.
    Nian, X., Chen, F.: Planar Domain Parameterization For Isogeometric Analysis Based On Teichmuller Mapping, Comput. Methods Appl. Mech. Eng., doi: 10.1016/j.cma.2016.07.035
  26. 26.
    Nian, X., Chen, F.: Planar shape interpolation based on Teichmller mapping. In: Proceedings of Pacific Graphics, to appear, Computer Graphics Forum (2016)Google Scholar
  27. 27.
    Levi, Z., Weber, O.: On the Convexity and Feasibility of the Bounded Distortion Harmonic Mapping Problem, ACM Trans. Graph. 35, 4, Article 106 (July 2016), 15 pages. DOI: 10.1145/2897824.2925929
  28. 28.
    Chien, E., Chen, R., Weber, O.: Bounded Distortion Harmonic Shape Interpolation, ACM Trans. Graph. 35, 4, Article 105 (July 2016), 15 pages. DOI: 10.1145/2897824.2925926
  29. 29.
    Weber, O., Myles, A., Zorin, D.: Computing extremal quasiconformal maps. Comput. Graph. Forum 31(5), 1679–1689 (2012)CrossRefGoogle Scholar
  30. 30.
    Goferman, S., Zelnik-Manor, L., Tal, A.: Context-aware saliency detection. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 1915–1926 (2012)CrossRefGoogle Scholar
  31. 31.
    Yan, Q., Xu, L., Shi, J., jia, J.: Hierarchical saliency detection. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1155–1162(2013)Google Scholar
  32. 32.
    Achanta, R., Hemami, S., Estrada, F., Susstrunk, S.: Frequency-tuned salient region detection. In: IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2009), 1597–1604(2009).Google Scholar
  33. 33.
    Ho, Kin Tat, Lui, Lok Ming: QCMC:quasi-conformal parameterization for multiply-connected domains. Advances in Computational Mathmetics 42, 279–312 (2016)MathSciNetCrossRefMATHGoogle Scholar
  34. 34.
    Aigerman, N., Lipman, Y.: Injective and Bounded Distortion Mappings in 3D, ACM Trans. Graphics 32, No.4, July 2013, Article No. 106 (2013)Google Scholar
  35. 35.
    Zhang, L., Liu, L., Gotsman, C., Gortler, S.J.: An as-rigid-as-possible approach to sensor network localization. ACM Transactions on Sensor Networks 6(4), 1–12 (2010)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  1. 1.School of Computer Science and TechnologyHangzhou Dianzi UniversityHangzhouChina
  2. 2.School of Mathematical SciencesUniversity of Science and Technology of ChinaHefeiChina

Personalised recommendations