Skip to main content
Log in

Edit Propagation via Edge-Aware Filtering

  • Regular Paper
  • Published:
Journal of Computer Science and Technology Aims and scope Submit manuscript

Abstract

This paper presents a novel framework for efficiently propagating the stroke-based user edits to the regions with similar colors and locations in high resolution images and videos. Our framework is based on the key observation that the edit propagation intrinsically can also be achieved by utilizing recently proposed edge-preserving filters. Therefore, instead of adopting the traditional global optimization which may involve a time-consuming solution, our algorithm propagates edits with the aid of the edge-preserve filters. Such a propagation scheme has low computational complexity and supports multiple kinds of strokes for more flexible user interactions. Further, our method can be easily and efficiently implemented in GPU. The experimental results demonstrate the efficiency and user-friendliness of our approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Levin A, Lischinski D, Weiss Y. Colorization using optimization. ACM Transactions on Graphics, 2004, 23(3): 689–694.

    Article  Google Scholar 

  2. Lischinski D, Farbman Z, Uyttendaele M, Szeliski R. Interactive local adjustment of tonal values. ACM Transactions on Graphics, 2006, 25(3): 646–653.

    Article  Google Scholar 

  3. Pellacini F, Lawrence J. Appward: Editing measured materials using appearance-driven optimization. ACM Transactions on Graphics, 2007, 26(3): Article No. 54:1–10.

  4. An X, Pellacini F. Appprop: All-pairs appearance-space edit propagation. ACM Transactions on Graphics, 2008, 27(3): Article No. 40:1–9.

  5. Xu K, Li Y, Ju T, Hu S, Liu T Q. Efficient affinity-based edit propagation using K-D tree. ACM Transactions on Graphics, 2009, 28(5): Article No. 118:1–9.

    Google Scholar 

  6. Xiao C, Nie Y, Tang F. Efficient edit propagation using hierarchical data structure. IEEE Transactions on Visualization and Computer Graphics, 2011, 17(8): 1135–1147.

    Article  Google Scholar 

  7. Li Y, Ju T, Hu S. Instant propagation of sparse edits on images and videos. Computer Graphics Forum, 2010, 29(7): 2049–2054.

    Article  Google Scholar 

  8. He K, Sun J, Tang X. Guided image filtering. In Proc. ECCV, Sept. 2010, pp.1–14.

  9. Gastal E S L, OliveiraM M. Domain transform for edge-aware image and video processing. ACM Transactions on Graphics, 2011, 30(4): Article No. 69:1–11.

    Google Scholar 

  10. Xu K, Wang J, Tong X, Hu S, Guo B. Edit propagation on bidirectional texture functions. Computer Graphics Forum, 2009, 28(7): 1871–1877.

    Article  Google Scholar 

  11. Criminisi A, Sharp T, Rother C, Pérez P. Geodesic image and video editing. ACM Transactions on Graphics, 2010, 29(5): Article No. 134: 1–12.

    Google Scholar 

  12. Ma L, Xu K. Antialiasing recovery for editing propagation. In Proc. ACM Siggraph VRCAI, Dec. 2011, pp.1–6.

  13. Bie X, Huang H, Wang W. Real time edit propagation by efficient sampling. Computer Graphics Forum, 2011, 30(7): 2041–2048.

    Article  Google Scholar 

  14. Kin M H, Ritschel T, Kautz J. Edge-aware color appearance. ACM Trans. Graphics, 2011, 30(2): Article No. 13:1–9.

  15. Farbman Z, Fattal R, Lischinski D, Szeliski R. Edit-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics, 2008, 27(3): Article No. 67:1–8.

    Google Scholar 

  16. Levin A, Lischinski D,Weiss Y. A closed-form solution to natural image matting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2): 228–242.

    Article  Google Scholar 

  17. Farbman Z, Fattal R, Lischinski D. Diffusion maps for edgeaware image editing. ACM Transactions on Graphics, 2010, 29(6): Article No. 145:1–6.

    Google Scholar 

  18. Perona P, Malik J. Scale-space and edge detection using anisotropic diffusion. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(7): 629–639.

    Article  Google Scholar 

  19. Weickert J, Romeny B M, Viergever M A. Efficient and reliable schemes for nonlinear diffusion filtering. IEEE Transactions on Image Processing, 1998, 7(3): 398–410.

    Article  Google Scholar 

  20. Tomasi C, Manduchi R. Bilateral filtering for gray and color images. In Proc. the 6th ICCV, Jan. 1998, pp.839–846.

  21. Barash D. A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(6): 844–847.

    Article  Google Scholar 

  22. Paris S, Hasinoff S W, Kautz J. Local laplacian filters: Edgeaware image processing with a Laplacian pyramid. ACM Transactions on Graphics, 2011, 30(6): Article No. 68:1–10.

    Google Scholar 

  23. Durand F, Dorsey J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics, 2002, 21(3): 257–266.

    Article  Google Scholar 

  24. Chen J, Paris S, Durand F. Real-time edge-aware image processing with the bilateral grid. ACM Transactions on Graphics, 2007, 26(3): Article No. 103:1–11.

    Google Scholar 

  25. Paris S, Durand F. A fast approximation of the bilateral filter using a signal processing approach. International Journal of Computer Vision, 2009, 81(1): 24–52.

    Article  Google Scholar 

  26. Fattal R. Edge-avoiding wavelets and their applications. ACM Trans. Graphics, 2009, 28(3): Article NO. 22:1–9.

    Google Scholar 

  27. Li Y, Adelson E H, Agarwala A. Scribbleboost: Adding classification to edge-aware interpolation of local image and video adjustments. Computer Graphics Forum, 2008, 27(4): 1255–1264.

    Article  Google Scholar 

  28. Li Y, Sun J, Tang C, Shum H. Lazy snapping. ACM Transactions on Graphics, 2004, 23(3): 303–308.

    Article  Google Scholar 

  29. Rother C, Kolmogorov V, Blake A. “Grabcut” — Interactive foreground extraction using iterated graph cuts. ACM Transactions on Graphics, 2004, 23(3): 309–314.

    Article  Google Scholar 

  30. Szeliski R, Zabih R, Scharstein D, Veksler O, Kolmogorov V, Agarwala A, Tappen M F, Rother C. A comparative study of energy minimization methods for Markov random fields with smoothness-based priors. IEEE Trans. Pattern Analysis and Machine Intelligence, 2008, 30(6): 1068–1080.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wei Hu.

Additional information

This work was supported by the National Natural Science Foundation of China under Grant No.61003132, the National High Technology Research and Development 863 Program of China under Grant No. 2010AA012400.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Hu, W., Dong, Z. & Yuan, GD. Edit Propagation via Edge-Aware Filtering. J. Comput. Sci. Technol. 27, 830–840 (2012). https://doi.org/10.1007/s11390-012-1267-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11390-012-1267-3

Keywords

Navigation