Skip to main content
Log in

A novel image matting method using sparse manual clicks

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Traditional image matting methods often have strict requirements on user input. This paper proposes a new matting method based on spectral clustering, which generates a well matte using a sparse user input. Firstly, connected components are obtained using spectral clustering, which actually utilizes a linear transformation of the smallest eigenvectors of the matting Laplacian matrix. An accurate trimap is obtained via user input and threshold segmentation. Secondly, sample sets are gathered by two-level hierarchical clustering and Fast Approximate Nearest Neighbors algorithm and unknown pixels are evaluated by the samples. Finally, an optimal matte is obtained by constructing an energy function with local smoothness constraint. Experiments show that the proposed method outperforms most of the state-of-the-art methods with a sparse user input and our method has fewer requirements to get a robust matte.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Chen Q, Li D, Tang C (2012) KNN matting. CVPR, 2175–2188

  2. Chen X, Zou D, Tan P (2013) Image matting with local and nonlocal smooth priors, CVPR, 1902–1907

  3. Chuang Y-Y, Curless B, Salesin DH, Szeliski R (2001) A Bayesian approach to digital matting. In Proc. 2001 I.E. Computer Society Conf. Computer Vision and Pattern Recognition. 2:II-264–271

  4. Gastal ESL, Oliveira MM (2010) Shared sampling for real-time alpha matting. Eurographics, pp 575–584

  5. Grady L, Schiwietz T, Aharon S (2005) Random walks for interactive alpha-matting. VIIP, pp 423–429

  6. Guan Y, Chen W, Liang X, Ding Z, Peng Q (2006) Easy matting–a stroke based approach for continuous image matting. Computer Graphics Forum 25(3):567–576

    Article  Google Scholar 

  7. He K, Sun J, Tang X (2010) Fast matting using large kernel matting Laplacian matrices, CVPR, pp 2165–2172

  8. He K, Rhemann C, Rother C, Tang X, Sun J (2011) A global sampling method for alpha matting. In Proc. 2011 I.E. Conf. Computer Vision and Pattern Recognition, pp 2049–2056

  9. He B, Wang G, Ruan Z, Yin X, Pei X, Lin X (2012) Local matting based on sample-pair propagation and iterative refinement, ICIP, pp 285–288

  10. He B, Wang G, Shi C, Yin X, Liu B, Lin X (2013) Iterative transductive learning for alpha matting. ICIP, 4282–4286

  11. Johnson J, Rajan D, Cholakkal H (2014) Sparse codes as alpha mattes, BMVC

  12. Kim B-K, Jin M, Song W-J (2014) Local and nonlocal color line models for image matting. IEICE Trans Fundam Electron Commun Comput Sci E97-A(8):1814–1819

    Article  Google Scholar 

  13. Lee P, Wu Y (2011) Nonlocal matting. In Proc. 201 1 I.E. Conf. Computer Vision and Pattern Recognition, pp 2193–2200

  14. Levin A, Lischinski D, Weiss Y (2008) A closed-form solution to natural image matting. IEEE Trans Pattern Analysis and Machine Intelligence 30(2):228–242

    Article  Google Scholar 

  15. Levin A, Rav Acha A, Lischinski D (2008) Spectral matting. IEEE Trans Pattern Analysis and Machine Intelligence 30(10):1699–1712

    Article  Google Scholar 

  16. Muja M, Lowe D (2009) Fast approximate nearest neighbors with automatic algorithm configuration. VISAPP, pp 331–340

  17. Ng AY, Jordan MI, Weiss Y (2001) On spectral clustering: analysis and an algorithm. In: Advances in neural information processing systems, MIT Press, Cambridge, pp 849–856

  18. Rhemann C, Rother C, Gelautz M (2008) Improving color modeling for alpha matting. BMVC, pp 115.1–115.10

  19. Rhemann C, Rother C, Wang J, Gelautz M, Kohli P, Rott P (2009) A perceptually motivated online benchmark for image matting. In: Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR ‘09), Miami, 20–25 June 2009, 8 p

  20. Rhemann C, Rother C, Kohli P, Gelautz M (2010) A spatially varying PSF-based prior for alpha matting. CVPR, pp 2149–2156

  21. Shahrian E, Rajan D, Price B, et al (2013) Improving image matting using comprehensive sampling sets. In Proc. 2013 I.E. Conf. Computer Vision and Pattern Recognition

  22. Sun J, Jia J, Tang C-K, Shum H-Y (2004) Poisson matting. In Proc. ACM SIGGRAPH 23(3):315–321

  23. Tseng C, Wang S (2012) A cell-based matting Laplacian for contrast enhancement. ICIP, pp 945–948

  24. Wang J, Cohen M (2007) Optimized color sampling for robust matting. In Proc. 2007 I.E. Conf. Computer Vision and Pattern Recognition, pp 1–8

  25. Wang J, Cohen MF (2008) Image and video matting: a survey. 3(2). Now Publishers Inc.

  26. Xiang S, Nie F, Zhang C (2010) Semi-supervised classification via local spline regression. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(11):2039–2053

    Article  MathSciNet  Google Scholar 

  27. Zhang Z, Zhu Q, Xie Y (2012) Learning based alpha matting using support vector regression, ICIP, 2109–2122

  28. Zheng Y, Kambhamettu C, Zheng Y, Kambhamettu C (2009) Learning based digital matting. ICCV, pp 889–896

Download references

Acknowledgments

This paper is supported by “the Fundamental Research Funds for the Central Universities” and “the Science and Technology Planning Project of Hunan Province (2014WK3002)”.

This work was partly supported by the National Science Foundation of China under grant No. 61262033,61262009; the Natural Science Foundation of Jiangxi Province, China under grant No. 20142BAB207009; the Science Foundation of Jiangxi Provincial Department of Education, China under grant No. GJJ13303.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hui Chen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tan, G., Chen, H. & Qi, J. A novel image matting method using sparse manual clicks. Multimed Tools Appl 75, 10213–10225 (2016). https://doi.org/10.1007/s11042-015-3160-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-3160-x

Keywords

Navigation