Skip to main content
SpringerLink
Log in

Saliency detection via PCA of image patches and ICA-R

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

A variety of computational models based on different views for visual saliency detection have emerged in computer vision. In this paper, we combine RGB space and Lab space to represent original features of each image patch in the vector form, and employ principal component analysis (PCA) to select effective features. The saliency cue is obtained by integrating the contrast and distribution of image patches in the reduced dimensional space and supposed to be the reference for saliency foreground. Then we regard saliency map computation as a source signal separation problem in the framework of independent component analysis with reference (ICA-R). Our approach utilizes the common ICA-R to separate the saliency object from the background of the input image with the saliency cue. The main benefits consist of two aspects. On one hand, the combination of Lab and RGB color spaces in both the saliency reference computation and saliency result computation is able to produce better saliency maps than those using only one color space. On the other hand, the input image is assumed to be a mixture of saliency foreground and background, which enables the saliency detection can be embedded into the source separation problem. This source separation problem is solved by ICA-R with the reference for saliency foreground. Extensive experiments on public saliency benchmarks demonstrate that compared with the state-of-the-art algorithms, the proposed method is more effective.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Achanta R, Estrada F, Wils P, Süsstrunk S (2008) Salient region detection and segmentation. In: Proceedings of the 6th International Conference on Computer Vision Systems. pp. 66–75. Berlin: Springer-Verlag

  2. Achanta R, Hemami S, Estrada F, Süsstrunk S(2009) Frequency-tuned salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 1579–160` Miami Beach

  3. Avidan S, Shamir A (2007) Seam carving for content-aware image resizing. ACM Trans Graph 26(3):10

    Article  Google Scholar 

  4. Aziz MZ, Mertsehing B (2008) Fast and robust generation of feature maps for region-based visual attention. IEEE Trans Image Process 17(5):633–644

    Article  MathSciNet  Google Scholar 

  5. Back AD (1997) A first application of independent component analysis to extracting structure from stock returns. Neur Syst 8(4):473–484

    Article  Google Scholar 

  6. Borji A, Itti L (2012) Exploiting local and global patch rarities for saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 478–485. Providence

  7. Bruce N, Tsotsos J (2005) Saliency based on information maximization. In: Advances in Neural Information Processing Systems, pp.155–162

  8. Cheng MM, Zhang GX, Mitra NJ, Huang X, Hu SM (2011) Global contrast based salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 409–416. Providence

  9. Christopoulos C, Skodra A, Ebrahimi T (2000) The ipeg2000 still image coding system:an overview. IEEE Trans On Consumer Electronics 46(4):1103–1127

    Article  Google Scholar 

  10. Duan L, Wu C, Miao J, Qing L, Fu Y(2011) Visual saliency detection by spatially weighted dissimilarity. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 473–480. Providence

  11. Feng J, Wei YC, Tao L T, Zhang C, Sun J(2011) Salient object detection by composition. In: Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain, Nov. 6–13, pp. 1028–1035

  12. Goferman S, Zelnik-Manor L, Tal A (2012) Context-aware saliency detection. IEEE Trans Pattern Anal Mach Intell 34(10):1915–1926

    Article  Google Scholar 

  13. Goldstein JS, Guerci JR, Reed IS (1999) An optimal generalized theory of signal representation. In: Proceedings of the IEEE International International Conference on Acoustics, Speech and Signal Processing, Vol. 3, pp. 1357–1360. Phoenix

  14. Gupta R, Chaudhury S (2011) A scheme for attentional video compression. Pattern Recognition and Machine Intelligence. Springer, Berlin, pp 458–465

    Book  Google Scholar 

  15. Harel J, Koch C, Perona P (2007) Graph-based visual saliency. Adv Neural Inf Process Syst 19:545

    Google Scholar 

  16. Hou XD, Zhang LQ (2007) Saliency detection: a spectral residual approach. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8. Minneapolis

  17. Hu ZP, Meng PQ (2011) Graph presentation random walk salient object detection algorithm based on global isolation and local homogeneity. Acta Automatica Sinica 37(10):1279–1284 (in Chinese)

    Google Scholar 

  18. Hyvärinen A(1998) New approximations of differential entropy for independent component analysis and projection pursuit. In: Advances in Neural Information Processing Systems 10, pp. 273–279, MIT Press

  19. Hyvärinen A (1999) Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans Neural Netw 10(3):626–634

    Article  Google Scholar 

  20. Hyvärinen A, Oja E (1997) A fast fixed-point algorithm for independent component analysis. Neural Comput 9(7):1483–1492

    Article  Google Scholar 

  21. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  22. Jian MW, Dong JY, Ma J (2011) Image retrieval using wavelet-based salient regions. Imaging Sci J 59(4):219–231

    Article  Google Scholar 

  23. Jiang HZ, Wang JD, Yuan ZJ, Wu Y, Zheng NN, Li SP (2013) Salient object detection: a discriminative regional feature integration approach. In: Proceedings of the International Computer Vision and Pattern Recognition Conference, pp. 2083–2090. Portland

  24. Klein AD, Frintrop S(2011) Center-surround divergence of feature statistics for salient object detection. In: Proceedings of the IEEE International Conference on Computer Vision, Barcelona, Spain, pp. 2214–2219

  25. Lin QH, Zheng YR, Yin FL, Liang HL (2004) Speech segregation using constrained ICA. Lect Notes Comput Sci 3173:755–760

    Article  Google Scholar 

  26. Lin QH, Zheng YR, Yin FL, Liang HL, Calhoun VD (2007) A fast algorithm for one-unit ICA-R. Inf Sci 5(177):1265–1275

    Article  MathSciNet  Google Scholar 

  27. Liu T, Sun J, Zhang N, Tang X, Shum HY (2011) Learning to detect a salient object. IEEE Trans Pattern Anal Mach Intell 33(2):353–367

    Article  Google Scholar 

  28. Lu W, Rajapakse JC (2006) ICA with reference. Neurocomputing 69(16):2244–2257

    Article  Google Scholar 

  29. Ma, YF, Zhang, HJ (2003) Contrast-based image attention analysis by using fuzzy growing. In: Proceedings of the 11th ACM International Conference on Multimedia. pp. 374–381. New York

  30. Marchesotti L, Cifarelli C, Csurka G (2009) A framework for visual saliency detection with application to image thumbnailing. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2232–2239, Kyoto

  31. Margolin R, Tal A, Manor LZ (2013) What makes a patch distinct. In: Proceedings of the International Computer Vision and Pattern Recognition Conference, pp. 1139–1146. Portland

  32. Peruzzi F, Krahenbuhl P, Pritch Y, Hornung A(2012) Saliency filters: Contrast based filtering for salient region detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. pp. 733–740. Providence

  33. Rajapakse JC, Kruggel F, Maisog JM, Von Cramon DY (1998) Modeling hemodynamic response for analysis of functional MRI time-series. Hum Brain Mapp 6(4):283–300

    Article  Google Scholar 

  34. Sun J, Lu HC, Li SF. (2012) Saliency detection based on integration of boundary and soft-segmentation. In: Proceeding of IEEE International Conference on Image Processing, pp.1085–1088

  35. Treisman A, Gelade G (1980) A feature-integration theory of attention. Cogn Psychol 12(1):97–136

    Article  Google Scholar 

  36. Xie YL, Lu HC (2011) Visual saliency detection based on bayesian model. In: Proceeding of IEEE International Conference on Image Processing, pp. 645–648

  37. Xin F, Dan Y, Zhang L (2011) Saliency variation based quality assessment for packet-loss-impaired videos. Acta Automatica Sinica 37(11):1322–1331 (in Chinese)

    Google Scholar 

  38. Yan J, Zhu M, Liu H, Liu Y (2010) Visual saliency detection via sparsity pursuit. IEEE Signal Proc Let 17(8):739–742

    Article  Google Scholar 

  39. Yan Q, Xu L, Shi JP, Jia JY (2013) Hierarchical saliency detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1155–1162. Portland

  40. Yang C, Zhang LH, Lu HC, Ruan X,Yang MH (2013) Saliency detection via graph-based manifold ranking. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3166–3173. Portland

  41. Zhai Y, Shah M (2006) Visual attention detection in video sequences using spatio-temporal cues. In: Proceedings of the 14th annual ACM international conference on Multimedia. pp. 815–824. New York

Download references

Author information

Authors and Affiliations

  1. Physics & Electronic Engineering College, Nanyang Normal University, Nanyang, 473061, People’s Republic of China

    Zhang Ying-Ying, Qin Yi, Lv Xiao-Dong & Zhang Ping

Authors
  1. Zhang Ying-Ying
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Qin Yi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Lv Xiao-Dong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhang Ping
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhang Ying-Ying.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ying-Ying, Z., Yi, Q., Xiao-Dong, L. et al. Saliency detection via PCA of image patches and ICA-R. Multimed Tools Appl 75, 4527–4542 (2016). https://doi.org/10.1007/s11042-015-2489-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2489-5

Keywords

Search

Navigation