Saliency detection based on superpixel correlation and cosine window filtering

  • Yunyi YanEmail author
  • Jiang Zhu


With the development of computer vision, image salient region detection plays an important role in the field of image processing. However, existing saliency detection methods can only generate saliency maps without achieving accuracy, thereby ignoring the integrity of the significant target. The present study proposed a saliency detection algorithm based on the correlation of superpixel and cosine window filtering (SPC) algorithm that introduced a variable weight superpixel segmentation method to keep the edge of information and enhance the integration of the salient target. Space distance and color distance are used to judge the correlation between two superpixels in the proposed algorithm, and based on the superpixel correlation, the saliency map is obtained by all superpixels’ voting. When the saliency map is corrected by a cosine window, we call this operation a cosine window filtering. Finally, we used the OSTU method for binarization and obtained the target position and size, using connected domain detection. The experiment results showed that the SPC algorithm can describe superpixels’ significance accurately and extract salient object. As compared with other algorithms, our algorithm offers higher accurate results, regarding the accurate position and size of salient targets.


Saliency detection Superpixel correlation Cosine window filtering Target extraction 



  1. 1.
    Achanta R, Hemami S, Estrada F, Susstrunk S (2009) Frequency-tuned salient region detection. Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, p 1597–1604Google Scholar
  2. 2.
    Achanta R, Shaji A, Smith K, Lucchi A, Fua P, Süsstrunk S (2010) SLIC superpixels. EpflGoogle Scholar
  3. 3.
    Cheng MM, Zhang GX, Mitra NJ, Torr PH, Hu SM (2011) Global contrast based salient region detection. Computer Vision and Pattern Recognition. IEEE, p 409–416Google Scholar
  4. 4.
    Ge W, Yu Y (2017) Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning Proc. IEEE Conference on Computer Vision and Pattern Recognition, HonoluluGoogle Scholar
  5. 5.
    Gupta R, Chaudhury S (2011) A scheme for attentional video compression. Pattern recognition and machine intelligence. Springer, Berlin Heidelberg, pp 458–465CrossRefGoogle Scholar
  6. 6.
    Hou X, Zhang L (2007) Saliency detection: a spectral residual approach. Computer Vision and Pattern Recognition, 2007. CVPR '07. IEEE Conference on. IEEE, p 1–8Google Scholar
  7. 7.
    Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20:1254–1259CrossRefGoogle Scholar
  8. 8.
    Kim W, Kim C (2011) A novel image importance model for content-aware image resizing. IEEE International Conference on Image Processing, p 2469–2472Google Scholar
  9. 9.
    Krahenbuhl P (2012) Saliency filters: contrast based filtering for salient region detection. Computer Vision and Pattern Recognition. IEEE, p 733–740Google Scholar
  10. 10.
    Li G, Yu Y (2015) Visual saliency based on multiscale deep features. Proc IEEE Conf Comput Vis Pattern Recognit:5455–5463Google Scholar
  11. 11.
    Mahadevan V, Vasconcelos N (2009) Saliency-based discriminant tracking. Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, p 1007–1013Google Scholar
  12. 12.
    Ohtsu N (2007) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9:62–66CrossRefGoogle Scholar
  13. 13.
    Schölkopf B, Platt J, Hofmann T (2006) Graph-based visual saliency. International conference on neural information processing systems. MIT Press, Cambridge, pp 545–552Google Scholar
  14. 14.
    Wang W, Shen J, Porikli F (2015) Saliency-aware geodesic video object segmentation. Computer Vision and Pattern Recognition IEEE, p 3395–3402Google Scholar
  15. 15.
    Wang L, Lu H, Xiang R, Yang MH (2015) Deep networks for saliency detection via local estimation and global search. IEEE Conference on Computer Vision and Pattern Recognition 3183–3192Google Scholar
  16. 16.
    Wang L, Wang L, Lu H, Zhang P, Ruan X (2018) Salient object detection with recurrent fully convolutional networks. IEEE Trans Pattern Anal Mach Intell PP(99):1–1Google Scholar
  17. 17.
    Xia Z, Wang X, Zhang L, Qin Z, Sun X, Ren K (2017) A privacy-preserving and copy-deterrence content-based image retrieval scheme in cloud computing. IEEE Transactions on Information Forensics & Security 11:2594–2608CrossRefGoogle Scholar
  18. 18.
    Zhai Y, Shah M (2006) Visual attention detection in video sequences using spatiotemporal cues. ACM International Conference on Multimedia, p 815–824Google Scholar
  19. 19.
    Zhao R, Ouyang W, Li H, Wang X (2015) Saliency detection by multi-context deep learning. Computer Vision and Pattern Recognition. IEEE, p 1265–1274Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.School of Aerospace Science and TechnologyXidian UniversityXi’anChina

Personalised recommendations