Skip to main content
SpringerLink
Log in

Salient object detection based on regions

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Salient object detection aims to automatically localize the attractive objects with respect to surrounding background in an image. It can be applied to image browsing, image cropping, image compression, content-based image retrieval, and etc. In the literature, the low-level (pixel-based) features (e.g., color and gradient) were usually adopted for modeling and computing visual attention; these methods are straightforward and efficient but limited by performance, due to losing global organization and inference. Some recent works attempt to use the region-based features but often lead to incomplete object detection. In this paper, we propose an efficient approach of salient object detection using region-based representation, in which two novel region-based features are extracted for proposing salient map and the salient object are localized with a region growing algorithm. Its brief procedure includes: 1) image segmentation to get disjoint regions with characteristic consistency; 2) region clustering; 3) computation of the region-based center-surround feature and color-distribution feature; 4) combination of the two features to propose the saliency map; 5) region growing for detecting salient object. In the experiments, we evaluate our method with the public dataset provided by Microsoft Research Asia. The experimental results show that the new approach outperforms other four state-of-the-arts methods with regard to precision, recall and F-measure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

Notes

  1. http://research.microsoft.com/en-us/um/people/jiansun/salientobject/salient_object.htm

References

  1. Cheng H-D, Sun Y (2000) A hierarchical approach to color image segmentation using homogeneity. IEEE Trans Image Process 9(12):2071–2082

    Article  Google Scholar 

  2. Deng Y, Manjunath B (2001) Unsupervised segmentation of color-texture regions in images and video. IEEE Trans Pattern Anal Mach Intell 23(8):800–810

    Article  Google Scholar 

  3. Frintrop S, Backer G, Rome E (2005) Goal-directed search with a top-down modulated computational attention system. DAGM-Symposium:117–124

  4. Hou X, Zhang L (2007) Saliency Detection: A Spectral Residual Approach. IEEE Conference on Computer Vision and Pattern Recognition (CVPR):1–8

  5. Itti L, Koch C (2001) Computational modeling of visual attention. Nat Rev Neurosci 2(3):194–203

    Article  Google Scholar 

  6. Itti L, Koch C, Niebur E (1998) A model of saliency-based visual attention for rapid scene analysis. IEEE Trans Pattern Anal Mach Intell 20(11):1254–1259

    Article  Google Scholar 

  7. Kanan C, Tong M, Zhang L, Cottrell G (2009) SUN: Top-down saliency using natural statistics. Visual Cognition 17:979–1003

    Article  Google Scholar 

  8. Kim S, Park S, Kim M (2003) Central object extraction for object-based image retrieval. Lecture Notes in Computer Science on Image and Video Retrieval l(2728):523–528

    Google Scholar 

  9. Ko BC, Byun HR (2003) Region-based image retrieval: a new method for extraction of salient regions and learning of importance scores. International Journal of Pattern Recognition and Artificial Intelligence 17(8):1349–1367

    Article  Google Scholar 

  10. Koch C, Ullman S (1985) Shifts in selective visual attention: towards the underlying neural circuitry. Hum Neurobiol 4:219–227

    Google Scholar 

  11. Liansheng Z, Ketan T, Nenghai Y, Yangchun Q (2009) Fast salient object detection based on segments. International Conference on Measuring Technology and Mechatronics Automation 1:469–472

    Google Scholar 

  12. Lin L, Liu X, Zhu S-C (2010) Layered graph matching with composite cluster sampling. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 32(8):1426–1442

    Article  Google Scholar 

  13. Lin L, Luo P, Chen X, Zeng K (2012) Representing and recognizing objects with massive local image patches. Pattern Recognition 45(1):231–240

    Article  MATH  Google Scholar 

  14. Lin L, Peng S, Porway J, Zhu S-C, Wang Y (2007) An empirical study of object category recognition: sequential testing with generalized samples. Proc IEEE International Conference on Computer Vision (ICCV) 1:419–426

    Google Scholar 

  15. Lin L, Wu T, Xu Z, Porway J (2009) A stochastic graph grammar for compositional object representation and recognition. Pattern Recognition 42(7):1297–1307

    Article  MATH  Google Scholar 

  16. Liu T, Sun J, Zheng NN, Tang X, Shum H-Y (2007) Learning to detect a salient object. IEEE Conference on Computer Vision and Pattern Recognition (CVPR):1–8

  17. Lucchese L, Mitra SK (2001) Color image segmentation: a state-of-the-art survey. The Indian National Science Academy (INSA-A) 67(2):207–221

    Google Scholar 

  18. Ma Y-F, Zhang H-J (2003) Contrast-based Image Attention Analysis by Using Fuzzy Growing. ACM International Conference on Multimedia:374–381

  19. Marchesotti L, Cifarelli C, Csurka G (2009) A framework for visual saliency detection with applications to image thumb nailing. International Conference on Computer Vision (ICCV):2232–2239

  20. Meur O, Callet P, Barba D, Thoreau D (2006) A coherent computational approach to model bottom-up visual attention. IEEE Trans Pattern Anal Mach Intell 28(5):802–817

    Article  Google Scholar 

  21. Navalpakkam V, Itti L (2006) An integrated model of top-down and bottom-up attention for optimizing detection speed. IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2:2049–2056

    Google Scholar 

  22. Nothdurft H (2000) Salience from feature contrast: add itivity across dimensions. Vision Res 40(10):1183–1201

    Article  Google Scholar 

  23. Nothdurft H (2000) Salience from feature contrast: variations with texture density. Vision Res 40(23):3181–3200

    Article  Google Scholar 

  24. Ouerhani N, Bracamonte J, Hugli H, Ansorge M, Pellandini F (2001) Adaptive color image compression based on visual attention. International Conference on Image Analysis and Processing (ICIAP):416–421

  25. Pedro F, Daniel P (2004) Efficient graph-based image segmentation. International Journal of Computer Vision 59(2):167–181

    Article  Google Scholar 

  26. Shi J, Malik J (2000) Normalized cuts and image segmentation. IEEE Trans Pattern Analysis and Machine Intelligence 22(8):888–905

    Article  Google Scholar 

  27. Stentiford F (2007) Attention based Auto Image Cropping. Workshop on Computational Attention and Applications (ICVS)

  28. Sun Y, Fisher R (2003) Object-based visual attention for computer vision. Artificial Intelligence 146(1):77–123

    Article  MATH  MathSciNet  Google Scholar 

  29. Thoma G, Hichem S (2007) Region-oriented visual attention framework for activity detection. The 4th International Workshop on Attention in Cognitive Systems (WAPCV): 481–496

  30. Thomas G, Hichem S, David H, Iris V, Valentin E (2008) Modeling attention and perceptual grouping to salient objects. The 5th International Workshop on Attention in Cognitive Systems (WAPCV):166–182

  31. Treue S (2003) Visual attention: the where, what, how and why of saliency. Curr Opin Neurobiol 13(4):428–432

    Article  Google Scholar 

  32. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol: 511–518

  33. Viswanath G, Yiqun H, Deepu R (2009) Salient region detection by modeling distributions of color and orientation. IEEE Transactions on Multimedia 11(5):892–905

    Article  Google Scholar 

  34. Walther D, Koch C (2006) Modeling attention to salient proto-objects. Neural Network 19(9):1395–1407

    Article  MATH  Google Scholar 

  35. Zhang W, Wu Q, Wang G (2008) Adaptive semantic bayesian framework for image attention pattern recognition. Proceedings of the International Conference on Pattern Recognition (ICPR):1–4

Download references

Author information

Authors and Affiliations

  1. School of Software, Sun Yat-sen University, Guangzhou, China

    Zhuojia Liang, Mingjia Wang, Liang Lin & Wenjun Li

  2. School of Information Science and Technology, Sun Yat-sen University, Guangzhou, China

    Zhuojia Liang, Mingjia Wang & Xiaocong Zhou

Authors
  1. Zhuojia Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingjia Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Xiaocong Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Liang Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wenjun Li
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wenjun Li.

Additional information

Supported by National Natural Science Foundation of China (under Grant nos.60970156 and 61173082), Fundamental Research Funds for the Central Universities (Grant nos.2010620003162041 and 10LGZD05), and SYSU-Sugon high performance computing typical application projects (Grant no. 62000-1132001).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liang, Z., Wang, M., Zhou, X. et al. Salient object detection based on regions. Multimed Tools Appl 68, 517–544 (2014). https://doi.org/10.1007/s11042-012-1040-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1040-1

Keywords

Search

Navigation