Skip to main content

Advertisement

Log in

OCRS: an interactive object-based image clustering and retrieval system

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we propose an Interactive Object-based Image Clustering and Retrieval System (OCRS). The system incorporates two major modules: Preprocessing and Object-based Image Retrieval. In preprocessing, an unsupervised segmentation method called WavSeg is used to segment images into meaningful semantic regions (image objects). This is an area where a huge number of image regions are involved. Therefore, we propose a Genetic Algorithm based algorithm to cluster these images objects and thus reduce the search space for object-based image retrieval. In the learning and retrieval module, the Diverse Density algorithm is adopted to analyze the user’s interest and generate the initial hypothesis which provides a prototype for future learning and retrieval. Relevance Feedback technique is incorporated to provide progressive guidance to the learning process. In interacting with user, we propose to use One-Class Support Vector Machine (SVM) to learn the user’s interest and refine the returned result. Performance is evaluated on a large image database and the effectiveness of our retrieval algorithm is demonstrated through comparative studies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Andrews S, Tsochantaridis I, Hofmann T (2003) Support vector machines for multiple-instance learning. In: Advances in neural information processing systems 15, pp 561–568. MIT Press, Cambridge, MA

    Google Scholar 

  2. Carson C, Belongie S, Greenspan H, Malik J (2002) Blobworld: image segmentation using expectation-maximization and its application to image querying. IEEE Trans Pattern Anal Mach Intell 24(8)

  3. Chen S-C, Rubin SH, Shyu M-L, Zhang C (2006) A dynamic user concept pattern learning framework for content-based image retrieval. IEEE Trans Syst Man Cybern Part C 36(6):772–783

    Article  Google Scholar 

  4. Chen S-C, Sista S, Shyu M-L, Kashyap RL (2000) An indexing and searching structure for multimedia database systems. In: Proceedings of the IS&T/SPIE conference on storage and retrieval for media databases, pp 262–270

  5. Chen YX, Wang JZ (2004) Image categorization by learning and reasoning with regions. J Mach Learn Res 5:913–939

    Google Scholar 

  6. Chen YX, Wang J, Krovetz R (2005) CLUE: cluster-based retrieval of images by unsupervised learning. IEEE Trans Image Process 14(8):1187–1201

    Article  Google Scholar 

  7. Chen Y, Zhou X, Tomas S, Huang TS (2001) One-class SVM for learning in image retrieval. In: Proceedings of IEEE international conference on image processing

  8. Dietterich TG, Lathrop RH, Lozano-Perez T (1997) Solving the multiple-instance problem with axis-parallel rectangles. Artif Intel J 89:31–71

    Article  MATH  Google Scholar 

  9. Ferhatosmanoglu H, Stanoi I, Agrawal D, Abbadi AE (2001) Constrained nearest neighbor queries. In: Proceedings of SSTD

  10. Gondra I, Heisterkamp DR (2004) Adaptive and efficient image retrieval with one-class support vector machines for inter-query learning. WSEAS Trans Circuits Syst 3(2):324–329, April

    Google Scholar 

  11. Holland JH (1975) Adaptation in natural and artificial systems. University of Michigan Press, Ann Arbor

    Google Scholar 

  12. Huang X, Chen S-C, Shyu M-L, Zhang C (2002) User concept pattern discovery using relevance feedback and multiple instance learning for content-based image retrieval. In: Proceedings of the 3rd international workshop on Multimedia Data Mining (MDM/KDD’2002), pp 100–108

  13. Jing F, Li MM, Zhang L, Zhang H-J, Zhang Bo (2003) Learning in region-based image retrieval. In: Proceedings of international conference on image and video retrieval

  14. Jing F, Li MM, Zhang L, Zhang H-J, Zhang Bo (2003) Support vector machines for region-based image retrieval. In: Proceedings of IEEE international conference on multimedia & expo

  15. Kanungo T, Mount D, Netanyahu N, Piatko CD, Silverman R, Wu AY (2002) An efficient K-means clustering algorithm: analysis and implementation. IEEE Trans Pattern Anal Mach Intell 24(7), July

  16. Kim DH, Chung CW (2003) Qcluster: relevance feedback using adaptive clustering for content based image retreival. In: Proceedings of SIGMOD conference

  17. Krishnamachari S, Abdel-Mottaleb M (1999) Hierarchial clustering algorithm for fast image retrieval. In: Proceedings of IS&T/SPIE conference on storage and retreival for image and video databases VII. San Jose, California, pp 427–435, Jan

  18. Maron O, Lozano-Perez T (1998) A framework for multiple instance learning. Advances in natural information processing system 10. MIT Press, Cambridge, MA

    Google Scholar 

  19. Ramon J, De Raedt L (2000) Multi-instance neural networks. In: Proceedings of the ICML 2000 workshop on attribute-value and relational learning

  20. Rosca J (1995) Entropy-driven adaptive representation. In: Proceedings of the workshop on genetic programming: From theory to real-world applications, pp 23–32

  21. Rui Y, Huang TS, Mehrotra S (1997) Content-based image retrieval with relevance feedback in MARS. In: Proceedings of the international conf. on image processing, pp 815–818

  22. Schölkopf B, Platt JC et al (1999) Estimating the support of a high-dimensional distribution. Microsoft research corporation technical report MSR-TR-99-87

  23. Su Z, Zhang HJ, Li S, Ma SP (2003) Relevance feedback in content-based image retrieval: bayesian framework, feature subspaces, and progressing learning. IEEE Trans Image Process 12(8):924–937

    Article  Google Scholar 

  24. Vladimir EC, Murray AT (1997) Spatial clustering for data mining with genetic algorithms. Technical report FIT-TR-97-10, Queensland University of Technology, Faculty of Information Management, September

  25. Wang L, Liu L, Khan L (2004) Automatic image annotation and retrieval using subspace clustering algorithm. In: Proceedings of the second ACM international workshop on multimedia databases, pp 100–108

  26. Wang J, Zucker J-D (2000) Solving the multiple instance learning problem: a lazy learning approach. In: Proceedings of the 17th international conference on machine learning, pp 1119–1125

  27. Wu P, Manjunath BS (2001) Adaptive nearest neighbor search for relevance feedback in large image databases. In: Proceedings of ACM multimedia

  28. Yang C, Dong M, Fotouhi F (2005) Region based image annotation through multiple-instance learning. In: Proceedings of ACM international conference on multimedia, Singapore, 6–11 Nov

  29. Yang C, Lozano-Prez T (2000) Image database retrieval with multiple-instance learning techniques. In: Proceedings of the 16th international conference on data engineering, pp 233–243

  30. Zhang C, Chen S-C, Shyu M-L, Peeta S (2003) Adaptive background learning for vehicle detection and spatio-temporal tracking. In: Proceedings of the 4th IEEE Pacific-rim conference on multimedia, pp 1–5

  31. Zhang Q, Goldman SA (2001) EM-DD: An improved multiple-instance learning technique. Adv Neural Inf Process Syst (NIPS) pp 14

  32. Zucker J-D, Chevaleyre Y (2001) Solving multiple-instance and multiple-part learning problems with decision trees and decision rules. Application to the mutagenesis problem. In: Proceedings of the 14the Biennial Conference of the Canadian Society for Computational Studies of Intelligence, AI 2001, pp 204–214

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chengcui Zhang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Zhang, C., Chen, X. OCRS: an interactive object-based image clustering and retrieval system. Multimed Tools Appl 35, 71–89 (2007). https://doi.org/10.1007/s11042-007-0116-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-007-0116-9

Keywords

Navigation