Image Retrieval Using Fuzzy Color Histogram and Fuzzy String Matching: A Correlation-Based Scheme to Reduce the Semantic Gap

Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 243)


The research interest in the recent years has progressed to improve the performance of image retrieval (IR) systems by reducing the semantic gap between the low-level features and the high-level concept. In this paper, we proposed an approach to combine the two modalities in IR systems, i.e., content and text, while considering the semantics between the query image and the textual query provided by the user. For content matching, color feature is extracted and is represented using fuzzy color histogram (FCH). For text matching, fuzzy string matching with edit distance is used. Furthermore, we find the correlation between the query image and the textual query provided by the user to reduce the semantic gap. Using this correlation, we combined the two modalities with late fusion approach. The proposed approach is assessed on standard annotated database. Higher values of precision and recall show better performance of the proposed approach. Moreover, the use of correlation helps in reducing the semantic gap and providing good results through better ranking of the similar images.


CBIR TBIR Fuzzy color histogram Fuzzy string matching Late fusion 


  1. 1.
    Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: ideas, influences, and trends of the new age. ACM Comput. Surv. (CSUR) 40(2), 5 (2008)Google Scholar
  2. 2.
    Singhai, N., Shandilya, S.K.: A survey on content based image retrieval systems. Int. J. Comput. Appl. IJCA 4(2), 22–26 (2010)Google Scholar
  3. 3.
    Zhang, H., Jiang, M., Zhang, X.: Exploring image context for semantic understanding and retrieval. Comput. Intell. Softw. Eng., IEEE, 1–4 (2009)Google Scholar
  4. 4.
    Gudivada, V.N., Raghavan, V.V.: Content based image retrieval systems. Computer 28(9), 18–22 (1995)CrossRefGoogle Scholar
  5. 5.
    Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach. Intell. 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
  6. 6.
    Pavlidis, T.: Limitations of content-based image retrieval. In: Invited Plenary Talk at the 19th Internet Conference on Pattern Recognition, vol. 8, No. 11, Tampa, Florida (2008)Google Scholar
  7. 7.
    Zhang, H.: Multimedia content analysis and search: new perspectives and approaches. In: Proceedings of the 17th ACM International Conference on Multimedia, pp. 1–2. ACM (2009)Google Scholar
  8. 8.
    Hua, X.S., Worring, M., Chua, T.S.: Internet multimedia search and mining. Internet Multimedia Search Min. (2010)Google Scholar
  9. 9.
    Zhou, X.S., Huang, T.S.: Unifying keywords and visual contents in image retrieval multimedia. IEEE 9(2), 23–33 (2002)Google Scholar
  10. 10.
    Müller, H., Ruch, P., Geissbuhler, A.: Enriching content-based image retrieval with multilingual search terms. Swiss Med. Inform. 54, 6–11 (2005)Google Scholar
  11. 11.
    Christel, M.G.: Examining user interactions with video retrieval systems. SPIE (2007)Google Scholar
  12. 12.
    Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)CrossRefGoogle Scholar
  13. 13.
    Grosky, W.I., Agrawal, R., Fotouchi, F.: Mind the gaps finding the appropriate dimensional representation for semantic retrieval of multimedia assets. Semantic Multimedia Ontol., 229–252 (2008)Google Scholar
  14. 14.
    Westman, S., Lustila, A., Oittinen, P.: Search strategies in multimodal image retrieval. In: Proceedings of the Second International Symposium on Information Interaction in Context, pp. 13–20. ACM (2008)Google Scholar
  15. 15.
    Zhang, N., Song, Y.: An image indexing and searching system based both on keyword and content. Advanced Intelligent Computing Theories and Applications. With Aspects of Theoretical and Methodological Issues, pp. 1032–1039 (2008)Google Scholar
  16. 16.
    Abbas, J., Qadri, S., Idrees, M., Awan, S., Khan, N.A.: Frame work for content based image retrieval (Textual Based) system. J. Am. Sci. 6(9), 704–707 (2010)Google Scholar
  17. 17.
    Jain, R., Sinha, P.: Content without context is meaningless. In: Proceedings of the International Conference on Multimedia, pp. 1259–1268. ACM (2010)Google Scholar
  18. 18.
    Gui, C., Liu, J., Xu, C., Lu, H.: Extended CBIR via learning semantics of query image. Adv. Multimedia Model., 782–785 (2010)Google Scholar
  19. 19.
    Hartvedt, C.: Using context to understand user intentions in Image retrieval. In: 2nd IEEE Conference on Advances in Multimedia (MMEDIA), pp. 130–133 (2010)Google Scholar
  20. 20.
    Singha, M., Hemachandran, K.: Content based image retrieval using color and texture. Signal Image Proc. 3(1), 39–57 (2012)Google Scholar
  21. 21.
    Patil, C., Dalal, V.: Content based image retrieval using combined features. In: Proceedings of the International Conference and Workshop on Emerging Trends in Technology, pp. 102–105. ACM (2011)Google Scholar
  22. 22.
    Kushki, A., Androutsos, P., Plataniotis, K.N., Venetsanopoulos, A.N.: Fuzzy aggregation of image features in content-based image retrieval. Int. Conf. Image Proc. 3, 909–912. IEEE (2002)Google Scholar
  23. 23.
    Konstantinidis, K., Gasteratos, A., Andreadis, I.: Image retrieval based on fuzzy color histogram processing. Opt. Commun. 248(4), 375–386 (2005)CrossRefGoogle Scholar
  24. 24.
    Bugatti, P.H., Traina, A.J., Traina Jr, C.: Assessing the best integration between distance-function and image-feature to answer similarity queries. In: Proceedings of the 2008 ACM Symposium on Applied Computing, pp. 1225–1230. ACM (2008)Google Scholar
  25. 25.
    Levenshtein, V.I.: Binary codes capable of correcting deletions, insertions, and reversals. In: Soviet Physics-Doklady, vol. 10, No. 8. (1966)Google Scholar
  26. 26.
    Salton, G., Wong, A., Yang, C.S.: A vector space model for automatic indexing. Commun. ACM 18(11), 613–620 (1975)CrossRefGoogle Scholar
  27. 27.
    Depeursinge, A., Müller, H.: Fusion techniques for combining textual and visual information retrieval. In: ImageCLEF, pp. 95–114 (2010)Google Scholar
  28. 28.
    Goel, N., Sehgal, P.: A refined hybrid image retrieval system using text and color. Int. J. Comput. Sci. Issues 9(4, 1), 48–56 (2012)Google Scholar

Copyright information

© Springer India 2014

Authors and Affiliations

  1. 1.Department of Computer ScienceUniversity of DelhiDelhiIndia
  2. 2.Department of Computer ScienceKeshav Mahavidyalaya, University of DelhiDelhiIndia

Personalised recommendations