Finding Image Semantics from a Hierarchical Image Database Based on Adaptively Combined Visual Features

  • Pritee Khanna
  • Shreelekha Pandey
  • Haruo Yokota
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8055)


Correlating image semantics with its low level features is a challenging task. Although, humans are adept in distinguishing object categories, both in visual as well as in semantic space, but to accomplish this computationally is yet to be fully explored. The learning based techniques do minimize the semantic gap, but unlimited possible categorization of objects in real world is a major challenge to these techniques. This work analyzes and utilizes the strength of a semantically categorized image database to assign semantics to query images. Semantics based categorization of images would result in image hierarchy. The algorithms proposed in this work exploit visual image descriptors and similarity measures in the context of a semantically categorized image database. A novel ‘Branch Selection Algorithm’ is developed for a highly categorized and dense image database, which drastically reduces the search space. The search space so obtained is further reduced by applying any one of the four proposed ‘Pruning Algorithms’. Pruning algorithms maintain accuracy while reducing the search space. These algorithms use an adaptive combination of multiple visual features of an image database to find semantics of query images. Branch Selection Algorithm tested on a subset of ‘ImageNet’ database reduces search space by 75%. The best pruning algorithm further reduces this search space by 26% while maintaining 95% accuracy.


Discrete Cosine Transform Image Retrieval Semantic Similarity Image Database Query Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Sternberg, R.J.: Cognitive Psychology, 5th edn. Wadsworth Cencage Learning, Belmont (2008)Google Scholar
  2. 2.
    Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image Retrieval: Ideas, Influences, and Trends of the New Age. ACM Comput. Surv. 40(2), 5–60 (2008)CrossRefGoogle Scholar
  3. 3.
    Deselaers, T., Keysers, D., Ney, H.: Features for Image Retrieval: An Experimental Comparison. Inf. Retr. 11(2), 77–107 (2008)CrossRefGoogle Scholar
  4. 4.
    Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)zbMATHCrossRefGoogle Scholar
  5. 5.
    Wang, H.H., Mohamad, D., Ismail, N.A.: Semantic Gap in CBIR: Automatic Objects Spatial Relationships Semantic Extraction and Representation. IJIP International Journal of Image Processing 4(3), 192–204 (2010)Google Scholar
  6. 6.
    Li, J., Wang, J.Z.: Automatic Linguistic Indexing of Pictures by a Statistical Modeling Approach. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1075–1088 (2003)CrossRefGoogle Scholar
  7. 7.
    Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: An incremental Bayesian approach tested on 101 object categories. Comput. Vis. Image Underst. 106(1), 59–70 (2007)CrossRefGoogle Scholar
  8. 8.
    Lowe, D.G.: Object recognition from local scale-invariant features. In: International Conference on Computer Vision, ICCV 1999, vol. 2, pp. 1150–1157 (1999)Google Scholar
  9. 9.
    Zhuang, Y., Liu, X., Pan, Y.: Apply Semantic Template to Support Content-based Image Retrieval. In: Proceeding of IS&T and SPIE Storage and Retrieval for Media Databases, San Jose, California, USA, January 23-28, pp. 442–449 (2000)Google Scholar
  10. 10.
    Shotton, J., Winn, J., Rother, C., Criminisi, A.: TextonBoost: Joint appearance, shape and context modeling for multi-class object recognition and segmentation. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 1–15. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Liu, Y., Zhang, D., Lu, G.: Region-based image retrieval with high-level semantics using decision tree learning. Pattern Recogn. 41(8), 2554–2570 (2008)zbMATHCrossRefGoogle Scholar
  12. 12.
    Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: ImageNet: A Large-Scale Hierarchical Image Database. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255 (June 2009)Google Scholar
  13. 13.
    Wang, X.Y., Yu, Y.J., Yang, H.Y.: An effective image retrieval scheme using color, texture and shape features. Computer Standards & Interfaces 33(1), 59–68 (2011)MathSciNetCrossRefGoogle Scholar
  14. 14.
    Vassilieva, N.S.: Content-based Image Retrieval Methods. Program. Comput. Softw. 35(3), 158–180 (2009)MathSciNetCrossRefGoogle Scholar
  15. 15.
    Liu, G.H., Yang, J.Y.: Content-based image retrieval using color difference histogram. Pattern Recogn. 46(1), 188–198 (2013)CrossRefGoogle Scholar
  16. 16.
    Pandey, K.K., Mishra, N., Sharma, H.K.: Enhanced of color matching algorithm for image retrieval. International Journal of Computer Science Issues 8(3), 529–532 (2011)Google Scholar
  17. 17.
    Sural, S., Qian, G., Pramanik, S.: A Histogram with Perceptually Smooth Color Transition for Image Retrieval. In: 4th International Conference on Computer Vision, Pattern Recognition and Image Processing, Durham, North Carolina, pp. 664–667 (2002)Google Scholar
  18. 18.
    Shih, J.L., Chen, L.H.: Colour image retrieval based on primitives of colour moments. IEEE Proceedings on Vision, Image and Signal Processing 149(6), 370–376 (2002)Google Scholar
  19. 19.
    Stricker, M., Orengo, M.: Similarity of Color Images. In: SPIE Conference on Storage and Retrieval for Image and Video Databases III, San Jose, CA, USA, vol. 2420, pp. 381–392 (1995)Google Scholar
  20. 20.
    Manjunath, B.S., Ma, W.Y.: Texture Features for Browsing and Retrieval of Image Data. IEEE Trans. Pattern Anal. Mach. Intell. 18(8), 837–842 (1996)CrossRefGoogle Scholar
  21. 21.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  22. 22.
    NIST/SEMATECH: e-handbook of statistical methods (2012),
  23. 23.
    Malik, F., Baharudin, B.: Quantized histogram color features analysis for image retrieval based on median and Laplacian filters in DCT domain. In: International Conference on Innovation Management and Technology Research (ICIMTR), Malacca, Malaysia, May 21-22, pp. 624–629 (2012)Google Scholar
  24. 24.
    Gali, R., Dewal, M.L., Anand, R.S.: Genetic Algorithm for Content Based Image Retrieval. In: International Conference on Computational Intelligence, Communication Systems and Networks (CICSyN), Phuket, Thailand, July 24-26, pp. 243–247 (2012)Google Scholar
  25. 25.
    Kinnaree, P., Pattanasethanon, S., Thanaputtiwirot, S., Boontho, S.: RGB Color Correlation Index for Image Retrieval. Procedia Engineering (8), 36–41 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Pritee Khanna
    • 1
  • Shreelekha Pandey
    • 1
  • Haruo Yokota
    • 2
  1. 1.Design and Manufacturing JabalpurPDPM Indian Institute of Information TechnologyJabalpurIndia
  2. 2.Graduate School of Information Science and EngineeringTokyo Institute of TechnologyMeguro-kuJapan

Personalised recommendations