Improved image retrieval and classification with combined invariant features and color descriptor

  • Yong-Hwan Lee
  • Sung-Il BangEmail author
Original Research


As the quantity of digital images grows in many applications in our daily life, users experience an increased difficulty in finding relevant images within their image collections and common image repositories. This paper proposes a novel image search scheme that extracts the features of an image using a combined invariant features and color description to retrieve specific images using query-by-example. The proposed method can be executed in real-time on an iPhone, and can be easily used to identify a natural color image with its invariant visual features. The proposed scheme is evaluated by assessing the performance of a simulation in terms of the average precision and F-score in image databases that are commonly used for image retrieval. The experimental results reveal that the proposed algorithm offers a significant improvement of more than 7.35 and 18.09% in retrieval effectiveness when compared to open source OpenSURF and MPEG-7 color and texture descriptor, respectively. The main contribution of this paper is that the proposed approach achieves a high accuracy and stability by using a combination of the improved SURF and color descriptor when searching for a natural image.


Image retrieval Image search Speeded-up robust feature (SURF) Color layout descriptor Locality sensitive hashing (LSH) 



The present research was conducted by the research fund of Dankook University in 2015.


  1. Baeza-Yates R, Ribeiro-Neto B (2011) Modern information retrieval: the concepts and technology behind search, 2nd edn. ACM Press Books. (ISBN 978-0321416919) Google Scholar
  2. Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded up robust features (SURF). Comput Vis Image Underst 110(3):346–359. Google Scholar
  3. Chaudhari A, Bhagat PKS (2014) An overview of content based image categorization using support vector machine. Int J Innov Sci Eng Technol 1(10):371–378Google Scholar
  4. Datta R, Joshi D, Li J, Wang JZ (2008) Image retrieval: ideas, influences, and trends of the new age. ACM Comput Surv 40(2):1–60. Google Scholar
  5. Evans C (2009) Notes on the OpenSURF library. Technical report on Open SURF computer vision library, pp 1–25. Accessed 21 May 2018
  6. Girija OK, Sudeep Elayidom M (2016) Recent trends in image retrieval techniques for the big data platform: a survey. Int J Adv Res Comput Commun Eng 5(1):71–74. Google Scholar
  7. ISO, International Organization for Standards (2005) ISO/IEC 24800-1: working draft—system framework and components, ISO/IEC JTC1 SC29 WG1N3684Google Scholar
  8. Juan L, Gwun O (2009) A comparison of SIFT, PCA-SIFT and SURF. Int J Image Process 3(4):143–152Google Scholar
  9. Kakade VM, Keche IA (2017) Review on content based image retrieval (CBIR) technique. Int J Eng Comput Sci 6(3):20414–20415. Google Scholar
  10. Kalantidis Y, Tolias G, Spyrou E, Mylonas P, Avrithis Y, Kollias S (2011) ViRaL: visual image retrieval and location. Multimed Tools Appl 51(2):555–592. Google Scholar
  11. Kim SM, Park SJ, Won CS (2007) Image retrieval via query-by-layout using MPEG-7 visual descriptors. ETRI J 29(2):246–248. Google Scholar
  12. Kumar A, Batra S (2011) Image retrieval using SURF features and annotated data. Int J Adv Res Comput Sci 2(3):121–124. Google Scholar
  13. Lakdashti A, Kialashaki N, Ghonoodi A, Soltani M (2005) Composition of MPEG7 color and edge descriptors based on human vision perception. Proc Int Soc Opt Eng. Google Scholar
  14. Lew MS, Sebe N, Djeraba C, Jain R (2006) Content-based multimedia information retrieval: state of the art and challenges. ACM Trans Multimed Comput Commun Appl 2(1):1–19. Google Scholar
  15. Li J, Wang JZ (2003) Automatic linguistic indexing of pictures by a statistical modeling approach. IEEE Trans Pattern Anal Mach Intell 25(9):1075–1088. Google Scholar
  16. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110. Google Scholar
  17. Manjunath BS, Ohm J-R, Vasudevan VV, Yamada A (2001) Color and texture descriptors. IEEE Trans Circuits Syst Video Technol 11(6):703–715. Google Scholar
  18. Meenakshi RP, Kumar A (2015) Approaches and trends in content based image retrieval. Int J Emerg Trends Sci Technol 2(7):2815–2824Google Scholar
  19. Mohamed AA, Makori CA, Kamau J (2016) A literature survey of image descriptors in content based image retrieval. Int J Sci Eng Res 7(3):919–929Google Scholar
  20. Mustikasari M, Madenda S (2015) Texture based image retrieval using GLCM and image sub-block. Int J Adv Res Comput Sci Softw Eng 5(3):9–13Google Scholar
  21. Oliva A, Torralba A (2001) Modeling the shape of the scene: a holistic representation of the spatial envelope. Int J Comput Vis 42(3):145–175. zbMATHGoogle Scholar
  22. Ranjani JJ, Babu M (2016) Image retrieval using generalized Gaussian distribution and score based support vector machine. Indian J Sci Technol 9(48):1–10. Google Scholar
  23. Sclaroff S, La Cascia M, Sethi S, Taycher L (1999) Unifying textual and visual cues for content-based image retrieval on the world wide web. Comput Vis Image Underst 75(1):86–98. Google Scholar
  24. Sharma S, Siddiqui AM (2014) Image retrieval using speeded up robust feature: an effort to improvement. Int J Comput Sci Netw Secur 14(11):102–107Google Scholar
  25. Shereena VB, Julie MD (2014) Content based image retrieval: classification using neural networks. Int J Multimed Appl 6(5):31–44Google Scholar
  26. Shin I-K, Ahn H, Lee Y-H (2016) Efficient image retrieval using image and audio features in video stream. International conference on innovative mobile and internet services in ubiquitous computing, pp 422–424.
  27. Silpa-Anan C, Hartley R (2008) Optimised KD-trees for fast image descriptor matching. IEEE conference on computer vision and pattern recognition, USA.
  28. Singh S, Rajput R (2015) Content based image retrieval using SVM, NN and KNN classification. Int J Adv Res Comput Commun Eng 4(6):549–552Google Scholar
  29. Tao D, Tang X, Li X, Wu X (2006) Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval. IEEE Trans Pattern Anal Mach Intell 28(7):1088–1099. Google Scholar
  30. Thomas S (2001) MPEG-7 visual standard for content description—an overview. IEEE Trans Circuits Syst Video Technol 11(6):696–702. Google Scholar
  31. Thomee B, Bakker EM, Lew MS (2010) TOP-SURF: a visual words toolkit. In: Proceedings of the 18th ACM international conference on multimedia, The Netherlands. pp 1473–1476.
  32. Tieu K, Viola P (2004) Boosting image retrieval. Int J Comput Vision 56(1):17–36. Google Scholar
  33. Ting S, Guohua G (2016) Image retrieval method for deep neural network. Int J Signal Process Image Process Pattern Recognit 9(7):33–42. Google Scholar
  34. Velmurugan K, Baboo S (2011) Content-based image retrieval using SURF and colour moments. Glob J Comput Sci Technol 11(10):1–4Google Scholar
  35. Wan J, Wang D, Hoi SCH, Wu P, Zhu J, Zhang Y, Li J (2014) Deep learning for content-based image retrieval: a comprehensive study. International conference on multimedia, New York. pp 157–166.
  36. Wong YM (2007) Design, implementation, and evaluation of scalable content-based image retrieval techniques. Master thesis, Chinese University of Hong Kong, Hong KongGoogle Scholar
  37. Xie L, Hong R, Zhang B Tian Q (2015) Image classification and retrieval are one. International conference on multimedia retrieval, pp 3–10.
  38. Zhou M, Zhou C, Wen C (2016) Real-time monitoring of batch processes using the fast k-nearest neighbor rule. Chinese Control Conference, China.

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Digital ContentsWonkwang UniversityIksanSouth Korea
  2. 2.Department of Electrical and Electronic EngineeringDankook UniversityYonginSouth Korea

Personalised recommendations