Multimedia Tools and Applications

, Volume 14, Issue 1, pp 55–78 | Cite as

An Evaluation of Color-Spatial Retrieval Techniques for Large Image Databases

  • Kian-Lee Tan
  • Beng Chin Ooi
  • Chia Yeow Yee


In a color-spatial retrieval technique, the color information is integrated with the knowledge of the colors' spatial distribution to facilitate content-based image retrieval. Several techniques have been proposed in the literature, but these works have been developed independently without much comparison. In this paper, we present an experimental evaluation of three color-spatial retrieval techniques—the signature-based technique, the partition-based algorithm and the cluster-based method. We implemented these techniques and compare them on their retrieval effectiveness and retrieval efficiency. The experimental study is performed on an image database consisting of 12,000 images. With the proliferation of image retrieval mechanisms and the lack of extensive performance study, the experimental results can serve as guidelines in selecting a suitable technique and designing a new technique.

content- based retrievals color-spatial information image database retrieval effectiveness retrieval efficiency 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    J.R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R.C. Jain, and C. Shu, “The virage image search enginee: An open framework for image management,” in SPIE Proceedings of the Storage and Retrieval for Still Images and Video Databases IV, Feb. 1996, pp. 76–86.Google Scholar
  2. 2.
    J. Beck, “Perceptual grouping produced by line figures,” Percept. Pyschophys., Vol. 2, pp. 491–495, 1967.Google Scholar
  3. 3.
    S. Belongie, C. Carson, H. Greenspan, and J. Malik, “Recognition of images in large databases using color and texture,” in, 1997.Google Scholar
  4. 4.
    E. Binaghi, I. Gaglardi, and R. Schettini, “Indexing and fuzzy logic-based retrieval of color images,” in Visual Database systems, II, IFIP, pp. 79–92, 1992.Google Scholar
  5. 5.
    Y. Chahir and L. Chen, “Peano key rediscovery for content-based retrieval of images,” in Proceedings of the SPIE Multimedia Storage and Archiving Systems II, Dallas, Texas, Nov. 1997, pp. 172–181.Google Scholar
  6. 6.
    D.K.Y. Chiu and T. Kolodziejczak, “Syntheszing knowledge: A cluster analysis approach using eventcovering,” IEEE Transactions on Systems, Manand Cybernetics, Vol. 16, No. 2, pp. 462–467, 1986.Google Scholar
  7. 7.
    T.S Chua, K.L. Tan, and B.C. Ooi, “Fast signature-based color-spatial image retrieval,” in Proc. of the International Conference on Multimedia Computing and Systems'97, June 1997, pp. 362–369.Google Scholar
  8. 8.
    T.S. Chua, S.K. Lim, and H.K. Pung, “Content-based retrieval of segmented images,” in Proceedings of the 1994 ACM Multimedia Conference, Oct. 1994, pp. 211–218.Google Scholar
  9. 9.
    T.S. Chua, K.C. Teo, B.C. Ooi, and K.L. Tan, “Using domain knowledge in querying image databases,” in Proceedings of the 3rd International Conference on Multimedia Modeling, Toulouse, France, Nov. 1996, pp. 497–498.Google Scholar
  10. 10.
    D. Comer, “The ubiquitous b-tree,” ACM Computing Surveys, Vol. 11, No. 2, pp. 121–137, 1979.Google Scholar
  11. 11.
    C. Faloutsos, W. Equitz, M. Flickner, W. Niblack, D. Petkovic, and R. Barber, “Efficient and effective querying by image content,” Journal of Intelligent Information Systems, Vol. 3, No. 3, pp. 231–262, 1994.Google Scholar
  12. 12.
    J. Foley, A. Dam, S. Feiner, and J. Hughes, Computer Graphics: Principle and Practice, 2nd edn., Addison Wesley, 1992.Google Scholar
  13. 13.
    Y. Gong, H.C. Chua, and X. Guo, “Image indexing and retrieval based on color histogram,” in Proceedings of the 2nd International Conference on Multimedia Modeling, Singapore, Nov. 1995, pp. 115–126.Google Scholar
  14. 14.
    A. Guttman, “R-trees: A dynamic index structure for spatial searching,” in Proceedings of the 1984 ACM SIGMOD Conference, May 1984, pp. 47–57.Google Scholar
  15. 15.
    J. Hafner, H. Sawhney, W. Equitz, M. Flickner, and W. Niblack, “Efficient color histogram indexing for quadratic form distance functions,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 17, No. 7, pp. 729–736, 1995.Google Scholar
  16. 16.
    W. Hsu, T.S. Chua, and H.K. Pung, “An integrated color-spatial approach to content-based image retrieval,” in Proceedings of the 1995 ACM Multimedia Conference, San Francisco, CA, Nov. 1995, pp. 305–313.Google Scholar
  17. 17.
    J. Huang, S.R. Kumar, and M. Mitra, “Combining supervised learning with color correlograms for contentbased image retrieval,” in Proceedings of the ACM Multimedia'97, Seattle, WA, Nov. 1997, pp. 325–334.Google Scholar
  18. 18.
    J. Huang, S.R. Kumar, M. Mitra, W.J. Zhu, and R. Zabih, “Image indexing using color correlograms,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Jose, Puerto Rico, June 1997, pp. 762–768.Google Scholar
  19. 19.
    C.E. Jacobs, A. Finkelstein, and D.H. Salesin, “Fast multi-resolution image querying,” in Proceedings of the Computer Graphics Conference, Los Angeles, CA, Aug. 1995, pp. 277–286.Google Scholar
  20. 20.
    H.V. Jagadish, “A retrieval technique for similar shape,” in Proceedings of the ACM SIGMOD Conference, May 1991, pp. 208–217.Google Scholar
  21. 21.
    R. Jain, R. Kasturi, and B.N. Schunck, Machine Vision, McGraw Hill, 1995.Google Scholar
  22. 22.
    K.F. Jea and Y.C. Lee, “Building efficient and flexible feature-based indexes,” Information Systems, Vol. 16, No. 6, pp. 653–662, 1990.Google Scholar
  23. 23.
    T. Kato, “Database architecture for content-based image retrieval,” in SPIE Proceedings of the International Society for Optical Engineering, San Jose, CA, 1992, pp. 112–123.Google Scholar
  24. 24.
    T. Kato, T. Kurita, and H. Shimogaki, “Intelligent visual interaction with image database systems—toward the multimedia personal interface,” Journal of Information Processing, Vol. 14, No. 2, pp. 134–143, 1991.Google Scholar
  25. 25.
    P.M. Kelley, M. Cannon, and D.R. Hush, “Query by image example: The comparison algorithm for navigating digital image databases (candid) approach,” in SPIE Proceedings of the Storage and Retrieval for Still Images and Video Databases III, Feb. 1995, pp. 238–249.Google Scholar
  26. 26.
    A. Kitamoto, C. Zhou, and M. Takagi, “Similarity retrieval of NOAA satellite imagery by graph matching,” in SPIE Proceedings of the Storage and Retrieval for Still Images and Video Databases I, Feb. 1993, pp. 60–73.Google Scholar
  27. 27.
    F. Korn, C. Faloutsos, N. Sidiropoulos, E. Siegel, and Z. Protopapas, “Fast nearest neighbor search in medical image databases,” in Proceedings of the 22th VLDB Conference, Mumbai, India, Sept. 1996, pp. 215–226.Google Scholar
  28. 28.
    S.Y. Lee and F.J. Hsu, “Spatial reasoning and similarity retrieval of images using 2D C string knowledge representation,” Pattern Recognition, Vol. 25, No. 3, pp. 305–318, 1992.Google Scholar
  29. 29.
    H. Lu, B.C. Ooi, and K.L. Tan, “Efficient image retrieval by color contents,” in Proceedings of the 1994 International Conference on Applications of Databases, Vadstena, Sweden, June 1994, pp. 95–108.Google Scholar
  30. 30.
    M. Miyahara and Y. Yoshida, “Mathematical transform of (r,g,b) color data to munsell (h,v,c) color data,” Journal of the Institute of Television Engineers, Vol. 43, No. 10, pp. 1129–1136, 1989.Google Scholar
  31. 31.
    A. Nagasaka and Y. Tanaka, “Automatic video indexing and full-video search for objects,” in Visual Database Systems, II, IFIP, 1992, pp. 113–127.Google Scholar
  32. 32.
    W. Niblack, R. Barber, W. Equitz, M. Flicker, E. Glasman, D. Petkovic, P. Yanker, and C. Faloutsos, “The QBIC project: Query images by content using color, texture and shape,” in SPIE V1908, 1993.Google Scholar
  33. 33.
    V.E. Ogle and M. Stonebraker, “Chabot: Retrieval from a relational database of images,” IEEE Computer, Vol. 28, No. 9, pp. 40–48, 1995.Google Scholar
  34. 34.
    B.C. Ooi, K.L. Tan, T.S. Chua, and W. Hsu, “Fast image retrieval using color-spatial information,” The VLDB Journal, Vol. 7, No. 2, pp. 115–128, 1998.Google Scholar
  35. 35.
    G. Pass and R. Zabih, “Histogram refinement for content-based image retrieval,” in Proceedings of the IEEE Workshop on Applications of Computer Vision, Sarasota, Florida, Dec. 1996, pp. 96–102.Google Scholar
  36. 36.
    G. Pass, R. Zabih, and J. Miller, “Comparing images using color coherence vectors,” in Proceedings of the ACM Multimedia'96 Boston, Massachusetts, Nov. 1996, pp. 65–73.Google Scholar
  37. 37.
    A. Pentland, R.W. Picard, and S. Sclaroff, “Photobook: Content-based manipulation of image databases,” Technical Report 255, MIT Media Lab Perceptual Computing, 1993.Google Scholar
  38. 38.
    E.G.M. Petrakis and C. Faloutsos, “Similarity searching in large image databases,” Technical Report CSTR-3388, University of Maryland Institute for Advanced Computer Studies, Dept. of Computer Science, University of Maryland, 1994.Google Scholar
  39. 39.
    W.K. Pratt, Digital Image Processing, 2nd edn. John-Wiley, 1991.Google Scholar
  40. 40.
    F. Rabitti and P. Savino, “Image query processing based on multi-level signatures,” in Proceedings of the IR Conference, 1991. pp. 305–314.Google Scholar
  41. 41.
    G. Salton and M.J. McGill, Introduction to Modern Information Retrieval, McGraw-Hill: New York, 1983.Google Scholar
  42. 42.
    H. Samet, The Design and Analysis of Spatial Data Structures, Addison Wesley, 1989.Google Scholar
  43. 43.
    R. Shann, D. Davis, J. Oakley, and F. White, “Detection and characterization of carboniferous foraminifera for content-based retrieval from an image database,” in SPIE Proceedings of the Storage and Retrieval for Still Images and Video Databases I, Feb. 1993, pp. 188–197.Google Scholar
  44. 44.
    J.R. Smith and S.-E. Chang, “VisualSEEk: A fully automated content-based image query system,” in Proceedings of the 1996 ACM Multimedia Conference, Boston, MA, Nov. 1996, pp. 87–98.Google Scholar
  45. 45.
    S.W. Smoliar and H.J. Zhang, “Content-based video indexing and retrieval,” IEEE Multimedia, Vol. 1, No. 2, pp, 62–72, 1994.Google Scholar
  46. 46.
    P.L. Stanchev, A.W.M. Smeulders, and F.C.A. Groen, “An approach to image indexing of documents,” in Visual Database Systems, II, IFIP, 1992, pp. 63–77.Google Scholar
  47. 47.
    M.J. Swain, “Interactive indexing into image database,” in SPIE V1908, 1993.Google Scholar
  48. 48.
    M.J. Swain and D.H. Ballard, “Color indexing,” International Journal of Computer Vision, Vol. 7, No. 1, pp. 11–32, 1991.Google Scholar
  49. 49.
    K. Tanabe and J. Ohya, “A similarity retrieval method for line drawing image database,” Progress in Image Analysis and Processing, 1989.Google Scholar
  50. 50.
    A. Treisman and R. Paterson, “Afeature integration theory of attention,” Cognit. Pyschol.,Vol. 12, pp. 97–136, 1980.Google Scholar
  51. 51.
    X. Wan and C.C.J. Kuo, “Pruned octree feature for interactive retrieval,” in Proceedings of the SPIE Multimedia Storage and Archiving Systems II, Dallas, Texas, Nov. 1997, pp. 182–193.Google Scholar
  52. 52.
    C.Y. Yee, K.L. Tan, T.S. Chua, and B.C. Ooi, “An empirical study of color-spatial retrieval techniques for large image databases,” in Proc. of the International Conference on Multimedia Computing and Systems'98, June 1998.Google Scholar

Copyright information

© Kluwer Academic Publishers 2001

Authors and Affiliations

  • Kian-Lee Tan
    • 1
  • Beng Chin Ooi
    • 1
  • Chia Yeow Yee
    • 1
  1. 1.Department of Computer Science, School of ComputingNational University of SingaporeSingapore

Personalised recommendations