Multimedia Tools and Applications

, Volume 26, Issue 1, pp 5–26 | Cite as

Transformation of Compressed Domain Features for Content-Based Image Indexing and Retrieval

  • Hau-San Wong
  • Horace H. S. Ip
  • Lawrence P. L. Iu
  • Kent K. T. Cheung
  • Ling Guan


In this paper, we address the problem of image content characterization in the compressed domain for the facilitation of similarity matching in content-based image retrieval. Specifically, given the disparity of the content characterization power of compressed domain approaches and those based on pixel-domain features, with the latter being usually considered as the more superior one, our objective is to transform the selected set of compressed domain feature histograms in such a way that the retrieval result based on these features is compatible with their spatial domain counterparts. Since there are a large number of possible transformations, we adopt a genetic algorithm approach to search for the optimal one, where each of the binary strings in the population represents a candidate transformation. The fitness of each transformation is defined as a function of the discrepancies between the spatial-domain and compressed-domain retrieval results. In this way, the GA mechanism ensures that transformations which best approximate the performance of spatial domain retrieval will survive into the next generation and are allowed through the operations of crossover and mutation to generate variations of themselves to further improve their performances.


content-based image retrieval evolutionary computation genetic algorithm 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    N. Ahmed, T. Natarajan, and K.R. Rao“Discrete cosine transform,” IEEE Trans. Comput., Vol. 23, pp. 90–93, 1974.Google Scholar
  2. 2.
    P. Aigrain, H. Zhang, and D. Petkovic“Content-based representation and retrieval of visual media: A state of the art review,” Multimedia Tools and Applications, Vol. 3, No. 3, pp. 179–202, 1996.Google Scholar
  3. 3.
    T. Bäck, Evolutionary Algorithms in Theory and Practice. Oxford Univ. Press: New York, 1996.Google Scholar
  4. 4.
    T. Bäck, U. Hammel, and H.-P. Schwefel“Evolutionary computation: Comments on the history and current state,” IEEE Trans. Evolutionary Comp., Vol. 1, No. 1, pp. 3–17, 1997.Google Scholar
  5. 5.
    S.-K. Chang, Q.Y. Shi, and C.W. Yan“Iconic indexing by 2-D strings,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 9, No. 3, pp. 413–428, 1987.Google Scholar
  6. 6.
    S.-F. Chang, J.R. Smith, M. Beigi, and A. Benitez“Visual information retrieval from large distributed online repositories,” Comm. ACM, Vol. 40, No. 12, pp. 63–71, 1997.Google Scholar
  7. 7.
    J.M. Corridoni, A. del Bimbo, and P. Pala“Image retrieval by color semantics,” Multimedia Systems, Vol. 7, No. 3, pp. 175–183, 1999.Google Scholar
  8. 8.
    I.J. Cox, M.L. Miller, T.P. Minka, T.V. Papathomas, and P.N. Yianilos“The Bayesian image retrieval system, picHunter: Theory, implementation and psychophysical experiments,” IEEE Trans. Image Proc., Vol. 9, No. 1, pp. 20–37, 2000.Google Scholar
  9. 9.
    J.P. Eakins, J.M. Boardman, and M.E. Graham“Similarity retrieval of trademark images,” IEEE Multimedia, Vol. 5, No. 2, pp. 53–63, 1998.Google Scholar
  10. 10.
    D.B. Fogel, Evolutionary Computation: Toward a New Philosophy of Machine Intelligence. IEEE Press: Piscataway, NJ, 1995.Google Scholar
  11. 11.
    D.E. Goldberg, Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley: Reading, MA, 1989.Google Scholar
  12. 12.
    W.I. Grosky“Multimedia information systems,” IEEE Multimedia, Vol. 1, No. 1, pp. 12–24, 1994.Google Scholar
  13. 13.
    A. Gupta and R. Jain“Visual information retrieval,” Comm. ACM, Vol. 40, No. 5, pp. 71–79, 1997.Google Scholar
  14. 14.
    J. Hafner, H.S. Sawhney, W. Equitz, M. Flickner, and W. Niblack“Efficient color histogram indexing for quadratic form distance functions,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 17, No. 7, pp. 729–736, 1995.Google Scholar
  15. 15.
    J.H. Holland, Adaptation in Natural and Artificial Systems. Univ. of Michigan Press: Ann Arbor, MI, 1975.Google Scholar
  16. 16.
    N.R. Howe and D.P. Huttenlocher“Integrating color, texture and geometry for image retrieval,” in Proc. CVPR, 2000, pp. 239–247.Google Scholar
  17. 17.
    C.C. Hsu, W.W. Chu, and R.K. Taira“A knowledge-based approach for retrieving images by content,” IEEE Trans. on Knowledge and Data Engineering, Vol. 8, No. 4, pp. 522–532, 1996.Google Scholar
  18. 18.
    J. Huang, S.R. Kumar, M. Mitra, W.-J. Zhu, and R. Zabih“Spatial color indexing and applications,” Int. J. Computer Vision, Vol. 35, No. 3, pp. 245–268, 1999.Google Scholar
  19. 19.
    B. Huet and E.R. Hancock“Line pattern retrieval using relational histograms,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 21, No. 12, pp. 1363–1371, 1999.Google Scholar
  20. 20.
    A.K. Jain and A. Vailaya“Image retrieval using color and shape,” Pattern Recognition, Vol. 29, No. 8, pp. 1233–1244, 1996.Google Scholar
  21. 21.
    A.K. Jain and A. Vailaya“Shape-based retrieval: A case study with trademark image databases,” Pattern Recognition, Vol. 31, No. 9, pp. 1369–1390, 1998.Google Scholar
  22. 22.
    J.A. Lay and L. Guan“Image retrieval based on energy histograms of the low frequency DCT coefficients,” in Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Proc., 1999, pp. 3009–3012.Google Scholar
  23. 23.
    M.K. Mandal, F. Idris, and S. Panchanathan“A critical evaluation of image and video indexing techniques in the compressed domain,” Image and Vision Computing, Vol. 17, No. 7, pp. 513–529, 1999.Google Scholar
  24. 24.
    B.S. Manjunath and W.Y. Ma“Texture features for browsing and retrieval of image data,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 18, No. 8, pp. 837–842, 1996.Google Scholar
  25. 25.
    R. Mehrotra and J.E. Gary“Similar-shape retrieval in shape data management,” IEEE Computer, Vol. 28, No. 9, pp. 57–62, 1995.Google Scholar
  26. 26.
    M. Mitchell, An Introduction to Genetic Algorithms. MIT Press: Cambridge MA, 1996.Google Scholar
  27. 27.
    P. Pala and S. Santini“Image retrieval by shape and texture,” Pattern Recognition, Vol. 32, No. 3, pp. 517–527, 1999.Google Scholar
  28. 28.
    W.B. Pennebaker and J.L. Mitchell, JPEG Still Image Compression Standard, Van Nostrand Reinhold: New York, NY, 1993.Google Scholar
  29. 29.
    A. Pentland, R.W. Picard, and S. Sclaroff“Photobook: Content-based manipulation of image databases,” Int. J. Computer Vision, Vol. 18, No. 3, pp. 233–254, 1996.Google Scholar
  30. 30.
    G.R. Roussas, A Course in Mathematical Statistics. Academic Press: San Diego, Calif., 1997.Google Scholar
  31. 31.
    Y. Rui, T.S. Huang, and S.-F. Chang“Image retrieval: Current techniques, promising directions and open issues,” J. Visual Comm. and Image Representation, Vol. 10, No. 1, pp. 39–62, 1999.Google Scholar
  32. 32.
    M. Schneier and M. Abdel-Mottaleb“Exploiting the JPEG compression scheme for image retrieval,” IEEE Trans. Pattern Analysis and Machine Intelligence, Vol. 18, No. 8, pp. 849–853, 1996.Google Scholar
  33. 33.
    M.J. Swain and B.H. Ballard“Color indexing,” Int. J. Computer Vision, Vol. 7, No. 1, pp. 11–32, 1991.Google Scholar
  34. 34.
    A. Vailaya, A.K. Jain, and H.J. Zhang“On image classification: City images vs landscapes,” Pattern Recognition, Vol. 31, No. 12, pp. 1921–1935, 1998.Google Scholar
  35. 35.
    G.K. Wallace“The JPEG still picture compression standard,” Communications of the ACM, Vol. 34, pp. 30–44, 1991.Google Scholar
  36. 36.
    J. Z. Wang, G. Wiederhold, O. Firschein, and S.X. Wei“Content-based image indexing and searching using Daubechies’ wavelets,” Int. J. Digital Libraries, Vol. 1, pp. 311–328, 1997.Google Scholar

Copyright information

© Springer Science + Business Media, Inc. 2005

Authors and Affiliations

  • Hau-San Wong
    • 1
  • Horace H. S. Ip
    • 1
  • Lawrence P. L. Iu
    • 1
  • Kent K. T. Cheung
    • 1
  • Ling Guan
    • 2
  1. 1.Department of Computer ScienceCity University of Hong KongKowloon TongHong Kong
  2. 2.Department of Electrical and Computer EngineeringRyerson Polytechnic UniversityTorontoCanada

Personalised recommendations