Skip to main content

Content-based Image Indexing and Retrieval in Compressed Domain

  • Conference paper
Advances in Modelling, Animation and Rendering
  • 296 Accesses

Abstract

As millions of images are being created and stored in computer networks and more and more images are already presented in compressed format at the source, it becomes increasingly important to consider direct image indexing and retrieval in compressed domain rather than in pixel domain. In this paper, we describe a range of such algorithms out of our recent research work to provide a platform for further research and further development of robust, efficient and effective software tools for many applications in the community of IT and computer science. As worldwide efforts for practical image compression are represented by JPEG international standardization activities, this presentation will focus on automatic image indexing directly in the compressed domain via: (a) DCT-based JPEG; (b) wavelets-based JPEG-2000; and (c) prediction-based JPEG-LS. Since human interpretation of image content is characterized by high level activities, attempts by the community of image processing and computer vision in extracting low-level features in pixel domain invites many questions about the accuracy of image indexing and retrieval. To this end, feature-extraction approach or automatic signatures of images often fail to produce satisfactory solution for retrieving images based on their content. As a result, pixel values are often desired for such content analysis or visual inspections. Therefore, one section out of this paper is contributed to the description of our work towards extracting not only features, but also a complete image for such content access. Compared with full decompression, the image extraction technology described features in low computing cost and low complexity, which essentially bridges the gap between the compressed domain and the pixel domain.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Faloutsos C. et. Al `Efficient and effective querying by image content’ J. Intell. Inform. Syst. Vol 3, pp 231–262, 1994.

    Article  Google Scholar 

  2. Pentland A., Picard R.W. and Sclaroff S.,‘Photobook: Content-basd manipulation of image databases’ Proceedings of SPIE storage Retrieval Image video databases, pp34–47, 1994.

    Google Scholar 

  3. Zhang H.J., et. Al ‘Video parsing retrieval and browsing: an integrated and content-based solution, Proceedings of ACM Multimedia’95, 1995, p 15–24.

    Google Scholar 

  4. Hampapur A. et. Al ‘Virage video engine’ Proceedings of SPIE, San Jose, CA Feb 1997, pp 188–197;

    Google Scholar 

  5. Smith J.R. and Chang S.F. ‘Visual seek: a fully automated content-based image query system’, Proceedings of ACM Multimedia, Boston MA, Nov 1996, pp87–98;

    Google Scholar 

  6. Ma W.Y. and B.S. Manjunath, ‘Netra: a toolbox for navigating large image databases’ Proceedings of ICIP’97, Vol 1, Santa Barbara, CA, 1997, pp568–571

    Google Scholar 

  7. Mehrotra S., Y.Rui et. Al ‘Supporting content-based queries over images in MARS’ Proceedings of IEEE International Conference on Multimedia Computing Systems, Canada, June 3–6, 1997, pp 3–6;

    Google Scholar 

  8. http://imagine.comp.glam.ac.uk/demonstration

    Google Scholar 

  9. Skodras A. et. Al ‘The JPEG 2000 still image compression standard’, IEEE Signal Processing Mgazine, September 2001, pp36–58;

    Google Scholar 

  10. Pichler O. et al. `An unsupervised texture segmentation algorithm with feature space reduction and knowledge feedback’ IEEE Trans. Image Processing, Vol 7, Jan. 1998, pp 53–61.

    Article  Google Scholar 

  11. Wilson R. and Hsu T.I.‘A two-compnent model of texture for analysis and synthesis’ IEEE Trans. Image Processing, Vol 7, No. 10, 1998, pp 1466–1476.

    Article  Google Scholar 

  12. R. Brunelli, O. Mich, and C.M. Modena `A survey on the automatic indexing of video data’ Journal of Visual Communication and Image Representation, 78–112, 1999.

    Google Scholar 

  13. B. M. Methtre, M. S. Kankanhalli, and W. F. Lee, Shape measures for content based image retrieval: A comparison, Information Processing & Management, Vol.33, No.3, pp319–337,1997

    Article  Google Scholar 

  14. R. Chantal and J. Michel, New minimum variance region growing algorithm for image segmentation, Pattern Recognition Letters, Vol.18, No. 3, pp.249–258, 1997

    Article  Google Scholar 

  15. Berman and L. G. Shapiro `A flexible image database system for content-based retrieval’ Computer Vision and Image Understanding, Vol 75, No V2, 1999, pp 175–195.

    Article  Google Scholar 

  16. I.J. Cox, M.L. Miller et. Al `The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments’ IEEE Trans. Image Processing, Vol 9, No 1 2000, pp 20–37.

    Article  Google Scholar 

  17. Theo Gevers and Arnold W.M. PicToSeek: Combining color and shape invariant features for image retrieval’ IEEE Trans. Image Processing, Vol 9, No 1, 2000, pp 102–119.

    Article  Google Scholar 

  18. A. P. Mendonca and E. A. B. da Silva, Segmentation approach using local image statistics, Electronics Letters, Vol. 36, No. 14, pp. 1199–1201, 2000

    Article  Google Scholar 

  19. K. C. Liang and C.O. Kuo Waveguide: a joint wavelet-based image representation and description system’ IEEE Trans. Image Processing, Vol 8, No 11, November, 1999, pp 1619–1629.

    Article  Google Scholar 

  20. S. D. Servetto, and et al. ‘Image coding based on a morphological representation of wavelet data’ IEEE Trans. Image processing, Vol 8, No 9, 1999, pp 1161–1174.

    Article  Google Scholar 

  21. M. Heath, et. Al. `Comparison of edge detectors’ Computer Vision and Image Understanding, Vol 69, No 1, 1998, pp 38–54.

    Article  Google Scholar 

  22. B.S. Manjunath and W. Y. Ma `Texture features for browsing and retrieval of image data’ IEEE Trans. Pattern Anal. Machine Intell., Vol 18, pp 837–842, 1996.

    Article  Google Scholar 

  23. M Beatty and B. S. Manjunath ‘Dimensionality reduction using multidimensional scaling for content-based retrieval’, IEEE Int. Conf. Image Processing, 1997.

    Google Scholar 

  24. B. Gunsel and A. M. Tekalp `Shape similarity matching for query-byexample’ Pattern Recognition, Vol 31, pp 931–944, 1998.

    Article  Google Scholar 

  25. Rui Y., Huang T.S. and Metrotra S. `Relevance feedback techniques in interactive content-based image retrieval’, Proc. IS&T and SPIE Storage and Retrieval of Image and Video Databases VI, San Juan, PR, June 1997, pp762–768.

    Google Scholar 

  26. Minka T.P. and Picard R.W. `Interactive learning with a society of models’ Pattern Recognition, Vol 30, pp565–581, 1997.

    Article  Google Scholar 

  27. Flickner M. et. al. ‘Query by image and video content: The QBIC system’, IEEE Computer, September 1995, pp 23–32. http://www.ipeg.org/public/jpeglinks.htm:JPEG-LS/ISO/IEC/JTC/1/SC29/WG1FCD 14495.

    Google Scholar 

  28. Weinberger M.J., Rissanen J. and Sapiro G. `LOCO-I: A low complexity, context-based, lossless image compression algorithm’, Proceedings of Data Compression Conference, Snowbird, Utah, April 1996, pp 140–149.

    Google Scholar 

  29. Salembier P. and Garrido L. `Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval’ IEEE Trans. On Image Processing, Vol 9, No. 4, April 2000, pp561–576.

    Article  Google Scholar 

  30. Lee C.S., Ma W. Y. and Zhang H. J. ‘Information embedding based on user’s relevance feedback for image retrieval’, SPIE Photonics East, Boston, Sept. 20–22, 1999.

    Google Scholar 

  31. M.K. Hu, Visaul pattern recognition by moment invariants, IRE Trans. in Information Theory, Vol.8, 179–187, 1962

    MATH  Google Scholar 

  32. G. K. Wallace, The JPEG still picture compression standard, Communication of the ACM, Vol.34, No.4, pp31–45,1991.

    Article  Google Scholar 

  33. R. Chantal and J. Michel, New minimum variance region growing algorithm for image segmentation, Pattern Recognition Letters, Von 8, No. 3, pp.249–258, 1997

    Google Scholar 

  34. B. M. Methtre, M. S. Kankanhalli, and W. F. Lee, Shape measures for content based image retrieval: A comparison, Information Processing & Management, Vol.33, No.3, pp319–337,1997

    Article  Google Scholar 

  35. M. K. Mandal, F. Idris and S. Panchanatha, A critical evaluation of image and video indexing techniques in the compressed domain, Image and Vision Computing, Vol.17, pp.513–529, 1999

    Article  Google Scholar 

  36. Sammeer A. Nene, Shree K. Nayar, and Hiroshi Murase, “Columbia Object Image Library (COIL-20),” Technical Report No. CUCS-006–96, Department of omputer Science, Columbia University

    Google Scholar 

  37. J. Serra. Image Analysis and Mathematical Morphology. Academic Press, 1982.

    MATH  Google Scholar 

  38. Yong Rui, Thomas S. Huang, Shih-Fu Chang Image, “Retrieval: Past, Present, And Future,” Proc. of Int. Symposium on Multimedia Information Processing, Dec 1997.

    Google Scholar 

  39. M. K. Hu, “Visual pattern recognition by moment invariants.” IRE Trans. Inform. Theory, vol. IT-8, pp. 179–187, Feb. 1962.

    Google Scholar 

  40. bannis Pitas, “Digital image processing algorithms,” Prentice Hall International, 1993.

    Google Scholar 

  41. J. M. Shapiro, “Embedded image coding using zerotrees of wavelet coefficents,” IEEE transaction on Signal Processing, Vol. 41, pp. 3445–3462, Dec. 1993.

    Article  MATH  Google Scholar 

  42. Said and W. A. Pearlman, “A new, fast, and efficient image codec based on set partitioning in hierarchical trees,” IEEE Transaction on Circuit and Systems for Video Technology, Vol. 6, No. 3, pp. 243–249, June 1996.

    Article  Google Scholar 

  43. E. Jacobs, A. Finkelstein, and D. H. Salesin, “Fast multiresolution image querying,” in Proc. SIGGRAPH Computer Graphics, Los Angeles, CA, 1995, pp. 278–280.

    Google Scholar 

  44. Stephane Mallat “Wavelet for a Vision”, Proceedings of the IEEE, Vol. 84, No. 4, April 1996, pp. 604–614.

    Article  Google Scholar 

  45. Milan Sonka, Vaclav Hlavac and Roger Boyle, “Image processing, analysis and machine vision,” Cambridge University Press, 1996, Cambridge.

    Google Scholar 

  46. R. Courant and D. Hilbert, Methods of Mathematical Physics, Volume I and II, John Wiley and Sons, 1989.

    Book  Google Scholar 

  47. J. Serra. Image Analysis and Mathematical Morphology. Academic Press, 1982.

    Google Scholar 

  48. Hearn and Baker, Computer Graphics -- C Version, 2nd ed. (1997), ISBN: 0–13–0–13.

    Google Scholar 

  49. Sammeer A. Nene, Shree K. Nayar, and Hiroshi Murase, “Columbia Object Image Library (COIL-20),” Technical Report No. CUCS-006–96, Department of Computer Science, Columbia University.

    Google Scholar 

  50. X. S. Zhou, T. S. Huang, “Edge-based structural features for content-based image retrieval”, Pattern Recognition Letters, 22 (2001), pp457–468.

    Article  MathSciNet  MATH  Google Scholar 

  51. A.A. Goodrum, “Image Information Retrieval: An Overview of Current Research”, Information Science, Volume 3, No 2, pp63–67, 2000.

    Google Scholar 

  52. Jiang J. `a generalized 1-D approach for paralled computing of NxN DCT’, Applied Signal Processing, Vol 5, pp 244–254, 1998;

    Article  Google Scholar 

  53. C. Faloutsos, R. Barber and M. Flickner et al, Efficient and effective querying by image content, Journal of Intelligent Information System, Vol.3, No.3, pp.231–262, 1994

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2002 Springer-Verlag London

About this paper

Cite this paper

Jiang, J. (2002). Content-based Image Indexing and Retrieval in Compressed Domain. In: Vince, J., Earnshaw, R. (eds) Advances in Modelling, Animation and Rendering. Springer, London. https://doi.org/10.1007/978-1-4471-0103-1_3

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-0103-1_3

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-1118-4

  • Online ISBN: 978-1-4471-0103-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics