Abstract
As millions of images are being created and stored in computer networks and more and more images are already presented in compressed format at the source, it becomes increasingly important to consider direct image indexing and retrieval in compressed domain rather than in pixel domain. In this paper, we describe a range of such algorithms out of our recent research work to provide a platform for further research and further development of robust, efficient and effective software tools for many applications in the community of IT and computer science. As worldwide efforts for practical image compression are represented by JPEG international standardization activities, this presentation will focus on automatic image indexing directly in the compressed domain via: (a) DCT-based JPEG; (b) wavelets-based JPEG-2000; and (c) prediction-based JPEG-LS. Since human interpretation of image content is characterized by high level activities, attempts by the community of image processing and computer vision in extracting low-level features in pixel domain invites many questions about the accuracy of image indexing and retrieval. To this end, feature-extraction approach or automatic signatures of images often fail to produce satisfactory solution for retrieving images based on their content. As a result, pixel values are often desired for such content analysis or visual inspections. Therefore, one section out of this paper is contributed to the description of our work towards extracting not only features, but also a complete image for such content access. Compared with full decompression, the image extraction technology described features in low computing cost and low complexity, which essentially bridges the gap between the compressed domain and the pixel domain.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Faloutsos C. et. Al `Efficient and effective querying by image content’ J. Intell. Inform. Syst. Vol 3, pp 231–262, 1994.
Pentland A., Picard R.W. and Sclaroff S.,‘Photobook: Content-basd manipulation of image databases’ Proceedings of SPIE storage Retrieval Image video databases, pp34–47, 1994.
Zhang H.J., et. Al ‘Video parsing retrieval and browsing: an integrated and content-based solution, Proceedings of ACM Multimedia’95, 1995, p 15–24.
Hampapur A. et. Al ‘Virage video engine’ Proceedings of SPIE, San Jose, CA Feb 1997, pp 188–197;
Smith J.R. and Chang S.F. ‘Visual seek: a fully automated content-based image query system’, Proceedings of ACM Multimedia, Boston MA, Nov 1996, pp87–98;
Ma W.Y. and B.S. Manjunath, ‘Netra: a toolbox for navigating large image databases’ Proceedings of ICIP’97, Vol 1, Santa Barbara, CA, 1997, pp568–571
Mehrotra S., Y.Rui et. Al ‘Supporting content-based queries over images in MARS’ Proceedings of IEEE International Conference on Multimedia Computing Systems, Canada, June 3–6, 1997, pp 3–6;
http://imagine.comp.glam.ac.uk/demonstration
Skodras A. et. Al ‘The JPEG 2000 still image compression standard’, IEEE Signal Processing Mgazine, September 2001, pp36–58;
Pichler O. et al. `An unsupervised texture segmentation algorithm with feature space reduction and knowledge feedback’ IEEE Trans. Image Processing, Vol 7, Jan. 1998, pp 53–61.
Wilson R. and Hsu T.I.‘A two-compnent model of texture for analysis and synthesis’ IEEE Trans. Image Processing, Vol 7, No. 10, 1998, pp 1466–1476.
R. Brunelli, O. Mich, and C.M. Modena `A survey on the automatic indexing of video data’ Journal of Visual Communication and Image Representation, 78–112, 1999.
B. M. Methtre, M. S. Kankanhalli, and W. F. Lee, Shape measures for content based image retrieval: A comparison, Information Processing & Management, Vol.33, No.3, pp319–337,1997
R. Chantal and J. Michel, New minimum variance region growing algorithm for image segmentation, Pattern Recognition Letters, Vol.18, No. 3, pp.249–258, 1997
Berman and L. G. Shapiro `A flexible image database system for content-based retrieval’ Computer Vision and Image Understanding, Vol 75, No V2, 1999, pp 175–195.
I.J. Cox, M.L. Miller et. Al `The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments’ IEEE Trans. Image Processing, Vol 9, No 1 2000, pp 20–37.
Theo Gevers and Arnold W.M. PicToSeek: Combining color and shape invariant features for image retrieval’ IEEE Trans. Image Processing, Vol 9, No 1, 2000, pp 102–119.
A. P. Mendonca and E. A. B. da Silva, Segmentation approach using local image statistics, Electronics Letters, Vol. 36, No. 14, pp. 1199–1201, 2000
K. C. Liang and C.O. Kuo Waveguide: a joint wavelet-based image representation and description system’ IEEE Trans. Image Processing, Vol 8, No 11, November, 1999, pp 1619–1629.
S. D. Servetto, and et al. ‘Image coding based on a morphological representation of wavelet data’ IEEE Trans. Image processing, Vol 8, No 9, 1999, pp 1161–1174.
M. Heath, et. Al. `Comparison of edge detectors’ Computer Vision and Image Understanding, Vol 69, No 1, 1998, pp 38–54.
B.S. Manjunath and W. Y. Ma `Texture features for browsing and retrieval of image data’ IEEE Trans. Pattern Anal. Machine Intell., Vol 18, pp 837–842, 1996.
M Beatty and B. S. Manjunath ‘Dimensionality reduction using multidimensional scaling for content-based retrieval’, IEEE Int. Conf. Image Processing, 1997.
B. Gunsel and A. M. Tekalp `Shape similarity matching for query-byexample’ Pattern Recognition, Vol 31, pp 931–944, 1998.
Rui Y., Huang T.S. and Metrotra S. `Relevance feedback techniques in interactive content-based image retrieval’, Proc. IS&T and SPIE Storage and Retrieval of Image and Video Databases VI, San Juan, PR, June 1997, pp762–768.
Minka T.P. and Picard R.W. `Interactive learning with a society of models’ Pattern Recognition, Vol 30, pp565–581, 1997.
Flickner M. et. al. ‘Query by image and video content: The QBIC system’, IEEE Computer, September 1995, pp 23–32. http://www.ipeg.org/public/jpeglinks.htm:JPEG-LS/ISO/IEC/JTC/1/SC29/WG1FCD 14495.
Weinberger M.J., Rissanen J. and Sapiro G. `LOCO-I: A low complexity, context-based, lossless image compression algorithm’, Proceedings of Data Compression Conference, Snowbird, Utah, April 1996, pp 140–149.
Salembier P. and Garrido L. `Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval’ IEEE Trans. On Image Processing, Vol 9, No. 4, April 2000, pp561–576.
Lee C.S., Ma W. Y. and Zhang H. J. ‘Information embedding based on user’s relevance feedback for image retrieval’, SPIE Photonics East, Boston, Sept. 20–22, 1999.
M.K. Hu, Visaul pattern recognition by moment invariants, IRE Trans. in Information Theory, Vol.8, 179–187, 1962
G. K. Wallace, The JPEG still picture compression standard, Communication of the ACM, Vol.34, No.4, pp31–45,1991.
R. Chantal and J. Michel, New minimum variance region growing algorithm for image segmentation, Pattern Recognition Letters, Von 8, No. 3, pp.249–258, 1997
B. M. Methtre, M. S. Kankanhalli, and W. F. Lee, Shape measures for content based image retrieval: A comparison, Information Processing & Management, Vol.33, No.3, pp319–337,1997
M. K. Mandal, F. Idris and S. Panchanatha, A critical evaluation of image and video indexing techniques in the compressed domain, Image and Vision Computing, Vol.17, pp.513–529, 1999
Sammeer A. Nene, Shree K. Nayar, and Hiroshi Murase, “Columbia Object Image Library (COIL-20),” Technical Report No. CUCS-006–96, Department of omputer Science, Columbia University
J. Serra. Image Analysis and Mathematical Morphology. Academic Press, 1982.
Yong Rui, Thomas S. Huang, Shih-Fu Chang Image, “Retrieval: Past, Present, And Future,” Proc. of Int. Symposium on Multimedia Information Processing, Dec 1997.
M. K. Hu, “Visual pattern recognition by moment invariants.” IRE Trans. Inform. Theory, vol. IT-8, pp. 179–187, Feb. 1962.
bannis Pitas, “Digital image processing algorithms,” Prentice Hall International, 1993.
J. M. Shapiro, “Embedded image coding using zerotrees of wavelet coefficents,” IEEE transaction on Signal Processing, Vol. 41, pp. 3445–3462, Dec. 1993.
Said and W. A. Pearlman, “A new, fast, and efficient image codec based on set partitioning in hierarchical trees,” IEEE Transaction on Circuit and Systems for Video Technology, Vol. 6, No. 3, pp. 243–249, June 1996.
E. Jacobs, A. Finkelstein, and D. H. Salesin, “Fast multiresolution image querying,” in Proc. SIGGRAPH Computer Graphics, Los Angeles, CA, 1995, pp. 278–280.
Stephane Mallat “Wavelet for a Vision”, Proceedings of the IEEE, Vol. 84, No. 4, April 1996, pp. 604–614.
Milan Sonka, Vaclav Hlavac and Roger Boyle, “Image processing, analysis and machine vision,” Cambridge University Press, 1996, Cambridge.
R. Courant and D. Hilbert, Methods of Mathematical Physics, Volume I and II, John Wiley and Sons, 1989.
J. Serra. Image Analysis and Mathematical Morphology. Academic Press, 1982.
Hearn and Baker, Computer Graphics -- C Version, 2nd ed. (1997), ISBN: 0–13–0–13.
Sammeer A. Nene, Shree K. Nayar, and Hiroshi Murase, “Columbia Object Image Library (COIL-20),” Technical Report No. CUCS-006–96, Department of Computer Science, Columbia University.
X. S. Zhou, T. S. Huang, “Edge-based structural features for content-based image retrieval”, Pattern Recognition Letters, 22 (2001), pp457–468.
A.A. Goodrum, “Image Information Retrieval: An Overview of Current Research”, Information Science, Volume 3, No 2, pp63–67, 2000.
Jiang J. `a generalized 1-D approach for paralled computing of NxN DCT’, Applied Signal Processing, Vol 5, pp 244–254, 1998;
C. Faloutsos, R. Barber and M. Flickner et al, Efficient and effective querying by image content, Journal of Intelligent Information System, Vol.3, No.3, pp.231–262, 1994
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag London
About this paper
Cite this paper
Jiang, J. (2002). Content-based Image Indexing and Retrieval in Compressed Domain. In: Vince, J., Earnshaw, R. (eds) Advances in Modelling, Animation and Rendering. Springer, London. https://doi.org/10.1007/978-1-4471-0103-1_3
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0103-1_3
Publisher Name: Springer, London
Print ISBN: 978-1-4471-1118-4
Online ISBN: 978-1-4471-0103-1
eBook Packages: Springer Book Archive