Abstract
Searching and filtering images and videos from large visual information sources calls for efficient algorithms and tools with new functionalities. Content-based tools have proven promising in recent research and development, as they provide powerful techniques that complement the traditional, text-based approach. This paper includes a brief survey of current work in this field, discusses promising directions of research based on experience in developing large-scale prototype systems, and finally describes our views towards the emerging multimedia content description standard, MPEG-7.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
M. Flickner, H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker, “Query by Image and Video Content: The QBIC System”, IEEE Computer Magazine, Sep. 1995, Vol. 28, No. 9, pp. 23–32.
J. R. Bach, C. Fuller, A. Gupta, A. Hampapur, B. Horowitz, R. Humphrey, R.C. Jain and C. Shu, “Virage image search engine: an open framework for image management”, Symposium on Electronic Imaging: Science and Technology—Storage & Retrieval for Image and Video Databases IV, IS&T/SPIE, Feb. 1996.
A. Pentland, R.W. Picard, and S. Sclaroff, “Photobook: Tools for Content-Based Manipulation of Image Databases”, Proc. Storage and Retrieval for Image and Video Databases II, Vol. 2185, SPIE, Bellingham, Wash., 1994, pp. 34–47.
J. R. Smith and S.-F. Chang, “VisualSEEk: A Fully Automated Content-Based Image Query System”, ACM Multimedia Conference, Boston, MA, Nov. 1996. (ftp://ftp.ctr.columbia.edu/CTR-Research/advent/public/papers/96/smith96f.ps) (demo http://www.ctr.columbia.edu/VisualSEEk).
C. E. Jacobs, A. Finkelstein, and D. H. Salesin, “Fast multiresolution image querying”, ACM SIGRAPH, pp. 277–286, August, 1995.
A. G. Hauptmann and M. Smith, “Text, Speech and Vision for Video Segmentation: The Informedia Project”, AAAI Fall Symposium, Computational Models for Integrating Language and Vision, Boston, November 10–12, 1995.
B. Shahraray and D. C. Gibbon, “Automatic Generation of Pictorial Transcript of Video Programs”, SPIE Vol. 2417, pp. 512–518, 1995.
R. Mohan, “Text Based Search of TV News Stories”, SPIE Photonics East Intern. Conf. on Digital Image Storage & Archiving System, Boston, MA, Nov. 1996.
W. Wolf, B. Liu, A. Wolfe, M. Yeung, B.-L. Yeo, and D. Markham, “Video as scholarly material in the digital library”, Chapter 1 in Advances in Digital Libraries ’95, Springer-Verlag, 1995.
S.-F. Chang, W. Chen, H.J. Meng, H. Sundaram, and D. Zhong, “VideoQ—An Automatic Content-Based Video Search System Using Visual Cues”, ACM Multimedia 1997, Seattle, WA, November 1997. (ftp://ftp.ctr.columbia.edu/CTR-Research/advent/public/public/chang/videoq/acmpaper.ps.gz)(Demo http://www.ctr.columbia.edu/videoq).
Excaliber System: http://www.excalib.com/rev2/products/vrw/vrw.html.
Islip Media: http://www.islip.com.
Magnifi: http://www.magnifi.com.
Arthur: Art Media and Text Hub and Retrieval System, The Getty Information Institute, http://www.ahip.getty.edu/arthur/.
C.-S. Li, L. Bergman, S. Carty, V. Castelli, S. Hutchins, L. Knapp, I. Kontoyiannis, J. Robinson, R. Ryniker, J. Shoudt, B. Skelly, J. Turek, “Scalable Content-Based Retrieval from Distributed Image/Video Databases, ”submitted to IEEE Trans. Circuits and Systems for Video Technology, 1997.
S.-F. Chang, J. R. Smith, M. Beigi, and A. Benitez, “Visual Information Retrieval from Large Distributed On-Line Repositories”, Communications of ACM, Special Issue on Visual Information Management, Vol. 40 No. 12, pp. 63–71, Dec. 1997.
S.-F. Chang, J. R. Smith, H. J. Meng, H. Wang, and D. Zhong, “Finding Images/Video in Large Archives— Columbia’s Content-Based Visual Query Projects”, CNRI Digital Library Magazine (on-line), Feb. 1997. (http://www.dlib.org/dlib/february97/columbia/02chang.html).
J. R. Smith and S.-F. Chang, “Visually Searching the Web for Content”, IEEE Multimedia Magazine, Summer, 4(3), pp. 12–20, 1997. (ftp://ftp.ctr.columbia.edu/CTR-Research/advent/public/papers/96/smith96e.ps) (demo http://www.ctr.columbia.edu/webseek).
M. Beigi, A. Benitez, and S.-F. Chang, “MetaSEEk: A Content-Based Meta Search Engine for Images”, SPIE Conference on Storage and Retrieval for Image and Video Database, San Jose, Feb. 1998. (demo and document: http://www.ctr.columbia.edu/metaseek).
J. Meng and S.-F. Chang, “CVEPS: A Compressed Video Editing and Parsing System”, ACM Multimedia Conference, Boston, MA, Nov. 1996. Demo: http://www.ctr.columbia.edu/WebClip ftp://ftp.ctr.columbia.edu/CTR-Research/advent/public/papers/96/meng96c.ps.
S.-F. Chang, W. Chen, and H. Sundaram, “Semantic Visual Templates -Linking Visual Features to Semantics”, IEEE Intern. Conference on Image Processing, October 1998.
ISO/IEC JTC1/SC29/WG11, MPEG-7: Context and Objectives (v. 5) Oct. 1997.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1999 Springer-Verlag London Limited
About this paper
Cite this paper
Chang, SF. (1999). Content-Based Searching and Filtering of Visual Information. In: De Natale, F., Pupolin, S. (eds) Multimedia Communications. Springer, London. https://doi.org/10.1007/978-1-4471-0859-7_44
Download citation
DOI: https://doi.org/10.1007/978-1-4471-0859-7_44
Publisher Name: Springer, London
Print ISBN: 978-1-85233-135-1
Online ISBN: 978-1-4471-0859-7
eBook Packages: Springer Book Archive