Abstract
Large video collections present a unique set of challenges to the search system designer. Text transcripts do not always provide an accurate index to the visual content, and the performance of visually based semantic extraction techniques is often inadequate for search tasks. The searcher must be relied upon to provide detailed judgment of the relevance of specific video segments. We describe a video search system that facilitates this user task by efficiently presenting search results in semantically meaningful units to simplify exploration of query results and query reformulation. We employ a story segmentation system and supporting user interface elements to effectively present query results at the story level. The system was tested in the 2004 TRECVID interactive search evaluations with very positive results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Fonda, D.: Downloading hollywood. Time Magazine 165 (2005)
Kraaij, W., Smeaton, A.F., Over, P., Arlandis, J.: TRECVID 2004 – an introduction (2004), http://www-nlpir.nist.gov/projects/tvpubs/tvpapers04/tv4intro.pdf
Internet Archive: Moving images archive (1996), http://www.archive.org/movies
Google: Google Video Search (2005), http://video.google.com
Yahoo: Yahoo! Video Search (2005), http://video.search.yahoo.com
Snoek, C., Worring, M., Geusebroek, J., Koelma, D., Seinstra, F.: The MediaMill TRECVID 2004 semantic video search engine. In: TREC Video Retrieval Evaluation Online Proceedings (2004)
Heesch, D., Howarth, P., Megalhaes, J., May, A., Pickering, M., Yavlinsky, A., Ruger, S.: Video retrieval using search and browsing. In: TREC Video Retrieval Evaluation Online Proceedings (2004)
Christel, M., Yang, J., Yan, R., Hauptmann, A.: Carnegie mellon university search. In: TREC Video Retrieval Evaluation Online Proceedings (2004)
Cooke, E., Ferguson, P., Gaughan, G., Gurrin, C., Jones, G., Borgue, H.L., Lee, H., Marlow, S., McDonald, K., McHugh, M., Murphy, N., O’Connor, N., O’Hare, N., Rothwell, S., Smeaton, A., Wilkins, P.: TRECVID 2004 experiments in dublin city university. In: TREC Video Retrieval Evaluation Online Proceedings (2004)
Yang, J., Chen, M.-y., Hauptmann, A.: Finding person X: Correlating names with visual appearances. In: Enser, P.G.B., Kompatsiaris, Y., O’Connor, N.E., Smeaton, A., Smeulders, A.W.M. (eds.) CIVR 2004. LNCS, vol. 3115, pp. 270–278. Springer, Heidelberg (2004)
Berry, M.W., Drmac, Z., Jessup, E.R.: Matrices, vector spaces, and information retrieval. SIAM Rev. 41, 335–362 (1999)
Ruiloba, R., Joly, P., Marchand-Maillet, S., Quénot, G.: Towards a standard protocol for the evaluation of video-to-shots segmentation algorithms. In: European Workshop on Content Based Multimedia Indexing, Toulouse, France, pp. 41–48 (1999)
Cooper, M.: Video segmentation combining similarity analysis and classification. In: MULTIMEDIA 2004: Proceedings of the 12th annual ACM international conference on Multimedia, pp. 252–255. ACM Press, New York (2004)
Gauvain, J.L., Lamel, L., Adda, G.: The LIMSI broadcast news transcription system. Speech Commun. 37, 89–108 (2002)
Berry, M.W., Dumais, S.T., O’Brien, G.W.: Using linear algebra for intelligent information retrieval. SIAM Rev. 37, 573–595 (1995)
Choi, F.Y.Y., Weimer-Hastings, P., Moore, J.: Latent semantic analysis for text segmentation. In: 6th Conference on Empirical Methods in Natural Language Processing, pp. 109–117 (2001)
Cooper, M., Foote, J.: Scene boundary detection via video self-similarity analysis. In: IEEE Intl. Conf. on Image Processing, pp. 378–381 (2001)
Porter, M.: An algorithm for suffix stripping. Program 14, 130–130 (1980)
Manning, C.D., Schütze, H.: Foundations of statistical natural language processing. MIT Press, Cambridge (1999)
TRECVID: TREC video retrieval evaluation. Workshop (2001, 2002, 2003, 2004), http://www-nlpir.nist.gov/projects/trecvid/
Pirolli, P., Card, S.: Information Foraging. Psychological Review (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Adcock, J., Cooper, M., Girgensohn, A., Wilcox, L. (2005). Interactive Video Search Using Multilevel Indexing. In: Leow, WK., Lew, M.S., Chua, TS., Ma, WY., Chaisorn, L., Bakker, E.M. (eds) Image and Video Retrieval. CIVR 2005. Lecture Notes in Computer Science, vol 3568. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11526346_24
Download citation
DOI: https://doi.org/10.1007/11526346_24
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27858-0
Online ISBN: 978-3-540-31678-7
eBook Packages: Computer ScienceComputer Science (R0)