Skip to main content

News Video Retrieval by Learning Multimodal Semantic Information

  • Conference paper
Advances in Visual Information Systems (VISUAL 2007)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 4781))

Included in the following conference series:

  • 1025 Accesses

Abstract

With the explosion of multimedia data especially that of video data, requirement of efficient video retrieval has becoming more and more important. Years of TREC Video Retrieval Evaluation (TRECVID) research gives benchmark for video search task. The video data in TRECVID are mainly news video. In this paper a compound model consisting of several atom search modules, i.e., textual and visual, for news video retrieval is introduced. First, the analysis on query topics helps to improve the performance of video retrieval. Furthermore, the multimodal fusion of all atom search modules ensures to get good performance. Experimental results on TRECVID 2005 and TRECVID 2006 search tasks demonstrate the effectiveness of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. TRECVID Video Retrieval Evaluation: http://www-nlpir.nist.gov/projects/trecvid/

  2. Yang, J., Hauptmann, A.: Naming Every Individual in News Video Monologues. In: Proceedings of 12th ACM International Conference on Multimedia, pp. 580–587. ACM Press, New York (2004)

    Chapter  Google Scholar 

  3. Christel, M., Conescu, R.: Addressing the Challenge of Visual Information Access from Digital Image and Video Libraries. In: JCDL 2005, June 7-11, pp. 69–78 (2005)

    Google Scholar 

  4. Rautiainen, M., Ojala, T., et al.: Analyzing the Performance of Visual, Concept, Text Features in Content-Based Video Retrieval. In: MIR 2004, October 15-16, pp. 197–204 (2004)

    Google Scholar 

  5. Hauptmannn, A., Chen, M.Y., Christel, M.C., et al.: Confounded Expectations: Informedia at TRECVID 2004. In: TRECVID Workshop, USA (2004)

    Google Scholar 

  6. Yan, R., Hauptmann, A.: Co-Retrieval: A Boosted Reranking Approach for Video Retrieval. In: IEE Proc. -Vis. Image Signal Process 152(6), 888–895

    Google Scholar 

  7. Chua, T.S., Neo, S.Y., Li, K.Y., et al.: TRECVID 2004 Search and Feature Extraction Task by NUS PRIS. In: TRECVID Workshop, USA (2004)

    Google Scholar 

  8. Yang, H., Chaisorn, L., Zhao, Y.L., Neo, S.Y., et al.: VideoQA: Question Answering on News Video. In: Proceedings of the ACM conference on Multimedia, pp. 632–641. ACM Press, New York (2003)

    Google Scholar 

  9. WordNet, a lexical database for the English language: http://wordnet.princeton.edu/

  10. Melnik, O., Vardi, Y., Zhang, C.H.: Mixed Group Ranks: Preference and Confidence in Classifier Combination. IEEE Trans on Pattern Analysis and Machine Intelligence 26, 973–981 (2004)

    Article  Google Scholar 

  11. MPEG-7 Overview, http://www.chiariglione.org/mpeg/standards/mpeg-7/mpeg-7.htm

  12. Zhu, X.Q., Elmagarmid, A.K., Xue, X.Y., Wu, L.D., Catlin, A.C.: InsightVideo: Toward Hierarchical Video Content Organization for Efficient Browsing, Summarization and Retrieval. IEEE Trans. on Multimedia 7, 648–666 (2005)

    Article  Google Scholar 

  13. Xue, X., Lu, H., Wu, L., et al.: Fudan University at TRECVID 2005. In: TRECVID workshop, Gaithersburg, MD ( November 2005)

    Google Scholar 

  14. Xue, X., Lu, H., Yu, H., et al.: Fudan University at TRECVID 2006. In: TRECVID workshop (November 2006)

    Google Scholar 

  15. Deng, Y., Manjunath, B.S: Unsupervised Segmentation of Color-texture Regions in Images and Video. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(8), 800–810 (2001)

    Article  Google Scholar 

  16. Peng, Y., Ngo, C.: Clip-based Similarity Measure for Hierarchical Video Retrieval. In: MIR 2004, October 15-16, pp. 53–60 (2004)

    Google Scholar 

  17. Houghton, R.: Named Faces: Putting Names to Faces. IEEE Intelligence System Magazine 14(5), 45–50 (1999)

    Article  Google Scholar 

  18. MediaMill, http://www.mediamill.nl/

  19. Over, P., et al.: TREC 2005 Video Retrieval Evaluation. In: TRECVID workshop, Gaithersburg, MD (November 2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Guoping Qiu Clement Leung Xiangyang Xue Robert Laurini

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yu, H., Su, B., Lu, H., Xue, X. (2007). News Video Retrieval by Learning Multimodal Semantic Information. In: Qiu, G., Leung, C., Xue, X., Laurini, R. (eds) Advances in Visual Information Systems. VISUAL 2007. Lecture Notes in Computer Science, vol 4781. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-76414-4_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-76414-4_39

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-76413-7

  • Online ISBN: 978-3-540-76414-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics