Semantic Modeling and Knowledge Representation for Multimedia Data
Image/Video/Music search; Multimedia information retrieval
Semantic modeling and knowledge representation is essential to a multimedia information retrieval system for supporting effective data organization and search. Semantic modeling and knowledge representation for multimedia data (e.g., imagery, video, and music) consists of three steps: feature extraction, semantic labeling, and features-to-semantics mapping. Feature extraction obtains perceptual characteristics such as color, shape, texture, salient-object, and motion features from multimedia data; semantic labeling associates multimedia data with cognitive concepts; and features-to-semantics mapping constructs correspondence between perceptual features and cognitive concepts. Analogically to data representation for text documents, improving semantic modeling and knowledge representation for multimedia data leads to enhanced data organization and query performance.
The principal design...
- 3.Beyer K, Goldstein J, Ramakrishnan R, Shaft U. When is nearest neighbor meaningful. In: Proceedings of the 7th International Conference on Database Theory; 1999. p. 217–35.Google Scholar
- 4.Blei DM, Ng A, Jordan M. Latent Dirichlet allocation. J Machine Learning Res. 2003;3(4/5):993–1022.Google Scholar
- 5.Chang EY, et al. Parallelizing support vector machines on distributed computers. In: Advances in Neural Information Proceedings of the Systems 20, Proceedings of the 21st Annual Conference on Neural Information Proceedings of the Systems; 2007.Google Scholar
- 7.Donoho DL. Aide-Memoire. High-dimensional data analysis: the curses and blessings of dimensionality (American Math. Society Lecture). In: Mathematical Challenges Of The 21st Century Explored at American Mathematical Society Conference; 2000.Google Scholar
- 8.Flickner M, et al. Query by image and video content: QBIC system. IEEE Comput. 1995;28(9).Google Scholar
- 9.Goh K, Chang EY, Lai W-C. Concept-dependent multimodal active learning for image retrieval. In: Proceedings of the 12th ACM International Conference on Multimedia; 2004. p. 564–71.Google Scholar
- 10.Hoi C-H, Lyu MR. A novel log-based relevance feedback technique in content-based image retrieval. In: Proceedings of the 12th ACM International Conference on Multimedia; 2004. p. 24–31.Google Scholar
- 12.Rocchio JJ. Relevance feedback in information retrieval. In: Salton G, editor. The SMART retrieval system – experiments in automatic document processing. Englewood Cliffs: Prentice-Hall; 1971. p. 313–23. Chapter 14.Google Scholar
- 14.Tong S, Chang EY. Support vector machine active learning for image retrieval. In: Proceedings of the 9th ACM International Conference on Multimedia; 2001. p. 107–18.Google Scholar