Abstract
We propose a query method that allows viewers to search video data based on the spatio-temporal relationships of moving objects using a simple and intuitive mode of input. In order to make a query, for example, of a certain segment or style of play in sports footage, it is necessary to express the complex movements of objects in an intuitive manner. In the proposed method, the user inputs this information as an object trajectory using a mouse or pen via a GUI. The usability of our proposed method is evaluated using a prototype query system with four main function; video query based on object speed, spatially absolute or relative query based on object movement, querying of movements of multiple moving objects specifying the spatio-temporal relationships among objects by expressing each object’s trace on a timeline or multi-canvas, and providing a non-linear viewing experience by allowing the user to control playback by drawing object traces directly on the video screen while watching the video.
Chapter PDF
Similar content being viewed by others
References
J.F.Allen. (1983) “Maintaining Knowledge about Temporal Intervals”, Communications of the ACM, 26(11):832-843, 1983.
E. Oomoto and K. Tanaka. (1993) “OVID: Design and Implementation of a Video-Object Database System”, IEEE Transactions on Knowledge and Data Engineering, 5(4):551-563, August, 1993.
E.J. Hwang and Y.S. Subrahmanian. (1996) “Querying Video Libraries”, Journal of Visual Communications and Image Representation, 7 ( 1 ):44-60, March, 1996.
H. Wactlar, T. Kanade, M. Smith, and S. Stevens. (1996) “Inteligent Access to Digital Video: Informedia Project”, IEEE Computer, 29(5):46-52.
L. Forlizzi, R.H. Güting, E. Nardelli, and M. Schneider. (2000) “A Data Model and Data Structure for Moving Objects Databases”, SIGMOD Record, 29(2):319-330,June 2000.
M. Nabil, A.H.H. Ngu, and J. Shepherd. (1997) “Modeling Moving Objects in Multimedia Database”, The 5th Conference on Database Systems for Advanced Applications, Melbourne, Australia, 1997.
M. Erwig, R.H. Güting, M. Schneider, and M. Vazirgiannis. (1999) “SpatioTemporal Data Types: An Approach to Modeling and Querying Moving Objects in Databases”, Geolnformatica, 3(3):269-296, 1999.
R.H. Güting, M.H. Böhlen, M. Erwig, C.S. Jensen, N.A. Lorentzos, M.Schneider, and M. Vazirgiannis. (2000) “A Foundation for Representing and Querying Moving Objects”, ACM Transaction on Database Systems, 25(1), 2000.
M. Erwig and M. Schneider. (2000) “Query-By-Trace: Visual Predicate Specification in Spatio-Temporal Databases”, The 5th IFIP Conference on Visual Database Systems (VDB5), 2000.
D.J.Berndt and J.Clifford. (1996) “Finding Patterns in Time Series: A Dynamic Programming Approach”, Advances in Knowledge Discovery and Data Mining, pp.229-248, 1996.
B. Yi, H.V. Jagadish, and C. Faloulsos. (1998) “Efficient Retrieval of Similar Time Sequences Under Time Warping”, The 14th International Conference on Data Engineering (ICDE’98), pp.201-208, IEEE Computer Society Press, Feb. 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer Science+Business Media New York
About this chapter
Cite this chapter
Yajima, C., Nakanishi, Y., Tanaka, K. (2002). Querying Video Data by Spatio-Temporal Relationships of Moving Object Traces. In: Zhou, X., Pu, P. (eds) Visual and Multimedia Information Management. VDB 2002. IFIP — The International Federation for Information Processing, vol 88. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-35592-4_25
Download citation
DOI: https://doi.org/10.1007/978-0-387-35592-4_25
Publisher Name: Springer, Boston, MA
Print ISBN: 978-1-4757-6935-7
Online ISBN: 978-0-387-35592-4
eBook Packages: Springer Book Archive