Abstract
One of the main goal for novel machine learning and computer vision systems is to perform automatic video event understanding. In this chapter, we present a content-based approach for understanding sports videos using players trajectories. To this aim, an object-based approach for temporal analysis of videos is described. An original hierarchical parallel semi-Markov model (HPaSMM) is proposed. In this latter, a lower level is used to model players trajectories motions and interactions using parallel hidden Markov models, while an upper level relying on semi-Markov chains is considered to describe activity phases. Such probabilistic graphical models help taking into account low level temporal causalities of trajectories features as well as upper level temporal transitions between activity phases. Hence, it provides an efficient and extensible machine learning tool for applications of sports video semantic-based understanding such that segmentation, summarization and indexing. To illustrate the efficiency of the proposed modeling, application of the novel modeling to two sports, and the corresponding results, are reported.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Anjum, N., Cavallaro, A.: Multifeature object trajectory clustering for video analysis. IEEE Trans. on Circuit and Systems for Video Technology, Special issue on event analysis in videosĀ 18(11), 1555ā1564 (2008)
http://vision.fe.uni-lj.si/cvbase06/download/CVBASE-06manual.pdf
Ge, X.: Segmental semi-Markov models and applications to sequence analysis. Ph. D. thesis. University of California (2002)
GĆ¼nsel, B., Tekalp, A.M., van Beek, P.J.L.: Content-based access to video objects: temporal segmentation, visual summarization, and feature extraction. Signal ProcessingĀ 66(2), 261ā280 (1998)
Hervieu, A., Bouthemy, P., Le Cadre, J.-P.: A HMM-based method for recognizing dynamic video contents from trajectories. In: Proc. of the IEEE International Conference on Image Processing (2007)
Hervieu, A., Bouthemy, P., Le Cadre, J.-P.: A statistical video content recognition method using invariant features on object trajectories. IEEE Trans. on Circuit and Systems for Video Technology, Special issue on event analysis in videosĀ 18(11), 1533ā1543 (2008)
Hervieu, A., Bouthemy, P., Le Cadre, J.-P.: Trajectory-based handball video understanding. In: Proc. of the ACM Conference on Image and Video Retrieval (2009)
Hongeng, S., Nevatia, R., Bremond, F.: Large-scale event detection using semi-hidden Markov models. In: Proc. of the IEEE International Conference on Computer Vision (2003)
Jung, C.R., Hennemann, L., Musse, S.R.: Event detection using trajectory clustering and 4-D histograms. IEEE Trans. on Circuit and Systems for Video Technology, Special issue on event analysis in videosĀ 18(11), 1565ā1574 (2008)
Kokaram, A., Rea, N., Dahyot, R., Tekalp, M., Bouthemy, P., Gros, P., Sezan, I.: Browsing sports video (Trends in sports-related indexing and retrieval work). IEEE Signal Processing MagazineĀ 23(2), 47ā58 (2006)
Kristan, M., PersĢ, J., PersĢe, M., Bon, M., KovacĢicĢ, S.: Multiple interacting targets tracking with application to team sports. In: Proc. off the International Symposium on Image and Signal Processing and Analysis (2005)
Mermelstein, P.: Distance measures for speech recognition, psychological and instrumental. In: Proc. of the Workshop on Pattern Recognition and Artificial Intelligence (1976)
Muscariello, A., Gravier, G., Bimbot, F.: Variability tolerant audio motif discovery. In: Proc. of the International Conference on Multimedia Modeling (2009)
Natarajan, P., Nevatia, R.: Coupled hidden semi-Markov models for activity recognition. In: Proc. of the IEEE International Joint Conference on Artificial Intelligence (2007)
Natarajan, P., Nevatia, R.: Hierarchical multi-channel hidden semi-Markov models. In: Proc. of the IEEE Workshop on Motion and Video Computing (2007)
Oliver, N.M., Rosario, B., Pentland, A.P.: A Bayesian computer vision system for modeling human interactions. IEEE Transactions Pattern Analysis and Machine IntelligenceĀ 22(8), 831ā843 (2000)
PersĢ, J., KovacĢicĢ, S.: Tracking people in sport: making use of partially controled environment. In: Proc. of the International Conference on Computer Analysis of Images and Patterns (2001)
PersĢe, M., PersĢ, J., Kristan, M., VucĢkovicĢ, G., KovacĢicĢ, S.: Physics-based modeling of human motion using Kalman filter and collision avoidance algorithm. In: Proc. of the International Symposium on Image and Signal Processing and Analysis (2005)
PersĢe, M., Kristan, M., KovacĢicĢ, S., VucĢkovicĢ, G., PersĢ, J.: A trajectory-based analysis of coordinated team activity in a basketball game. Computer Vision and Image UnderstandingĀ 113(5), 612ā621 (2009)
Piciarelli, C., Micheloni, C., Foresti, G.L.: Trajectory-based anomalous event detection. IEEE Trans. on Circuit and Systems for Video Technology, Special issue on event analysis in videosĀ 18(11), 1544ā1554 (2008)
Richardson, M., Domingos, P.: Markov logic networks. Machine LearningĀ 62, 107ā136 (2006)
Vogler, C., Metaxas, D.: Parallel hidden Markov models for American sign language recognition. In: Proc. of the IEEE International Conference on Computer Vision (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
Ā© 2011 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Hervieu, A., Bouthemy, P. (2011). Understanding Sports Video Using Players Trajectories. In: Zhang, J., Shao, L., Zhang, L., Jones, G.A. (eds) Intelligent Video Event Analysis and Understanding. Studies in Computational Intelligence, vol 332. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17554-1_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-17554-1_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17553-4
Online ISBN: 978-3-642-17554-1
eBook Packages: EngineeringEngineering (R0)