Abstract
Watching TV or Internet video is the most common way for people perceiving soccer matches. However, it is immature to generalize this mean to amateur soccer, as it is expensive to direct a match professionally by human. As an alternative, using multiple cameras to generate a panoramic video can faithfully record the match, but with bad watching experience. In this work, we develop a psDirector system to address this dilemma. It takes the panoramic soccer video as input and outputs a corresponding watching view counterpart, which continuously focuses on attractive playing areas that people are interested in. The task is somewhat unique and we propose a novel pipeline to implement it. It first extracts several soccer-related semantics, i.e., soccer field, attractive ROI, distribution of players, attacking direction. Then, the semantics are reasonably utilized to produce the outputted video, where important match content, camera action as well as their consistency along the time axis are carefully considered to ensure the video quality. Experiments on school soccer videos show rationality of the proposed pipeline. Meanwhile, psDirector generates video with better watching experience than an existing commercial tool.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Bertini, M., Del Bimbo, A., Nunziati, W.: Soccer videos highlight prediction and annotation in real time. In: Roli, F., Vitulano, S. (eds.) ICIAP 2005. LNCS, vol. 3617, pp. 637–644. Springer, Heidelberg (2005). https://doi.org/10.1007/11553595_78
Ekin, A., Tekalp, A.M., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. Image Process. 12(7), 796–807 (2003). A Publication of the IEEE Signal Processing Society
Gong, Y., Sin, L.T., Chuan, C.H., Zhang, H., Sakauchi, M.: Automatic parsing of TV soccer programs. In: International Conference on Multimedia Computing and Systems, p. 167 (2002)
Intille, S.S., Aaron, A., Bobick, F.: Tracking using a local closed-world assumption: tracking in the football domain. In: Proceedings of the SPIE Storage and Retrieval for Image and Video Databases (1994)
Khatoonabadi, S.H., Rahmati, M.: Automatic soccer players tracking in goal scenes by camera motion elimination. Image Vis. Comput. 27(4), 469–479 (2009)
Redmon, J., Farhadi, A.: Yolov3: an incremental improvement (2018)
Seo, Y., Choi, S., Kim, H., Hong, K.-S.: Where are the ball and players? Soccer game analysis with color-based tracking and image mosaick. In: Del Bimbo, A. (ed.) ICIAP 1997. LNCS, vol. 1311, pp. 196–203. Springer, Heidelberg (1997). https://doi.org/10.1007/3-540-63508-4_123
Tong, X.F., Lu, H.Q., Liu, Q.S.: An effective and fast soccer ball detection and tracking method. In: International Conference on Pattern Recognition, vol. 4, pp. 795–798 (2004)
Wang, Z., Yu, J., He, Y.: Soccer video event annotation by synchronization of attack-defense clips and match reports with coarse-grained time information. IEEE Trans. Circuits Syst. Video Technol. 27(5), 1104–1117 (2017)
Wang, Z., Yu, J., He, Y., Guan, T.: Affection arousal based highlight extraction for soccer video. Multimed. Tools Appl. 73(1), 519–546 (2014)
Yao, A., Uebersax, D., Gall, J., Gool, L.V.: Tracking people in broadcast sports. In: DAGM Conference on Pattern Recognition, pp. 151–161 (2010)
Zawbaa, H.M., El-Bendary, N., Hassanien, A.E., Kim, T.: Machine learning-based soccer video summarization system. In: Kim, T., Adeli, H., Grosky, W.I., Pissinou, N., Shih, T.K., Rothwell, E.J., Kang, B.-H., Shin, S.-J. (eds.) MulGraB 2011. CCIS, vol. 263, pp. 19–28. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-27186-1_3
Zhao, Z., Jiang, S., Huang, Q., Ye, Q.: Highlight summarization in soccer video based on goalmouth detection. In: Asia (2006)
Zhao, Z., Jiang, S., Huang, Q., Zhu, G.: Highlight summarization in sports video based on replay detection. In: IEEE International Conference on Multimedia & Expo, pp. 1613–1616 (2006)
Acknowledgements
This research is supported by National Nature Science Foundation of China (Grant No. 61772526, 61876016).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Li, C., Jia, C., Chen, Z., Gu, X., Bao, H. (2019). psDirector: An Automatic Director for Watching View Generation from Panoramic Soccer Video. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, WH., Vrochidis, S. (eds) MultiMedia Modeling. MMM 2019. Lecture Notes in Computer Science(), vol 11296. Springer, Cham. https://doi.org/10.1007/978-3-030-05716-9_18
Download citation
DOI: https://doi.org/10.1007/978-3-030-05716-9_18
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-05715-2
Online ISBN: 978-3-030-05716-9
eBook Packages: Computer ScienceComputer Science (R0)