Abstract
In this work, we have classified the frames of a broadcast soccer video into four classes, namely long shot, medium shot, close shot and logo frame. A two-stream deep neural network (DNN) model is proposed for the shot classification. Along with static image features, player attributes like count of the players in a frame, area, width and height of the players are used as features for the classification. The heterogeneous features are fed into the DNN model through a late fusion strategy. In addition to shot classification, we propose a model to detect replay within a soccer video. The logo frames are used to decide the temporal boundary of a replay segment. A majority class assignment strategy is employed to improve the accuracy of replay detection. The experimental results show that our method is at least 12% better than that of similar approaches.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chollet, F., et al.: Keras. https://keras.io (2015)
Chollet, F.: Xception: Deep learning with depthwise separable convolutions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1251–1258 (2017)
Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE, New York (2009)
Ekin, A., Tekalp, A.M.: Shot type classification by dominant color for sports video segmentation and summarization. In: 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings (ICASSP’03), vol. 3, pp. III–173. IEEE, New York (2003)
Giancola, S., Amine, M., Dghaily, T., Ghanem, B.: Soccernet: A scalable dataset for action spotting in soccer videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1711–1721 (2018)
Nguyen, N., Yoshitaka, A.: Shot type and replay detection for soccer video parsing. In: 2012 IEEE International Symposium on Multimedia, pp. 344–347. IEEE, New York (2012)
Pan, H., Li, B., Sezan, M.I.: Automatic detection of replay segments in broadcast sports programs by detection of logos in scene transitions. In: 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 4, pp. IV–3385. IEEE, New York (2002)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Sarkar, S., Chakrabarti, A., Mukherjee, P.D.: Generation of ball possession statistics in soccer using minimum-cost flow network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (2019)
Tabii, Y., Djibril, M.O., Hadi, Y., Thami, R.O.H.: A new method for video soccer shot classification. In: VISAPP, vol. 1, pp. 221–224 (2007)
Thomas, G., Gade, R., Moeslund, T.B., Carr, P., Hilton, A.: Computer vision for sports: current applications and research topics. Comput. Vis. Image Understanding 159, 3–18 (2017)
Wang, L., Zeng, B., Lin, S., Xu, G., Shum, H.Y.: Automatic extraction of semantic colors in sports video. In: 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, vol. 3, pp. iii–617. IEEE, New York (2004)
Xu, P., Xie, L., Chang, S.F., Divakaran, A., Vetro, A., Sun, H., et al.: Algorithms and system for segmentation and structure analysis in soccer video. In: ICME, vol. 1, pp. 928–931. Citeseer (2001)
Zhou, Y.H., Cao, Y.D., Zhang, L.F., Zhang, H.X.: An svm-based soccer video shot classification. In: 2005 International Conference on Machine Learning and Cybernetics, vol. 9, pp. 5398–5403. IEEE, New York (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Sarkar, S., Ali, S., Chakrabarti, A. (2020). Shot Classification and Replay Detection in Broadcast Soccer Video. In: Chaki, R., Cortesi, A., Saeed, K., Chaki, N. (eds) Advanced Computing and Systems for Security. Advances in Intelligent Systems and Computing, vol 1136. Springer, Singapore. https://doi.org/10.1007/978-981-15-2930-6_5
Download citation
DOI: https://doi.org/10.1007/978-981-15-2930-6_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-2929-0
Online ISBN: 978-981-15-2930-6
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)