Abstract
The automatic detection of events in sport videos has important applications for data analytics, as well as for broadcasting and media companies. This paper presents a comprehensive approach for detecting a wide range of complex events in soccer videos starting from positional data. The event detector is designed as a two-tier system that detects atomic and complex events. Atomic events are detected based on temporal and logical combinations of the detected objects, their relative distances, as well as spatio-temporal features such as velocity and acceleration. Complex events are defined as temporal and logical combinations of atomic and complex events, and are expressed by means of a declarative Interval Temporal Logic (ITL). The effectiveness of the proposed approach is demonstrated over 16 different events, including complex situations such as tackles and filtering passes. By formalizing events based on a principled ITL, it is possible to easily perform reasoning tasks, such as understanding which passes or crosses result in a goal being scored. To counterbalance the lack of suitable, annotated public datasets, we built on an open source soccer simulation engine to release the synthetic SoccER (Soccer Event Recognition) dataset, which includes complete positional data and annotations for more than 1.6 million atomic events and 9,000 complex events. The dataset and code are available at https://gitlab.com/grains2/slicing-and-dicing-soccer.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alcalá, R., Gacto, M.J., Herrera, F., Alcalá-Fdez, J.: A multi-objective genetic algorithm for tuning and rule selection to obtain accurate and compact linguistic fuzzy rule-based systems. Int. J. Uncertain. Fuzziness Knowl.-Based Syst. 15(05), 539–557 (2007)
Anicic, D., Fodor, P., Stuhmer, R., Stojanovic, N.: Event-driven approach for logic-based complex event processing. In: 2009 International Conference on Computational Science and Engineering, vol. 1, pp. 56–63. IEEE (2009)
Cannavó, A., Calandra, D., Basilicó, G., Lamberti, F.: Automatic recognition of sport events from spatio-temporal data: an application for virtual reality-based training in basketball. In: 14th International Conference on Computer Graphics Theory and Applications, GRAPP 2019, pp. 310–316. SCITEPRESS (2019)
D. Anicic, P. Fodor, R.S.: Etalis Home. http://code.google.com/p/etalis
Gaidon, A., Harchaoui, Z., Schmid, C.: Actom sequence models for efficient action detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3201–3208. IEEE (2011)
Giancola, S., Amine, M., Dghaily, T., Ghanem, B.: SoccerNet: a scalable dataset for action spotting in soccer videos. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 1711–1721 (2018)
Khan, A., Lazzerini, B., Calabrese, G., Serafini, L.: Soccer event detection. In: 4th International Conference on Image Processing and Pattern Recognition, IPPR 2018, pp. 119–129. AIRCC Publishing Corporation (2018)
Konur, S.: Real-time and probabilistic temporal logics: an overview. Computing Research Repository - CoRR, May 2010
Kurach, K., et al.: Google research football: a novel reinforcement learning environment. CoRR (2019)
Lee, J., Nam, D., Moon, S., Lee, J., Yoo, W.: Soccer event recognition technique based on pattern matching. In: 2017 Federated Conference on Computer Science and Information Systems (FedCSIS), pp. 643–646, September 2017
Morra, L., Coccia, N., Cerquitelli, T.: Optimization of computer aided detection systems: an evolutionary approach. Expert Syst. Appl. 100, 145–156 (2018)
Pettersen, S.A., et al.: Soccer video and player position dataset. In: Proceedings of the 5th ACM Multimedia Systems Conference, MMSys 2014, pp. 18–23. Association for Computing Machinery, New York (2014)
Rematas, K., Kemelmacher-Shlizerman, I., Curless, B., Seitz, S.: Soccer on your tabletop. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4738–4747 (2018)
Richly, K., Bothe, M., Rohloff, T., Schwarz, C.: Recognizing compound events in spatio-temporal football data. In: International Conference on Internet of Things and Big Data, vol. 2, pp. 27–35. SCITEPRESS (2016)
Richly, K., Moritz, F., Schwarz, C.: Utilizing artificial neural networks to detect compound events in spatio-temporal soccer data, August 2017
Schuiling, B.K.: Gameplay Football. https://github.com/BazkieBumpercar/GameplayFootball
Shih, H.C.: A survey of content-aware video analysis for sports. IEEE Trans. Circuits Syst. Video Technol. 28(5), 1212–1231 (2017)
Tovinkere, V., Qian, R.J.: Detecting semantic events in soccer games: towards a complete solution. In: IEEE International Conference on Multimedia and Expo, ICME 2001, pp. 833–836, August 2001
Zitzler, E., Laumanns, M., Thiele, L.: SPEA2: improving the strength Pareto evolutionary algorithm for multiobjective optimization. In: Proceedings of the EUROGEN 2001 Conference, Athens, Greece (2001)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Morra, L., Manigrasso, F., Canto, G., Gianfrate, C., Guarino, E., Lamberti, F. (2020). Slicing and Dicing Soccer: Automatic Detection of Complex Events from Spatio-Temporal Data. In: Campilho, A., Karray, F., Wang, Z. (eds) Image Analysis and Recognition. ICIAR 2020. Lecture Notes in Computer Science(), vol 12131. Springer, Cham. https://doi.org/10.1007/978-3-030-50347-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-030-50347-5_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-50346-8
Online ISBN: 978-3-030-50347-5
eBook Packages: Computer ScienceComputer Science (R0)