Skip to main content

Action Recognition in Handball Scenes

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 283)

Abstract

Action recognition in sports, especially in handball, is a challenging task due to a lot of players being on the sports field performing different actions simultaneously. Training or match recordings and analysis can help an athlete, or his coach gain a better overview of statistics related to player activity, but more importantly, action recognition and analysis of action performance can indicate key elements of technique that need to be improved. In this paper the focus is on recognition of 11 actions that might occur during a handball match or practice. We compare the performance of a baseline CNN-model that classifies each frame into an action class with LSTM and MLP based models built on top of the baseline model, that additionally use the temporal information in the input video. The models were trained and tested with different lengths of input sequences ranging from 20 to 80, since the action duration varies roughly in the same range. Also, different strategies for reduction of the number of frames were tested. We found that increasing the number of frames in the input sequence improved the results for the MLP based model, while it didn't affect the performance of the LSTM model in the same way.

Keywords

  • Human action recognition
  • Action recognition in sport
  • Handball
  • Inception v3
  • CNN
  • MLP
  • LSTM

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-80119-9_41
  • Chapter length: 12 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   219.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-80119-9
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   279.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.

References

  1. Ji, R.: Research on basketball shooting action based on image feature extraction and machine learning. IEEE Access 8, 138743–138751 (2020)

    CrossRef  Google Scholar 

  2. Ramanathan, V., Huang, J., Abu-El-Haija, S., Gorban, A., Murphy, K., Fei-Fei, L.: Detecting events and key actors in multi-person videos. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas (2016)

    Google Scholar 

  3. Sanford, R., Gorji, S., Hafemann, L.G., Pourbabaee, B., Javan, M.: Group activity detection from trajectory and video data in soccer. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Seattle (2020)

    Google Scholar 

  4. Gerats, B.: Individual action and group activity recognition in soccer videos. Faculty of EEMCS, University of Twente, Twente (2020)

    Google Scholar 

  5. Bonenkamp, K.: Action recognition in soccer videos. Informatics Institute, Faculty of Science, University of Amsterdam, Amsterdam (2014)

    Google Scholar 

  6. Piergiovanni, A., Ryoo, M.S.: Fine-grained activity recognition in baseball videos. In: 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City (2018)

    Google Scholar 

  7. Rangasamy, K., As’ari, M., Rahmad, N., Ghazali, N.F.: Hockey activity recognition using pre-trained deep learning model. ICT Express 6(3), 170–174 (2020)

    CrossRef  Google Scholar 

  8. Sozykin, K., Protasov, S., Khan, A., Hussain, R., Lee, J.: Multi-label class-imbalanced action recognition in hockey videos via 3D convolutional neural networks. In: 2018 19th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), Busan (2018)

    Google Scholar 

  9. Haider, F., et al.: A super-bagging method for volleyball action recognition using wearable sensors. Multimodal Technol. Interact. 4(2), 33 (2020)

    CrossRef  Google Scholar 

  10. Ibrahim, M.S., Muralidharan, S., Deng, Z., Vahdat, A., Mori, G.: A hierarchical deep temporal model for group activity recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas (2016)

    Google Scholar 

  11. Bagautdinov, T., Alahi, A., Fleuret, F., Fua, P., Savarese, S.: Social scene understanding: end-to-end multi-person action localization and collective activity recognition. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, (2017)

    Google Scholar 

  12. Zhu, G., Xu, C., Huang, Q., Gao, W., Xing, L.: Player action recognition in broadcast tennis video with applications to semantic analysis of sports game. Association for Computing Machinery, New York (2006)

    Google Scholar 

  13. Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. arXiv:1502.03167 [cs] (2015)

  14. Rahmad, N.A., As’ari, M.A.: The new Convolutional Neural Network (CNN) local feature extractor for automated badminton action recognition on vision based data. J. Phys. Conf. Ser. 1529(2), 022021 (2020)

    CrossRef  Google Scholar 

  15. Martin, P., Benois-Pineau, J., Péteri, R.: Fine-grained action detection and classification in table tennis with siamese spatio-temporal convolutional neural network. In: 2019 IEEE International Conference on Image Processing (ICIP), Taipei (2019)

    Google Scholar 

  16. Pareek, P., Thakkar, A.: A survey on video-based Human Action Recognition: recent updates, datasets, challenges, and applications. Artif. Intell. Rev. 54(3), 2259–2322 (2020). https://doi.org/10.1007/s10462-020-09904-8

    CrossRef  Google Scholar 

  17. Burić, M., Pobar, M., Ivašić-Kos, M.: Adapting YOLO network for ball and player detection. In: 8th International Conference on Pattern Recognition Applications and Methods (ICPRAM 2019), pp. 845–851 (2019)

    Google Scholar 

  18. Host, K., Ivasic-Kos, M., Pobar, M.: Tracking handball players with the DeepSORT algorithm, In: ICPRAM, pp. 593–599 (2020)

    Google Scholar 

  19. Buric, M., Ivasic-Kos, M., Pobar, M.: Player tracking in sports videos. In: 2019 IEEE International Conference on Cloud Computing Technology and Science (CloudCom), pp. 334–340 (2019)

    Google Scholar 

  20. Pobar, M., Ivasic-Kos, M.: Active player detection in handball scenes based on activity measures. Sensors 20(5), 1475 (2020)

    CrossRef  Google Scholar 

  21. Ivasic-Kos, M., Pobar, M., Gonzàlez, J.: Active player detection in handball videos using optical flow and STIPs based measures. In: 2019 13th International Conference on Signal Processing and Communication Systems (ICSPCS), pp. 1–8 (2019)

    Google Scholar 

  22. Ivasic-Kos, M., Pobar, M.: Building a labeled dataset for recognition of handball actions using mask R-CNN and STIPS. In: 7th IEEE European Workshop on Visual Information Processing (EUVIP), Tampere (2018)

    Google Scholar 

  23. Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J., Wojna, Z.: Rethinking the inception architecture for computer vision. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, pp. 2818–2826. IEEE (2016)

    Google Scholar 

  24. Deng, J., Dong, W., Socher, R., Li, K.L.L., Fei-Fei, L.: ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami (2009)

    Google Scholar 

Download references

Acknowledgment

This research was fully supported by the Croatian Science Foundation under the project IP-2016-06-8345 “Automatic recognition of actions and activities in multimedia content from the sports domain” (RAASS) and by the University of Rijeka under the project number uniri-drustv-18-222.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marina Ivasic-Kos .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Host, K., Ivasic-Kos, M., Pobar, M. (2022). Action Recognition in Handball Scenes. In: Arai, K. (eds) Intelligent Computing. Lecture Notes in Networks and Systems, vol 283. Springer, Cham. https://doi.org/10.1007/978-3-030-80119-9_41

Download citation