Skip to main content
SpringerLink
Log in

SmartTennisTV: Automatic Indexing of Tennis Videos

  • Conference paper
  • First Online:
Computer Vision, Pattern Recognition, Image Processing, and Graphics (NCVPRIPG 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 841))

Abstract

In this paper, we demonstrate a score based indexing approach for tennis videos. Given a broadcast tennis video (btv), we index all the video segments with their scores to create a navigable and searchable match. Our approach temporally segments the rallies in the video and then recognizes the scores from each of the segments, before refining the scores using the knowledge of the tennis scoring system. We finally build an interface to effortlessly retrieve and view the relevant video segments by also automatically tagging the segmented rallies with human accessible tags such as ‘fault’ and ‘deuce’. The efficiency of our approach is demonstrated on btv’s from two major tennis tournaments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Huang, Y.P., Chiou, C.L., Sandnes, F.E.: An intelligent strategy for the automatic detection of highlights in tennis video recordings. Expert Syst. Appl. 36(6), 9907–9918 (2009)

    Article  Google Scholar 

  2. Ghanem, B., Kreidieh, M., Farra, M., Zhang, T.: Context-aware learning for automatic sports highlight recognition. In: 21st International Conference on Pattern Recognition (ICPR), pp. 1977–1980. IEEE (2012)

    Google Scholar 

  3. Hanjalic, A.: Generic approach to highlights extraction from a sport video. In: International Conference on Image Processing (ICIP), vol. 1, pp. I–1. IEEE (2003)

    Google Scholar 

  4. Mentzelopoulos, M., Psarrou, A., Angelopoulou, A., Garcıá-Rodrıáguez, J.: Active foreground region extraction and tracking for sports video annotation. Neural Process. Lett. 37(1), 33–46 (2013)

    Article  Google Scholar 

  5. Zhang, Y., Zhang, X., Xu, C., Lu, H.: Personalized retrieval of sports video. In: Proceedings of the International Workshop on Workshop on Multimedia Information Retrieval, pp. 313–322 (2007)

    Google Scholar 

  6. Kolekar, M.H., Sengupta, S.: Bayesian network-based customized highlight generation for broadcast soccer videos. IEEE Trans. Broadcast. 61(2), 195–209 (2015)

    Article  Google Scholar 

  7. Liu, C., Huang, Q., Jiang, S., Xing, L., Ye, Q., Gao, W.: A framework for flexible summarization of racquet sports video using multiple modalities. Comput. Vis. Image Underst. 113(3), 415–424 (2009)

    Article  Google Scholar 

  8. Connaghan, D., Kelly, P., O’Connor, N.E.: Game, shot and match: event-based indexing of tennis. In: 2011 9th International Workshop on Content-Based Multimedia Indexing (CBMI), pp. 97–102. IEEE (2011)

    Google Scholar 

  9. Miyamori, H., Iisaku, S.-I.: Video annotation for content based retrieval using human behavior analysis and domain knowledge. In: Fourth IEEE International Conference on Automatic Face and Gesture Recognition Proceedings, pp. 320–325. IEEE (2000)

    Google Scholar 

  10. Sukhwani, M., Jawahar, C.: TennisVid2Text: fine-grained descriptions for domain specific videos. In: Proceedings of the British Machine Vision Conference (BMVC), pp. 117.1-117.12. BMVA Press, September 2015

    Google Scholar 

  11. Sukhwani, M., Jawahar, C.: Frame level annotations for tennis videos. In: International Conference on Pattern Recognition (2016)

    Google Scholar 

  12. Xu, C., Wang, J., Lu, H., Zhang, Y.: A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans. Multimed. 10(3), 421–436 (2008)

    Article  Google Scholar 

  13. Yan, F., Christmas, W., Kittler, J.: All pairs shortest path formulation for multiple object tracking with application to tennis video analysis. In: British Machine Vision Conference (2007)

    Google Scholar 

  14. Yan, F., Kittler, J., Windridge, D., Christmas, W., Mikolajczyk, K., Cox, S., Huang, Q.: Automatic annotation of tennis games: an integration of audio, vision, and learning. Image Vis. Comput. 32(11), 896–903 (2014)

    Article  Google Scholar 

  15. Zhou, X., Xie, L., Huang, Q., Cox, S.J., Zhang, Y.: Tennis ball tracking using a two-layered data association approach. IEEE Trans. Multimed. 17(2), 145–156 (2015)

    Article  Google Scholar 

  16. Liao, S., Wang, Y., Xin, Y.: Research on scoreboard detection and localization in basketball video. Int. J. Multimed. Ubiquit. Eng. 10(11), 57–68 (2015)

    Article  Google Scholar 

  17. Miao, G., Zhu, G., Jiang, S., Huang, Q., Xu, C., Gao, W.: A real-time score detection and recognition approach for broadcast basketball video. In: IEEE International Conference on Multimedia and Expo, pp. 1691–1694 (2007)

    Google Scholar 

  18. Smith, R.: An overview of the Tesseract OCR engine. In: Ninth International Conference on Document Analysis and Recognition, vol. 2, pp. 629–633 (2007)

    Google Scholar 

  19. Gupta, A., Vedaldi, A., Zisserman, A.: Synthetic data for text localisation in natural images. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2315–2324 (2016)

    Google Scholar 

  20. Shi, B., Bai, X., Yao, C.: An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2298–2304 (2016)

    Article  Google Scholar 

  21. Jaderberg, M., Simonyan, K., Vedaldi, A., Zisserman, A.: Synthetic data and artificial neural networks for natural scene text recognition. arXiv preprint arXiv:1406.2227 (2014)

Download references

Author information

Authors and Affiliations

  1. CVIT, KCIS, IIIT, Hyderabad, India

    Anurag Ghosh & C. V. Jawahar

Authors
  1. Anurag Ghosh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. C. V. Jawahar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Anurag Ghosh .

Editor information

Editors and Affiliations

  1. Indian Institute of Technology Mandi, Mandi, Himachal Pradesh, India

    Renu Rameshan

  2. Indraprastha Institute of Information Technology, New Delhi, India

    Chetan Arora

  3. Indian Institute of Technology, New Delhi, India

    Sumantra Dutta Roy

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ghosh, A., Jawahar, C.V. (2018). SmartTennisTV: Automatic Indexing of Tennis Videos. In: Rameshan, R., Arora, C., Dutta Roy, S. (eds) Computer Vision, Pattern Recognition, Image Processing, and Graphics. NCVPRIPG 2017. Communications in Computer and Information Science, vol 841. Springer, Singapore. https://doi.org/10.1007/978-981-13-0020-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-0020-2_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-0019-6

  • Online ISBN: 978-981-13-0020-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation