A Vision-Based Mobile Augmented Reality System for Baseball Games

  • Seong-Oh Lee
  • Sang Chul Ahn
  • Jae-In Hwang
  • Hyoung-Gon Kim
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6773)


In this paper we propose a new mobile augmented-reality system that will address the need of users in viewing baseball games with enhanced contents. The overall goal of the system is to augment meaningful information on each player position on a mobile device display. To this end, the system takes two main steps which are homography estimation and automatic player detection. This system is based on still images taken by mobile phone. The system can handle various images that are taken from different angles with a large variation in size and pose of players and the playground, and different lighting conditions. We have implemented the system on a mobile platform. The whole steps are processed within two seconds.


Mobile augmented-reality baseball game still image homography human detection computer vision 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hurwitz, A., Jeffs, A.: EYEPLY: Baseball proof of concept - Mobile augmentation for entertainment and shopping venues. In: IEEE International Symposium on ISMAR-AMH 2009, pp. 55–56 (2009)Google Scholar
  2. 2.
    Demiris, A.M., Garcia, C., Malerczyk, C., Klein, K., Walczak, K., Kerbiriou, P., Bouville, C., Traka, M., Reusens, E., Boyle, E., Wingbermuhle, J., Ioannidis, N.: Sprinting Along with the Olympic Champions: Personalized, Interactive Broadcasting using Mixed Reality Techniques and MPEG-4. In: Proc. of BIS 2002, Business Information Systems (2002)Google Scholar
  3. 3.
    Inamoto, N., Saito, H.: Free viewpoint video synthesis and presentation of sporting events for mixed reality entertainment. In: Proc. of ACM ACE, vol. 74, pp. 42–50 (2004)Google Scholar
  4. 4.
    Matsui, K., Iwase, M., Agata, M., Tanaka, T., Ohnishi, N.: Soccer image sequence computed by a virtual camera. In: Proc. of CVPR, pp. 860–865 (1998)Google Scholar
  5. 5.
    Kammann, T.D.: Interactive Augmented Reality in Digital Broadcasting Environments. Diploma Thesis, University of Koblenz-Landau (2005)Google Scholar
  6. 6.
    Han, J., Farin, D., de With, P.H.N.: A Real-Time Augmented-Reality System for Sports Broadcast Video Enhancement. In: Proc. of ACM Multimedia, pp. 337–340 (2007)Google Scholar
  7. 7.
    Farin, D., Han, J., de With, P.: Fast Camera Calibration for the Analysis of Sport Sequences. In: IEEE Int. Conf. Multimedia Expo (ICME 2005), pp. 482–485 (2005)Google Scholar
  8. 8.
    Kuo, C.-M., Hung, M.-H., Hsieh, C.-H.: Baseball Playfield Segmentation Using Adaptive Gaussian Mixture Models. In: International Conference on Innovative Computing, Information and Control, pp. 360–363 (2008)Google Scholar
  9. 9.
    Nguyen, T.M., Ahuja, S., Wu, Q.M.: A real-time ellipse detection based on edge grouping. In: Proc. of the IEEE International Conference on Systems, Man and Cybernetics, pp. 3280–3286 (2009)Google Scholar
  10. 10.
    Halir, R., Flusser, J.: Numerically stable direct least squares fitting of ellipses. In: 6th International Conference on Computer Graphics and Visualization (1998)Google Scholar
  11. 11.
    Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)CrossRefzbMATHGoogle Scholar
  12. 12.
    Korea Baseball Organization: Guide Book (2010),
  13. 13.
    Zhu, Q., Avidan, S., Yeh, M.C., Cheng, K.T.: Fast Human Detection Using a Cascade of Histograms of Oriented Gradients. In: IEEE Conf. on CVPR, pp. 1491–1498. IEEE Computer Society Press, Los Alamitos (2006)Google Scholar
  14. 14.
    Dalal, N., Triggs, B.: Histogram of Oriented Gradients for Human Detection. In: IEEE Conf. on Computer Vision and Pattern Recognition, CVPR, vol. 2, pp. 886–893 (2005)Google Scholar
  15. 15.
    Schweighofer, G., Pinz, A.: Robust Pose Estimation from a Planar Target. IEEE Trans. on Pattern Analysis and Machine Intelligence 28, 2024–2030 (2005)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Seong-Oh Lee
    • 1
  • Sang Chul Ahn
    • 1
  • Jae-In Hwang
    • 1
  • Hyoung-Gon Kim
    • 1
  1. 1.Imaging Media Research CenterKorea Institute of Science and TechnologySeoulKorea

Personalised recommendations