KinectBalls: An Interactive Tool for Ball Throwing Games

  • Jonathan Schoreels
  • Romuald Deshayes
  • Tom Mens
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 124)


We present a tool that was developed in the context of the first author’s masters project. The tool implements an interactive computer game combining the real and the virtual world in a seamless way. The player interacts with the game by throwing balls towards a wall on which a virtual 3D scene is projected. Using the Kinect 3D sensor, we compute and predict the trajectory, speed and position of the ball. Upon impact with the screen, a virtual ball continues its trajectory in the virtual scene, and interacts with the objects around it using a physical and a graphical 3D engine Bullet, and Ogre3D. The prototype game has been successfully tested on a large number of people of varying ages.


Kinect HCI virtual reality object tracking 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bailly, G., Walter, R., Müller, J., Ning, T., Lecolinet, E.: Comparing free hand menu techniques for distant displays using linear, marking and finger-count menus. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011, Part II. LNCS, vol. 6947, pp. 248–262. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  2. 2.
    Boulos, M.K.N., Blanchard, B., Walker, J.M.C., Tripathy, R.G.-O.A.: Web GIS in practice X: A Microsoft Kinect natural user interface for Google Earth navigation. Int’l J. Health Geographics 10, 14 (2011)CrossRefGoogle Scholar
  3. 3.
    Dalpé, S., Monat-rodier, J., Riendeau, G., Voutsinas, P.: Poly-pétanque. In: Int’l Meeting on Virtual Reality and Converging Technologies, LAVAL VIRTUAL (2013),
  4. 4.
    Deshayes, R.: Reconstruction algorithmique d’objets 3D. Master’s thesis, Faculty of Sciences, University of Mons, Belgium (June 2011)Google Scholar
  5. 5.
    Deshayes, R., Jacquet, C., Hardebolle, C., Boulanger, F., Mens, T.: Heterogeneous modeling of gesture-based 3D applications. In: MoDELS Workshops (2012)Google Scholar
  6. 6.
    Drummond, T., Cipolla, R.: Real-time visual tracking of complex structures. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 932–946 (2002)CrossRefGoogle Scholar
  7. 7.
    Gong, Y., Sin, L.T., Chuan, C.H., Zhang, H., Sakauchi, M.: Automatic parsing of TV soccer programs. In: IEEE Int’l Conf. Multimedia Computing and Systems (ICMCS), pp. 167–174 (1995)Google Scholar
  8. 8.
    Harris, C.: Tracking with rigid objects. MIT Press (1992)Google Scholar
  9. 9.
    Hoff, W.A., Nguyen, K., Lyon, T.: Computer vision-based registration techniques for augmented reality. In: Intelligent Robots and Computer Vision XV, pp. 538–548 (1996)Google Scholar
  10. 10.
    Klein, G., Drummond, T.: Robust visual tracking for non-instrumented augmented reality. In: IEEE/ACM Int’l Symp. Mixed and Augmented Reality (ISMAR), pp. 113–122. IEEE Computer Society (2003)Google Scholar
  11. 11.
    Lepetit, V., Fua, P.: Monocular model-based 3D tracking of rigid objects: A survey. Foundations and Trends in Computer Graphics and Vision 1(1), 91 (2005)CrossRefGoogle Scholar
  12. 12.
    Pingali, G.S., Opalach, A., Jean, Y.: Ball tracking and virtual replays for innovative tennis broadcasts. In: Int’l Conf. Pattern Recognition, pp. 4152–4156 (2000)Google Scholar
  13. 13.
    Ren, Z., Meng, J., Yuan, J., Zhang, Z.: Robust hand gesture recognition with Kinect sensor. In: ACM Int’l Conf. Multimedia, pp. 759–760 (2011)Google Scholar
  14. 14.
    State, A., Hirota, G., Chen, D.T., Garrett, W.F., Livingston, M.A.: Superior augmented reality registration by integrating landmark tracking and magnetic tracking. In: SIGGRAPH, pp. 429–438 (1996)Google Scholar
  15. 15.
    Tong, X.-F., Lu, H.-Q., Liu, Q.-S.: An effective and fast soccer ball detection and tracking method. In: Int’l Conf. Pattern Recognition, pp. 795–798 (2004)Google Scholar

Copyright information

© ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering 2013

Authors and Affiliations

  • Jonathan Schoreels
    • 1
  • Romuald Deshayes
    • 1
  • Tom Mens
    • 1
  1. 1.Software Engineering Lab, NUMEDIART Research InsitituteUniversity of Mons – UMONSBelgium

Personalised recommendations