Interaction Between Real and Virtual Humans: Playing Checkers

  • Rémy Torre
  • Pascal Fua
  • Selim Balcisoy
  • Michal Ponder
  • Daniel Thalmann
Part of the Eurographics book series (EUROGRAPH)


For some years, we have been able to integrate virtual humans into virtual environments. As the demand for Augmented Reality systems grows, so will the need for these synthetic humans to coexist and interact with humans who live in the real world. In this paper, we use the example of a checkers game between a real and a virtual human to demonstrate the integration of techniques required to achieve a realistic-looking interaction in real-time. We do not use cumbersome devices such as a magnetic motion capture system. Instead, we rely on purely image-based techniques to address the registration issue, when the camera or the objects move, and to drive the virtual human’s behavior.


Virtual Environment Augmented Reality Camera Parameter Tracking Process Virtual Human 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    R.T. Azuma. A Survey of Augmented Reality. Presence, Teleoperators and Virtual Environments, 6 (4): 355–385, August 1997.Google Scholar
  2. 2.
    S. Balcisoy and D.Thalmann. Interaction between Real and Virtual Humans in Augmented Reality. In Computer Animation, pages 31–38, 1997.Google Scholar
  3. 3.
    R. Boulic, T. Capin, Z. Huang, L. Moccozet, T. Molet, P. Kalra, B. Lintermann, N. Magnenat-Thalmann, I. Pandzic, K. Saar, A. Schmitt, J. Shen, and D. Thalmann. Environment for Interactive Animation of Multiple Deformable Human Characters. In Eurographics, pages 337–348, Maastricht, Netherlands, August 1995.Google Scholar
  4. 4.
    T. Capin, I. Pandzic, N. Magnenat-Thalmann, and D.Thalmann. Avatars in Networked Virtual Environments. John Wiley and Sons, 1999.Google Scholar
  5. 5.
    L. Emering, R. Boulic, and D. Thalmann. Interacting with Virtual Humans through Body Actions. IEEE Computer Graphics and Applications, 18: 8–11, 1998.CrossRefGoogle Scholar
  6. 6.
    P. Fua. RADIUS: Image Understanding for Intelligence Imagery, chapter Model-Based Optimization: An Approach to Fast, Accurate, and Consistent Site Modeling from Imagery. Morgan Kaufmann, 1997. O. Firschein and T.M. Strat, Eds. Available as Tech Note 570, Artificial Intelligence Center, SRI International.Google Scholar
  7. 7.
    G. Klinker, K. Ahlers, D. Breen, P.-Y. Chevalier, C. Crampton, D. Greer, D. Koller, A. Kramer, E. Rose, M. Tuceryan, and R. Whitaker. Confluence of Computer Vision and Interactive Graphics for Augmented Reality. Presence: Teleoperations and Virtual Environments, 6 (4): 433–451, 1997.Google Scholar
  8. 8.
    D. Koller, G. Klinker, E. Rose, D.E. Breen, R.T. Whitaker, and M. Tuceryan. Real-time Vision-Based Camera Tracking for Augmented Reality Applications. In ACM Symposium on Virtual Reality Software and Technology, pages 87–94, Lausanne, Switzerland, September 1997.CrossRefGoogle Scholar
  9. 9.
    N. Magnenat-Thalmann and D. Thalmann. Animating Virtual Actors in Real Environments. ACM Multimedia Journal, 1998.Google Scholar
  10. 10.
    E. Marchand, P. Bouthemy, F. Chaumette, and V. Moreau. Robust real-time Visual Tracking Using a 2D–3D Model-Based Approach. In International Conference on Computer Vision, pages 262–268, Corfu, Greece, September 1999.CrossRefGoogle Scholar
  11. 11.
    B. Murtagh and M.A. Saunders. Minos 5.4 User’s Guide. Technical Report SOL 83–20R, Department of Operations Research, Stanford University, 1983.Google Scholar
  12. 12.
    Z. Szalavari, E. Eckstein, and M. Gervautz. Collaborative Gaming in Augmented Reality. In ACM Symposium on Virtual Reality Software and Technology, pages 195–204, Taipei, Taiwan, November 1998.Google Scholar
  13. 13.
    J.P. Tarel and J.M. Vezien. Camcal Manual: A Complete Software Solution for Camera Calibration. Technical Report 0196, INRIA, September 1996.Google Scholar
  14. 14.
    G. Sannier S. Balcisoy N. Magnenat-Thalmann D. Thalmann. VHD: A System for Directing Real-Time Virtual Actors. In The Visual Computer. Springer, 1999.Google Scholar
  15. 15.
    G. Wolberg. Digital Image Warping. Computer Society Press, 1990.Google Scholar

Copyright information

© Springer-Verlag/Wien 2000

Authors and Affiliations

  • Rémy Torre
    • 1
  • Pascal Fua
    • 1
  • Selim Balcisoy
    • 1
  • Michal Ponder
    • 1
  • Daniel Thalmann
    • 1
  1. 1.Swiss Federal Institute of TechnologyComputer Graphics Lab (LIG)Switzerland

Personalised recommendations