An Optical Tracking System for VR/AR-Applications

  • Klaus Dorfmüller
Part of the Eurographics book series (EUROGRAPH)


In this paper, an optical tracking system is introduced for the use within Virtual and Augmented Reality applications. The system uses retroreflective markers which are attached to a special designed interaction device. The construction of the device allows us to gather six degrees of freedom. In order to achieve high tracking precision we introduce a calibration algorithm which results in sub-pixel accuracy and is therefore well applicable within Augmented Reality scenarios. Further the algorithm for calculating the pose of a rigid body is described. Finally, the optical tracking system is evaluated in regard to its accuracy.


Virtual Reality Augmented Reality Interaction Device Augmented Reality Application Optical Tracking System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. [1]
    A. Azarbayejani and A. P. Pentland Recursive Estimation of Motion, Structure, and Focal Length, IEEE PAMI 17 (6), June 1995Google Scholar
  2. [2]
    A. Azarbayejani and A. P. Pentland Camera Self-Calibration from One Point Correspondence, Media Lab Technical Report 341, 1995Google Scholar
  3. [3]
    S. Birchfield Elliptical Head Tracking Using Intensity Gradients and Color Histograms, IEEE Conference on Computer Vision and Pattern Recognition, Santa Barbara, California, June 1998Google Scholar
  4. [4]
    D.F. DeMenthon and L.S. Davis Model-Based Object Pose in 25 Lines of Code, International Journal of Coputer Vision (IJVC), Vol. 15, No. 1–2, June 1995, pp. 123–141CrossRefGoogle Scholar
  5. [5]
    K. Dorfmüller and H. Wirth Real-Time Hand and Head Tracking for Virtual Environments Using Infrared Beacons In: N. Magnenat-Thalmann, D. Thalmann (Eds.) “Modelling and Motion Capture Techniques for Virtual Environments”, International Workshop, CAPTECH’98, Geneva, Switzerland, November 1998, Proceedings LNAI 1537, Heidelberg: Springer Verl., 1998Google Scholar
  6. [6]
    T. Heap and D. Hogg Towards 3-D Hand Tracking using a Deformable Model, 2nd International Face and Gesture Recognition Conference, 1996Google Scholar
  7. [7]
    D. Koller, G. Klinker, E. Rose, D. Breen, R. Whitaker and M.Tuceryan Real-time Vision-Based Camera Tracking for Augmented Reality Applications, In Proc. of the ACM Symposium on Virtual Reality Software and Technology (VRST-97), Lausanne, Switzerland, September 15–17, 1997, pp. 87–94CrossRefGoogle Scholar
  8. [8]
    K.J. Kutulakos and J. Vallino Affine Object Representations for Calibration-Free Augmented Reality, IEEE Virtual Reality Ann. Int’1 Symposium (VRAIS’96), 1996, pp. 25–36CrossRefGoogle Scholar
  9. [9]
    F.Madritsch and M. Gervautz. CCD-Camera Based Optical Beacon Tracking for Virtual and Augmented Reality, Eurographics 15 (3), 1996Google Scholar
  10. [10]
    J. Rehg and T. Kanade Digiteyes: Vision-based Human Hand Tracking, Technical Report CMU-CS-TR-93–220, Carnegie Mellon University, 1993Google Scholar
  11. [11]
    J. Rehg and T. Kanade Visual Tracking of Self-occluding Articulated Objects, Technical Report CMU-CS-94–224, Carnegie Mellon University, 1994Google Scholar
  12. [12]
    F. Seibert and M. Wolf Tracking Faces for Virtual Holography, Proc. 3D Image Analysis and Synthesis’97, 1997Google Scholar
  13. [13]
    F. Seibert Stereo based Augmented Reality in Medicine, The Third Korea-Germany Joint Workshop on Advanced Medical Image Processing, Seoul, Korea, August 13–16, 1998Google Scholar
  14. [14]
    A. State, G. Hirota, D.T. Chen, W.F. Garrett and M.A. Livingston Superior Augmented Reality Registration by Integrating Landmark Tracking and Magnetic Tracking, SIGGRAPH’96 ( New Orleans, LA ), August 1996, pp. 429–438Google Scholar
  15. [15]
    R. T. Tsai An Efficient and Accurate Camera Calibration Technique for 3-D Machine Vision, Proccedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1986Google Scholar
  16. [16]
    J. Weng, T.S. Huang and Ahuja 3D Motion Estimation, Understanding, and Prediction from Noisy Image Sequences, IEEE Transactions on Pattern Recognition and Machine Intelligence, Vol. PAMI-9, No. 3, May, 1987Google Scholar
  17. [17]
    C. Wren, A. Azarbayejani, T. Darrell and A. Pentland. Pfinder: Real-time Tracking of the Human Body, Integration Issues in Large Commercial Media Delivery Systems. A. G. Tescher and V. M. Bove, 1996Google Scholar
  18. [18]
    Z. Zhang and O. Faugeras 3-D Dynamic Scene Analysis, Springer Series in Information Sciences, Springer-Verlag, Berlin 1992Google Scholar

Copyright information

© Springer-Verlag/Wien 1999

Authors and Affiliations

  • Klaus Dorfmüller
    • 1
  1. 1.Visual Computing DepartmentZGDV Computer Graphics CenterDarmstadtGermany

Personalised recommendations