Vision-Based Registration for Augmented Reality with Integration of Arbitrary Multiple Planes

  • Yuko Uematsu
  • Hideo Saito
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3617)


We propose a novel vision-based registration approach for Augmented Reality with integration of arbitrary multiple planes. In our approach, we estimate the camera rotation and translation by an uncalibrated image sequence which includes arbitrary multiple planes. Since the geometrical relationship of those planes is unknown, for integration of them, we assign 3D coordinate system for each plane independently and construct projective 3D space defined by projective geometry of two reference images. By integration with the projective space, we can use arbitrary multiple planes, and achieve high-accurate registration for every position in the input images.


  1. 1.
    Azuma, R.T.: A survey of augmented reality. Presence, 355–385 (1997)Google Scholar
  2. 2.
    Azuma, R.T.: Recent advances in augmented reality. IEEE Computer Graphics and Applications 21, 34–47 (2001)CrossRefGoogle Scholar
  3. 3.
    Billinghurst, M., et al.: Magic book: Exploring transitions in collaborative ar interfaces. In: Proc. of SIGGRAPH 2000, vol. 87 (2000)Google Scholar
  4. 4.
    Satoh, K., et al.: Robust vision-based registration utilizing bird’s-eye with user’s view. In: Proc. of the ISMAR, pp. 46–55 (2003)Google Scholar
  5. 5.
    Drummond, T., Cipolla, R.: Real-time tracking of complex structures with on-line camera calibration. In: Proc. of the BMVC, pp. 574–583 (1999)Google Scholar
  6. 6.
    Comport, A.I., Marchand, E., Chaumette, F.: A real-time tracker for markerless augmented reality. In: Proc. of the ISMAR, pp. 36–45 (2003)Google Scholar
  7. 7.
    Klein, K., Drummond, T.: Sensor fusion and occlusion refinement for tablet-based ar. In: Proc. of the ISMAR, pp. 38–47 (2004)Google Scholar
  8. 8.
    Chia, K.W., Cheok, A., Prince, S.J.D.: Online 6 dof augmented reality registration from natural features. In: Proc. of the ISMAR, pp. 305–313 (2002)Google Scholar
  9. 9.
    Simon, G., Fitzgibbon, A., Zisserman, A.: Markerless tracking using planar structures in the scene. In: Proc. of the ISAR, pp. 120–128 (2000)Google Scholar
  10. 10.
    Simon, G., Berger, M.: Reconstructing while registering: a novel approach for markerless augmented reality. In: Proc. of the ISMAR, pp. 285–294 (2002)Google Scholar
  11. 11.
    Simon, G., Berger, M.O.: Real time registration known or recovered multi-planar structures: application to ar. In: Proc. of the BMVC, pp. 567–576 (2002)Google Scholar
  12. 12.
    Shi, J., Tomasi, C.: Good features to track. In: IEEE Conf. on CVPR, pp. 593–600 (1994)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Yuko Uematsu
    • 1
  • Hideo Saito
    • 1
  1. 1.Dept. of Information and Computer ScienceKeio UniversityYokohamaJapan

Personalised recommendations