Skip to main content

An Improved Augmented Reality Registration Method Based on Visual SLAM

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 10345))

Abstract

Markerless Augmented Reality registration using standard Homography matrix is instable and has low registration accuracy. In this paper, we present a new method to improve the augmented reality registration method based on the Visual Simultaneous Localization and Mapping (VSLAM). We improved the method implemented in ORBSLAM in order to increase stability and accuracy of AR registration. VSLAM algorithm generate 3D scene maps in dynamic camera tracking process. Hence, for AR based on VSLAM utilizes the 3D map of the scene reconstruction to compute the location for virtual object augmentation. In this paper, a Maximum Consistency with Minimum Distance and Robust Z-score (MCMD_Z) algorithm is used to perform the planar detection of 3D maps, then the Singular Value Decomposition (SVD) and Lie group are used to calculate the rotation matrix that helps to solve the problem of virtual object orientation. Finally, the method integrates camera poses on the virtual object registration. We show experimental results to demonstrate the robustness and registration accuracy of the method for augmented reality applications.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graphics Appl. 21(6), 34–47 (2001)

    Article  Google Scholar 

  2. Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)

    Article  Google Scholar 

  3. Bailey, T., Durrant-Whyte, H.: Simultaneous localization and mapping (SLAM): part II. IEEE Robot. Autom. Mag. 13(3), 108–117 (2006)

    Article  Google Scholar 

  4. Bimber, O., Raskar, R.: Spatial Augmented Reality Merging Real and Virtual Worlds. A K Peters Ltd., Natick (2005)

    Book  Google Scholar 

  5. Davison, A.J., Mayol, W.W., Murray, D.W.: Real-time localization and mapping with wearable active vision. In: Proceedings of Second IEEE and ACM International Symposium Mixed and Augmented Reality, pp. 18–27, October 2003

    Google Scholar 

  6. Davison, A.J., Mayol, W.W., Murray, D.W.: Real-time workspace localisation and mapping for wearable robot. In: Proceedings of Second IEEE and ACM International Symposium Mixed and Augmented Reality, pp. 315–316, October 2003

    Google Scholar 

  7. Fiala, M.: Artag, a fiducial marker system using digital techniques. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 2, pp. 590–596, June 2005

    Google Scholar 

  8. Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge (2000)

    MATH  Google Scholar 

  9. Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 225–234, November 2007

    Google Scholar 

  10. Mur-Artal, R., Montiel, J.M.M., Tards, J.D.: Orb-SLAM: a versatile and accurate monocular SLAM system. IEEE Trans. Robot. 31(5), 1147–1163 (2015)

    Article  Google Scholar 

  11. Prince, S.J.D., Xu, K., Cheok, A.D.: Augmented reality camera tracking with homographies. IEEE Comput. Graphics Appl. 22(6), 39–45 (2002)

    Article  Google Scholar 

  12. Reitmayr, G., Eade, E., Drummond, T.W.: Semi-automatic annotations in unknown environments. In: Proceedings of the 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, pp. 67–70, November 2007

    Google Scholar 

  13. Rublee, E., Rabaud, V., Konolige, K., Bradski, G.: Orb: an efficient alternative to sift or surf. In: Proceedings of International Conference on Computer Vision, pp. 2564–2571, November 2011

    Google Scholar 

  14. Strasdat, H., Montiel, J., Davison, A.J.: Visual SLAM: why filter? Image Vis. Comput. 30(2), 65–77 (2012)

    Article  Google Scholar 

  15. Szalaviri, Z., Gervautz, M.: The personal interaction panel - a two-handed interface for augmented reality. Comput. Graph. Forum 16(3), C335–C346 (1997). http://onlinelibrary.wiley.com/doi/10.1111/1467-8659.00137/abstract

    Article  Google Scholar 

  16. Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment—a modern synthesis. In: Triggs, B., Zisserman, A., Szeliski, R. (eds.) IWVA 1999. LNCS, vol. 1883, pp. 298–372. Springer, Heidelberg (2000). doi:10.1007/3-540-44480-7_21

    Chapter  Google Scholar 

Download references

Acknowledgement

This work is supported by Shanxi Province Science and Technology Department: Projects (2016JZ026 2016KW-043) and (2016GY-047).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Wen Tang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Gao, Q.H., Wan, T.R., Tang, W., Chen, L., Zhang, K.B. (2017). An Improved Augmented Reality Registration Method Based on Visual SLAM. In: Tian, F., Gatzidis, C., El Rhalibi, A., Tang, W., Charles, F. (eds) E-Learning and Games. Edutainment 2017. Lecture Notes in Computer Science(), vol 10345. Springer, Cham. https://doi.org/10.1007/978-3-319-65849-0_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-65849-0_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-65848-3

  • Online ISBN: 978-3-319-65849-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics