Skip to main content

3D Planar RGB-D SLAM System

  • Conference paper
  • First Online:
Advanced Concepts for Intelligent Vision Systems (ACIVS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10016))

  • 2409 Accesses

Abstract

Applications such as Simultaneous Localization and Mapping (SLAM) can greatly benefit from RGB-D sensor data to produce 3D maps of the environment as well as sensor’s trajectory estimation. However, the resulting 3D points map can be cumbersome, and since indoor environments are mainly composed of planar surfaces, the idea is to use planes as building blocks for a SLAM process. This paper describes an RGB-D SLAM system benefiting from planes segmentation to generate lightweight 3D plane-based maps. Our goal is to produce reduced 3D maps composed solely of planes sections that can be used on platforms with limited memory and computation resources. We present the introduction of planar regions in a regular RGB-D SLAM system and evaluate the benefits regarding both resulting map and estimated camera trajectory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ababsa, F., Mallem, M.: Robust camera pose tracking for augmented reality using particle filtering framework. Mach. Vis. Appl. 22(1), 181–195 (2011)

    Article  Google Scholar 

  2. Ataer-Cansizoglu, E., Taguchi, Y., Ramalingam, S., Garaas, T.: Tracking an rgb-d camera using points and planes. In: 2013 IEEE International Conference on Computer Vision Workshops (ICCVW), pp. 51–58, December 2013

    Google Scholar 

  3. Elghor, H.E., Roussel, D., Ababsa, F., Bouyakhf, E.H.: Planes detection for robust localization and mapping in RGB-D SLAM systems. In: 2015 International Conference on 3D Vision, 3DV 2015, pp. 452–459, October 2015

    Google Scholar 

  4. Endres, F., Hess, J., Sturm, J., Cremers, D., Burgard, W.: 3D mapping with an RGB-D camera. IEEE Trans. Robot. 30(1), 177–187 (2014)

    Article  Google Scholar 

  5. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  6. Gao, X., Zhang, T.: Robust rgb-d simultaneous localization and mapping using planar point features. Robot. Auton. Syst. 72, 1–14 (2015)

    Article  Google Scholar 

  7. Grisetti, G., Kümmerle, R., Stachniss, C., Burgard, W.: A tutorial on graph-based SLAM. IEEE Intell. Transp. Syst. Mag. 2(4), 31–43 (2010)

    Article  Google Scholar 

  8. Henry, P., Krainin, M., Herbst, E., Ren, X., Fox, D.: RGB-D mapping: Using kinect-style depth cameras for dense 3D modeling of indoor environments. Int. J. Robot. Res. (IJRR) 31(5), 647–663 (2012)

    Article  Google Scholar 

  9. Hornung, A., Wurm, K.M., Bennewitz, M., Stachniss, C., Burgard, W.: Octomap: an efficient probabilistic 3d mapping framework based on octrees. Auton. Robots 34(3), 189–206 (2013)

    Article  Google Scholar 

  10. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., Fitzgibbon, A.: Kinectfusion: real-time 3d reconstruction and interaction using a moving depth camera. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, UIST 2011, pp. 559–568. ACM, New York, October 2011

    Google Scholar 

  11. Kaess, M.: Simultaneous localization and mapping with infinite planes. In: 2015 IEEE International Conference on Robotics and Automation (ICRA), pp. 4605–4611, May 2015

    Google Scholar 

  12. Keller, M., Lefloch, D., Lambers, M., Izadi, S., Weyrich, T., Kolb, A.: Real-time 3d reconstruction in dynamic scenes using point-based fusion. In: 2013 International Conference on 3D Vision - 3DV 2013, pp. 1–8. IEEE Computer Society, Washington (2013)

    Google Scholar 

  13. Kümmerle, R., Grisetti, G., Strasdat, H., Konolige, K., Burgard, W.: G2o: a general framework for graph optimization. In: IEEE International Conference on Robotics and Automation (ICRA 2011), pp. 3607–3613. IEEE, May 2011

    Google Scholar 

  14. Newcombe, R.A., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A.J., Kohi, P., Shotton, J., Hodges, S., Fitzgibbon, A.: Kinectfusion: real-time dense surface mapping and tracking. In: 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2011), ISMAR 2011, pp. 127–136. IEEE Computer Society, October 2011

    Google Scholar 

  15. Pfister, H., Zwicker, M., van Baar, J., Gross, M.: Surfels: surface elements as rendering primitives. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2000, pp. 335–342 (2000)

    Google Scholar 

  16. Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, (3DIM 2001), pp. 145–152, May 2001

    Google Scholar 

  17. Rusu, R., Cousins, S.: 3d is here: point cloud library (PCL). In: IEEE International Conference on Robotics and Automation (ICRA 2011), pp. 1–4. IEEE, May 2011

    Google Scholar 

  18. Salas-Moreno, R.F., Glocken, B., Kelly, P.H.J., Davison, A.J.: Dense planar slam. In: 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 157–164, September 2014

    Google Scholar 

  19. Sturm, J., Engelhard, N., Endres, F., Burgard, W., Cremers, D.: A benchmark for the evaluation of RGB-D SLAM systems. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2012), pp. 573–580, October 2012

    Google Scholar 

  20. Taguchi, Y., Jian, Y.D., Ramalingam, S., Feng, C.: Point-plane SLAM for hand-held 3D sensors. In: IEEE International Conference on Robotics and Automation (ICRA 2013), pp. 5182–5189, May 2013

    Google Scholar 

  21. Trevor, A.J.B., Rogers, J.G., Christensen, H.I.: Planar surface slam with 3d and 2d sensors. In: 2012 IEEE International Conference on Robotics and Automation (ICRA), pp. 3041–3048, May 2012

    Google Scholar 

  22. Whelan, T., Ma, L., Bondarev, E., de With, P., McDonald, J.: Incremental and batch planar simplification of dense point cloud maps. Robot. Auton. Syst. 69(C), 3–14 (2015)

    Article  Google Scholar 

  23. Whelan, T., Kaess, M., Johannsson, H., Fallon, M., Leonard, J.J., McDonald, J.: Real-time large-scale dense rgb-d slam with volumetric fusion. Int. J. Robot. Res. 34(4–5), 598–626 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Hakim ElChaoui ElGhor .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

ElChaoui ElGhor, H., Roussel, D., Ababsa, F., Bouyakhf, EH. (2016). 3D Planar RGB-D SLAM System. In: Blanc-Talon, J., Distante, C., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2016. Lecture Notes in Computer Science(), vol 10016. Springer, Cham. https://doi.org/10.1007/978-3-319-48680-2_43

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48680-2_43

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48679-6

  • Online ISBN: 978-3-319-48680-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics