Skip to main content

A Pipeline for the Segmentation and Classification of 3D Point Clouds

  • Chapter
Experimental Robotics

Part of the book series: Springer Tracts in Advanced Robotics ((STAR,volume 79))

Abstract

This paper presents algorithms for fast segmentation of 3D point clouds and subsequent classification of the obtained 3D segments. The method jointly determines the ground surface and segments individual objects in 3D, including overhanging structures. When compared to six other terrain modelling techniques, this approach has minimal error between the sensed data and the representation; and is fast (processing a Velodyne scan in approximately 2 seconds). Applications include improved alignment of successive scans by enabling operations in sections (Velodyne scans are aligned 7% sharper compared to an approach using raw points) and more informed decision-making (paths move around overhangs). The use of segmentation to aid classification through 3D features, such as the Spin Image or the Spherical Harmonic Descriptor, is discussed and experimentally compared. Moreover, the segmentation facilitates a novel approach to 3D classification that bypasses feature extraction and directly compares 3D shapes via the ICP algorithm. This technique is shown to achieve accuracy on par with the best feature based classifier (92.1%) while being significantly faster and allowing a clearer understanding of the classifier’s behaviour.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anguelov, D., Taskar, B., Chatalbashev, V., Koller, D., Gupta, D., Heitz, G., Ng, A.: Discriminative learning of Markov random fields for segmentation of 3D scan data. In: Proc. of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR (2005)

    Google Scholar 

  2. Bosse, M., Zlot, R.: Place recognition using regional point descriptors for 3d mapping. In: Proc. of the International Conference on Field and Service Robotics, FSR (2009)

    Google Scholar 

  3. Choset, H., Lynch, K.M., Hutchinson, S., Kantor, G., Burgard, W., Kavraki, L.E., Thrun, S.: Principles of Robot Motion: Theory, Algorithms, and Implementations. MIT Press, Cambridge (2005)

    Google Scholar 

  4. MIT Urban Challenge datasets, http://grandchallenge.mit.edu/wiki/index.php/PublicData

  5. Johnson, A.: Spin-Images: A Representation for 3-D Surface Matching. PhD thesis, Carnegie Mellon University (1997)

    Google Scholar 

  6. Johnson, A., Hebert, M.: Using spin images for efficient object recognition in cluttered 3d scenes. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 25(1), 433–449 (1999)

    Article  Google Scholar 

  7. Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3d shape descriptors. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH Symposium on Geometry Processing (2003)

    Google Scholar 

  8. Kelly, A., Stentz, A., Amidi, O., Bode, M., Bradley, D., Diaz-Calderon, A., Happold, M., Herman, H., Pilarski, T., Rander, P., Thayer, S., Vallidis, N., Warner, R.: Toward reliable off road autonomous vehicles operating in challenging environments. International Journal of Robotics Research (IJRR) 25(5-6), 449–483 (2006)

    Article  Google Scholar 

  9. Lai, K., Fox, D.: 3D laser scan classification using web data and domain adaptation. In: Proceedings of Robotics: Science and Systems, Seattle, USA (June 2009)

    Google Scholar 

  10. Lalonde, J., Vandapel, N., Huber, D., Hebert, M.: Natural terrain classification using three-dimensional ladar data for ground robot mobility. Journal of Field Robotics 23(10), 839–861 (2006)

    Article  Google Scholar 

  11. Malisiewicz, T., Efros, A.: Improving spatial support for objects via multiple segmentations. In: British Machine Vision Conference, pp. 282–289 (2007)

    Google Scholar 

  12. Melkumyan, N.: Surface-based Synthesis of 3D Maps for Outdoor Unstructured Environments. PhD thesis, University of Sydney, Australian Centre for Field Robotics (2008)

    Google Scholar 

  13. Moosmann, F., Pink, O., Stiller, C.: Segmentation of 3D Lidar Data in non-flat Urban Environments using a Local Convexity Criterion. In: Intl. Conf. Information Visualisation (2009)

    Google Scholar 

  14. Munoz, D., Vandapel, N., Hebert, M.: Onboard contextual classification of 3-d point clouds with learned high-order markov random fields. In: Proc. of the IEEE International Conference on Robotics & Automation, ICRA (2009)

    Google Scholar 

  15. Pfaff, P., Burgard, W.: An efficient extension to elevation maps for outdoor terrain mapping and loop closing. International Journal of Robotics Research (IJRR) 26(2), 217–230 (2007)

    Article  Google Scholar 

  16. Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proc. 3DIM, pp. 145–152 (2001)

    Google Scholar 

  17. Siciliano, B., Khatib, O.: Springer handbook of robotics. Springer (2008)

    Google Scholar 

  18. Simmons, R., Henriksen, L., Chrisman, L., Whelan, G.: Obstacle avoidance and safeguarding for a lunar rover. In: AIAA Forum on Advanced Developments in Space Robotics (1996)

    Google Scholar 

  19. Thrun, S., et al.: Stanley: The robot that won the darpa grand challenge. Journal of Field Robotics 23(9), 661–692 (2006)

    Article  Google Scholar 

  20. Triebel, R., Kersting, K., Burgard, W.: Robust 3D scan point classification using associative Markov networks. In: Proc. of the IEEE International Conference on Robotics & Automation (ICRA), pp. 2603–2608 (2006)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer-Verlag GmbH Berlin Heidelberg

About this chapter

Cite this chapter

Douillard, B., Underwood, J., Vlaskine, V., Quadros, A., Singh, S. (2014). A Pipeline for the Segmentation and Classification of 3D Point Clouds. In: Khatib, O., Kumar, V., Sukhatme, G. (eds) Experimental Robotics. Springer Tracts in Advanced Robotics, vol 79. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-28572-1_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-28572-1_40

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-28571-4

  • Online ISBN: 978-3-642-28572-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics