Abstract
Segmentation and classification of 3D urban point clouds is a complex task, making it very difficult for any single method to overcome all the diverse challenges offered. This sometimes requires the combination of several techniques to obtain the desired results for different applications. This work presents and compares two different approaches for segmenting and classifying 3D urban point clouds. In the first approach, detection, segmentation and classification of urban objects from 3D point clouds, converted into elevation images, are performed by using mathematical morphology. First, the ground is segmented and objects are detected as discontinuities on the ground. Then, connected objects are segmented using a watershed approach. Finally, objects are classified using SVM (Support Vector Machine) with geometrical and contextual features. The second method employs a super-voxel based approach in which the 3D urban point cloud is first segmented into voxels and then converted into super-voxels. These are then clustered together using an efficient link-chain method to form objects. These segmented objects are then classified using local descriptors and geometrical features into basic object classes. Evaluated on a common dataset (real data), both these methods are thoroughly compared on three different levels: detection, segmentation and classification. After analyses, simple strategies are also presented to combine the two methods, exploiting their complementary strengths and weaknesses, to improve the overall segmentation and classification results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Aijazi, A.K., Checchin, P., Trassoudaine, L.: Segmentation based classification of 3D urban point clouds: a super-voxel based approach. Remote Sens. 5(4), 1624–1650 (2013)
Anguelov, D., Taskar, B., Chatalbashev, V., Koller, D., Gupta, D., Heitz, G., Ng, A.: Discriminative learning of markov random fields for segmentation of 3D scan data. In: IEEE Conference on CVPR, vol. 2, pp. 169–176. Los Alamitos, CA, USA (2005)
Brédif, M., Vallet, B., Serna, A., Marcotegui, B., Paparoditis, N.: Terramobilita/IQmulus urban point cloud analysis benchmark. In: IQmulus workshop in conjunction with SGP 14. Cardiff, UK (2014)
Byun, J., Na, K.I., Seo, B.S., Roh, M.: Drivable road detection with 3D point clouds based on the MRF for intelligent vehicle. In: Mejias, L., Corke, P., Roberts, J. (eds.) Field and Service Robotics, Springer Tracts in Advanced Robotics, vol. 105, pp. 49–60. Springer International Publishing (2015)
Chehata, N., Guo, L., Mallet, C.: Airborne lidar feature selection for urban classification using random forests. Int. Archiv. Photogramm. Remote Sens. Spat. Inf. Sci. 38(3), 207–212 (2009)
Douillard, B., Underwood, J., Kuntz, N., Vlaskine, V., Quadros, A., Morton, P., Frenkel, A.: On the segmentation of 3D LIDAR point clouds. In: IEEE International Conference on Robotics and Automation (ICRA), p. 8. Shanghai, China (2011)
Filin, S., Pfeifer, N.: Segmentation of airborne laser scanning data using a slope adaptive neighborhood. ISPRS J. Photogramm. Remote Sens. 60(2), 71–80 (2006)
Friedman, S., Stamos, I.: Online detection of repeated structures in point clouds of urban scenes for compression and registration. Int. J. Comput. Vis. 102(1–3), 112–128 (2013)
Golovinskiy, A., Funkhouser, T.: Min-cut based segmentation of point clouds. In: IEEE Workshop on Search in 3D and Video (S3DV) at ICCV, pp. 39–46 (2009)
Goulette, F., Nashashibi, F., Abuhadrous, I., Ammoun, S., Laurgeau, C.: An integrated on-board laser range sensing system for on-the-way city and road modelling. In: ISPRS RFPT (2006)
Lalonde, J.F., Unnikrishnan, R., Vandapel, N., Hebert, M.: Scale selection for classification of point-sampled 3D surfaces. In: 5th International Conference on 3-D Digital Imaging and Modeling, pp. 285–292 (2005)
Lee, I., Schenk, T.: Perceptual organization of 3D surface points. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XXXIV, Part 3A, pp. 193–198 (2002)
Linsen, L., Prautzsch, H.: Global versus local triangulations. In: Roberts, J. (ed.) Procedings of Eurographics 2001, Short Presentations, pp. 257–263. Oxford, UK (2001)
Lodha, S., Fitzpatrick, D., Helmbold, D.: Aerial lidar data classification using adaboost. In: 6th International Conference on 3-D Digital Imaging and Modeling, 3DIM’07, pp. 435–442 (2007)
Moosmann, F., Pink, O., Stiller, C.: Segmentation of 3D lidar data in non-flat urban environments using a local convexity criterion. In: IEEE Intelligent Vehicles Symposium (IV), pp. 215–220 (2009)
Munoz, D., Bagnell, J.A.D., Vandapel, N., Hebert, M.: Contextual classification with functional max-margin Markov networks. In: IEEE Conference on CVPR, pp. 975–982 (2009)
Munoz, D., Vandapel, N., Hebert, M.: Onboard contextual classification of 3-D point clouds with learned high-order Markov random fields. In: IEEE International Conference on Robotics and Automation, pp. 2009–2016 (2009)
Niemeyer, J., Rottensteiner, F., Soergel, U.: Conditional random fields for lidar point cloud classification in complex urban areas. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. I(3), 263–268 (2012)
Elberink, S.O., Kemboi, B.: User-assisted object detection by segment based similarity measures in mobile laser scanner data. ISPRS - Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. XL-3, 239–246 (2014)
Rabbani, T., van den Heuvel, F.A., Vosselmann, G.: Segmentation of point clouds using smoothness constraint. In: IEVM06 (2006)
Schoenberg, J., Nathan, A., Campbell, M.: Segmentation of dense range information in complex urban scenes. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2033–2038. Taipei, Taiwan (2010)
Secord, J., Zakhor, A.: Tree detection in urban regions using aerial lidar and image data. IEEE Geosci. Remote Sens. Lett. 4(2), 196–200 (2007)
Serna, A., Marcotegui, B.: Urban accessibility diagnosis from mobile laser scanning data. ISPRS J. Photogramm. Remote Sens. 84, 23–32 (2013)
Serna, A., Marcotegui, B.: Detection, segmentation and classification of 3d urban objects using mathematical morphology and supervised learning. ISPRS J. Photogramm. Remote Sens. 93, 243–255 (2014)
Serna, A., Marcotegui, B., Goulette, F., Deschaud, J.E., et al.: Paris-Rue-Madame database: a 3D mobile laser scanner dataset for benchmarking urban detection, segmentation and classification methods. In: 4th International Conference on Pattern Recognition, Applications and Methods (2014)
Shapovalov, R., Velizhev, A., Barinova, O.: Non-associative markov networks for 3D point cloud classification. In: Photogrammetric Computer Vision and Image Analysis (PCV 2010), vol. 38, pp. 103–108 (2010)
Sithole, G., Vosselman, G.: Automatic structure detection in a point-cloud of an urban landscape. In: 2nd GRSS/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas, pp. 67–71 (2003)
Xiong, X., Munoz, D., Bagnell, J.A.D., Hebert, M.: 3-D scene analysis via sequenced predictions over points and regions. In: IEEE International Conference on Robotics and Automation (2011)
Acknowledgments
The work reported in this paper was supported by the French national research agency (ANR CONTINT iSpace & Time – ANR-10-CONT-23) and has been performed as part of Cap Digital Business Cluster TerraMobilita project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Aijazi, A.K., Serna, A., Marcotegui, B., Checchin, P., Trassoudaine, L. (2016). Segmentation and Classification of 3D Urban Point Clouds: Comparison and Combination of Two Approaches. In: Wettergreen, D., Barfoot, T. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 113. Springer, Cham. https://doi.org/10.1007/978-3-319-27702-8_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-27702-8_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-27700-4
Online ISBN: 978-3-319-27702-8
eBook Packages: EngineeringEngineering (R0)