Abstract
For planning grasps and other object manipulation actions in complex environments, 3D semantic information becomes crucial. This paper focuses on the application of recent 3D Time-of-Flight (ToF) cameras in the context of semantic scene analysis. For being able to acquire semantic information from ToF camera data, we a) pre-process the data including outlier removal, filtering and phase unwrapping for correcting erroneous distance measurements, and b) apply a randomized algorithm for detecting shapes such as planes, spheres, and cylinders. We present experimental results that show that the robustness against noise and outliers of the underlying RANSAC paradigm allows for segmenting and classifying objects in 3D ToF camera data captured in natural mobile manipulation setups.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Capel, D.P.: An effective bail-out test for RANSAC consensus scoring. In: Proc. British Machine Vision Conf., pp. 629–638 (2005)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Frey, B.J., Koetter, R., Petrovic, N.: Very Loopy Belief Propagation for Unwrapping Phase Images. In: Neural Information Processing Systems Conference (NIPS), Algorithms & Architectures (2001)
Graham, R.L.: An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set. Information Processing Letters 1(4), 132–133 (1972)
Matas, J., Chum, O.: Randomized RANSAC with t(d, d) test. In: Proc. of the British Machine Vision Conference 2002, BMVC (2002)
May, S., Droeschel, D., Holz, D., Fuchs, S., Malis, E., Nüchter, A., Hertzberg, J.: Three-dimensional mapping with time-of-flight cameras. Journal of Field Robotics, Special Issue on Three-Dimensional Mapping, Part 2 26(11-12), 934–965 (2009)
Mount, D., Arya, S.: ANN: A library for approximate nearest neighbor searching. In: Proc. of the 2nd Annual Fall Workshop on Computational Geometry (1997)
Nüchter, A., Hertzberg, J.: Towards semantic maps for mobile robots. Robotics and Autonomous Systems 56(11), 915–926 (2008)
Ohno, K., Nomura, T., Tadokoro, S.: Real-time robot trajectory estimation and 3d map construction using 3d camera. In: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2006)
Rusu, R.B., Blodow, N., Marton, Z.C., Beetz, M.: Close-range Scene Segmentation and Reconstruction of 3D Point Cloud Maps for Mobile Manipulation in Human Environments. In: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2009)
Schnabel, R., Wahl, R., Klein, R.: Efficient RANSAC for Point-Cloud Shape Detection. Computer Graphics Forum 26(2), 214–226 (2007)
Sheh, R., Kadous, M.W., Sammut, C.: On building 3d maps using a range camera: Applications to rescue robotics. Technical report, UNSW, Sydney, Australia (2006)
Torr, P.H., Zisserman, A.: MLESAC: a new robust estimator with application to estimating image geometry. Computer Vision and Image Understanding 78(1), 138–156 (2000)
Weingarten, J.W., Grüner, G., Siegwart, R.: A State-of-the-Art 3D Sensor for Robot Navigation. In: Proc. of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Holz, D., Schnabel, R., Droeschel, D., Stückler, J., Behnke, S. (2011). Towards Semantic Scene Analysis with Time-of-Flight Cameras. In: Ruiz-del-Solar, J., Chown, E., Plöger, P.G. (eds) RoboCup 2010: Robot Soccer World Cup XIV. RoboCup 2010. Lecture Notes in Computer Science(), vol 6556. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20217-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-642-20217-9_11
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20216-2
Online ISBN: 978-3-642-20217-9
eBook Packages: Computer ScienceComputer Science (R0)