Abstract
This article describes interactive object segmentation for autonomous service robots acting in human living environments. The proposed system allows a robot to effectively segment textured and textureless objects in cluttered scenes by leveraging its manipulation capabilities. In this interactive perception approach, RGB and depth (RGB-D) camera based features are tracked while the robot actively induces motions into a scene using its arm. The robot autonomously infers appropriate arm movements which can effectively separate objects. The resulting tracked feature trajectories are assigned to their corresponding object by clustering. In the final step, we reconstruct the dense models of the objects from the previously clustered sparse RGB-D features. The approach is integrated with robotic grasping and is demonstrated on scenes consisting of various textured and textureless objects, showing the advantages of a tight integration between perception, cognition and action.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bergström N, Ek CH, Björkman M, Kragic D (2011) Scene understanding through interactive perception. In: 8th international conference on computer vision systems (ICVS). Sophia Antipolis
Bersch C, Pangercic D, Osentoski S, Hausman K, Marton ZC, Ueda R, Okada K, Beetz M (2012) Segmentation of textured and textureless objects through interactive perception. In: RSS workshop on robots in clutter: manipulation, perception and navigation in human environments. Sydney, Australia
Bouguet JY (2001) Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm. Intel Corp 5:1–10
Brox T, Malik J (2010) Object segmentation by long term analysis of point trajectories. In: Proceedings of the 11th European conference on computer vision: Part V (ECCV’10). Springer, Berlin, pp 282–295
Chang L, Smith JR, Fox D (2012) Interactive singulation of objects from a pile. In: 2012 IEEE international conference on robotics and automation (ICRA). IEEE, pp 3875–3882
Cohen LB, Cashon CH (2003) Infant perception and cognition. Comprehensive handbook of psychology, volume 6: developmental psychology. Wiley, New York, pp 65–89 (Chap II. Infancy)
Felzenszwalb PF, Huttenlocher DP (2004) Efficient graph-based image segmentation. Int J Comput Vis 59(2):167–181. doi:10.1023/B:VISI.0000022288.19776.77
Fischler M, Bolles R (1981) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun ACM 24:381–395
Fitzpatrick P (2003) First contact: an active vision approach to segmentation. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems (IROS 2003), vol 3. IEEE, pp 2161–2166
Gupta M, Sukhatme G (2012) Using manipulation primitives for brick sorting in clutter. In: 2012 IEEE international conference on robotics and automation (ICRA). IEEE, pp 3883–3889
Gupta M, Ruhr T, Beetz M, Sukhatme GS (2013) Interactive environment exploration in clutter. In: 2013 IEEE/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 5265–5272
Hausman K, Balint-Benczedi F, Pangercic D, Marton ZC, Ueda R, Okada K, Beetz M (2013) Tracking-based interactive segmentation of textureless objects. In: IEEE international conference on robotics and automation (ICRA). Karlsruhe, Germany, Best Service Robotics Paper Award Finalist
Hausman K, Corcos C, Mueller J, Sha F, Sukhatme GS (2014) Towards interactive object recognition. In: 3rd workshop on robots in clutter: perception and interaction in clutter, IEEE/RSJ international conference on intelligent robots and systems (IROS). Chicago, IL
Heyer LJ, Kruglyak S, Yooseph S (1999) Exploring expression data: identification and analysis of coexpressed genes. Genome Res 9(11):1106–1115
Horn BKP (1987) Closed-form solution of absolute orientation using unit quaternions. J Opt Soc Am A 4(4):629–642
Jacobs DW (2001) Perceptual organization as generic object recognition. In: Shipley TF, Kellman PJ (eds) From fragments to objects—segmentation and grouping in vision. Elsevier, Amsterdam, pp 295–329 (Chap IV. Models of segmentation and grouping)
Katz D, Brock O (2011) Interactive segmentation of articulated objects in 3D. In: Workshop on mobile manipulation at ICRA
Kenney J, Buckley T, Brock O (2009) Interactive segmentation for manipulation in unstructured environments. In: Proceedings of the 2009 IEEE international conference on robotics and automation, ICRA’09
Klappstein J, Vaudrey T, Rabe C, Wedel A, Klette R (2008) Moving object segmentation using optical flow and depth information. In: Proceedings of the 3rd Pacific rim symposium on advances in image and video technology (PSIVT’09). Springer, Berlin, pp 611–623
Klingbeil E, Rao D, Carpenter B, Ganapathi V, Ng AY, Khatib O (2011) Grasping with application to an autonomous checkout robot. In: IEEE international conference on robotics and automation (ICRA). IEEE, Shanghai, China, pp 2837–2844
Marton ZC, Pangercic D, Blodow N, Beetz M (2011) Combined 2D–3D categorization and classification for multimodal perception systems. Int J Robot Res 30(11):1378–1402
Marton ZC, Balint-Benczedi F, Mozos OM, Blodow N, Kanezaki A, Goron LC, Pangercic D, Beetz M (2014) Part-based geometric categorization and object reconstruction in cluttered table-top scenes. J Intell Robot Syst 76(1):35–56
Mishra AK, Aloimonos Y (2009) Active segmentation with fixation. In: Proceedings of the international conference on computer vision (ICCV). IEEE
Mozos OM, Marton ZC, Beetz M (2011) Furniture models learned from the WWW—using web catalogs to locate and categorize unknown furniture pieces in 3D laser scans. Robot Autom Mag 18(2):22–32
Rusu RB, Blodow N, Marton ZC, Soos A, Beetz M (2007) Towards 3D object maps for autonomous household robots. In: Proceedings of the 20th IEEE international conference on intelligent robots and systems (IROS). San Diego, CA, USA
Rusu RB, Marton ZC, Blodow N, Dolha ME, Beetz M (2008) Functional object mapping of kitchen environments. In: Proceedings of the 21st IEEE/RSJ international conference on intelligent robots and systems (IROS). Nice, France, 22–26 Sept 2008
Schiebener D, Morimoto J, Asfour T, Ude A (2013) Integrating visual perception and manipulation for autonomous learning of object representations. Adapt Behav 21(5):328–345
Shi J, Tomasi C (1994) Good features to track. In: 1994 IEEE conference on computer vision and pattern recognition (CVPR’94), pp 593–600
Suzuki S, Abe K (1985) Topological structural analysis of digitized binary images by border following. Comput Vis Graph Image Process 30(1):32–46
van Hoof H, Kroemer O, Peters J (2014) Probabilistic segmentation and targeted exploration of objects in cluttered environments. IEEE Trans Robot 30(5):1198–1209. doi:10.1109/TRO.2014.2334912
Zhan Q, Liang Y, Xiao Y (2009) Color-based segmentation of point clouds. In: Laserscanning 2009 ISPRS Workshop
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Hausman, K. et al. (2015). Interactive Segmentation of Textured and Textureless Objects. In: Busoniu, L., Tamás, L. (eds) Handling Uncertainty and Networked Structure in Robot Control. Studies in Systems, Decision and Control, vol 42. Springer, Cham. https://doi.org/10.1007/978-3-319-26327-4_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-26327-4_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-26325-0
Online ISBN: 978-3-319-26327-4
eBook Packages: EngineeringEngineering (R0)