Flexible Multi-modal Graph-Based Segmentation
This paper aims at improving the well-known local variance segmentation method by adding extra signal modi and specific processing steps. As a key contribution, we extend the uni-modal segmentation method to perform multi-modal analysis, such that any number of signal modi available can be incorporated in a very flexible way. We have found that the use of a combined weight of luminance and depth values improves the segmentation score by 6.8%, for a large and challenging multi-modal dataset. Furthermore, we have developed an improved uni-modal texture-segmentation algorithm. This improvement relies on a clever choice of the color space and additional pre- and post-processing steps, by which we have increased the segmentation score on a challenging texture dataset by 2.1%. This gain is mainly preserved when using a different dataset with worse lighting conditions and different scene types.
KeywordsMulti-modal Signal Analysis RGBD Segmentation Graphs
Unable to display preview. Download preview PDF.
- 3.Cour, T., Benezit, F., Shi, J.: Spectral segmentation with multiscale graph decomposition. In: IEEE Comp. Soc. Conf. on Computer Vision and Pattern Recognition (CVPR), vol. 2, pp. 1124–1131. IEEE (2005)Google Scholar
- 9.Strom, J., Richardson, A., Olson, E.: Graph-based segmentation for colored 3D laser point clouds. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, pp. 2131–2136. IEEE, Taipei (2010)Google Scholar