Luminance: A New Visual Feature for Visual Servoing
This chapter is dedicated to a new way to achieve robotic tasks by 2D visual servoing. Contrary to most of related works in this domain where geometric visual features are usually used, we directly here consider the luminance of all pixels in the image. We call this new visual servoing scheme photometric visual servoing. The main advantage of this new approach is that it greatly simplifies the image processing required to track geometric visual features all along the camera motion or to match the initial visual features with the desired ones. However, as it is required in classical visual servoing, the computation of the so-called interaction matrix is required. In our case, this matrix links the time variation of the luminance to the camera motions.We will see that this computation is based on a illumination model able to describe complex luminance changes. However, since most of the classical control laws fail when considering the luminance as a visual feature, we turn the visual servoing problem into an optimization one leading to a new control law. Experimental results on positioning tasks validate the feasibility of photometric visual servoing and show its robustness regarding to approximated depths, Lambertian and non Lambertian objects, low textured objects, partial occlusions and even, to some extent, to image content.
KeywordsCost Function Visual Feature Interaction Matrix Visual Servoing Illumination Model
Unable to display preview. Download preview PDF.
- 1.Abdul Hafez, A., Achar, S., Jawahar, C.: Visual servoing based on gaussian mixture models. In: IEEE Int. Conf. on Robotics and Automation, ICRA 2008, Pasadena, California, pp. 3225–3230 (2008)Google Scholar
- 3.Blinn, J.: Models of light reflection for computer synthesized pictures. In: ACM Conf. on Computer graphics and interactive techniques, SIGGRAPH 1977, San Jose, California, pp. 192–198 (1977), http://doi.acm.org/10.1145/563858.563893
- 5.Collewet, C., Marchand, E.: Modeling complex luminance variations for target tracking. In: IEEE Int. Conf. on Computer Vision and Pattern Recognition, CVPR 2008, Anchorage, Alaska, pp. 1–7 (2008)Google Scholar
- 6.Collewet, C., Marchand, E.: Photometric visual servoing. Tech. Rep. No. 6631, INRIA (2008)Google Scholar
- 11.Feddema, J., Lee, C., Mitchell, O.: Automatic selection of image features for visual servoing of a robot manipulator. In: IEEE Int. Conf. on Robotics and Automation, ICRA 1989, Scottsdale, Arizona, vol. 2, pp. 832–837 (1989)Google Scholar
- 12.Hashimoto, K., Kimura, H.: LQ optimal and non-linear approaches to visual servoing. In: Hashimoto, K. (ed.) Visual Servoing, vol. 7, pp. 165–198. World Scientific Series in Robotics and Automated Systems, Singapore (1993)Google Scholar
- 15.Kallem, V., Dewan, M., Swensen, J., Hager, G., Cowan, N.: Kernel-based visual servoing. In: IEEE/RSJ Int. Conf. on Intelligent Robots and System, IROS 2007, San Diego, USA (2007)Google Scholar
- 16.Malis, E.: Improving vision-based control using efficient second-order minimization techniques. In: IEEE Int. Conf. on Robotics and Automation, ICRA 2004, New Orleans, vol. 2, pp. 1843–1848 (2004)Google Scholar
- 21.Questa, P., Grossmann, E., Sandini, G.: Camera self orientation and docking maneuver using normal flow. In: SPIE AeroSense 1995, Orlando, Florida, USA, vol. 2488, pp. 274–283 (1995)Google Scholar
- 25.Tahri, O., Mezouar, Y.: On the efficient second order minimization and image-based visual servoing. In: IEEE Int. Conf. on Robotics and Automation, Pasadena, California, pp. 3213–3218 (2008)Google Scholar