Abstract
In this chapter, image-based visual servoing is addressed via nonlinear model predictive control. The visual servoing task is formulated into a nonlinear optimization problem in the image plane. The proposed approach, named visual predictive control, can easily and explicitly take into account 2D and 3D constraints. Furthermore, the image prediction over a finite prediction horizon plays a crucial role for large displacements. This image prediction is obtained thanks to a model. The choice of this model is discussed. A nonlinear global model and a local model based on the interaction matrix are considered. Advantages and drawbacks of both models are pointed out. Finally, simulations obtained with a 6 degrees of freedom (DOF) free-flying camera highlight the capabilities and the efficiency of the proposed approach by a comparison with the classical image-based visual servoing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allibert, G., Courtial, E., Touré, Y.: Visual predictive control. In: IFAC Workshop on Nonlinear Predictive Control for Fast Systems, Grenoble, France (2006)
Allibert, G., Courtial, E., Touré, Y.: Real-time visual predictive controller for image-based trajectory tracking of mobile robot. In: 17th IFAC World Congress, Seoul, Korea (2008)
Allibert, G., Courtial, E., Touré, Y.: Visual predictive control for manipulators with catadioptric camera. In: IEEE Int. Conf. on Robotics and Automation, Pasadena, USA (2008)
Chaumette, F.: Potential problems of stability and convergence in image-based and position-based visual servoing. In: Kriegman, D., Hager, G., Morse, A. (eds.) The Confluence of Vision and Control. LNCIS, vol. 237, pp. 66–78. Springer, Heidelberg (1998)
Chaumette, F., Hutchinson, S.: Visual servo control, part i: Basic approaches. IEEE Robotics and Automation Magazine 13(4), 82–90 (2006)
Chaumette, F., Hutchinson, S.: Visual servo control, part ii: Advanced approaches. IEEE Robotics and Automation Magazine 14(1), 109–118 (2007)
Chesi, G.: Visual servoing path planning via homogeneous forms and lmi optimizations. IEEE Trans. Robotics and Automation 25(2), 281–291 (2009)
Chong, E., Zak, S.H.: An Introduction to Optimization, 2nd edn. John Wiley & Sons Inc., Chichester (2001)
Danès, P., Bellot, D.: Towards an lmi approach to multicriteria visual servoing in robotics. European Journal of Control 12(1), 86–110 (2006)
Durola, S., Danès, P., Coutinho, D., Courdesses, M.: Rational systems and matrix inequalities to the multicriteria analysis of visual servos. In: IEEE Int. Conf. on Robotics and Automation, Kobe, Japan (2009)
Folio, D., Cadenat, V.: Dealing with visual features loss during a vision-based task for a mobile robot. International Journal of Optomechatronics 2(3), 185–204 (2008)
Gangloff, J., De Mathelin, M.: Visual servoing of a 6 dof manipulator for unknown 3-d profile following. IEEE Trans. Robotics and Automation 18(4), 511–520 (2002)
Ginhoux, R., Gangloff, J., De Mathelin, M., Soler, M., Sanchez, L.: Active filtering of physiological motion in robotized surgery using predictive control. IEEE Trans. Robotics and Automation 21(1), 67–79 (2005)
Hashimoto, K., Kimura, H.: LQ optimal and nonlinear approaches to visual servoing. In: Hashimoto, K. (ed.) Visual Servoing, Robotics and Automated Systems, pp. 165–198. World Scientific, Singapore (1993)
Hutchinson, S., Hager, G.D., Corke, P.: A tutorial on visual servo control. IEEE Trans. Robotics and Automation 12(5), 651–671 (1996)
Kazemi, M., Gupta, K., Mehrandezh, M.: Global path planning for robust visual servoing in complex environments. In: IEEE Int. Conf. on Robotics and Automation, Kobe, Japan (2009)
Mahony, R., Corke, P., Chaumette, F.: Choice of image features for depth-axis control in image-based visual servo control. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, Lausanne, Switzerland (2002)
Malis E.: Improving vision-based control using efficient second-order minimization techniques. In: IEEE Int. Conf. on Robotics and Automation, New Orleans, LA, USA (2004)
Mezouar, Y., Chaumette, F.: Optimal camera trajectory with image-based control. Int. Journal of Robotics Research 22(10), 781–804 (2003)
Morari, M., Zafiriou, E.: Robust Control. Dunod (1983)
Nasisi, O., Carelli, R.: Adaptive servo visual robot control. Robotics and Autonomous Systems 43(1), 51–78 (2003)
Papanikolopoulos, N., Khosla, P., Kanade, T.: Visual tracking of a moving target by a camera mounted on a robot: A combination of vision and control. IEEE Trans. Robotics and Automation 9(1), 14–35 (1993)
Sauvée, M., Poignet, P., Dombre, E., Courtial, E.: Image based visual servoing through nonlinear model predictive control. In: 45th IEEE CDC, San Diego, CA, pp. 1776–1781 (2006)
Schramm, F., Morel, G.: Ensuring visibility in calibration-free path planning for image-based visual servoing. IEEE Trans. Robotics and Automation 22(4), 848–854 (2006)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer London
About this chapter
Cite this chapter
Allibert, G., Courtial, E., Chaumette, F. (2010). Visual Servoing via Nonlinear Predictive Control . In: Chesi, G., Hashimoto, K. (eds) Visual Servoing via Advanced Numerical Methods. Lecture Notes in Control and Information Sciences, vol 401. Springer, London. https://doi.org/10.1007/978-1-84996-089-2_20
Download citation
DOI: https://doi.org/10.1007/978-1-84996-089-2_20
Publisher Name: Springer, London
Print ISBN: 978-1-84996-088-5
Online ISBN: 978-1-84996-089-2
eBook Packages: EngineeringEngineering (R0)