Skip to main content

A Variational Approach to Trajectory Planning in Visual Servoing

  • Chapter
Visual Servoing via Advanced Numerical Methods

Part of the book series: Lecture Notes in Control and Information Sciences ((LNCIS,volume 401))

Abstract

One deficiency of image-based servo is that the induced 3D trajectories are not optimal and sometimes, especially when the displacements to realize is large, these trajectories are not physically valid leading to the failure of the servoing process. In this chapter, we address the problem of generating trajectories of some image features that corresponds to optimal 3D trajectories in order to control efficiently a robotic system using an image-based control strategy. First, a collineation path between given start and end points is obtained and then the trajectories of the image features are derived. Path planning is formulate as a variational problem which allows to consider simultaneously optimality and inequality constraints (visibility). A numerical method is employed for solving the path-planning problem in the variational form.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Chaumette, F.: Potential problems of stability and convergence in image-based and position-based visual servoing. In: Kriegman, D., Hager, G., Morse, A. (eds.) The Confluence of Vision and Control. LNCIS, vol. 237, pp. 66–78. Springer, Heidelberg (1998)

    Chapter  Google Scholar 

  2. Chaumette, F., Hutchinson, S.: Visual servo control, part i: Basic approaches. IEEE Robotics and Automation Magazine 13(4), 82–90 (2006)

    Article  Google Scholar 

  3. Chaumette, F., Hutchinson, S.: Visual servo control, part ii: Advanced approaches. IEEE Robotics and Automation Magazine 14(1), 109–118 (2007)

    Article  Google Scholar 

  4. Chesi, G., Malis, E., Cipolla., R.: Automatic segmentation and matching of planar contours for visual servoing. In: International Conference on Robotics and Automation, San Francisco (2000)

    Google Scholar 

  5. Chesi, G., Prattichizzo, D., Vicino, A.: Straight line path-planning in visual servoing. Journal of Dynamic Systems, Measurement and Control 129(4), 541–543 (2007)

    Article  Google Scholar 

  6. Chesi, G., Vicino, A.: Visual servoing for large camera displacements. IEEE Transactions on Robotics 20(4), 724–735 (2004)

    Article  Google Scholar 

  7. Corke, P.I., Hutchinson, S.A.: A new partitioned approach to image-based visual servo control. IEEE Transaction on Robotics and Automation 17(4), 507–515 (2001)

    Article  Google Scholar 

  8. Cowan, N., Lopes, G., Koditschek, D.: Rigid body visual servoing using navigation functions. In: IEEE Int. Conf. on Decision and Control, Sydney, Australia, pp. 3920–3926 (2000)

    Google Scholar 

  9. Deguchi, K.: Optimal motion control for image-based visual servoing by decoupling translation and rotation. In: IEEE/RSJ International Conference on Intelligent Robots Systems, Victoria, BC, Canada, vol. 2, pp. 705–711 (1998)

    Google Scholar 

  10. Faugeras, O.: Three-dimensionnal computer vision: a geometric view point. MIT Press, Cambridge (1993)

    Google Scholar 

  11. Faugeras, O., Lustman, F.: Motion and structure from motion in a piecewise planar environment. Int. Journal of Pattern Recognition and Artificial Intelligence 2(3), 485–508 (1988)

    Article  Google Scholar 

  12. Fomena, R.T., Chaumette, F.: Visual servoing from spheres using a spherical projection model. In: IEEE International Conference on Robotics and Automation, ICRA 2007, Roma, Italia, pp. 2080–2085 (2007)

    Google Scholar 

  13. Gregory, J., Lin, C.: Constrained optimization in the calculus of variations and optimal control theory. Van Nostrand Reinhold, New York (1992)

    MATH  Google Scholar 

  14. Hamel, T., Mahony, R.: Visual servoing of an under-actuated dynamic rigid body system: an image-based approach. IEEE Transaction on Robotics and Automation 18(2), 187–198 (2002)

    Article  Google Scholar 

  15. Hashimoto, K., Noritugu, T.: Potential switching control in visual servo. In: IEEE Int. Conf. on Robotics and Automation, San Francisco, USA, pp. 2765–2770 (2000)

    Google Scholar 

  16. Hosoda, K., Sakamoto, K., Asada, M.: Trajectory generation for obstacle avoidance of uncalibrated stereo visual servoing without 3d reconstruction. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems 1(3), 29–34 (1995)

    Google Scholar 

  17. Iwatsuki, M., Okiyama, N.: A new formulation of visual servoing based on cylindrical coordinate system. IEEE Transactions on Robotics 21(2), 266–273 (2005)

    Article  Google Scholar 

  18. Lee, J.S., Suh, I., You, B.J., Oh, S.R.: A novel visual servoing approach involving disturbance observer. In: IEEE International Conference on Robotics and Automation, ICRA 1999, Detroit, Michigan, pp. 269–274 (1999)

    Google Scholar 

  19. Mahony, R., Corke, P., Chaumette, F.: Choice of image features for depth-axis control in image-based visual servo control. In: IEEE/RSJ Int. Conf. on Intelligent Robots and Systems, IROS 2002, Lausanne, Switzerland, vol. 1, pp. 390–395 (2002)

    Google Scholar 

  20. Malis, E., Chaumette, F.: 2 1/2 d visual servoing with respect to unknown objects through a new estimation scheme of camera displacement. International Journal of Computer Vision 37(1), 79–97 (2000)

    Article  MATH  Google Scholar 

  21. Malis, E., Chesi, G., Cipolla, R.: 2 1/2 d visual servoing with respect to planar contours having complex and unknown shapes. International Journal of Robotics Research, Special Issue on Visual Servoing 22(10-11), 841–853 (2003)

    Google Scholar 

  22. Mezouar, Y., Chaumette, F.: Path planning for robust image-based control. IEEE Trans. on Robotics and Automation 18(4), 534–549 (2002)

    Article  Google Scholar 

  23. Mezouar, Y., Chaumette, F.: Optimal camera trajectory with image-based control. Int. Journal of Robotics Research, IJRR 22(10), 781–804 (2003)

    Article  Google Scholar 

  24. Mezouar, Y., Malis, E.: Robustness of central catadioptric image-based visual servoing to uncertainties on 3d parameters. In: IEEE/RSJ International Conference on Intelligent Robots Systems, pp. 1389–1394 (2004)

    Google Scholar 

  25. Ruf, A., Horaud, R.: Visual trajectories from uncalibrated stereo. In: IEEE Int. Conf. on Intelligent Robots and Systems, pp. 83–91 (1997)

    Google Scholar 

  26. Singh, R., Voyle, R.M., Littau, D., Papanikolopoulos, N.P.: Alignement of an eye-in-hand system to real objects using virtual images, Leuven, Belgium (1998)

    Google Scholar 

  27. Tahri, O., Chaumette, F., Mezouar, Y.: New decoupled visual servoing scheme based on invariants from projection onto a sphere. In: IEEE International Conference on Robotics and Automation, ICRA 2008, Pasadena, California, USA, pp. 3238–3243 (2008)

    Google Scholar 

  28. Zefran, M., Kumar., V.: Optimal control of systems with unilateral constraints. In: IEEE International Conference on Robotics and Automation, Nagoya, Japan, pp. 2695–2700 (1995)

    Google Scholar 

  29. Zhang, H., Ostrowski, J.: Optimal motion planning in the image plane for mobile robots. In: IEEE Int. Conf. on Robotics and Automation, San Francisco, USA, pp. 3811–3816 (2000)

    Google Scholar 

  30. Zhang, Z., Hanson, A.R.: Scaled euclidean 3d reconstruction based on externally uncalibrated cameras. In: IEEE Symposium on Computer Vision, Coral Gables, FL (1995)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer London

About this chapter

Cite this chapter

Mezouar, Y. (2010). A Variational Approach to Trajectory Planning in Visual Servoing. In: Chesi, G., Hashimoto, K. (eds) Visual Servoing via Advanced Numerical Methods. Lecture Notes in Control and Information Sciences, vol 401. Springer, London. https://doi.org/10.1007/978-1-84996-089-2_7

Download citation

  • DOI: https://doi.org/10.1007/978-1-84996-089-2_7

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-84996-088-5

  • Online ISBN: 978-1-84996-089-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics