Skip to main content

Vision and IMU Data Fusion: Closed-Form Determination of the Absolute Scale, Speed, and Attitude

  • Reference work entry
Handbook of Intelligent Vehicles

Abstract

This chapter describes an algorithm for determining the speed and the attitude of a sensor assembling constituted by a monocular camera and inertial sensors (three orthogonal accelerometers and three orthogonal gyroscopes). The system moves in a 3D unknown environment. The algorithm inputs are the visual and inertial measurements during a very short time interval. The outputs are the speed and attitude, the absolute scale and the bias affecting the inertial measurements. The determination of these outputs is obtained by a simple closed-form solution which analytically expresses the previous physical quantities in terms of the sensor measurements. This closed-form determination allows performing the overall estimation in a very short time interval and without the need of any initialization or prior knowledge. This is a key advantage since allows eliminating the drift on the absolute scale and on the orientation. The performance of the proposed algorithm is evaluated with real experiments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 849.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 549.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ahrens S, Levine D, Andrews G, How JP (2009) Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments. In: IEEE international conference on robotics and automation (ICRA 2009). Kobe, May 2009

    Google Scholar 

  • Armesto L, Tornero J, Vincze M (2007) Fast ego-motion estimation with multi-rate fusion of inertial and vision. Int J Robot Res 26:577–589

    Article  Google Scholar 

  • Blosch M, Weiss S, Scaramuzza D, Siegwart R (2010) Vision based MAV navigation in unknown and unstructured environments. In: IEEE international conference on robotics and automation (ICRA 2010). Anchorage, May 2010

    Google Scholar 

  • Bryson M, Sukkarieh S (2007) Building a robust implementation of bearing-only inertial SLAM for a UAV. J Field Robot 24:113–143

    Article  Google Scholar 

  • Corke P, Lobo J, Dias J (2007) An introduction to inertial and visual sensing. Int J Robot Res 26:519–535

    Article  Google Scholar 

  • Dias J, Vinzce M, Corke P, Lobo J (2007) Editorial: special issue: 2nd workshop on integration of vision and inertial sensors. Int J Robot Res 26(6):515–517

    Article  Google Scholar 

  • Gemeiner P, Einramhof P, Vincze M (2007) Simultaneous motion and structure estimation by fusion of inertial and vision data. Int J Robot Res 26:591–605

    Article  Google Scholar 

  • Goldstein H (1980) Classical mechanics, 2nd edn. Addison-Wesley, Reading

    MATH  Google Scholar 

  • John F (1982) Partial differential equations. Springer, New York

    Google Scholar 

  • Kim J, Sukkarieh S (2007) Real-time implementation of airborne inertial-SLAM. Robot Auton Syst 55:62–71

    Article  Google Scholar 

  • Kuipers JB (1999) Quaternions and rotation sequences: a primer with applications to orbits, aerospace, and virtual reality. Princeton University Press, Princeton copyright

    MATH  Google Scholar 

  • Lobo J, Dias J (2007) Relative pose calibration between visual and inertial sensors. Int J Rob Res 26(6):561–575

    Article  Google Scholar 

  • Lupashin S, Schollig A, Sherback M, D'Andrea R (2010) A simple learning strategy for high-speed quadrocopter multi-flips. In: IEEE international conference on robotics and automation. Anchorage

    Google Scholar 

  • Martinelli A (2011a) State estimation based on the concept of continuous symmetry and observability analysis: the case of calibration. IEEE Trans Robot 27(2):239–255

    Article  Google Scholar 

  • Martinelli A (2011b) Closed-form solution for attitude and speed determination by fusing monocular vision and inertial sensor measurements, to be presented at the international conference on robotics and automation, ICRA 2011. Shanghai

    Google Scholar 

  • Martinelli A (2011c) Vision and IMU data fusion: closed-form solutions for attitude, speed, absolute scale and bias determination. IEEE Trans on Robot 28(1)

    Google Scholar 

  • Scaramuzza D, Martinelli A, Siegwart R (2006) A toolbox for easy calibrating omnidirectional cameras. In: Proceedings of the IEEE international conference on intelligent robots and systems (IROS 2006). Beijing, October 2006

    Google Scholar 

  • Veth M, Raquet J (2007) Fusing low-cost image and inertial sensors for passive navigation. NAVIGATION 54(1):11–20

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Agostino Martinelli .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag London Ltd.

About this entry

Cite this entry

Martinelli, A., Siegwart, R. (2012). Vision and IMU Data Fusion: Closed-Form Determination of the Absolute Scale, Speed, and Attitude. In: Eskandarian, A. (eds) Handbook of Intelligent Vehicles. Springer, London. https://doi.org/10.1007/978-0-85729-085-4_52

Download citation

Publish with us

Policies and ethics