Abstract
The quest to build smaller, more agile micro aerial vehicles has led the research community to address cameras and Inertial Measurement Units (IMUs) as the primary sensors for state estimation and autonomy. In this paper we present a monocular visual-inertial system (VINS) for an autonomous quadrotor which relies only on an inexpensive off-the-shelf camera and IMU, and describe a robust state estimator which allows the robot to execute trajectories at 2 m/s with roll and pitch angles of 20 degrees, with accelerations over 4 m/\(\text {s}^2\). The main innovations in the paper are an approach to estimate the vehicle motion without initialization and a method to determine scale and metric state information without encountering any degeneracy in real time.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Ascending Technologies, GmbH, http://www.asctec.de/.
- 2.
Robot Operating System, http://www.ros.org/.
- 3.
Vicon, http://www.vicon.com/.
References
Weiss, S., Achtelik, M.W., Lynen, S., Chli, M., Siegwart, R.: Real-time onboard visual-inertial state estimation and self-calibration of mavs in unknown environments. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 957–964. Saint Paul, MN, May 2012
Jones, E.S., Soatto, S.: Visual-inertial navigation, mapping and localization: a scalable real-time causal approach. Intl. J. Robot. Res. 30(4), 407–430 (2011)
Mourikis, A.I., Roumeliotis, S.I.: A multi-state constraint Kalman filter for vision-aided inertial navigation. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3565–3572. Roma, Italy, Apr 2007
Kelly, J., Sukhatme, G.S.: Visual-inertial sensor fusion: localization, mapping and sensor-to-sensor self-calibration. Intl. J. Robot. Res. 30(1), 56–79 (2011). January
Kottas, D.G., Hesch, J.A., Bowman, S.L., Roumeliotis, S.I.: On the consistency of vision-aided inertial navigation. In: Proceedings of the International Symposium on Experimental Robotics, Quebec, Canada, June 2012
Li, M., Mourikis, A.: High-precision, consistent ekf-based visual-inertial odometry. Int. J. Robot. Res 32(6), 690–711 (2013)
Kottas, D., Wu, K., Roumeliotis, S.: Detecting and dealing with hovering maneuvers in vision-aided inertial navigation systems. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan, Nov 2013 (To appear)
Sibley, G., Matthies, L., Sukhatme, G.: Sliding window filter with application to planetary landing. J. Field Robot. 27(5), 587–608 (2010)
Leutenegger, S., Furgale, P., Rabaud, V., Chli, M., Konolige, K., Siegwart, R.: Keyframe-based visual-inertial SLAM using nonlinear optimization. In: Proceedings of Robotics: Science and Systems, p. 0. Berlin, Germany June 2013
Indelman, V., Melim, A., Dellaert, F.: Incremental light bundle adjustment for robotics navigation. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1952–1959. Tokyo, Japan, Nov 2013
Lange, S., Sunderhauf, N., Protzel, P.: Incremental smoothing vs. filtering for sensor fusion on an indoor UAV. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 1773–1778. Karlsruhe, Germany, May 2013
Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proceedings of Sixth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’07), Nara, Japan, Nov 2007
Lupton, T., Sukkarieh, S.: Visual-inertial-aided navigation for high-dynamic motion in built environments without initial conditions. IEEE Trans. Robot. 28(1), 61–76 (2012)
Kneip, L., Weiss, S., Siegwart, R.: Deterministic initialization of metric state estimation filters for loosely-coupled monocular vision-inertial systems. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 2235–2241. San Francisco, CA, Sept 2011
Dong-Si, T., Mourikis, A.I.: Estimator initialization in vision-aided inertial navigation with unknown camera-IMU calibration. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1064–1071. Vilamoura, Algarve, Portugal, Oct 2012
Martinelli, A.: Vision and imu data fusion: Closed-form solutions for attitude, speed, absolute scale, and bias determination. IEEE Trans. Robot. 28(1), 44–60 (2012)
Martinelli, A.: Closed-form solution of visual-inertial structure from motion. IEEE Trans. Robot. (2013)
Lippiello, V., Mebarki, R.: Closed-form solution for absolute scale velocity estimation using visual and inertial data with a sliding least-squares estimation. In: Proceedings of Mediterranean Conference on Control and Automation, pp. 1261–1266. Platanias-Chania, Crete, Greece, June 2013
Martinec, D., Pajdla, T.: Robust rotation and translation estimation in multiview reconstruction. In: Proceedings of the IEEE International Conference on Pattern Recognition, pp. 1–8. Minneapolis, MN (2007)
Shen, S., Mulgaonkar, Y., Michael, N., Kumar, V.: Vision-based state estimation and trajectory control towards high-speed flight with a quadrotor. In: Proceedings of Robotics: Science and Systems. Berlin, Germany (2013)
Acknowledgments
We gratefully acknowledge support from ARL Micro Autonomous Systems and Technology Collaborative Technology Alliance Grant No. W911NF-08-2-0004.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Shen, S., Mulgaonkar, Y., Michael, N., Kumar, V. (2016). Initialization-Free Monocular Visual-Inertial State Estimation with Application to Autonomous MAVs. In: Hsieh, M., Khatib, O., Kumar, V. (eds) Experimental Robotics. Springer Tracts in Advanced Robotics, vol 109. Springer, Cham. https://doi.org/10.1007/978-3-319-23778-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-23778-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23777-0
Online ISBN: 978-3-319-23778-7
eBook Packages: EngineeringEngineering (R0)