PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision
- 5.9k Downloads
We describe a novel quadrotor Micro Air Vehicle (MAV) system that is designed to use computer vision algorithms within the flight control loop. The main contribution is a MAV system that is able to run both the vision-based flight control and stereo-vision-based obstacle detection parallelly on an embedded computer onboard the MAV. The system design features the integration of a powerful onboard computer and the synchronization of IMU-Vision measurements by hardware timestamping which allows tight integration of IMU measurements into the computer vision pipeline. We evaluate the accuracy of marker-based visual pose estimation for flight control and demonstrate marker-based autonomous flight including obstacle detection using stereo vision. We also show the benefits of our IMU-Vision synchronization for egomotion estimation in additional experiments where we use the synchronized measurements for pose estimation using the 2pt+gravity formulation of the PnP problem.
KeywordsMicro aerial vehicles Quadrotor Computer vision Stereo vision
We would like to thank our students (in alphabetical order) Bastian Bücheler, Andi Cortinovis, Christian Dobler, Dominik Honegger, Fabian Landau, Laurens Mackay, Tobias Nägeli, Philippe Petit, Martin Rutschmann, Amirehsan Sarabadani, Christian Schluchter and Oliver Scheuss for their contributions to the current system and the students of the previous semesters for the foundations they provided. Raffaello d’Andrea and Sergei Lupashin (ETH IDSC) provided valuable feedback.
This work was supported in part by the European Community’s Seventh Framework Programme (FP7/2007-2013) under grant #231855 (sFly) and by the Swiss National Science Foundation (SNF) under grant # 200021-125017.
<Pixhawk_Alpha_Autonomous.avi: This video shows one of the first autonomous flights using computer vision localization with ARToolkit+ markers. It shows the general flight behaviour of our vision based system. The MAV is not thetered, images are fully processed online. The MAV flies several rounds, defined by pre-set waypoints.> (AVI 11.3 MB)
- Bouabdallah, S., Murrieri, P., & Siegwart, R. (2004). Design and control of an indoor micro quadrotor. In Proceedings of int. conf. on robotics and automation. URL http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.89.842. Google Scholar
- Conte, G., & Doherty, P. (2008). An integrated UAV navigation system based on aerial image matching. In Proceedings of the IEEE aerospace conference. URL http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.119.3963&rep=rep1&type=pdf. Google Scholar
- Fowers, S., Lee, D. J., Tippetts, B., Lillywhite, K., Dennis, A., & Archibald, J. (2007). Vision aided stabilization and the development of a quad-rotor micro UAV. In International symposium on computational intelligence in robotics and automation, 2007. CIRA 2007 (pp. 143–148). doi: 10.1109/CIRA.2007.382886 CrossRefGoogle Scholar
- Hofiann, G., Rajnarqan, D., & Waslander, S. (2004). The Stanford testbed of autonomous rotorcraft for multi agent control (starmac). In Proceedings of digital avionics systems conference (DASC04). URL http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1390847. Google Scholar
- Kemp, C. (2006). Visual control of a miniature quad-rotor helicopter. Ph.D. thesis, Churchill College, University of Cambridge. Google Scholar
- Kukelova, Z., Bujnak, M., & Pajdla, T. (2010). Closed-form solutions to the minimal absolute pose problems with known vertical direction. In ACCV. Google Scholar
- Kukelova, Z., Bujnak, M., & Pajdla, T. (2011). Closed-form solutions to minimal absolute pose problems with known vertical direction. In Computer vision–ACCV 2010. URL http://www.springerlink.com/index/M012M78244081306.pdf. Google Scholar
- Mellinger, D., & Kumar, V. (2011). Minimum snap trajectory generation and control for quadrotors. In Proceedings of the IEEE international conference on robotics and automation (ICRA). Google Scholar
- Mellinger, D., Shomin, M., Michael, N., & Kumar, V. (2010). Cooperative grasping and transport using multiple quadrotors. In Proceedings of the international symposium on distributed autonomous robotic systems. Google Scholar
- Montemerlo, M., Roy, N., & Thrun, S. (2003). Perspectives on standardization in mobile robot programming: the Carnegie Mellon navigation (Carmen) toolkit. In Intelligent robots and systems, 2003. (IROS 2003). Proceedings. 2003 IEEE/RSJ international conference on (vol. 3, pp. 2436–2441). doi: 10.1109/IROS.2003.1249235. CrossRefGoogle Scholar
- Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., & Ng, A. (2009). Ros: An open-source robot operating system. Google Scholar
- Roy, N., He, R., Bachrach, A., & Achtelik, M. (2009). On the design and use of a micro air vehicle to track and avoid adversaries. International Journal of Robotics Research. URL http://ijr.sagepub.com/cgi/content/abstract/29/5/529.
- Wagner, D., & Schmalstieg, D. (2007). Artoolkitplus for pose tracking on mobile devices. In Proceedings of 12th computer vision winter workshop. URL http://www.icg.tu-graz.ac.at/Members/daniel/ARToolKitPlusMobilePoseTracking. Google Scholar