Abstract
The ability to automate forced landings in an emergency such as engine failure is an essential ability to improve the safety of Unmanned Aerial Vehicles operating in General Aviation airspace. By using active vision to detect safe landing zones below the aircraft, the reliability and safety of such systems is vastly improved by gathering up-to-the-minute information about the ground environment. This paper presents the Site Detection System, a methodology utilising a downward facing camera to analyse the ground environment in both 2D and 3D, detect safe landing sites and characterise them according to size, shape, slope and nearby obstacles. A methodology is presented showing the fusion of landing site detection from 2D imagery with a coarse Digital Elevation Map and dense 3D reconstructions using INS-aided Structure-from-Motion to improve accuracy. Results are presented from an experimental flight showing the precision/recall of landing sites in comparison to a hand-classified ground truth, and improved performance with the integration of 3D analysis from visual Structure-from-Motion.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)
Comport, A., Malis, E., Rives, P.: Real-time Quadrifocal Visual Odometry. The International Journal of Robotics Research 1 (2010)
Davison, A.J., Reid, I.D., Molton, N.D., Stasse, O.: MonoSLAM: Real-Time Single Camera SLAM. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(6) (June 2007)
Garcia-Pardo, P.J., Sukhatme, G.S., Montgomery, J.F.: Towards Vision-Based Safe Landing for an Autonomous Helicopter. Robotics and Autonomous Systems 38 (January 2002)
Hoppe, H.: Poisson Surface Reconstruction and its Applications. In: ACM Symposium on Solid and Physical Modelling (2008)
Johnson, A., Montgomery, J., Matthies, L.: Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain. In: International Conference on Robotics and Automation. IEEE (2005)
Klein, G., Murray, D.: Parallel Tracking and Mapping for Small AR Workspaces. 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (November 2007)
Konolige, K., Agrawal, M., Sola, J.: Large Scale Visual Odometry for Rough Terrain. In: International Symposium on Robotics Research (2007)
McKinnon, D., Smith, R.N., Upcroft, B.: A Semi-Local Method for Iterative Depth-Map Refinement. In: International Conference on Robotics and Automation, ICRA (2012)
Mejias, L., Fitzgerald, D.: A Multi-Layered Approach for Site Detection in UAS Emergency Landing Scenarios Using Geometry-Based Image Segmentation. In: International Conference on Unmanned Aircraft Systems (ICUAS). IEEE (May 2013)
Mejias, L., Fitzgerald, D., Eng, P., Liu, X.: Forced Landing Technologies for Unmanned Aerial Vehicles: Towards Safer Operations. Aerial Vehicles (2009)
Newcombe, R., Lovegrove, S., Davison, A.: DTAM: Dense Tracking and Mapping in Real-Time. In: International Conference on Computer Vision (November 2011)
Pollefeys, M., Nistér, D., Frahm, J.-M., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S.-J., Merrell, P., Salmi, C., Sinha, S., Talton, B., Wang, L., Yang, Q., Stewénius, H., Yang, R., Welch, G., Towles, H.: Detailed Real-Time Urban 3D Reconstruction from Video. International Journal of Computer Vision 78(2-3) (October 2007)
Scaramuzza, D., Fraundorfer, F., Siegwart, R.: Real-Time Monocular Visual Odometry for On-Road Vehicles with 1-Point RANSAC. In: International Conference on Robotics and Automation, ICRA (2009)
Scherer, S., Chamberlain, L., Singh, S.: Autonomous Landing at Unprepared Sites by a Full-Scale Helicopter. Robotics and Autonomous Systems 60(12) (December 2012)
Shen, Y.-F., Rahman, Z.-U., Krusienski, D., Li, J.: A Vision-Based Automatic Safe Landing-Site Detection System. IEEE Transactions on Aerospace and Electronic Systems 49(1) (January 2013)
Warren, M., McKinnon, D., He, H., Glover, A., Shiel, M.: Large Scale Monocular Vision-only Mapping from a Fixed-Wing sUAS. In: Yoshida, K., Tadokoro, S. (eds.) Field and Service Robotics. STAR, vol. 92, pp. 495–509. Springer, Heidelberg (2014)
Warren, M., Upcroft, B.: High Altitude Stereo Visual Odometry. In: Proceedings of Robotics: Science and Systems (2013)
Warren, M., Upcroft, B.: Robust Scale Initialization for Long-Range Stereo Visual Odometry. In: IROS (2013)
Weiss, S.M.: Vision Based Navigation for Micro Helicopters. PhD thesis, Swiss Federal Institute of Technology (2012)
Yu, Z., Nonami, K.: 3D Vision Based Landing Control of a Small Scale Autonomous Helicopter. International Journal of Advanced Robotics Systems (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Warren, M., Mejias, L., Yang, X., Arain, B., Gonzalez, F., Upcroft, B. (2015). Enabling Aircraft Emergency Landings Using Active Visual Site Detection. In: Mejias, L., Corke, P., Roberts, J. (eds) Field and Service Robotics. Springer Tracts in Advanced Robotics, vol 105. Springer, Cham. https://doi.org/10.1007/978-3-319-07488-7_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-07488-7_12
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07487-0
Online ISBN: 978-3-319-07488-7
eBook Packages: EngineeringEngineering (R0)