Skip to main content
Log in

Vision algorithms for fixed-wing unmanned aerial vehicle landing system

  • Article
  • Published:
Science China Technological Sciences Aims and scope Submit manuscript

Abstract

Autonomous landing has become a core technology of unmanned aerial vehicle (UAV) guidance, navigation and control system in recent years. As a novel autonomous landing approach, computer vision has been studied and applied in rotary-wing UAV landing successfully. This paper aims to fixed-wing UAV and focus on two problems: how to find runway only depending on airborne front-looking camera and how to align UAV with the designated landing runway. The paper can be divided into two parts to solve above two problems respectively. In the first part, the paper firstly presents an algorithm of region of interest (ROI) detection, which is based on spectral residual saliency map, and then an algorithm of feature vector extraction based on sparse coding and spatial pyramid matching (SPM) is proposed, finally, ROI including designated landing runway is recognized by a linear support vector machine. In the second part, the paper presents an approach of relative position and pose estimation between UAV and landing runway. Estimation algorithm firstly selects five feature points on the runway surface, and then establishes a new earth-fixed reference frame, finally uses orthogonal iteration to estimate landing parameters including three parameters of distance, height and offset, and three pose parameters of roll, yaw, pitch. The experimental results verify the effectiveness of the algorithms proposed in this paper.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Eisen N D, Gagne A, Stutsman R, et al. Low-cost autonomous landing of a midsize fixed-wing UAV. Technical Report. Pennsylvania: University of Pennsylvania, 2014

    Google Scholar 

  2. Duan H, Li H, Luo Q, et al. A binocular vision-based UAVs autonomous aerial refueling platform. Sci China Inf Sci, 2016, 59: 053201

    Article  Google Scholar 

  3. Sanchez-Lopez J L, Pestana J, Saripalli S, et al. An approach toward visual autonomous ship board landing of a VTOL UAV. J Intell Robot Syst, 2014, 74: 113–127

    Article  Google Scholar 

  4. Tang D, Hu T, Shen L, et al. Ground stereo vision-based navigation for autonomous take-off and landing of UAVs: A chan-vese model approach. Int J Adv Robot Syst, 2016, doi: 10.5772/62027

    Google Scholar 

  5. Ma Z, Hu T, Shen L. Stereo vision guiding for the autonomous landing of fixed-wing UAVs: A saliency-inspired approach. Int J Adv Robot Syst, 2016, doi: 10.5772/62257

    Google Scholar 

  6. Kim J, Lee S, Choi S, et al. Fully automatic taxiing, takeoff and landing of a UAV using a single-antenna GPS receiver only. In: International Conference on Control, Automation and Systems. IEEE, 2007. 821–825

    Google Scholar 

  7. Lange S, Sünderhauf N, Protzel P. Autonomous landing for a multirotor UAV using vision. In: Workshop Proceedings of SIMPAR 2008, Venice, Italy, 2008. 482–491

    Google Scholar 

  8. Vegula S K, Kashyap S K, Shanthakumar N. Detection of runway and obstacles using electro-optical and infrared sensors before landing. Defence Sci J, 2014, 64: 67–76

    Article  Google Scholar 

  9. Kim H J, Kim M, Lim H, et al. Fully autonomous vision-based netrecovery landing system for a fixed-wing UAV. IEEE/ASME Trans Mechatron, 2013, 18: 1320–1333

    Article  Google Scholar 

  10. Yang Z Z, Zhou J L, Lang F N. Detection algorithm of airport runway in remote sensing images. Telkomnika Indonesian Journal of Electrical Engineering, 2014, 12: 2776–2783

    Google Scholar 

  11. Aytekin Ö, Zongur U, Halici U. Texture-based airport runway detection. IEEE Geosci Remote Sens Lett, 2013, 10: 471–475

    Article  Google Scholar 

  12. Alexe B, Deselaers T, Ferrari V. Measuring the objectness of image windows. IEEE Trans Pattern Anal Mach Intell, 2012, 34: 2189–2202

    Article  Google Scholar 

  13. Kang H W, Hebert M, Efros A A, et al. Data-drive objectness. IEEE Trans Pattern Anal Mach Intell, 2014, 37: 189–195

    Article  Google Scholar 

  14. Hou X D, Zhang L. Saliency detection: A spectral residual approach. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2007

    Google Scholar 

  15. Li J, Duan L Y, Chen X, et al. Finding the secret of image saliency in the frequency domain. IEEE Trans Pattern Anal Mach Intell, 2015, 37: 2428–2440

    Article  Google Scholar 

  16. Yang J C, Yu K, Gong Y H, et al. Linear spatial pyramid matching using sparse coding for image classification. In: IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2009

    Google Scholar 

  17. Ding M, Wei L, Wang B. Vision-based estimation of relative pose in autonomous aerial refueling. Chin J Aeronautics, 2011, 24: 807–815

    Article  Google Scholar 

  18. Lu C P, Hager G D, Mjolsness E. Fast and globally convergent pose estimation from video images. IEEE Trans Pattern Anal Machine Intell, 2000, 22: 610–622

    Article  Google Scholar 

  19. Qiu H X, Duan H B. Multi-objective pigeon-inspired optimization for brushless direct current motor parameter design. Sci China Tech Sci, 2015, 58: 1915–1923

    Article  Google Scholar 

  20. Sun C H, Duan H B. Markov decision evolutionary game theoretic learning for cooperative sensing of unmanned aerial vehicles. Sci China Tech Sci, 2015, 58: 1392–1400

    Article  Google Scholar 

  21. Zhu Z S, Su A, Liu H B, et al. Vision navigation for aircrafts based on 3D reconstruction from real-time image sequences. Sci China Tech Sci, 2015, 58: 1196–1208

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to YanMing Fan.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Fan, Y., Ding, M. & Cao, Y. Vision algorithms for fixed-wing unmanned aerial vehicle landing system. Sci. China Technol. Sci. 60, 434–443 (2017). https://doi.org/10.1007/s11431-016-0618-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11431-016-0618-3

Keywords

Navigation