Skip to main content
SpringerLink
Log in

Computer Vision Onboard UAVs for Civilian Tasks

  • Chapter
Unmanned Aircraft Systems

Abstract

Computer vision is much more than a technique to sense and recover environmental information from an UAV. It should play a main role regarding UAVs’ functionality because of the big amount of information that can be extracted, its possible uses and applications, and its natural connection to human driven tasks, taking into account that vision is our main interface to world understanding. Our current research’s focus lays on the development of techniques that allow UAVs to maneuver in spaces using visual information as their main input source. This task involves the creation of techniques that allow an UAV to maneuver towards features of interest whenever a GPS signal is not reliable or sufficient, e.g. when signal dropouts occur (which usually happens in urban areas, when flying through terrestrial urban canyons or when operating on remote planetary bodies), or when tracking or inspecting visual targets—including moving ones—without knowing their exact UMT coordinates. This paper also investigates visual servoing control techniques that use velocity and position of suitable image features to compute the references for flight control. This paper aims to give a global view of the main aspects related to the research field of computer vision for UAVs, clustered in four main active research lines: visual servoing and control, stereo-based visual navigation, image processing algorithms for detection and tracking, and visual SLAM. Finally, the results of applying these techniques in several applications are presented and discussed: this study will encompass power line inspection, mobile target tracking, stereo distance estimation, mapping and positioning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Puri, A., Valavanis, K.P., Kontitsis, M.: Statistical profile generation for traffic monitoring using real-time UAV based video data. In: Control and Automation, 2007. MED ’07. Mediterranean Conference on, MED, pp. 1–6 (2007)

    Google Scholar 

  2. Nikolos, I.K., Tsourveloudis, N.C., Valavanis, K.P.: Evolutionary algorithm based path planning for multiple UAV cooperation. In: Advances in Unmanned Aerial Vehicles, Intelligent Systems, Control and Automation: Science and Engineering, pp. 309–340. Springer, The Netherlands (2007)

    Chapter  Google Scholar 

  3. Nikolos, I.K., Tsourveloudis, N.C., Valavanis, K.P.: A UAV vision system for airborne surveillance. In: Robotics and Automation, 2004. Proceedings. ICRA ’04. 2004 IEEE International Conference on, pp. 77–83. New Orleans, LA, USA (2004), May

    Google Scholar 

  4. Nikolos, I.K., Tsourveloudis, N.C., Valavanis, K.P.: Multi-UAV experiments: application to forest fires. In: Multiple Heterogeneous Unmanned Aerial Vehicles, Springer Tracts in Advanced Robotics, pp. 207–228. Springer, Berlin (2007)

    Google Scholar 

  5. Green, W., Oh, P.Y.: The integration of a multimodal mav and biomimetic sensing for autonomous flights in near-earth environments. In: Advances in Unmanned Aerial Vehicles, Intelligent Systems, Control and Automation: Science and Engineering, pp. 407–430. Springer, The Netherlands (2007)

    Chapter  Google Scholar 

  6. Belloni, G., Feroli, M., Ficola, A., Pagnottelli, S., Valigi, P.: Obstacle and terrain avoidance for miniature aerial vehicles. In: Advances in Unmanned Aerial Vehicles, Intelligent Systems, Control and Automation: Science and Engineering, pp. 213–244. Springer, The Netherlands (2007)

    Google Scholar 

  7. Dalamagkidis, K., Valavanis, K.P., Piegl, L.A.: Current status and future perspectives for unmanned aircraft system operations in the US. In: Journal of Intelligent and Robotic Systems, pp. 313–329. Springer, The Netherlands (2007)

    Google Scholar 

  8. Long, L.N., Corfeld, K.J., Strawn, R.C.: Computational analysis of a prototype martian rotorcraft experiment. In: 20th AIAA Applied Aerodynamics Conference, number AIAA Paper 2002–2815, Saint Louis, MO, USA. Ames Research Center, June–October 22 (2001)

    Google Scholar 

  9. Yavrucuk, I., Kanan, S., Kahn, A.D.: Gtmars—flight controls and computer architecture. Technical report, School of Aerospace Engineering, Georgia Institute of Technology, Atlanta (2000)

    Google Scholar 

  10. Buenaposada, J.M., Munoz, E., Baumela, L.: Tracking a planar patch by additive image registration. In: Proc. of International Workshop, VLBV 2003, vol. 2849 of LNCS, pp. 50–57 (2003)

    Google Scholar 

  11. Miller, R., Mettler, B., Amidi, O.: Carnegie mellon university’s 1997 international aerial robotics competition entry. In: International Aerial Robotics Competition (1997)

    Google Scholar 

  12. Montgomery, J.F.: The usc autonomous flying vehicle (afv) project: Year 2000 status. Technical Report IRIS-00-390, Institute for Robotics and Intelligent Systems Technical Report, Los Angeles, CA, 90089-0273 (2000)

    Google Scholar 

  13. Saripalli, S., Montgomery, J.F., Sukhatme, G.S.: Visually-guided landing of an unmanned aerial vehicle. IEEE Trans. Robot Autom. 19(3), 371–381, June (2003)

    Article  Google Scholar 

  14. Mejias, L.: Control visual de un vehiculo aereo autonomo usando detección y seguimiento de características en espacios exteriores. PhD thesis, Escuela Técnica Superior de Ingenieros Industriales. Universidad Politécnica de Madrid, Spain, December (2006)

    Google Scholar 

  15. Mejias, L., Saripalli, S., Campoy, P., Sukhatme, G.: Visual servoing approach for tracking features in urban areas using an autonomous helicopter. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 2503–2508, Orlando, FL, May (2006)

    Google Scholar 

  16. Mejias, L., Saripalli, S., Sukhatme, G., Campoy, P.: Detection and tracking of external features in a urban environment using an autonomous helicopter. In: Proceedings of IEEE International Conference on Robotics and Automation, pp. 3983–3988, May (2005)

    Google Scholar 

  17. Mejias, L., Saripalli, S., Campoy, P., Sukhatme, G.: Visual servoing of an autonomous helicopter in urban areas using feature tracking. J. Field Robot. 23(3–4), 185–199, April (2006)

    Article  Google Scholar 

  18. Harris, C.G., Stephens, M.: A combined corner and edge detection. In: Proceedings of the 4th Alvey Vision Conference, pp. 147–151 (1988)

    Google Scholar 

  19. Lowe, D.G.: Distintive image features from scale-invariant keypoints. Int. J. Computer Vision 60(2), 91–110 (2004)

    Article  Google Scholar 

  20. Duda, R.O., Hart, P.E.: Use of the hough transformation to detect lines and curves in pictures. Commun. ACM 15(1), 11–15 (1972)

    Article  Google Scholar 

  21. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Machine Intel. 8(6), 679–698, November (1986)

    Article  Google Scholar 

  22. Feldman, G., Sobel, I.: A 3 × 3 isotropic gradient operator for image processing. Presented at a talk at the Stanford Artificial Project (1968)

    Google Scholar 

  23. Mejías, L., Mondragón, I., Correa, J.F., Campoy, P.: Colibri: Vision-guided helicopter for surveillance and visual inspection. In: Video Proceedings of IEEE International Conference on Robotics and Automation, Rome, Italy, April (2007)

    Google Scholar 

  24. Lucas, B.D., Kanade, T.: An iterative image registration technique with an application to stereo vision. In: Proc. of the 7th IJCAI, pp. 674–679, Vancouver, Canada (1981)

    Google Scholar 

  25. Beis, J.S., Lowe, D.G.: Shape indexing using approximate nearest-neighbour search in high-dimensional spaces. In: CVPR ’97: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition (CVPR ’97), p. 1000. IEEE Computer Society, Washington, DC, USA (1997)

    Chapter  Google Scholar 

  26. Fischer, M.A., Bolles, R.C.: Random sample concensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)

    Article  Google Scholar 

  27. Baker, S., Matthews, I.: Lucas-kanade 20 years on: A unifying framework: Part 1. Technical Report CMU-RI-TR-02-16, Robotics Institute, Carnegie Mellon University, Pittsburgh, PA, July (2002)

    Google Scholar 

  28. Mejias, L., Campoy, P., Mondragon, I., Doherty, P.: Stereo visual system for autonomous air vehicle navigation. In: 6th IFAC Symposium on Intelligent Autonomous Vehicles (IAV 07), Toulouse, France, September (2007)

    Google Scholar 

  29. Martin, J., Crowley, J.: Experimental comparison of correlation techniques. Technical report, IMAG-LIFIA, 46 Av. Félix Viallet 38031 Grenoble, France (1995)

    Google Scholar 

  30. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: Speeded Up Robust Features. In: Proceedings of the Ninth European Conference on Computer Vision, May (2006)

    Google Scholar 

  31. Montiel, J.M.M., Civera, J., Davison, A.J.: Unified inverse depth parametrization for monocular slam. In: Robotics: Science and Systems (2006)

    Google Scholar 

  32. Civera, J., Davison, A.J., Montiel, J.M.M.: Dimensionless monocular slam. In: IbPRIA, pp. 412–419 (2007)

    Google Scholar 

  33. COLIBRI. Universidad Politécnica de Madrid. Computer Vision Group. COLIBRI Project. http://www.disam.upm.es/colibri (2005)

Download references

Author information

Authors and Affiliations

  1. Computer Vision Group, Universidad Politécnica Madrid, Jose Gutierrez Abascal 2, 28006, Madrid, Spain

    Pascual Campoy, Juan F. Correa, Ivan Mondragón, Carol Martínez, Miguel Olivares & Jorge Artieda

  2. Australian Research Centre for Aerospace Automation (ARCAA), School of Engineering Systems, Queensland University of Technology, GPO Box 2434, Brisbane, 4000, Australia

    Luis Mejías

Authors
  1. Pascual Campoy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juan F. Correa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ivan Mondragón
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Carol Martínez
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Miguel Olivares
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Luis Mejías
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Jorge Artieda
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pascual Campoy .

Editor information

Editors and Affiliations

  1. Dept. Computer Science & Engineering, University of South Florida, 4202 E. Fowler Ave., Tampa, FL, 33620, USA

    Kimon P. Valavanis  & Les A. Piegl  & 

  2. Applied Engineering Technology, Drexel University, 3001 One Drexel Plaza, Market St., Philadelphia, PA, 19104, USA

    Paul Oh

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer Science + Business Media B.V.

About this chapter

Cite this chapter

Campoy, P. et al. (2008). Computer Vision Onboard UAVs for Civilian Tasks. In: Valavanis, K.P., Oh, P., Piegl, L.A. (eds) Unmanned Aircraft Systems. Springer, Dordrecht. https://doi.org/10.1007/978-1-4020-9137-7_8

Download citation

Publish with us

Policies and ethics

Search

Navigation