Skip to main content

Efficient Algorithms for Indoor MAV Flight Using Vision and Sonar Sensors

  • Conference paper
  • First Online:
Advances in Visual Computing (ISVC 2015)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 9474))

Included in the following conference series:

  • 2848 Accesses

Abstract

This work describes an efficient perception-control coupled system and its underlying algorithms that enable autonomous exploration of indoor environments by a Micro Aerial Vehicle (MAV) equipped with a monocular camera and sonar sensors. The perception subsystem uses inputs from the camera to detect the vanishing point and doors in corridors. It detects the vanishing point by grid-based line-intersection voting (GLV) and Mixture-of-Gaussians (MoG)-based classification, while doors are detected by using simple but effective geometric scene properties (GSP) with template matching and temporal filtering. It also detects distance to obstacles, for example walls, using inputs from one forward-looking and two side-looking sonar sensors. These algorithms are accurate, computationally efficient, and suitable for real-time operation on offboard and onboard power-constrained computing platforms. The control subsystem employs a priority-based planner that combines outputs from the perception subsystem to compute high-level direction and velocity commands for the MAV. We evaluate our perception-control system on a commercially available AR.Drone 2.0 MAV with offboard processing and successfully demonstrate collision-free autonomous exploration and flight in building corridors and rooms at approximately 2 m/s speed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Forney, G.D.: The Viterbi algorithm. Proc. IEEE 61(3), 268–278 (1973)

    Article  MathSciNet  Google Scholar 

  2. Yang, X., Tian, Y.: Robust door detection in unfamiliar environments by combining edge and corner features. In: Proceedings of the 3rd Workshop on Computer Vision Applications for the Visually Impaired (CVAVI) (2010)

    Google Scholar 

  3. Hensler, J., Blaich, M., Bittel, O.: Real-time door detection based on AdaBoost learning algorithm. In: Gottscheber, A., Obdržálek, D., Schmidt, C. (eds.) EUROBOT 2009. CCIS, vol. 82, pp. 61–73. Springer, Heidelberg (2010)

    Chapter  Google Scholar 

  4. Lee, J.-S., Doh, N.L. Chung, W.K., You, B.-J., Youm, Y.: Door detection algorithm of mobile robot in hallway using PC-camera. In: International Symposium on Automation and Robotics in Construction (2004)

    Google Scholar 

  5. Murillo, A.C., Košecká, J., Guerrero, J.J., Sagüés, C.: Visual door detection integrating appearance and shape cues. Robot. Auton. Syst. 56(6), 512–521 (2008)

    Article  Google Scholar 

  6. Parrot AR.Drone 2.0. http://ardrone2.parrot.com/

  7. Ranft, B., Dugelay, J.-L., Apvrille, L.: 3D perception for autonomous navigation of a low-cost MAV using minimal landmarks. In: Proceedings of IMAV (2013)

    Google Scholar 

  8. Soundararaj, S.P., Sujeeth, A.K., Saxena, A.: Autonomous indoor helicopter flight using a single onboard camera. In: Proceedings of IROS (2009)

    Google Scholar 

  9. Eckert, J., German, R., Dressler, F.: On autonomous indoor flights: high-quality real-time localization using low-cost sensors. In: Proceedings of IEEE International Conference on Communications (ICC) (2012)

    Google Scholar 

  10. Briod, A., Zufferey, J.-C., Floreano, D.: Optic-flow based control of a 46 g quadrotor. In: Proceedings of IROS (2013)

    Google Scholar 

  11. Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 8(6), 679–698 (1986)

    Article  Google Scholar 

  12. Bills, C., Chen, J., Saxena, A.: Autonomous MAV flight in indoor environments using single image perspective cues. In: Proceedings of ICRA (2011)

    Google Scholar 

  13. Brunelli, R.: Template Matching Techniques in Computer Vision: Theory and Practice. Wiley, Hoboken (2009). ISBN 978-0-470-51706-2

    Google Scholar 

  14. Lowe, D.: Object recognition from local scale-invariant features. International Conference on Computer Vision, Corfu, Greece, pp. 1150–1157 (1999)

    Google Scholar 

  15. Bay, H., Tuytelaars, T., Van Gool, L.: SURF: speeded up robust features. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006, Part I. LNCS, vol. 3951, pp. 404–417. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

Download references

Acknowledgement

This material is based upon work supported by Defense Advanced Research Projects Agency under contract numbers W31P4Q-08-C-0264 and HR0011-09-C-0001. The views, opinions, and/or findings contained in this material are those of the authors and should not be interpreted as representing the official views or policies of the Department of Defense or the U.S. Government. Approved for Public Release, Distribution Unlimited.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kyungnam Kim .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Kim, K., Huber, D.J., Xu, J., Khosla, D. (2015). Efficient Algorithms for Indoor MAV Flight Using Vision and Sonar Sensors. In: Bebis, G., et al. Advances in Visual Computing. ISVC 2015. Lecture Notes in Computer Science(), vol 9474. Springer, Cham. https://doi.org/10.1007/978-3-319-27857-5_38

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-27857-5_38

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-27856-8

  • Online ISBN: 978-3-319-27857-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics