Choosing the Best Embedded Processing Platform for On-Board UAV Image Processing

  • Dries HulensEmail author
  • Jon Verbeke
  • Toon Goedemé
Part of the Communications in Computer and Information Science book series (CCIS, volume 598)


Nowadays, complex image processing algorithms are a necessity to make UAVs more autonomous. Currently, the processing of images of the on-board camera is often performed on a ground station, thus severely limiting the operating range. On-board processing has numerous advantages, however determining a good trade-off between speed, power consumption and weight of a specific hardware platform for on-board processing is hard. Many hardware platforms exist, and finding the most suited one for a specific vision algorithm is difficult. We present a framework that automatically determines the most-suited hardware platform given an arbitrary complex vision algorithm. Our framework estimates the speed, power consumption and flight time of this algorithm for multiple hardware platforms on a specific UAV. We demonstrate this methodology on two real-life cases and give an overview of the present top performing CPU-based platforms for on-board UAV image processing.


UAV Vision On-board Real-time Speed estimation Power estimation Flight time estimation 



This work is funded by KU Leuven via the CAMETRON project.


  1. 1.
    Dries, H., Maarten, V.: UAV autonoom laten vliegen in een boomgaard. College University Lessius, Department of Industrial Engineering (2012)Google Scholar
  2. 2.
    Paul, V., Michael, J.: Rapid object detection using a boosted cascade of simple features. Comput. Vis. Pattern Recogn. 1, 511–518 (2001)Google Scholar
  3. 3.
    Prouty, R.W.: Helicopter Performance, Stability, and Control. Krieger, Malabar (1995)Google Scholar
  4. 4.
    Verbeke, J., Hulens, D., Ramon, H., Goedemé, T., De Schutter, J.: The design and construction of a high endurance hexacopter suited for narrow corridor (2014)Google Scholar
  5. 5.
    Theys, B., Dimitriadis, G., Andrianne, T., Hendrick, P., De Schutter, J.: Wind tunnel testing of a VTOL MAV propeller in tilted operating mode. In: ICUAS (2014)Google Scholar
  6. 6.
    Shoaib, E., McDonald-Maier, K.D.: On-board vision processing for small UAVs: time to rethink strategy. In: NASA/ESA Conference on Adaptive Hardware and Systems (2009)Google Scholar
  7. 7.
    Taro, S., Yoshiharu, A., Takumi, H.: Development of a SIFT based monocular EKF-SLAM algorithm for a small unmanned aerial vehicle. In: SICE Annual Conference (SICE) (2011)Google Scholar
  8. 8.
    Lorenz, M., Petri, T., Friedrich, F., Marc, P.: Pixhawk: a system for autonomous flight using onboard computer vision. In: IEEE International Conference on Robotics and Automation (ICRA) (2011)Google Scholar
  9. 9.
    Wenzel, K.E., Masselli, A., Zell, A.: Automatic take off, tracking and landing of a miniature UAV on a moving carrier vehicle. Journal of intelligent & robotic systems 61, 221–238 (2011)CrossRefGoogle Scholar
  10. 10.
    McGee, T.G., Raja, S., Karl, H.: Obstacle detection for small autonomous aircraft using sky segmentation. In: Proceedings of the 2005 IEEE International Conference on Robotics and Automation, ICRA 2005 (2005)Google Scholar
  11. 11.
    Kok, J., Gonzalez, L.F., Kelson, N.: FPGA implementation of an evolutionary algorithm for autonomous unmanned aerial vehicle on-board path planning. In: IEEE Transactions on Evolutionary Computation (2013)Google Scholar
  12. 12.
    Siebert, S., Teizer, J.: Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system. Autom. Constr. 41, 1–14 (2014)CrossRefGoogle Scholar
  13. 13.
    Allen, F., Jesse, F., Edward, V., Lee Gregory, S.: UAV obstacle avoidance using image processing techniques. In: IEEE International Conference on Technologies for Practical Robot Applications (TePRA) (2012)Google Scholar
  14. 14.
    Yucong, L., Srikanth, S.: Path planning using 3D dubins curve for unmanned aerial vehicles. In: International Conference on Unmanned Aircraft Systems (ICUAS) (2014)Google Scholar
  15. 15.
    David, A., Sebastian, E., Aaron, L., Carrick, D.: On crop height estimation with UAVs. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014) (2014)Google Scholar
  16. 16.
    Matthias, N., Sven, B.: Hierarchical planning with 3D local multiresolution obstacle avoidance for micro aerial vehicles. In: Proceedings of the Joint International Symposium on Robotics (ISR) and the German Conference on Robotics (ROBOTIK) (2014)Google Scholar
  17. 17.
    Inkyu, S., Stefan, H., Peter, C.: Inspection of pole-like structures using a vision-controlled VTOL UAV and shared autonomy. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2014) (2014)Google Scholar
  18. 18.
    Shaojie, S., Yash, M., Nathan, M., Vijay, K.: Vision-based state estimation and trajectory control towards high-speed flight with a quadrotor. Robotics: Science and Systems (2013)Google Scholar
  19. 19.
    Christophe, D.W., Sjoerd, T., Remes Bart, D.W., de Croon Guido, C.H.E.: Autonomous flight of a 20-gram flapping wing MAV with a 4-gram onboard stereo vision system. In: IEEE International Conference on Robotics and Automation (ICRA) (2014)Google Scholar
  20. 20.
    Christian, F., Matia, P., Daviden, S.: SVO: fast semi-direct monocular visual odometry. In: Proceedings of the IEEE International Conference on Robotics and Automation (2014)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.EAVISEKU LeuvenLeuvenBelgium
  2. 2.Department of EngineeringKU LeuvenLeuvenBelgium

Personalised recommendations