A POMDP Framework for Coordinated Guidance of Autonomous UAVs for Multitarget Tracking

  • Scott A. Miller
  • Zachary A. Harris
  • Edwin K.P. Chong
Open Access
Research Article
Part of the following topical collections:
  1. Signal Processing Advances in Robots and Autonomy


This paper discusses the application of the theory of partially observable Markov decision processes (POMDPs) to the design of guidance algorithms for controlling the motion of unmanned aerial vehicles (UAVs) with onboard sensors to improve tracking of multiple ground targets. While POMDP problems are intractable to solve exactly, principled approximation methods can be devised based on the theory that characterizes optimal solutions. A new approximation method called nominal belief-state optimization (NBO), combined with other application-specific approximations and techniques within the POMDP framework, produces a practical design that coordinates the UAVs to achieve good long-term mean-squared-error tracking performance in the presence of occlusions and dynamic constraints. The flexibility of the design is demonstrated by extending the objective to reduce the probability of a track swap in ambiguous situations.


Approximation Method Unmanned Aerial Vehicle Tracking Performance Markov Decision Process Full Article 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Publisher note

To access the full article, please see PDF.

Copyright information

© Scott A. Miller et al. 2009

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Authors and Affiliations

  • Scott A. Miller
    • 1
  • Zachary A. Harris
    • 1
  • Edwin K.P. Chong
    • 2
  1. 1.Numerica CorporationLovelandUSA
  2. 2.Department of Electrical and Computer Engineering (ECE)Colorado State UniversityFort CollinsUSA

Personalised recommendations