Reinforcement Learning Based UAV Trajectory and Power Control Against Jamming
- 701 Downloads
Unmanned aerial vehicles (UAVs) are vulnerable to jamming attacks that aim to interrupt the communications between the UAVs and ground nodes and to prevent the UAVs from completing their sensing duties. In this paper, we design a reinforcement learning based UAV trajectory and power control scheme against jamming attacks without knowing the ground node and jammer locations, the UAV channel model and jamming model. By evaluating the UAV transmission quality obtained from the feedback channel and the UAV channel condition, this scheme uses reinforcement learning to choose the UAV trajectory and transmit power based on the UAV location, signal-to-interference-and-noise ratio of the previous sensing data signal received by the ground node, and the radio channel state. Simulation results show that this scheme improves the quality of service of the UAV sensing duty given the required UAV waypoints and saves the UAV energy consumption.
KeywordsUnmanned aerial vehicle Jamming Trajectory control Power control Reinforcement learning
This paper was in part supported by the National Natural Science Foundation of China (Grants No. 61671396 and No. 61971366), the Natural Science Foundation of Fujian Province, China (Grant No. 2019J01843), the open research fund of National Mobile Communications Research Laboratory, Southeast University (No. 2018D08) and the Fundamental Research Funds for the Central Universities of China (No. 20720190034).
- 1.Bhattacharya, S., Başar, T.: Game-theoretic analysis of an aerial jamming attack on a UAV communication network. In: Proceedings of the American Control Conference, Baltimore, MD, pp. 818–823, June/July 2010Google Scholar
- 2.Bhunia, S., Sengupta, S.: Distributed adaptive beam nulling to mitigate jamming in 3D UAV mesh networks. In: Proceedings of the IEEE International Conference on Computing Networking Communication (ICNC), Santa Clara, CA, pp. 120–125, January 2017Google Scholar
- 3.Gwon, Y., Dastangoo, S., Fossa, C., Kung, H.: Competing mobile network game: Embracing antijamming and jamming strategies with reinforcement learning. In: Proceedings of the IEEE Conference on Communication Network Security (CNS), National Harbor, MD, pp. 28–36, October 2013Google Scholar
- 4.Han, G., Xiao, L., Poor, H.V.: Two-dimensional anti-jamming communication based on deep reinforcement learning. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), New Orleans, LA, March 2017Google Scholar
- 5.Kingston, D., Rasmussen, S., Humphrey, L.: Automated UAV tasks for search and surveillance. In: IEEE Conference on Control Application (CCA), Buenos Aires, Argentina, pp. 1–8, September 2016Google Scholar
- 6.Lv, S., Xiao, L., Hu, Q., Wang, X., Hu, C., Sun, L.: Anti-jamming power control game in unmanned aerial vehicle networks. In: Proceedings of the IEEE Global Communication Conference (GLOBECOM), Singapore, pp. 1–6, December 2017Google Scholar
- 8.Roldán, J.J., del Cerro, J., Barrientos, A.: A proposal of methodology for multi-UAV mission modeling. In: Proceedings of the IEEE Mediterranean Conference on Control Automation (MED), Torremolinos, Spain, pp. 1–7, June 2015Google Scholar