Optimal Control of Data Transmission over a Fluctuating Channel with Unknown State
- 31 Downloads
Abstract—Optimization problem for data packet transmission over a communication channel governed by a hidden Markov process is considered. The transmitter is modeled as a single-channel finite-buffer queuing system with non-stationary Poisson arrivals. The service rate is proportional to the controlled transmission rate with channel-dependent factor. Buffer overflow leads to packet losses, whereas channel state worsening results in lower service rate. The goal of the optimization problem is to minimize average losses under constraint on the transmitter energy consumption. The exact form of the optimal policy is presented for the augmented control problem. Several control policies with incomplete information are proposed on the basis of the optimal control and hidden state estimates. We consider two estimates based on the optimal filtering equations and the current queue state. Results of computer simulation are presented to compare the control policies under consideration.
Keywords:queuing system data transmission optimal control augmented problem control with incomplete information filtering estimate
This work was supported by the Russian Science Foundation (project no. 16-11-00063).
- 1.A. V. Borisov, “Monitoring remote server accessibility: the optimal filtering approach,” Informatics and Applications 8 (3), 53–69 (2014).Google Scholar
- 2.A. V. Borisov, A. V. Bosov, and G. B. Miller, “Modeling and monitoring of VoIP connection,” Informatics and Applications 10 (2), 2–13 (2016).Google Scholar
- 5.B. M. Miller, G. B. Miller, and K. V. Semenikhin, “Optimal channel choice for lossy data flow transmission,” Automation and Remote Control 79 (1), 66–77 (2018).Google Scholar
- 12.B. M. Miller, G. B. Miller, and K. V. Semenikhin, “Methods to design optimal control of Markov process with finite state set in the presence of constraints,” Automation and Remote Control 72 (2), 323‒341 (2011).Google Scholar
- 14.B. Miller, G. Miller, and K. Semenikhin, “Optimization of the data transmission flow from moving object to nonhomogeneous network of base stations,” in Proc. 20th IFAC World Congress (IFAC’2017), Toulouse, France, 2017 (IFAC, 2017).Google Scholar
- 15.T. M. Cover and J. A. Thomas, Elements of Information Theory (Wiley, New York, 1991).Google Scholar
- 17.B. M. Miller, G. B. Miller, and K. V. Semenikhin, “Optimal control problem regularization for the Markov process with finite number of states and constraints,” Automation and Remote Control 77 (9), 1589–1611 (2016).Google Scholar