Skip to main content
SpringerLink
Log in

Optimal Channel Choice for Lossy Data Flow Transmission

  • Topical Issue
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

We consider the optimal control problem for the load of several communication channels defined by independent Markov jump processes. Implicit information on the state of a channel is available in the form of a flow of losses whose intensity is proportional to the controllable load of this channel. The optimized functionals take into account the total throughput of channels and energy costs for data transmission over a fixed interval of time. We obtain optimal filtering equations for joint estimation of channel states. We construct a locally optimal strategy that explicitly depends on the set of state estimates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Kushner, H.J. and Dupuis, P., Numerical Methods for Stochastic Control Problems in Continuous Time, New York: Springer-Verlag, 2001, 2nd ed.

    Book  MATH  Google Scholar 

  2. Dynkin, E.B. and Yushkevich, A.A., Controlled Markov Processes, New York: Springer-Verlag, 1979.

    Book  MATH  Google Scholar 

  3. Davis, M.H.A., Markov Models and Optimization, London: Chapman and Hall, 1993.

    Book  MATH  Google Scholar 

  4. Altman, E., Constrained Markov Decision Processes, Boca Raton: Chapman and Hall/CRC, 1999.

    MATH  Google Scholar 

  5. Miller, A.B., Using Methods of Stochastic Control to Prevent Overloads in Data Transmission Networks, Autom. Remote Control, 2010, vol. 71, no. 9, pp. 1804–1815.

    Article  MathSciNet  MATH  Google Scholar 

  6. Miller, B.M., Miller, G.B., and Semenikhin, K.V., Methods to Design Optimal Control ofMarkov Process with Finite State Set in the Presence of Constraints, Autom. Remote Control, 2011, vol. 72, no. 2, pp. 323–341.

    Article  MathSciNet  MATH  Google Scholar 

  7. Solodyannikov, Yu.V., Control and Observation for Dynamical Queueing Networks. I, Autom. Remote Control, 2014, vol. 75, no. 3, pp. 422–446.

    Article  MathSciNet  MATH  Google Scholar 

  8. Choi, D.H., Kim, S.H., and Sung, D.K., Energy-efficient Maneuvering and Communication of a Single UAV-Based Relay, IEEE Trans. Aerosp. Electron. Syst., 2014, vol. 50, no. 3, pp. 2319–2326.

    Article  Google Scholar 

  9. Ho, D.-T., Grotli, E.I., Sujit, P.B., Johansen, T.A., and Sousa, J.B., Optimization of Wireless Sensor Network and UAV Data Acquisition, J. Intelligent Robot. Syst., 2015, vol. 78, no. 1, pp. 159–179.

    Article  Google Scholar 

  10. Gilbert, E.N., Capacity of a Burst-Noise Channel, Bell Syst. Techn. J., 1960, vol. 39, no. 5, pp. 1253–1265.

    Article  MathSciNet  Google Scholar 

  11. Borisov, A.V., Miller, B.M., and Semenikhin, K.V., Filtering of the Markov Jump Process Given the Observations of Multivariate Point Process, Autom. Remote Control, 2015, vol. 76, no. 2, pp. 219–240.

    Article  MathSciNet  MATH  Google Scholar 

  12. Ceci, C., Gerardi, A., and Tardelli, P., Existence of Optimal Controls for Partially Observed Jump Processes, Acta Appl. Math., 2002, vol. 74, no. 2, pp. 155–175.

    Article  MathSciNet  MATH  Google Scholar 

  13. Liptser, R.S. and Shiryayev, A.N., Statistics of Random Processes, New York: Springer-Verlag, 2005, 3rd ed.

    MATH  Google Scholar 

  14. Elliott, R.J., Aggoun, L., and Moore, J.B., Hidden Markov Models. Estimation and Control, New York: Springer-Verlag, 2008.

    MATH  Google Scholar 

  15. Miller, B.M., Avrachenkov, K.E., Stepanyan, K.V., and Miller, G.B., Flow Control as Stochastic Optimal Control Problem with Incomplete Information, Probl. Inf. Transm., 2005, vol. 41, no. 2, pp. 150–170.

    Article  MathSciNet  MATH  Google Scholar 

  16. Rieder, U. and Winter, J., Optimal Control of Markovian Jump Processes with Partial Information and Applications to a Parallel Queueing Model, Math. Meth. Oper. Res., 2009, vol. 70, pp. 567–596.

    Article  MathSciNet  MATH  Google Scholar 

  17. Solodyannikov, Yu.V., Control and Observation for Dynamical Queueing Networks. II, Autom. Remote Control, 2014, vol. 75, no. 5, pp. 880–899.

    Article  MathSciNet  MATH  Google Scholar 

  18. Glisic, S.G., Advanced Wireless Communications: 4G Technologies, Chichester: Wiley, 2004.

    Book  Google Scholar 

  19. Chiang, M., Tan, C.W., Hande, P., and Lan, T., Power Control in Wireless Cellular Networks, Foundat. Trends Networking, 2008, vol. 2, no. 4, pp. 381–533.

    Article  Google Scholar 

  20. Altman, E., Avrachenkov, K., Menache, I., Miller, G., Prabhu, B.J., and Shwartz, A., Dynamic Discrete Power Control in Cellular Networks, IEEE Trans. Autom. Control, 2009, vol. 54, no. 10, pp. 2328–2340.

    Article  MathSciNet  MATH  Google Scholar 

  21. Jacod, J. and Shiryaev, A.N., Limit Theorems for Stochastic Processes, New York: Springer-Verlag, 2003, 2nd ed.

    Book  MATH  Google Scholar 

  22. Wong, E. and Hajek, B., Stochastic Processes in Engineering Systems, New York: Springer-Verlag, 1985.

    Book  MATH  Google Scholar 

  23. Miller, B., Miller, G., and Semenikhin, K., Optimization of the Data Transmission Flow from Moving Object to Nonhomogeneous Network of Base Stations, Proc. 20th IFAC World Congr., Toulouse, France, 2017, July 9–14, IFAC-PapersOnLine, 2017, vol. 50, no. 1, pp. 6160–6165.

    Google Scholar 

  24. Boyd, S. and Vandenberghe, L., Convex Optimization, Cambridge: Cambridge Univ. Press, 2004.

    Book  MATH  Google Scholar 

  25. Pankov, A.R., Platonov, E.N., and Semenikhin, K.V., Robust Filtering of a Process in the Stationary Difference Stochastic System, Autom. Remote Control, 2011, vol. 72, no. 2, pp. 377–392.

    Article  MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for Information Transmission Problems (Kharkevich Institute), Russian Academy of Sciences, Moscow, Russia

    B. M. Miller

  2. Institute of Informatics Problems of Federal Research Center “Computer Science and Control,”, Russian Academy of Sciences, Moscow, Russia

    G. B. Miller

  3. Moscow Aviation Institute, Moscow, Russia

    K. V. Semenikhin

Authors
  1. B. M. Miller
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. B. Miller
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. V. Semenikhin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to B. M. Miller.

Additional information

Original Russian Text © B.M. Miller, G.B. Miller, K.V. Semenikhin, 2018, published in Avtomatika i Telemekhanika, 2018, No. 1, pp. 84–99.

This paper was recommended for publication by A.I. Kibzun, a member of the Editorial Board

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Miller, B.M., Miller, G.B. & Semenikhin, K.V. Optimal Channel Choice for Lossy Data Flow Transmission. Autom Remote Control 79, 66–77 (2018). https://doi.org/10.1134/S000511791801006X

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S000511791801006X

Keywords

Search

Navigation