Abstract
We consider a family of resource sharing networks that were introduced in the work of Massoulié and Roberts (2000) as models for Internet flows and study an optimal stochastic control problem associated with the dynamic allocation of resource capacities to jobs in the system. Since these stochastic control problems are in general intractable, we analyze the system in a heavy traffic regime where one can formally approximate these control problems by certain Brownian control problems (BCP). It is shown that, both for a discounted cost and an ergodic cost criterion, an appropriate BCP gives a lower bound on the best achievable asymptotic cost under any sequence of admissible policies. The lower bounds established in this work show that the threshold control policies constructed in Budhiraja and Johnson (2017), which achieve the Hierarchical Greedy Ideal (HGI) performance (cf. Harrison et al. (2014)) in the heavy traffic limit, are in fact asymptotically optimal when certain monotonicity conditions on the cost function are satisfied.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Patrick Billingsley. Convergence of probability measures. John Wiley & Sons, 2013.
Volker Böhm. On the continuity of the optimal policy set for linear programs. SIAM Journal on Applied Mathematics, 28(2):303–306, 1975.
Maury Bramson and RJWilliams. Two workload properties for brownian networks. Queueing Systems, 45(3):191–221, 2003.
Amarjit Budhiraja, Arka Prasanna Ghosh, et al. Diffusion approximations for controlled stochastic networks: An asymptotic bound for the value function. The Annals of Applied Probability, 16(4):1962–2006, 2006.
Amarjit Budhiraja and Dane Johnson. Control policies approaching HGI performance in heavy traffic for resource sharing networks. arXiv preprint arXiv:1710.09042, 2017.
Stewart N Ethier and Thomas G Kurtz. Markov processes: characterization and convergence, volume 282. John Wiley & Sons, 2009.
J. M. Harrison and R. J. Williams. Brownian models of open queueing networks with homogeneous customer populations. Stochastics, 22(2):77–115, 1987.
J Michael Harrison. Brownian models of queueing networks with heterogeneous customer populations. In Stochastic differential systems, stochastic control theory and applications, pages 147–186. Springer, 1988.
J Michael Harrison. Brownian models of open processing networks: Canonical representation of workload. The Annals of Applied Probability, 13(1):390–393, 2003.
J Michael Harrison, Chinmoy Mandayam, Devavrat Shah, and Yang Yang. Resource sharing networks: Overview and an open problem. Stochastic Systems, 4(2):524–555, 2014.
J Michael Harrison and Jan A Van Mieghem. Dynamic control of brownian networks: state space collapse and equivalent workload formulations. The Annals of Applied Probability, pages 747–771, 1997.
WN Kang, FP Kelly, NH Lee, and RJ Williams. State space collapse and diffusion approximation for a network operating under a fair bandwidth sharing policy. The Annals of Applied Probability, pages 1719–1780, 2009.
Laurent Massoulie and James W Roberts. Bandwidth sharing and admission control for elastic traffic. Telecommunication systems, 15(1-2):185–201, 2000.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Budhiraja, A., Conroy, M. (2019). Resource Sharing Networks and Brownian Control Problems. In: Yin, G., Zhang, Q. (eds) Modeling, Stochastic Control, Optimization, and Applications. The IMA Volumes in Mathematics and its Applications, vol 164. Springer, Cham. https://doi.org/10.1007/978-3-030-25498-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-25498-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-25497-1
Online ISBN: 978-3-030-25498-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)