Skip to main content

Resource Sharing Networks and Brownian Control Problems

  • Chapter
  • First Online:
Modeling, Stochastic Control, Optimization, and Applications

Part of the book series: The IMA Volumes in Mathematics and its Applications ((IMA,volume 164))

  • 1586 Accesses

Abstract

We consider a family of resource sharing networks that were introduced in the work of Massoulié and Roberts (2000) as models for Internet flows and study an optimal stochastic control problem associated with the dynamic allocation of resource capacities to jobs in the system. Since these stochastic control problems are in general intractable, we analyze the system in a heavy traffic regime where one can formally approximate these control problems by certain Brownian control problems (BCP). It is shown that, both for a discounted cost and an ergodic cost criterion, an appropriate BCP gives a lower bound on the best achievable asymptotic cost under any sequence of admissible policies. The lower bounds established in this work show that the threshold control policies constructed in Budhiraja and Johnson (2017), which achieve the Hierarchical Greedy Ideal (HGI) performance (cf. Harrison et al. (2014)) in the heavy traffic limit, are in fact asymptotically optimal when certain monotonicity conditions on the cost function are satisfied.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 139.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 179.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 179.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Patrick Billingsley. Convergence of probability measures. John Wiley & Sons, 2013.

    Google Scholar 

  2. Volker Böhm. On the continuity of the optimal policy set for linear programs. SIAM Journal on Applied Mathematics, 28(2):303–306, 1975.

    Article  MathSciNet  MATH  Google Scholar 

  3. Maury Bramson and RJWilliams. Two workload properties for brownian networks. Queueing Systems, 45(3):191–221, 2003.

    Article  MathSciNet  Google Scholar 

  4. Amarjit Budhiraja, Arka Prasanna Ghosh, et al. Diffusion approximations for controlled stochastic networks: An asymptotic bound for the value function. The Annals of Applied Probability, 16(4):1962–2006, 2006.

    Article  MathSciNet  MATH  Google Scholar 

  5. Amarjit Budhiraja and Dane Johnson. Control policies approaching HGI performance in heavy traffic for resource sharing networks. arXiv preprint arXiv:1710.09042, 2017.

    Google Scholar 

  6. Stewart N Ethier and Thomas G Kurtz. Markov processes: characterization and convergence, volume 282. John Wiley & Sons, 2009.

    Google Scholar 

  7. J. M. Harrison and R. J. Williams. Brownian models of open queueing networks with homogeneous customer populations. Stochastics, 22(2):77–115, 1987.

    Article  MathSciNet  MATH  Google Scholar 

  8. J Michael Harrison. Brownian models of queueing networks with heterogeneous customer populations. In Stochastic differential systems, stochastic control theory and applications, pages 147–186. Springer, 1988.

    Google Scholar 

  9. J Michael Harrison. Brownian models of open processing networks: Canonical representation of workload. The Annals of Applied Probability, 13(1):390–393, 2003.

    Article  MathSciNet  Google Scholar 

  10. J Michael Harrison, Chinmoy Mandayam, Devavrat Shah, and Yang Yang. Resource sharing networks: Overview and an open problem. Stochastic Systems, 4(2):524–555, 2014.

    Article  MathSciNet  MATH  Google Scholar 

  11. J Michael Harrison and Jan A Van Mieghem. Dynamic control of brownian networks: state space collapse and equivalent workload formulations. The Annals of Applied Probability, pages 747–771, 1997.

    Article  MathSciNet  MATH  Google Scholar 

  12. WN Kang, FP Kelly, NH Lee, and RJ Williams. State space collapse and diffusion approximation for a network operating under a fair bandwidth sharing policy. The Annals of Applied Probability, pages 1719–1780, 2009.

    Article  MathSciNet  MATH  Google Scholar 

  13. Laurent Massoulie and James W Roberts. Bandwidth sharing and admission control for elastic traffic. Telecommunication systems, 15(1-2):185–201, 2000.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Amarjit Budhiraja .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Budhiraja, A., Conroy, M. (2019). Resource Sharing Networks and Brownian Control Problems. In: Yin, G., Zhang, Q. (eds) Modeling, Stochastic Control, Optimization, and Applications. The IMA Volumes in Mathematics and its Applications, vol 164. Springer, Cham. https://doi.org/10.1007/978-3-030-25498-8_4

Download citation

Publish with us

Policies and ethics