Abstract
This chapter puts together some of the applications of simultaneous perturbation-based approaches in the context of communication networks. Three applications are studied in particular: (i) the problem of tuning the parameters for the random early detection adaptive queue management scheme, (ii) finding the optimal retransmission probabilities for the slotted Aloha multi-access communication system and (iii) obtaining dynamic price allocation schemes for Internet traffic management.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bertsekas, D.P.: Nonlinear Programming. Athena Scientific, Belmont (1999)
Bertsekas, D.P., Gallager, R.G.: Data Networks. Prentice-Hall, New York (1991)
Bhatnagar, S., Fu, M.C., Marcus, S.I., Fard, P.J.: Optimal structured feedback policies for ABR flow control using two-timescale SPSA. IEEE/ACM Transactions on Networking 9(4), 479–491 (2001)
Bhatnagar, S., Karmeshu, Mishra, V.: Optimal parameter trajectory estimation in parameterized sdes: an algorithmic procedure. ACM Transactions on Modeling and Computer Simulation (TOMACS)Â 19(2), 8 (2009)
Bhatnagar, S., Kumar, S.: A simultaneous perturbation stochastic approximation based actor-critic algorithm for Markov decision processes. IEEE Transactions on Automatic Control 49(4), 592–598 (2004)
Bhatnagar, S., Patro, R.K.: A proof of convergence of the B-RED and P-RED algorithms in random early detection. IEEE Communication Letters 13(10), 809–811 (2009)
Chakraborty, A., Bhatnagar, S.: Optimized policies for the retransmission probabilities in slotted aloha. Simulation 86(4), 247–261 (2010)
Garg, D., Borkar, V.S., Manjunath, D.: Network pricing for QoS: A ‘regulation’ appproach. In: Abed, E.H. (ed.) Advances in Control, Communication Networks and Transportation Systems (in honour of Pravin Varaiya), pp. 137–157 (2005)
Floyd, S., Gummadi, R., Shenker, S., et al.: Adaptive red: An algorithm for increasing the robustness of reds active queue management (2001), http://www.icir.org/floyd/papers.html
Floyd, S., Jacobson, V.: Random early detection gateways for congestion avoidance. IEEE/ACM Transactions on Networking 1(4), 397–413 (1993)
Glasserman, P.: Monte Carlo methods in financial engineering, vol. 53. Springer (2004)
Gockenbach, M.: Analysis of the logarithmic barrier method (preprint), http://www.math.mtu.edu
Issariyakul, T., Hossain, E.: Introduction to network simulator NS2. Springer (2008)
Kaj, I.: Stochastic modeling in broadband communications systems. Society for Industrial Mathematics, vol. 8 (2002)
Karmeshu, Bhatnagar, S., Mishra, V.: An optimized sde model for slotted aloha. IEEE Transactions on Communications 59(6), 1502–1508 (2011)
Patro, R.K., Bhatnagar, S.: A probabilistic constrained nonlinear optimization framework to optimize RED parameters. Performance Evaluation 66(2), 81–104 (2009)
Dube, P., Borkar, V.S., Manjunath, D.: Differential join prices for parallel queues: Social optimality, dynamic pricing algorithms and application to internet pricing. In: Proceedings of IEEE Infocom, N.Y., vol. 1, pp. 276–283 (2002)
Ramana Reddy, G., Bhatnagar, S., Rakesh, V., Chaturvedi, V.: An efficient algorithm for scheduling in bluetooth piconets and scatternets. Wireless Networks 16(7), 1799–1816 (2010)
Rao, S., Rao, S.: Engineering optimization: theory and practice. Wiley (2009)
Tandra, R., Hemachandra, N., Manjunath, D.: Diffserv node with join minimum cost queue policy and multiclass traffic. Perform. Eval. 55(1-2), 69–91 (2004), http://dx.doi.org/10.1016/S0166-53160300105-6
Spall, J.C.: Adaptive stochastic approximation by the simultaneous perturbation method. IEEE Trans. Autom. Contr. 45, 1839–1853 (2000)
Taha, H., Taha, H.: Operations research: an introduction, vol. 8. Prentice Hall, Upper Saddle River (1997)
Uri, A.: Penalty, barrier and augmented lagrangian methods (preprint), www.cs.ubc.ca/spider/ascher/542/chap10.pdf
Vaidya, R., Bhatnagar, S.: Robust optimization of random early detection. Telecommunication Systems 33(4), 291–316 (2006)
Vemu, K., Bhatnagar, S., Hemachandra, N.: Link-Route Pricing for Enhanced QoS. Technical Report 2007-8, Department of Computer Science and Automation. Indian Institute of Science, Bangalore (2007); Shorter version in Proceedings of IEEE Conference on Decision and Control, New Orleans, USA, December 12-14, pp. 504–1509 (2007), http://archive.csa.iisc.ernet.in/TR/2007/8/
Vemu, K.R., Bhatnagar, S., Hemachandra, N.: Optimal multi-layered congestion based pricing schemes for enhanced qos. Computer Networks (2011), http://dx.doi.org/10.1016/j.comnet.2011.12.004
Borkar, V.S., Manjunath, D.: Charge-based control of diffserv-like queues. Automatica 40(12), 2043–2057 (2004)
Zhu, X., Spall, J.C.: A modified second-order SPSA optimization algorithm for finite samples. Int. J. Adapt. Control Signal Process. 16, 397–409 (2002)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2013 Springer-Verlag London
About this chapter
Cite this chapter
Bhatnagar, S., Prasad, H., Prashanth, L. (2013). Communication Networks. In: Stochastic Recursive Algorithms for Optimization. Lecture Notes in Control and Information Sciences, vol 434. Springer, London. https://doi.org/10.1007/978-1-4471-4285-0_14
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4285-0_14
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4284-3
Online ISBN: 978-1-4471-4285-0
eBook Packages: EngineeringEngineering (R0)