Abstract
We consider, in this paper, the call admission control (CAC) problem in a multimedia cellular network that handles several classes of traffic with different resource requirements. The problem is formulated as a Semi-Markov Decision Process (SMDP) problem. It is too complex to allow for an exact solution for this problem, so, we use a real-time neuro-dynamic programming (NDP) [Reinforcement Learning (RL)] algorithm to construct a dynamic call admission control policy. A broad set of experiments shows the robustness of our policies compared to the classical solutions such as Guard Channel
Channels could be frequencies, time slots or codes depending on the radio access technique
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
T. M. Mitchell, “Machine Learning”, McGraw-Hill companies, Inc., 1997.
C.H. Yoon, C.K. Un, Performance of personal portable radio telephone systems with and without guard channels, IEEE Journal on Selected Areas in Communications (JSAC’1993), vol. 11, pp. 911–917, August 1993.
P. Marbach, O. Mihatsch and J. N. Tsitsikils, “Call admission control and routing in integrated services networks using neuro-dynamic programming”, IEEE Journal on Selected Areas in Communications (JSAC’2000), vol. 18, Nℴ. 2, pp. 197–208, Feb. 2000.
H. Tong and T. X. Brown, “Adaptive Call Admission Control under Quality of Service Constraint: a Reinforcement Learning Solution”, IEEE Journal on Selected Areas in Communications (JSAC’2000), vol. 18, Nℴ. 2, pp. 209–221, Feb. 2000.
R. Ramjee, R. Nagarajan and D. Towsley, “On Optimal Call Admission Control in Cellular Networks”, IEEE INFOCOM, pp. 43–50, San Francisco, CA, Mar. 1996.
S. Senouci, A.-L. Beylot, Guy Pujolle, “A dynamic Q-learning-based call admission control for multimedia cellular networks”, IEEE International Conference on Mobile and Wireless Communications Networks (MWCN’2001), pp. 37–43, Recife, Brazil, Aug. 2001.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Senouci, SM., Beylot, AL., Pujolle, G. (2002). Call Admission Control for Multimedia Cellular Networks Using Neuro-dynamic Programming. In: Gregori, E., Conti, M., Campbell, A.T., Omidyar, G., Zukerman, M. (eds) NETWORKING 2002: Networking Technologies, Services, and Protocols; Performance of Computer and Communication Networks; Mobile and Wireless Communications. NETWORKING 2002. Lecture Notes in Computer Science, vol 2345. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-47906-6_109
Download citation
DOI: https://doi.org/10.1007/3-540-47906-6_109
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-43709-3
Online ISBN: 978-3-540-47906-2
eBook Packages: Springer Book Archive