Abstract
Admission control aims to compensate for the inability of slow-changing network configurations to react rapidly enough to load fluctuations. Even though many admission control approaches exist, most of them suffer from the fact that they are based on some very rigid assumptions about the per-flow and aggregate underlying traffic models, requiring manual reconfiguration of their parameters in a “trial and error” fashion when these original assumptions stop being valid. In this paper we present a fuzzy reinforcement learning admission control approach based on the increasingly popular Pre-Congestion Notification framework that requires no a priori knowledge about traffic flow characteristics, traffic models and flow dynamics. By means of simulations we show that the scheme can perform well under a variety of traffic and load conditions and adapt its behavior accordingly without requiring any overly complicated operations and with no need for manual and frequent reconfigurations.
Chapter PDF
References
Wright, S.: Admission Control In Multi-Service IP Networks: A Tutorial. IEEE Communications Surveys & Tutorials, 2nd Quarter (2007)
Lima, S., Carvalho, P., Freitas, V.: Admission Control in Multiservice IP Networks: Architectural Issues and Trends. IEEE Communications Magazine (April 2007)
Breslau, L., Jamin, S., Shenker, S.: Comments on the Performance of Measurement-Based Admission Control Algorithms. In: IEEE INFOCOM (2000)
EU FP7 UniverSelf project website, www.univerself-project.eu
Eardley, P. (ed.): Pre-Congestion Notification Architecture, Internet RFC 5559 (June 2009)
Blake, S., Black, D., Carlson, M., Davies, E., Wang, Z., Weiss, W.: An Architecture for Differentiated Services, Internet RFC 2475 (December 1998)
Menth, M., Lehrieder, F., Briscoe, B., Eardley, P., Moncaster, T., BBabiarz, J., Charny, A., Zhang, X., Taylor, T., Chan, K., Satoh, D., Geib, R., Karagiannis, G.: A Survey of PCN-based Admission Control and Flow Termination. IEEE Communications Surveys and Tutorials (2010)
Lundqvist, H., Mas, I., Karlsson, G.: Edge-Based Differentiated Services. In: IEEE IWQoS (2005)
Menth, M., Lehrieder, F.: Performance Evaluation of PCN-based Admission Control. In: IWQoS (2008)
Menth, M., Lehrieder, F.: Applicability of PCN-based Admission Control, University of Wuzburg Technical Report (2010)
Zhang, X., Charny, A.: Performance Evaluation of Pre-Congestion Notification. In: IWQoS 2008 (2008)
Latre, S., Vleeschauwer, B., Meerssche, W., Perrault, S., Turck, F., Demeester, P., Schepper, K., Hublet, C., Rogiest, W., Custers, S., Leekwijck, W.: An Autonomic PCN based Admission Control Mechanism for Video Services in Access Networks. In: IFIP/IEEE IM (2009)
Roosbroeck, K., Latre, S., Wauters, T., Turck, F.: Optimized Network Utilization through Buffering in PCN enabled Multimedia Access Networks. In: IFIP/IEEE IM (2011)
Latre, S., Vleeschauwer, B., Meerssche, W., Schepper, K., Hublet, C., Leekwijck, W., Turck, F.: PCN Based Admission Control for Autonomic Video Quality Differentiation: Design and Evaluation. Journal of Network and Systems Management (2011)
Razavi, R., Klien, S., Claussen, H.: A Fuzzy Reinforcement Learning Approach for Self-Optimization of Coverage in LTE Networks. Bell Labs Technical Journal (2010)
Dirani, M., Altman, Z.: Self-organizing networks in next generation radio access networks: Application to fractional power control. Elsevier Computer Networks (2010)
Chen, G., Pham, T.: Introduction to Fuzzy Sets, Fuzzy Logic and Fuzzy Control Systems. CRC Press (2000)
Sutton, R.S., Barto, A.G.: Reinforcement Learning: An Introduction. MIT Press (1998)
The NS-2 network simulator, http://www.isi.edu/nsnam/ns/
Pinson, M., Wolf, S., Stafford, R.: Video Performance Requirements for Tactical Video Applications. In: IEEE Conference on Technologies for Homeland Security (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 IFIP International Federation for Information Processing
About this paper
Cite this paper
Georgoulas, S., Moessner, K., Mansour, A., Pissarides, M., Spapis, P. (2012). A Fuzzy Reinforcement Learning Approach for Pre-Congestion Notification Based Admission Control. In: Sadre, R., Novotný, J., Čeleda, P., Waldburger, M., Stiller, B. (eds) Dependable Networks and Services. AIMS 2012. Lecture Notes in Computer Science, vol 7279. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30633-4_4
Download citation
DOI: https://doi.org/10.1007/978-3-642-30633-4_4
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30632-7
Online ISBN: 978-3-642-30633-4
eBook Packages: Computer ScienceComputer Science (R0)