Abstract
Assuring Quality of Service (QoS) over multiple Network Service Providers (NSPs) requires to negotiate QoS contracts as Service Level Agreements (SLAs) between NSPs. The goal of an NSP is to maximize its revenues by selling as much as possible SLAs. However, provisioning too much SLAs might increase the risk of violations of the committed QoS thus impacting the NSP’s reputation. In order to determine the appropriate provisioning strategies, we propose to extend existing solutions based on Reinforcement Learning with reputation-awareness so that NSPs maximize their revenues.
This work has been partially supported by the ETICS-project, a project funded by the European Commission through the 7th ICT-Framework Program. Grant agreement no.: FP7-248567 Contract Number: INFSO-ICT-248567.
Chapter PDF
Similar content being viewed by others
Keywords
- Reinforcement Learn
- Markov Decision Process
- Service Level Agreement
- Decision Epoch
- Service Level Agreement Violation
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Keller, A., et al.: Quality assurance of grid service provisioning by risk aware managing of resource failures. In: CRiSIS (2008)
Battré, D., Djemame, K., Gourlay, I., Hovestadt, M., Kao, O., Padgett, J., Voß, K., Warneke, D.: AssessGrid Strategies for Provider Ranking Mechanisms in Risk–Aware Grid Systems. In: Altmann, J., Neumann, D., Fahringer, T. (eds.) GECON 2008. LNCS, vol. 5206, pp. 226–233. Springer, Heidelberg (2008)
Barth, D., Mautor, T., Monteiro, D.V.: Impact of Alliances on End-to-End QoS Satisfaction in an Interdomain Network. In: ICC (2009)
Even-Dar, E., Mansour, Y.: Learning Rates for Q-Learning. Journal of Machine Learning Research 5 (2003)
Groléat, T., Pouyllau, H.: Distributed inter-domain SLA negotiation using Reinforcement Learning. In: Integrated Network Management (2011)
Medem, A., Akodjenou, M.-I., Teixeira, R.: Troubleminer: Mining network trouble tickets. In: IFIP/IEEE International Symposium on Integrated Network Management Workshops, IM 2009 (June 2009)
Nisan, N., Roughgarden, T., Tardos, E., Vazirani, V.V.: Algorithmic Game Theory. Cambridge University Press (2007)
Seitz, N.: ITU-T QoS standards for IP-based networks. IEEE Communications Magazine 41(6) (June 2003)
Suksomboon, K., Pongpaibool, P., Aswakul, C.: An equilibrium policy for providing end-to-end service level agreements in interdomain network. In: WCNC (2008)
Watkins, C.J.C.H., Dayan, P.: Technical Note Q-Learning. Machine Learning, 8 (1992)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 IFIP International Federation for Information Processing
About this paper
Cite this paper
Lamali, M.L., Barth, D., Cohen, J. (2012). Reputation-Aware Learning for SLA Negotiation. In: Becvar, Z., Bestak, R., Kencl, L. (eds) NETWORKING 2012 Workshops. NETWORKING 2012. Lecture Notes in Computer Science, vol 7291. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-30039-4_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-30039-4_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-30038-7
Online ISBN: 978-3-642-30039-4
eBook Packages: Computer ScienceComputer Science (R0)