Market-Based Hierarchical Resource Management Using Machine Learning

  • Ramy Farha
  • Alberto Leon-Garcia
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4785)


Service providers are constantly seeking ways to reduce the costs incurred in managing the services they deliver. With the increased distribution and virtualization of resources in the next generation network infrastructure, novel resource management approaches are sought for effective service delivery. In this paper, we propose a market-based hierarchical resource management mechanism using Machine Learning, which consists of a negotiation phase where customers are allocated the resources needed by their activated service instances, and a learning phase where service providers adjust the prices of their resources in order to steer the network infrastructure towards the desired goal of increasing their revenues, while delivering the mix of services requested by their customers. We present the operation of such a market where distributed and virtualized resources are traded as commodities between autonomic resource brokers performing the negotiation and learning on behalf of service providers. We perform extensive simulations to study the performance of the proposed hierarchical resource management mechanism.


Service Provider Utility Function Reinforcement Learn Network Infrastructure Service Instance 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Kephart, J., et al.: The vision of autonomic computing. IEEE Computer Magazine, 41–50 (2003)Google Scholar
  2. 2.
    Farha, R., et. al.: Towards an Autonomic Service Architecture. LNCS, pp. 58–67 (2005)Google Scholar
  3. 3.
    Osborne, M.: An introduction to Game Theory. Oxford University Press, Oxford (2002)Google Scholar
  4. 4.
    Alpaydin, E.: Introduction to Machine Learning. MIT Press, Cambridge (2004)zbMATHGoogle Scholar
  5. 5.
    Kaelbling, L., et al.: Reinforcement Learning A Survey. Journal of Artificial Intelligence Research, 237–285 (1996)Google Scholar
  6. 6.
    Wang, W., Li, B.: Market-based self-optimization for autonomic service overlay networks. IEEE Journal on Selected Areas in Communications, 2320–2332 (2005)Google Scholar
  7. 7.
    Leon-Garcia, A., et al.: Virtual Network Resource Management for Next-Generation Networks. IEEE Communications Magazine, 102–109 (2003)Google Scholar
  8. 8.
    Garfinkel, S.: Commodity Grid Computing with Amazon’s S3 and EC2. Usenix (2007)Google Scholar
  9. 9.
    Minoli, D.: A networking approach to Grid Computing. Wiley, Chichester (2004)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2007

Authors and Affiliations

  • Ramy Farha
    • 1
  • Alberto Leon-Garcia
    • 1
  1. 1.University of Toronto, Toronto, OntarioCanada

Personalised recommendations