A Markov Decision Evolutionary Game for Individual Energy Management
We study in this paper a noncooperative game with an infinite number of players that are involved in many local interactions, each involving a randomly selected pair of players. Each player has to choose between an aggressive or a nonaggressive action. The expected lifetime of an individual as well as its expected total fitness during its lifetime (given as the total amount of packets it transmits during the lifetime) depend on the level of aggressiveness (power level) of all actions it takes during its life. The instantaneous reward of each player depends on the level of aggressiveness of his action as well as on that of his opponent. We model this as a Markov Decision Evolutionary Game which is an extension of the evolutionary game paradigm introduced in 1972 by Maynard Smith, and study the structure of equilibrium policies.
KeywordsTime Slot Pure Strategy Markov Decision Process Mobile Terminal Global Optimum Solution
Unable to display preview. Download preview PDF.
- 1.Altman, E., Hayel, Y.: A Stochastic Evolutionary Game of Energy Management in a Distributed Aloha Network. In: Proceedings of IEEE INFOCOM (2008)Google Scholar
- 2.Altman, E., Hayel, Y., Tembine, H., El Azouzi, R.: Markov Decision Evolutionary Games with Expected Average Fitness. In: Brown, J.S., Vincent, T.L.S. (eds.) Evolutionary Ecology Research Journal, Special issue in honour of Thomas Vincent (2009)Google Scholar
- 4.Axelrod, R.: The Evolution of Cooperation (Revised ed.). Basic Books, New York, NY (2006)Google Scholar
- 6.Hayel, Y., Tembine, H., Altman, E., El Azouzi, R.: A Markov Decision Evolutionary Game for Individual Energy Management. Technical Report, CERI (2009)Google Scholar
- 8.Hofbauer, J., Sigmund, K.: Evolutionary game dynamics. American Mathematical Society 40(4) (2003)Google Scholar
- 10.Maynard Smith, J.: Game Theory and the Evolution of Fighting. In: Maynard Smith, J. (ed) On Evolution, pp. 8–28. Edinburgh University Press, Edinburgh (1972)Google Scholar
- 11.Maynard Smith, J.: Evolution and the Theory of Games. Cambridge University Press, Cambridge, UK (1982)Google Scholar
- 15.Sandholm, W.H.: Population Games and Evolutionary Dynamics. MIT, Cambridge, MA (to be published)Google Scholar
- 16.Susu, A., Acquaviva, A., Atienza, D., De Micheli, G.: Stochastic Modeling and Analysis for Environmentally Powered Wireless Sensor Nodes. Proceedings of WiOpt (2008)Google Scholar
- 17.Tembine, H., Altman, E., El Azouzi, R., Sandholm, W.H.: Evolutionary game dynamics with migration for hybrid power control in wireless communications. 47th IEEE Conference on Decision and Control, pp. 4479–4484, Cancun, Mexico (2008)Google Scholar
- 18.Tembine, H., Altman, e., El Azouzi, R., Hayel, Y.: Evolutionary Games in Wireless Networks. IEEE Transactions on Systems, Man, and Cybernetics: Part B, special issue on Game TheoryGoogle Scholar