Reinforcement Learning Based on the Bayesian Theorem for Electricity Markets Decision Support
This paper presents the applicability of a reinforcement learning algorithm based on the application of the Bayesian theorem of probability. The proposed reinforcement learning algorithm is an advantageous and indispensable tool for ALBidS (Adaptive Learning strategic Bidding System), a multi-agent system that has the purpose of providing decision support to electricity market negotiating players. ALBidS uses a set of different strategies for providing decision support to market players. These strategies are used accordingly to their probability of success for each different context. The approach proposed in this paper uses a Bayesian network for deciding the most probably successful action at each time, depending on past events. The performance of the proposed methodology is tested using electricity market simulations in MASCEM (Multi-Agent Simulator of Competitive Electricity Markets). MASCEM provides the means for simulating a real electricity market environment, based on real data from real electricity market operators.
KeywordsBayesian Network Success Probability Multiagent System Electricity Market Dynamic Bayesian Network
Unable to display preview. Download preview PDF.
- 1.Pinto, T., et al.: Multiagent System for Adaptive Strategy Formulation in Electricity Markets. In: IEEE Symposium on Intelligent Agents, SSCI-IA. IEEE Symposium Series on Computational Intelligence (2011)Google Scholar
- 3.Korb, K., Nicholson, A.: Bayesian Artificial Intelligence. Chapman & Hall/CRC (2003)Google Scholar
- 4.Shahidehpour, M., et al.: Market Operations in Electric Power Systems: Forecasting, Scheduling, and Risk Management, pp. 233–274. Wiley-IEEE Press (2002)Google Scholar
- 8.Pinto, T., Vale, Z., Rodrigues, F., Morais, H., Praça, I.: Strategic Bidding Methodology for Electricity Markets using Adaptive Learning. In: Mehrotra, K.G., Mohan, C.K., Oh, J.C., Varshney, P.K., Ali, M. (eds.) IEA/AIE 2011, Part II. LNCS (LNAI), vol. 6704, pp. 490–500. Springer, Heidelberg (2011)CrossRefGoogle Scholar
- 9.Sun, J., Tesfatsion, L.: Dynamic Testing of Wholesale Power Market Designs: An Open-Source Agent-Based Framework. Computational Economics 30(3) (2007)Google Scholar
- 12.Bompard, E., et al.: A game theory simulator for assessing the performances of competitive electricity markets. IEEE St. Petersburg Power Tech (2005)Google Scholar
- 13.MIBEL - Operador del Mercado Ibérico de Energia – Iberian Electricity Market Operator (accessed on December 2013), http://www.omie.es