Variant Roth-Erev Reinforcement Learning Algorithm-Based Smart Generator Bidding as Agents in Electricity Market

  • P. KiranEmail author
  • K. R. M. Vijaya Chandrakala
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1048)


The dynamically changing deregulated electricity market involves different entities and the aim of each entity is to achieve maximum profit while performing electricity price and power bidding. The agent-based modeling of electricity systems was used to model the market entities under whole sale electricity market operation. This paper discusses about the strategic learning ability of generators in an IEEE 30 bus system using Variant Roth-Erev learning algorithm. It also analyzes the variation in the generator commitments through the implemented learning algorithm during the present day schedule and helps the generator to perform smart bidding in the next electricity market operation. The results presented show that the smart generators are able to bid strategically in the electricity market and which will reflect in its net earnings in a market scheduled on a day-ahead basis.


Deregulated electricity market Variant Roth-Erev learning Agent-based modeling Independent system operator Generator company (GenCo) 


  1. 1.
    Shirmohammadi, D., Wollenberg, B., Vojdani, A., Sandrin, P., Pereira, M., Rahimi, F.: Transmission dispatch and congestion management in the emerging energy market structures. IEEE Trans. Power Syst. 13, 1466–1476 (1998). Scholar
  2. 2.
    Sun, J.: Dynamic testing of wholesale power market designs: an open-source agent-based framework. Comput. Econ. Springer 30, 291–327 (2007). Scholar
  3. 3.
    Fang, R.S., David, A.K.: Transmission congestion management in an electricity market. IEEE Trans. Power Syst. 14, 877–883 (1999). doi: Scholar
  4. 4.
    Conejo, Antonio J.: Electricity markets: analysis & operations. IET Gener. Transm. Distrib. 4, 123–124 (2010). Scholar
  5. 5.
    Foo, Y.S., Gooi, H.B., Chen, S.X.: Multi agent system for distributed management of microgrids. IEEE Trans. Power Syst. 30, 24–34 (2015). Scholar
  6. 6.
    Krishnamurthy, D., Li, W., Tesfatsion, Leigh: An 8-zone test system based on ISO New England data: development and application. IEEE Trans. Power Syst. 31, 234–246 (2016). Scholar
  7. 7.
    Huang, S., Wu, Q., Zhao, H., Li, C.: Distributed optimization based dynamic tariff for congestion management in distribution networks. IEEE Trans. Smart Grid 1, 1–10 (2017). Scholar
  8. 8.
    Ebrahimian, H., Barmayoon, S., Mohammadi, Mohsen, Ghadimi, Noradin: The price prediction for the energy market based on a new method. J. Econ. Res. 31, 313–337 (2018). Scholar
  9. 9.
    Yang, J., Zhao, J., Luo, F., Wen, F., Dong, Z.Y.: Decision-making for electricity retailers: a brief survey. IEEE Trans. Smart Grid 9, 4140–4153 (2017). Scholar
  10. 10.
    Chen, T., Pourbabak, H., Su, W.: A game theoretic approach to analyze the dynamic interactions of multiple residential prosumers considering power flow constraints. In: Proceedings of the 2016 IEEE power and energy society general meeting, pp. 17–21 (2016). doi:
  11. 11.
    Song, M., Amelin, M.: Purchase bidding strategy for a retailer with flexible demands in day-ahead electricity market. IEEE Trans. Power Syst. 32, 1839–1850 (2017). Scholar
  12. 12.
    Balamurugan, S., Lekshmi, R.R.: Control strategy development for multi-source multi area restructured system based on Genco and Transco reserve. Int. J. Electr. Power Energy Syst. 75, 320–327 (2016). Scholar
  13. 13.
    Solanki, Z., Wani, U., Patel, J.: Demand side management program for balancing load curve for CGPIT College, Bardoli. In: 2017 international conference on energy, communication, data analytics and soft computing (ICECDS) (2017).
  14. 14.
    Kiran, P., Chandrakala, K.R.M.V., Nambiar, T.N.P.: Multi-agent based systems on microgrid—a review. In: 2017 international conference on intelligent computing and control (I2C2), (2017). doi:
  15. 15.
    Kiran, P., Chandrakala, K.R.M.V., Nambiar, T.N.P.: Day ahead market operation with agent based modeling. In: Proceedings of the IEEE international conference on technological advancements in power and energy (Tap Energy 2017), pp. 690–693 (2017). doi:

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  1. 1.Department of Electrical and Electronics EngineeringAmrita School of EngineeringCoimbatore, Amrita Vishwa VidyapeethamIndia

Personalised recommendations