Skip to main content

Exploring Cooperative Multi-agent Reinforcement Learning Algorithm (CMRLA) for Intelligent Traffic Signal Control

  • Conference paper
  • First Online:
Smart Trends in Information Technology and Computer Communications (SmartCom 2017)

Abstract

Traffic crisis frequently happen because of traffic burden by the large number automobiles are on the path. Increasing transportation move and decreasing the average waiting time of each vehicle are the objectives of cooperative intelligent traffic control system. Each signal wishes to catch better travel move. During the course, signals form a strategy of cooperation in addition to restriction for neighboring signals to exploit their individual benefit. A superior traffic signal scheduling strategy is useful to resolve the difficulty. The several parameters may influence the traffic control model. So it is hard to learn the best possible result. Traffic light controllers are not expert to study from previous results. Due to this they are unable to include uncertain transformation of traffic flow. Reinforcement learning algorithm based traffic control model can be used to obtain fine timing rules by properly defining real time parameters of the real traffic scenario. The projected real-time traffic control optimization prototype is able to continue with the traffic signal scheduling rules successfully. The model expands traffic value of the vehicle, which consists of delay time, the number of vehicles stopped at signal, and the newly arriving vehicles to learn and establish the optimal actions. The experimentation outcome illustrates a major enhancement in traffic control, demonstrating the projected model is competent of making possible real-time dynamic traffic control.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhu, F., Ning, J., Ren, Y., Peng, J.: Optimization of image processing in video-based traffic monitoring. Elektronika ir Elektrotechnika 18(8), 91–96 (2012)

    Article  Google Scholar 

  2. de Schutter, B.: Optimal traffic light control for a single intersection. In: Proceedings of the American Control Conference (ACC 1999), vol. 3, pp. 2195–2199, June 1999

    Google Scholar 

  3. Findler, N., Stapp, J.: A distributed approach to optimized control of street traffic signals. J. Transp. Eng. 118(1), 99–110 (1992)

    Article  Google Scholar 

  4. Vidhate, D.A., Kulkarni, P.: Innovative approach towards cooperation models for multi-agent reinforcement learning (CMMARL). In: Unal, A., Nayak, M., Mishra, D.K., Singh, D., Joshi, A. (eds.) SmartCom 2016. CCIS, vol. 628, pp. 468–478. Springer, Singapore (2016). https://doi.org/10.1007/978-981-10-3433-6_56

    Chapter  Google Scholar 

  5. Baskar, L.D., Hellendoorn, H.: Traffic management for automated highway systems using model-based control. IEEE Trans. Intell. Transp. Syst. 3(2), 838–847 (2012)

    Article  Google Scholar 

  6. Vidhate, D.A., Kulkarni, P.: New approach for advanced cooperative learning algorithms using RL methods (ACLA). In: Proceedings of the Third International Symposium on Computer Vision and the Internet, VisionNet 2016, pp. 12–20. ACM DL (2016)

    Google Scholar 

  7. Mase, K., Yamamoto, H.: Advanced traffic control methods for network management. IEEE Mag. 28(10), 82–88 (1990)

    Article  Google Scholar 

  8. Vidhate, D.A., Kulkarni, P.: Performance enhancement of cooperative learning algorithms by improved decision making for context based application. In: International Conference on Automatic Control and Dynamic Optimization Techniques (ICACDOT), pp. 246–252. IEEE Xplorer (2016)

    Google Scholar 

  9. Baskar, L.D., de Schutter, B., Hellendoorn, J., Papp, Z.: Traffic control and intelligent vehicle highway systems: a survey. IET Intell. Transp. Syst. 5(1), 38–52 (2011)

    Article  Google Scholar 

  10. Choi, W., Yoon, H., Kim, K., Chung, I., Lee, S.: A traffic light controlling FLC considering the traffic congestion. In: Pal, N.R., Sugeno, M. (eds.) AFSS 2002. LNCS (LNAI), vol. 2275, pp. 69–75. Springer, Heidelberg (2002). https://doi.org/10.1007/3-540-45631-7_10

    Chapter  Google Scholar 

  11. Vidhate, D.A., Kulkarni, P.: Enhancement in decision making with improved performance by multiagent learning algorithms. IOSR J. Comput. Eng. 1(18), 18–25 (2016)

    Google Scholar 

  12. Wiering, M.A.: Multi-agent reinforcement learning for traffic light control. In: 17th International Conference on Machine Learning (ICML 2000), pp. 1151–1158 (2000)

    Google Scholar 

  13. Vidhate, D.A., Kulkarni, P.: Multilevel relationship algorithm for association rule mining used for cooperative learning. Int. J. Comput. Appl. 86(4), 20–27 (2014)

    Google Scholar 

  14. Zegeye, S., de Schutter, B., Hellendoorn, J., Breunesse, E.A., Hegyi, A.: A predictive traffic controller for sustainable mobility using parameterized control policies. IEEE Trans. Intell. Transp. Syst. 13(3), 1420–1429 (2012)

    Article  Google Scholar 

  15. Vidhate, D.A., Kulkarni, P.: A novel approach to association rule mining using multilevel relationship algorithm for cooperative learning. In: 4th International Conference on Advanced Computing and Communication Technologies, pp. 230–236 (2014)

    Google Scholar 

  16. Chin, Y.K., Wei, Y.K., Teo, K.T.K.: Q-learning traffic signal optimization within multiple intersections traffic network. In: Proceedings of the 6th UKSim/AMSS European Symposium on Computer Modeling and Simulation (EMS 2012), pp. 343–348, November 2012

    Google Scholar 

  17. Vidhate, D.A., Kulkarni, P.: To improve association rule mining using new technique: multilevel relationship algorithm towards cooperative learning. In: International Conference on Circuits, Systems, Communication and Information Technology Applications (CSCITA), pp. 241–246. IEEE (2014)

    Google Scholar 

  18. Chin, Y.K., Lee, L.K., Bolong, N., Yang, S.S., Teo, K.T.K.: Exploring Q-learning optimization in traffic signal timing plan management. In: Proceedings of the 3rd International Conference on Computational Intelligence, Communication Systems and Networks (CICSyN 2011), pp. 269–274, July 2011

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Deepak A. Vidhate .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Vidhate, D.A., Kulkarni, P. (2018). Exploring Cooperative Multi-agent Reinforcement Learning Algorithm (CMRLA) for Intelligent Traffic Signal Control. In: Deshpande, A., et al. Smart Trends in Information Technology and Computer Communications. SmartCom 2017. Communications in Computer and Information Science, vol 876. Springer, Singapore. https://doi.org/10.1007/978-981-13-1423-0_9

Download citation

  • DOI: https://doi.org/10.1007/978-981-13-1423-0_9

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-13-1422-3

  • Online ISBN: 978-981-13-1423-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics