In this paper we present DALI, a distributed, collaborative multi-agent traffic signal timing system (TST) for highly dynamic traffic conditions. In DALI, intersection controllers are augmented with software agents which collaboratively adapt signal timings by considering the feedback of all controller agents that may be affected by a change. The model is based on a real-world TST and will be deployed with minimal changes to the infrastructure. DALI has been validated by traffic engineers as well as through extensive simulation of the City of Richardson’s traffic network, comprising 128 signalized intersections. The experimental results show that, in highly dynamic scenarios, DALI outperforms the conventional traffic system used by the city as well as a state-of-the-art reinforcement learning-based TST.
This is a preview of subscription content, log in to check access.
Buy single article
Instant unlimited access to the full article PDF.
Price includes VAT for USA
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
This is the net price. Taxes to be calculated in checkout.
Abdoos, M., Mozayani, N., & Bazzan, A. L. C. (2013). Holonic multi-agent system for traffic signals control. Engineering Applications of Artificial Intelligence, 26(5–6), 1575–1587.
Abdulhai, B., Pringle, R., & Karakoulas, G. J. (2003). Reinforcement learning for true adaptive traffic signal control. Journal of Transportation Engineering, 129(3), 278–285.
Al-Zinati, M., & Zalila-Wenkstern, R. (2015). Matisse 2.0: A large-scale multi-agent simulation system for agent-based its. In IEEE/WIC/ACM international conference on web intelligence and intelligent agent technology (WI-IAT), 2015 (vol. 2, pp. 328–335).
Balke, K, N., & Herrick, C. (2004). Potential measures of assessing signal timing performance using existing technologies. Technical Report FHWA/TX-04/0-4422-1, Texas A&M Transportation Institute, College Station, Texas 77843-3135.
Bazzan, A. L. C. (2005). A distributed approach for coordination of traffic signal agents. Autonomous Agents and Multi-Agent Systems, 10(1), 131–164.
Bazzan, A. L. C., de Oliveira, D., & da Silva, B. C. (2010). Learning in groups of traffic signals. Engineering Applications of Artificial Intelligence, 23(4), 560–568.
Bi, Y., Srinivasan, D., Xiaobo, L., Sun, Z., & Zeng, W. (2014). Type-2 fuzzy multi-intersection traffic signal control with differential evolution optimization. Expert Systems with Applications, 41(16), 7338–7349.
Chao, K.-H., Lee, R.-H., & Wang, M.-H. (2008). An intelligent traffic light control based on extension neural network. In Knowledge-based intelligent information and engineering systems (pp. 17–24). Berlin: Springer.
Cheng, S.-F., Epelman, M. A., & Smith, R. L. (2006). Cosign: A parallel algorithm for coordinated traffic signal control. IEEE Transactions on Intelligent Transportation Systems, 7(4), 551–564.
Chin, Y. K., Lee, L. K., Bolong, N., Yang, S. S., & Teo, K. T. K. (2011). Exploring Q-learning optimization in traffic signal timing plan management. In 2011 third international conference on computational intelligence, communication systems and networks (pp. 269–274).
Collotta, M., Bello, L. L., & Pau, G. (2015). A novel approach for dynamic traffic lights management based on wireless sensor networks and multiple fuzzy logic controllers. Expert Systems with Applications, 42(13), 5403–5415.
Diakaki, C., Papageorgiou, M., & Aboudolas, K. (2002). A multivariable regulator approach to traffic-responsive network-wide signal control. Control Engineering Practice, 10(2), 183–195.
Dusparic, I., & Cahill, V. (2012). Autonomic multi-policy optimization in pervasive systems: Overview and evaluation. ACM Transactions on Autonomous and Adaptive Systems (TAAS), 7(1), 11.
Dusparic, I., Monteil, J., & Cahill, V. (2016). Towards autonomic urban traffic control with collaborative multi-policy reinforcement learning. In 2016 IEEE 19th international conference on intelligent transportation systems (ITSC) (pp. 2065–2070).
El-Tantawy, S., & Abdulhai, B. (2010). An agent-based learning towards decentralized and coordinated traffic signal control. In 2010 13th international IEEE conference on intelligent transportation systems (ITSC) (pp. 665–670).
El-Tantawy, S., Abdulhai, B., & Abdelgawad, H. (2013). Multiagent reinforcement learning for integrated network of adaptive traffic signal controllers (MARLIN-ATSC): Methodology and large-scale application on downtown toronto. IEEE Transactions on Intelligent Transportation Systems, 14(3), 1140–1150.
France, J., & Ghorbani, A. A. (2003). A multiagent system for optimizing urban traffic. In Proceedings of the IEEE/WIC international conference on intelligent agent technology (pp. 411–414).
Gartner, N. H., Pooran, F. J., & Andrews, C. M. (2001). Implementation of the OPAC adaptive control strategy in a traffic signal network. In Proceedings. 2001 IEEE intelligent transportation systems, 2001 (pp. 195–200).
Goldstein, R., & Smith, S. F. (2018). Expressive real-time intersection scheduling. In Thirty-second AAAI conference on artificial intelligence.
Henry, J.-J., Farges, J. L., & Tuffal, J. (1983). The prodyn real time traffic algorithm. IFAC Proceedings Volumes, 16(4), 305–310.
Hu, H.-C., & Smith, S. F. (2018). Bi-directional information exchange in decentralized schedule-driven traffic control. In Proceedings of the 17th international conference on autonomous agents and multiagent systems. Bi-directional information exchange in decentralized schedule-driven traffic control (pp. 1962–1964).
Koonce, P., et al. (2008). Traffic signal timing manual. Technical report, United States. Federal Highway Administration.
Lu, S., Liu, X., & Dai, S. (2008). Incremental multistep Q-learning for adaptive traffic signal control based on delay minimization strategy. In 7th world congress on intelligent control and automation, WCICA (pp. 2854–2858). IEEE.
Mannion, P., Duggan, J., & Howley, E. (2015). Parallel reinforcement learning for traffic signal control (Vol. 52, pp. 956–961). Amsterdam: Elsevier.
Mirchandani, P., & Head, L. (2001). A real-time traffic signal control system: Architecture, algorithms, and analysis. Transportation Research Part C: Emerging Technologies, 9(6), 415–432.
Papageorgiou, M., Diakaki, C., Dinopoulou, V., Kotsialos, A., & Wang, Y. (2003). Review of road traffic control strategies. Proceedings of the IEEE, 91(12), 2043–2067.
Pham, T. T., Brys, T., Taylor, M. E., Brys, T., Drugan, M. M., Bosman, P. A., Cock, M.-D., Lazar, C., Demarchi, L., & Steenhoff, D., et al. (2013). Learning coordinated traffic light control. In Proceedings of the adaptive and learning agents workshop (at AAMAS-13) (vol. 10, pp. 1196–1201).
Prabuchandran, K. J., AN, H. K, & Bhatnagar, S. (2014). Multi-agent reinforcement learning for traffic signal control. In 2014 IEEE 17th international conference on intelligent transportation systems (ITSC) (pp. 2529–2534).
PTV Group. Ptv vissim. http://vision-traffic.ptvgroup.com/en-us/products/ptvvissim/. Accessed Oct 2018.
Richter, S. (2006). Learning traffic control-towards practical traffic control using policy gradients. Albert-Ludwigs-Universitat Freiburg, Tech. Rep.
Roads and Maritime Services. Scats: The benchmark in urban traffic control. http://www.scats.com.au/. Accessed Oct 2018.
Roozemond, D. A. (2001). Using intelligent agents for pro-active, real-time urban intersection control. European Journal of Operational Research, 131(2), 293–301.
Smith, S. F., Barlow, G. J., Xie, X.-F., & Rubinstein, Z. B. (2013). Smart urban signal networks: Initial application of the surtrac adaptive traffic signal control system. In Twenty-third international conference on automated planning and scheduling.
Srinivasan, D., Choy, M. C., & Cheu, R. L. (2006). Neural networks for real-time traffic signal control. IEEE Transactions on Intelligent Transportation Systems, 7(3), 261–272.
Torabi, B. (2017). A self-organizing traffic management system and its real-world implementation, Ph.D. proposal. Technical report, University of Texas at Dallas.
Torabi, Behnam, Al-Zinati, Mohammad, & Wenkstern, Rym Z. (2018). MATISSE 3.0: A Large-Scale Multi-agent Simulation System for Intelligent Transportation Systems. In Proceedings of the 16th international conference on practical applications of agents and multi-agent systems, PAAMS 18,Toledo, Spain (pp. 357–360).
Torabi, B., Wenkstern, R. Z., & Al-Zinati, M. (2018). An agent-based micro-simulator for ITS. In Proceedings of the 21st IEEE international conference on intelligent transportation systems, IEEE ITSC 2018, Maui, Hawaii, USA.
Torabi, B., Wenkstern, R. Z., & Saylor, R. (2018). A collaborative agent-based traffic signal system for highly dynamic traffic conditions. In Proceedings of the 21st IEEE international conference on intelligent transportation systems, IEEE ITSC 2018, Maui, Hawaii, USA.
Torabi, B., Wenkstern, R. Z., & Saylor, R. (2018). A multi-hop agent-based traffic signal timing system for the city of richardson. In Proceedings of the the sixteenth international conference on autonomous agent and multiagent systems, AAMAS, Stockholm, Sweden (pp. 2094–2096).
UK’s Transport Research Laboratory. Split cycle and offset optimisation technique. https://trlsoftware.co.uk/products/traffic_control/scoot. Accessed Oct 2018.
UK’s Transport Research Laboratory. Traffic network and isolated intersection study tool. https://trlsoftware.co.uk/products/junction_signal_design/transyt. Accessed Oct 2018.
Wen, K., Qu, S., & Zhang, Y. (2007). A stochastic adaptive control model for isolated intersections. In IEEE international conference on robotics and biomimetics, 2007. ROBIO (pp. 2256–2260).
Xie, X.-F., Smith, S. F., Chen, T.-W., & Barlow, G. J. (2014). Real-time traffic control for sustainable urban living. In 17th international IEEE conference on intelligent transportation systems (ITSC) (pp. 1863–1868).
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Torabi, B., Wenkstern, R.Z. & Saylor, R. A collaborative agent-based traffic signal system for highly dynamic traffic conditions. Auton Agent Multi-Agent Syst 34, 17 (2020) doi:10.1007/s10458-019-09434-w
- Intelligent transportation system
- Multi-agent systems
- Coordinated decision making