Skip to main content

An Improved Learning Automata Approach for the Route Choice Problem

  • Conference paper
Agent Technology for Intelligent Mobile Services and Smart Societies (AVSA 2014, CARE 2014)

Abstract

Urban mobility is a major challenge in modern societies. Increasing the infrastructure’s physical capacity has proven to be unsustainable from a socio-economical perspective. Intelligent transportation systems (ITS) emerge in this context, aiming to make a more efficient use of existing road networks by means of new technologies. In this paper we address the route choice problem, in which drivers need to decide which route to take to reach their destinations. In this respect, we model the problem as a multiagent system where each driver is represented by a learning automaton, and learns to choose routes based on past experiences. In order to improve the learning process, we also propose a mechanism that updates the drivers’ set of routes, allowing faster routes to be learned. We show that our approach provides reasonably good solutions, and is able to mitigate congestion levels in main roads.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bazzan, A.L., Klügl, F.: Introduction to Intelligent Systems in Traffic and Transportation. Synthesis Lectures on Artificial Intelligence and Machine Learning, vol. 7. Morgan and Claypool(2013)

    Google Scholar 

  2. Ortúzar, J., Willumsen, L.G.: Modelling Transport, 3rd edn. John Wiley & Sons (2001)

    Google Scholar 

  3. Buriol, L.S., Hirsh, M.J., Pardalos, P.M., Querido, T., Resende, M.G., Ritt, M.: A biased random-key genetic algorithm for road congestion minimization. Optimization Letters 4, 619–633 (2010)

    Article  MATH  MathSciNet  Google Scholar 

  4. Tavares, A.R., Bazzan, A.L.C.: Independent learners in abstract traffic scenarios. Revista de Informática Teórica e Aplicada 19(2), 13–33 (2012)

    Google Scholar 

  5. Klügl, F., Bazzan, A.L.C.: Route decision behaviour in a commuting scenario. Journal of Artificial Societies and Social Simulation 7(1) (2004)

    Google Scholar 

  6. Bazzan, A.L.C., Fehler, M., Klügl, F.: Implicit coordination in a network of social drivers: The role of information in a commuting scenario. In: Tuyls, K., Jan’t Hoen, P., Verbeeck, K., Sen, S. (eds.) LAMAS 2005. LNCS (LNAI), vol. 3898, pp. 115–128. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Narendra, K.S., Thathachar, M.A.L.: Learning Automata: An Introduction. Prentice-Hall, Upper Saddle River (1989)

    Google Scholar 

  8. Cagara, D., Bazzan, A.L.C., Scheuermann, B.: Getting you faster to work - A genetic algorithm approach to the traffic assignment problem. In: Proc. of the 16th Annual Conf. on Genetic and Evol. Comp. (Companion), New York (2014)

    Google Scholar 

  9. Pel, A.J., Nicholson, A.J.: Network effects of percentile-based route choice behaviour for stochastic travel times under exogenous capacity variations. In: Proc. of the 16th Intl. IEEE Annual Conf. on Int. Transp. Systems, pp. 1864–1869 (2013)

    Google Scholar 

  10. Yen, J.Y.: Finding the k shortest loopless paths in a network. Management Science 17(11), 712–716 (1971)

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

de O. Ramos, G., Grunitzki, R. (2015). An Improved Learning Automata Approach for the Route Choice Problem. In: Koch, F., Meneguzzi, F., Lakkaraju, K. (eds) Agent Technology for Intelligent Mobile Services and Smart Societies. AVSA CARE 2014 2014. Communications in Computer and Information Science, vol 498. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-46241-6_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-46241-6_6

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-46240-9

  • Online ISBN: 978-3-662-46241-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics