Skip to main content

Data Driven Validation Framework for Multi-agent Activity-Based Models

  • Conference paper
  • First Online:
Multi-Agent Based Simulation XVI (MABS 2015)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9568))

Abstract

Activity-based models, as a specific instance of agent-based models, deal with agents that structure their activity in terms of (daily) activity schedules. An activity schedule consists of a sequence of activity instances, each with its assigned start time, duration and location, together with transport modes used for travel between subsequent activity locations. A critical step in the development of simulation models is validation. Despite the growing importance of activity-based models in modelling transport and mobility, there has been so far no work focusing specifically on statistical validation of such models. In this paper, we propose a six-step Validation Framework for Activity-based Models (VALFRAM) that allows exploiting historical real-world data to assess the validity of activity-based models. The framework compares temporal and spatial properties and the structure of activity schedules against real-world travel diaries and origin-destination matrices. We confirm the usefulness of the framework on three activity-based transport models.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 34.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 44.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Valid model is a model of sufficient accuracy. We use these terms interchangeably in the following text.

  2. 2.

    We have also experimented with related Anderson-Darling and Cramér–von Mises statistics getting similar results. Kolmogorv-Smrnov was finally selected as it is widely known and easier to get insight into.

  3. 3.

    Note, that none activities are added to the beginning and end of the activity schedule in order to preserve information about initial/terminal activity.

  4. 4.

    Although we call M\(_{\text {A}}\) the rule-based model, it estimates activity count, durations and occasionally start times using linear-regression models based on data. All other activity schedule properties are based on rules constructed using expert knowledge.

  5. 5.

    At least given the limited size of the RNN training dataset.

References

  • Arentze, T., Timmermans, H.: Albatross: a learning based transportation oriented simulation system. Eirass Eindhoven (2000)

    Google Scholar 

  • Ben-Akivai, M., Bowman, J.L., Gopinath, D.: Travel demand model system for the information era. Transportation 23(3), 241–266 (1996)

    Article  Google Scholar 

  • Bonabeau, E.: Agent-based modeling: methods and techniques for simulating human systems. Proc. Nat. Acad. Sci. U.S.A. 99(suppl 3), 7280–7287 (2002)

    Article  Google Scholar 

  • Chen, B., Cheng, H.H.: A review of the applications of agent technology in traffic and transportation systems. IEEE Trans. Intell. Transp. Syst. 11(2), 485–497 (2010)

    Article  Google Scholar 

  • de Dios Ortúzar, J., Willumsen, L.: Modelling Transport. Wiley, Hoboken (2011)

    Book  Google Scholar 

  • Gärling, T., Kwan, M.-P., Golledge, R.G.: Computational-process modelling of household activity scheduling. Transp. Res. Part B Methodol. 28(5), 355–364 (1994)

    Article  Google Scholar 

  • Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)

    Article  Google Scholar 

  • Hollander, M., Wolfe, D.A., Chicken, E.: Nonparametric Statistical Methods, 3rd edn. Wiley, Hoboken (2013)

    MATH  Google Scholar 

  • Jones, P.M., Dix, M.C., Clarke, M.I., Heggie, I.G.: Understanding travel behaviour. Number Monograph (1983)

    Google Scholar 

  • Jones, P.M., Koppelman, F., Orfeuil, J.-P.: Activity analysis: state-of-the-art and future directions. Developments in dynamic and activity-based approaches to travel analysis, pp. 34–55 (1990)

    Google Scholar 

  • Klügl, F.: Agent-based simulation engineering. Ph.D. thesis, Habilitation Thesis, University of Würzburg (2009)

    Google Scholar 

  • Law, A.M.: Simulation Modeling and Analysis, 4th edn. McGraw-Hill, New York (2007)

    Google Scholar 

  • Law, A.M.: How to build valid and credible simulation models. In: Proceedings of the 2009 Winter Simulation Conference (WSC), pp. 24–33. IEEE (2009)

    Google Scholar 

  • Manning, C.D.: Foundations of Statistical Natural Language Processing. MIT Press, Cambridge (1999)

    MATH  Google Scholar 

  • Sokal, R.R., Rohlf, F.J.: Biometry: The Principles and Practices of Statistics in Biological Research, 3rd edn. W.H. Freeman, New York (1994)

    MATH  Google Scholar 

Download references

Acknowledgement

This publication was supported by the European social fund within the framework of realizing the project “Support of inter-sectoral mobility and quality enhancement of research teams at Czech Technical University in Prague”, CZ.1.07/ 2.3.00/30.0034, period of the project’s realization 1.12.2012 – 30.6.2015. This publication was further supported by the Technology Agency of the Czech Republic (grant no. TE01020155).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jan Drchal .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Drchal, J., Čertický, M., Jakob, M. (2016). Data Driven Validation Framework for Multi-agent Activity-Based Models. In: Gaudou, B., Sichman, J. (eds) Multi-Agent Based Simulation XVI. MABS 2015. Lecture Notes in Computer Science(), vol 9568. Springer, Cham. https://doi.org/10.1007/978-3-319-31447-1_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-31447-1_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-31446-4

  • Online ISBN: 978-3-319-31447-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics