Abstract
Comparisons of simulation results (model-to-model approach) are important for examining the validity of simulation models. One of the factors preventing the widespread application of this approach is the lack of methods for comparing multi-agent-based simulation results. In order to expand the application area of the model-to-model approach, this paper introduces a quantitative method for comparing multi-agent-based simulation models that have the following properties: (1) time series data is regarded as a simulation result and (2) simulation results are different each time the model is used due to the effect of randomness, even though the parameter setups are all the same. To evaluate the effectiveness of the proposed method, we used it for the comparison of artificial stock market simulations using two different learning algorithms. We concluded that our method is useful for (1) investigating the difference in the trends of simulation results obtained from models using different learning algorithms; and (2) identifying reliable simulation results that are minimally influenced by the learning algorithms used.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Takadama, K., Fujita, H.: Toward guidelines for modeling learning agents in multiagent-based simulation: Implications from Q-learning and Sarsa agents. In: Davidsson, P., Logan, B., Takadama, K. (eds.) MABS 2004. LNCS (LNAI), vol. 3415, pp. 159–172. Springer, Heidelberg (2005)
Axtell, R., Axelrod, R., Epstein, J., Cohen, M.: Aligning simulation models: A case study and results. Santa Fe Institute, Working Papers 95-07-065 (1995)
Takadama, K., Suematsu, Y.L., Sugimoto, N., Nawa, N.E., Shimohara, K.: Cross-element validation in multiagent-based simulation: Switching learning mechanisms in agents. Journal of Artificial Societies and Social Simulation 6(4) (2003), http://jasss.soc.surrey.ac.uk/6/4/6.html
Keogh, E., Kasetty, S.: On the need for time series data mining benchmarks: A survey and empirical demonstration. In: ACM SIGKDD International Conference on Knowledge discovery and data mining, pp. 102–111 (2002)
Morchen, F.: Time series feature extraction for data mining using DWT and DFT. Technical Report 33. Departement of Mathematics and Computer Science, Philipps-University Marburg (2003)
Beyer, K., Goldstein, J., Ramakrishnan, R., Shaft, U.: When is “nearest neighbor” meaningful? In: Beeri, C., Bruneman, P. (eds.) ICDT 1999. LNCS, vol. 1540, pp. 217–235. Springer, Heidelberg (1999)
Agrawal, R., Faloutsos, C., Arun, N., Swami, A.N.: Efficient Similarity Search In Sequence Databases. In: Lomet, D. (ed.) 4th International Conference of Foundations of Data Organization and Algorithms (FODO), pp. 69–84. Springer, Heidelberg (1993)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. John Wiley & Sons, Inc., Chichester (2000)
Torgerson, W.S.: Multidimensional scaling: I. theory and method. Psychometrika 17(4), 401–419 (1952)
Eckart, C., Young, G.: Approximation of one matrix by another of lower rank. Psychometrika 1(3), 211–218 (1936)
Palmer, R.G., Arthur, W.B., Holland, J.H., LeBaron, B., Tayler, P.: Artificial economic life: a simple model of a stockmarket. Physica D: Nonlinear Phenomena 75(1-3), 264–274 (1994)
Arthur, W.B., Holland, J.H., LeBaron, B., Palmer, R.G., Tayler, P.: Asset Pricing Under Endogenous Expectations in an Artificial Stock Market. Santa Fe Institute, Working Paper 96-12-093 (1996)
Tsay, R.S.: Analysis of financial time series: financial econometrics. John Wiley & Sons, Inc., Chichester (2002)
Chan, K.P., Fu, A.W.C.: Efficient time series matching by wavelets. In: 15th International Conference on Data Engineering, pp. 126–133. IEEE Computer Society, Los Alamitos (1999)
Wu, Y.L., Agrawal, D., Abbadi, A.E.: A comparison of DFT and DWT based similarity search in time-series databases. In: Ninth Internatinal Conference on Information and Knowledge Management, pp. 488–495 (2000)
Terano, T.: Exploring the vast parameter space of multi-agent based simulation. In: Antunes, L., Takadama, K. (eds.) MABS 2006. LNCS (LNAI), vol. 4442, pp. 1–14. Springer, Heidelberg (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Arai, R., Watanabe, S. (2009). A Quantitative Method for Comparing Multi-Agent-Based Simulations in Feature Space. In: David, N., Sichman, J.S. (eds) Multi-Agent-Based Simulation IX. MABS 2008. Lecture Notes in Computer Science(), vol 5269. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-01991-3_12
Download citation
DOI: https://doi.org/10.1007/978-3-642-01991-3_12
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-01990-6
Online ISBN: 978-3-642-01991-3
eBook Packages: Computer ScienceComputer Science (R0)