Abstract
Large scale distributed agent-based simulations run on several computing units (e.g., virtual machines in the Cloud, nodes in a supercomputer). Classically, these systems try to (re-)load-balance the nodes as overloaded nodes slow down the process.However another challenge in large scale distributed simulations is that the overall load evolves. In this paper we leverage on commodity computing to adapt resource provisioning (number of computing units) to the load during the execution of the simulation. We also propose an asynchronous migration mechanism that migrate workload between computing nodes efficiently when nodes wait for synchronisation barriers to happen. We validate our implementation on a scenario simulating one day of vehicular traffic in Tokyo, running on 2 to 8 machines depending on the demand. Our evaluation shows a 26% reduction in data migration time compared to a naive migration approach between computing units.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Amazon EC2, https://aws.amazon.com/ec2/
Google Compute Engine, https://cloud.google.com/products/compute-engine/
K computer, http://www.kcomputer.jp/en/
Matsim, http://www.matsim.org/
Microsft Asure, http://azure.microsoft.com/
Rackspace Cloud, http://www.rackspace.com/
Tsubame 2.5, http://www.gsic.titech.ac.jp/en/tsubame/
Bragard, Q., Ventresque, A., Murphy, L.: dSUMO: towards a distributed SUMO. In: SUMO Conference (2013)
Charles, P., Grothoff, C., Saraswat, V., Donawa, C., Kielstra, A., Ebcioglu, K., Von Praun, C., Sarkar, V.: X10: an object-oriented approach to non-uniform cluster computing. ACM SIGPLAN Notices 40(10), 519–538 (2005)
Collier, N., North, M.: Repast HPC: A platform for large-scale agent-based modeling. Wiley (2011)
Gandhi, A., Chen, Y., Gmach, D., Arlitt, M., Marwah, M.: Minimizing data center sla violations and power consumption via hybrid resource provisioning. In: Green Computing Conference and Workshops, pp. 1–8. IEEE (2011)
Karypis, G., Kumar, V.: Multilevel k-way partitioning scheme for irregular graphs. Journal of Parallel and Distributed Computing 48(1), 96–129 (1998)
Karypis, G., Kumar, V.: METIS - a software package for partitioning unstructured graphs, meshes, and computing fill-reducing orderings of sparse matrices-version 5.0. University of Minnesota (2011)
Li, S., Wang, Y., Qiu, X., Wang, D., Wang, L.: A workload prediction-based multi-vm provisioning mechanism in cloud computing. In: Asia-Pacific Network Operations and Management Symposium, pp. 1–6. IEEE (2013)
Osogami, T., Imamichi, T., Mizuta, H., Morimura, T., Raymond, R., Suzumura, T., Takahashi, R., Ide, T.: IBM Mega Traffic Simulator. Technical report, Technical Report RT0896, IBM Research–Tokyo (2012)
Osogami, T., Imamichi, T., Mizuta, H., Suzumura, T., Ide, T.: Toward simulating entire cities with behavioral models of traffic. IBM Journal of Research and Development 57(5), 1–6 (2013)
Paolucci, M., et al.: Towards a living earth simulator. The European Physical Journal Special Topics 214(1), 77–108 (2012)
Raney, B., Cetin, N., Völlmy, A., Vrtic, M., Axhausen, K., Nagel, K.: An agent-based microsimulation model of swiss travel: First results. Networks and Spatial Economics 3(1), 23–41 (2003)
Suzumura, T., Kanezashi, H.: Accelerating large-scale distributed traffic simulation with adaptive synchronization method. In: ITS World Congress (2013)
Suzumura, T., Kato, S., Imamichi, T., Takeuchi, M., Kanezashi, H., Ide, T., Onodera, T.: X10-based massive parallel large-scale traffic flow simulation. In: ACM SIGPLAN X10 Workshop, p. 3. ACM (2012)
Ventresque, A., Bragard, Q., Liu, E.S., Nowak, D., Murphy, L., Theodoropoulos, G., Liu, J.Q.: SParTSim: A space partitioning guided by road network for distributed traffic simulations. In: DS-RT, pp. 202–209. IEEE (2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Hanai, M., Suzumura, T., Ventresque, A., Shudo, K. (2014). Towards a Framework for Adaptive Resource Provisioning in Large-Scale Distributed Agent-Based Simulation. In: Lopes, L., et al. Euro-Par 2014: Parallel Processing Workshops. Euro-Par 2014. Lecture Notes in Computer Science, vol 8805. Springer, Cham. https://doi.org/10.1007/978-3-319-14325-5_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-14325-5_37
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-14324-8
Online ISBN: 978-3-319-14325-5
eBook Packages: Computer ScienceComputer Science (R0)