Abstract
In cloud computing, the arrival process of user requests is becoming more diversiform with the globalization of users and the popularization of mobile technology. Moreover, the workloads in cloud computing are tending towards a hybrid of more applications types. It is hardly for the traditional arrival process models to cover the ever-increasing new arrival processes in reality. For that, we propose a general and flexible arrival process model to describe various arrival processes. At the same time, we present a unified generation algorithm to generate the corresponding workload arrival instance based on the arrival process model automatically. The model defines the arrival process by four steps: firstly defines the number of intervals during the workload lifetime, then defines the length of each time interval, next defines the number of requests arriving during each time interval, lastly defines the arrival time points during each time interval. In the case study, we use the generic arrival process model to describe three arrival process models of typical cloud application types and a custom arrival process model, and present corresponding arrival instances using the generation algorithm. The cases showed the flexibility and extensibility of the model. The model and algorithm are simple and generic and are more approaching to realistic hybrid arrival processes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Li, H.: Realistic workload modeling and its performance impacts in large-scale escience grids. IEEE Trans. Parallel Distrib. Syst. 21(4), 480–493 (2010)
Guo, M., Guan, Q. Ke, W.: Optimal Scheduling of VMs in Queueing Cloud Computing Systems with a Heterogeneous Workload, vol. 6 (2018)
Vakilinia, S., Ali, M.M., Qiu, D.: Modeling of the resource allocation in cloud computing centers. Comput. Netw. 91, 453–470 (2015)
Lin, A.D., Li, C.S., Liao, W., Franke, H.: Capacity optimization for resource pooling in virtualized data centers with composable systems. IEEE Trans. Parallel Distrib. Syst. 29(2), 324–337 (2018)
Iosup, A., Sonmez, O., Anoep, S., Epema, D.: The performance of bags-of-tasks in large-scale distributed systems. In: Proceedings of the 17th International Symposium on High Performance Distributed Computing—HPDC 2008, p. 97 (2008)
Costa, G.D., Grange, L. Courchelle, I.D., Costa, G.D., Grange, L., Courchelle, I.D.: Modeling and generating large-scale google-like workload (2016)
Wolski, R., Brevik, J.: Using parametric models to represent Private cloud workloads. IEEE Trans. Serv. Comput. 7(4), 714–725 (2014)
Atmaca, T., Begin, T., Brandwajn, A., Castel-Taleb, H.: Performance evaluation of cloud computing centers with general arrivals and service. IEEE Trans. Parallel Distrib. Syst. 27(8), 2341–2348 (2016)
Bolch, et al.: Queueing Networks and Markov Chains. Wiley, New York (1998)
Casale, G.: Building accurate workload models using Markovian arrival processes. In: Proceedings of the ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems - SIGMETRICS 2011, p. 357 (2011)
Meier-Hellstern, K., Fischer, W.: The Markov-modulated Poisson process (MMPP) cookbook. Perform. Eval. 18(18), 149–171 (1993)
Wang, E., Yang, Y., Wu, J., Liu, W., Wang, X.: An efficient prediction-based user recruitment for mobile crowdsensing. IEEE Trans. Mob. Comput. 17(1), 1 (2017)
Pacheco-Sanchez, S., Casale, G., Scotney, B., McClean, S., Parr, G., Dawson, S.: Markovian workload characterization for QoS prediction in the cloud. In: Proceedings—2011 IEEE 4th International Conference on Cloud Computing CLOUD 2011, pp. 147–154 (2011)
Li, H., Muskulus, M., Wolters, L.: Modeling job arrivals in a data-intensive grid. Job Sched. Strateg. Parallel Process. 4376, 210–231 (2007)
Ware, P.P., Page, T.W., Nelson, B.L.: Automatic modeling of file system workloads using two-level arrival processes. ACM Trans. Model. Comput. Simul. 8(3), 305–330 (1998)
RUBiS. http://rubis.ow2.org/ (2018)
Wilkes, J.: PRESS: PRedictive Elastic ReSource Scaling for cloud systems. In: 2010 International Conference on Network and Service Management, pp. 9–16 (2010)
Cloud, S., et al.: SPEC Cloud TM IaaS 2016 Benchmark Design Overview, pp. 1–37 (2016)
Yin, J., Lu, X., Zhao, X., Chen, H., Liu, X.: BURSE: a bursty and self-similar workload generator for cloud computing. IEEE Trans. Parallel Distrib. Syst. 9219 (2014)
An, C., Zhou, J., Liu, S., Geihs, K.: A multi-tenant hierarchical modeling for cloud computing workload. Intell. Autom. Soft Comput. 1–8 (2016)
The Apache Olio Project. http://incubator.apache.org/olio/
Chen, Y., Ganapathi, A., Griffith, R., Katz, R.: The case for evaluating MapReduce performance using workload suites. In: 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems, pp. 390–399 (2011)
Acknowledgement
The authors wish to thank Natural Science Foundation of China under Grant No. 61662054, 61262082,61562064 and 61462066, Natural Science Foundation of Inner Mongolia under Grand No.2015MS0608 and 2018MS06029, Inner Mongolia Science and Technology Innovation Team of Cloud Computing and Software Engineering and Inner Mongolia Application Technology Research and Development Funding Project “Mutual Creation Service Platform Research and Development Based on Service Optimizing and Operation Integrating”, Inner Mongolia Engineering Lab of Cloud Computing and Service Software and Inner Mongolia Engineering Lab of Big Data Analysis Technology.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
An, C., Zhou, Jt., Mou, Z. (2019). A Generic Arrival Process Model for Generating Hybrid Cloud Workload. In: Sun, Y., Lu, T., Xie, X., Gao, L., Fan, H. (eds) Computer Supported Cooperative Work and Social Computing. ChineseCSCW 2018. Communications in Computer and Information Science, vol 917. Springer, Singapore. https://doi.org/10.1007/978-981-13-3044-5_8
Download citation
DOI: https://doi.org/10.1007/978-981-13-3044-5_8
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-3043-8
Online ISBN: 978-981-13-3044-5
eBook Packages: Computer ScienceComputer Science (R0)