Abstract
Spot instances are extensively used to take advantage of large-scale Cloud infrastructures at lower prices than traditional on-demand instances. Autoscaling scientific workflows in the Cloud considering both spot and on-demand instances presents a major challenge as the autoscalers have to determine the proper amount and type of virtual machine instances to acquire, dynamically adjusting the number of instances under each pricing model (spots or on-demand) depending on the workflow needs. Under budget constraints, this adjustment is performed by an assignment policy that determines the suitable proportion of the available budget intended for each model. We propose an approach to derive an adaptive budget assignment policy able to reassign the budget at any point in the workflow execution. Given the inherent variability of the resources in a Cloud, we formalize the described problem as a Markov Decision Process and derive adaptive policies based on other baseline policies. Experiments demonstrate that our policies outperform all the baseline policies in terms of makespan and most of them in terms of cost. These promising results encourage the future study of new strategies aiming to find optimal budget policies applied to the execution of workflows on the Cloud.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
Amazon EC2 spot instances. https://aws.amazon.com/ec2/spot/pricing/.
- 2.
The task dependencies structure defines workflow levels.
References
Buyya, R., Yeo, C., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599–616 (2009)
Mao, M., Humphrey, M.: Scaling and scheduling to maximize application performance within budget constraints in cloud workflows. In: 2013 IEEE 27th International Symposium on Parallel & Distributed Processing (IPDPS), pp. 67–78. IEEE (2013)
Monge, D.A., Yisel, G., Mateos, C., García Garino, C.: Autoscaling scientific workflows on the cloud by combining on-demand and spot instances. Int. J. Comput. Syst. Sci. Eng. 32(4 Special Issue on Elastic Data Management in Cloud Systems), 291–306 (2017)
Expósito, R.R., Taboada, G.L., Ramos, S., Touriño, J., Doallo, R.: Performance analysis of HPC applications in the cloud. Future Gener. Comput. Syst. 29(1), 218–229 (2013)
Ben-Yehuda, O.A., Ben-Yehuda, M., Schuster, A., Tsafrir, D.: Deconstructing Amazon EC2 spot instance pricing. ACM Trans. Econ. Comput. 1(3), 16:1–16:20 (2013)
Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. Future Gener. Comput. Syst. 29(3), 682–692 (2013)
Huu, T.T., Koslovski, G., Anhalt, F., Montagnat, J., Vicat-Blanc Primet, P.: Joint elastic cloud and virtual network framework for application performance-cost optimization. J. Grid Comput. 9(1), 27–47 (2011)
Monge, D.A., García Garino, C.: Adaptive spot-instances aware autoscaling for scientific workflows on the cloud. In: Hernández, G., Barrios Hernández, C.J., Díaz, G., García Garino, C., Nesmachnow, S., Pérez-Acle, T., Storti, M., Vázquez, M. (eds.) CARLA 2014. CCIS, vol. 485, pp. 13–27. Springer, Heidelberg (2014). https://doi.org/10.1007/978-3-662-45483-1_2
Turchenko, V., Shultz, V., Turchenko, I., Wallace, R.M., Sheikhalishahi, M., Vazquez-Poletti, J.L., Grandinetti, L.: Spot price prediction for cloud computing using neural networks. Int. J. Comput. 12(4), 348–359 (2013)
Tang, S., Yuan, J., Li, X.Y.: Towards optimal bidding strategy for Amazon EC2 cloud spot instance. In: Proceedings of the 2012 IEEE 5th International Conference on Cloud Computing, CLOUD 2012, pp. 91–98 (2012)
Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)
Van Otterlo, M.: The Logic of Adaptive Behavior. Frontiers in Artificial Intelligence and Applications, vol. 192. IOS Press, Amsterdam (2009)
Barrett, E., Howley, E., Duggan, J.; A learning architecture for scheduling workflow applications in the cloud. In: Proceedings of the 9th IEEE European Conference on Web Services, ECOWS 2011, pp. 83–90 (2011)
Barrett, E., Howley, E., Duggan, J.: Applying reinforcement learning towards automating resource allocation and application scalability in the cloud. Concurr. Comput. Pract. Exp. 25, 1656–1674 (2012)
Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw.: Pract. Exp. 41(1), 23–50 (2011)
Jia, Y., Buyya, R., Tham, C.K.: Cost-based scheduling of scientific workflow applications on utility grids. In: Proceedings of the First International Conference on e-Science and Grid Computing, e-Science 2005, pp. 140–147 (2005)
Acknowledgements
This research is supported by the ANPCyT projects No. PICT-2012-2731 and PICT-2014-1430; and by the UNCuyo project No. SeCTyP-M041. The authors want to thank the anonymous reviewers for their valuable comments and suggestions that helped to improve the quality of this paper.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Garí, Y., Monge, D.A., Mateos, C., García Garino, C. (2018). Markov Decision Process to Dynamically Adapt Spots Instances Ratio on the Autoscaling of Scientific Workflows in the Cloud. In: Mocskos, E., Nesmachnow, S. (eds) High Performance Computing. CARLA 2017. Communications in Computer and Information Science, vol 796. Springer, Cham. https://doi.org/10.1007/978-3-319-73353-1_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-73353-1_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-73352-4
Online ISBN: 978-3-319-73353-1
eBook Packages: Computer ScienceComputer Science (R0)