Markov Decision Process to Dynamically Adapt Spots Instances Ratio on the Autoscaling of Scientific Workflows in the Cloud

  • Yisel GaríEmail author
  • David A. Monge
  • Cristian Mateos
  • Carlos García Garino
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 796)


Spot instances are extensively used to take advantage of large-scale Cloud infrastructures at lower prices than traditional on-demand instances. Autoscaling scientific workflows in the Cloud considering both spot and on-demand instances presents a major challenge as the autoscalers have to determine the proper amount and type of virtual machine instances to acquire, dynamically adjusting the number of instances under each pricing model (spots or on-demand) depending on the workflow needs. Under budget constraints, this adjustment is performed by an assignment policy that determines the suitable proportion of the available budget intended for each model. We propose an approach to derive an adaptive budget assignment policy able to reassign the budget at any point in the workflow execution. Given the inherent variability of the resources in a Cloud, we formalize the described problem as a Markov Decision Process and derive adaptive policies based on other baseline policies. Experiments demonstrate that our policies outperform all the baseline policies in terms of makespan and most of them in terms of cost. These promising results encourage the future study of new strategies aiming to find optimal budget policies applied to the execution of workflows on the Cloud.



This research is supported by the ANPCyT projects No. PICT-2012-2731 and PICT-2014-1430; and by the UNCuyo project No. SeCTyP-M041. The authors want to thank the anonymous reviewers for their valuable comments and suggestions that helped to improve the quality of this paper.


  1. 1.
    Buyya, R., Yeo, C., Venugopal, S., Broberg, J., Brandic, I.: Cloud computing and emerging IT platforms: vision, hype, and reality for delivering computing as the 5th utility. Future Gener. Comput. Syst. 25(6), 599–616 (2009)CrossRefGoogle Scholar
  2. 2.
    Mao, M., Humphrey, M.: Scaling and scheduling to maximize application performance within budget constraints in cloud workflows. In: 2013 IEEE 27th International Symposium on Parallel & Distributed Processing (IPDPS), pp. 67–78. IEEE (2013)Google Scholar
  3. 3.
    Monge, D.A., Yisel, G., Mateos, C., García Garino, C.: Autoscaling scientific workflows on the cloud by combining on-demand and spot instances. Int. J. Comput. Syst. Sci. Eng. 32(4 Special Issue on Elastic Data Management in Cloud Systems), 291–306 (2017)Google Scholar
  4. 4.
    Expósito, R.R., Taboada, G.L., Ramos, S., Touriño, J., Doallo, R.: Performance analysis of HPC applications in the cloud. Future Gener. Comput. Syst. 29(1), 218–229 (2013)CrossRefGoogle Scholar
  5. 5.
    Ben-Yehuda, O.A., Ben-Yehuda, M., Schuster, A., Tsafrir, D.: Deconstructing Amazon EC2 spot instance pricing. ACM Trans. Econ. Comput. 1(3), 16:1–16:20 (2013)Google Scholar
  6. 6.
    Juve, G., Chervenak, A., Deelman, E., Bharathi, S., Mehta, G., Vahi, K.: Characterizing and profiling scientific workflows. Future Gener. Comput. Syst. 29(3), 682–692 (2013)CrossRefGoogle Scholar
  7. 7.
    Huu, T.T., Koslovski, G., Anhalt, F., Montagnat, J., Vicat-Blanc Primet, P.: Joint elastic cloud and virtual network framework for application performance-cost optimization. J. Grid Comput. 9(1), 27–47 (2011)CrossRefGoogle Scholar
  8. 8.
    Monge, D.A., García Garino, C.: Adaptive spot-instances aware autoscaling for scientific workflows on the cloud. In: Hernández, G., Barrios Hernández, C.J., Díaz, G., García Garino, C., Nesmachnow, S., Pérez-Acle, T., Storti, M., Vázquez, M. (eds.) CARLA 2014. CCIS, vol. 485, pp. 13–27. Springer, Heidelberg (2014). Google Scholar
  9. 9.
    Turchenko, V., Shultz, V., Turchenko, I., Wallace, R.M., Sheikhalishahi, M., Vazquez-Poletti, J.L., Grandinetti, L.: Spot price prediction for cloud computing using neural networks. Int. J. Comput. 12(4), 348–359 (2013)Google Scholar
  10. 10.
    Tang, S., Yuan, J., Li, X.Y.: Towards optimal bidding strategy for Amazon EC2 cloud spot instance. In: Proceedings of the 2012 IEEE 5th International Conference on Cloud Computing, CLOUD 2012, pp. 91–98 (2012)Google Scholar
  11. 11.
    Bellman, R.: Dynamic Programming. Princeton University Press, Princeton (1957)zbMATHGoogle Scholar
  12. 12.
    Van Otterlo, M.: The Logic of Adaptive Behavior. Frontiers in Artificial Intelligence and Applications, vol. 192. IOS Press, Amsterdam (2009)zbMATHGoogle Scholar
  13. 13.
    Barrett, E., Howley, E., Duggan, J.; A learning architecture for scheduling workflow applications in the cloud. In: Proceedings of the 9th IEEE European Conference on Web Services, ECOWS 2011, pp. 83–90 (2011)Google Scholar
  14. 14.
    Barrett, E., Howley, E., Duggan, J.: Applying reinforcement learning towards automating resource allocation and application scalability in the cloud. Concurr. Comput. Pract. Exp. 25, 1656–1674 (2012)CrossRefGoogle Scholar
  15. 15.
    Calheiros, R.N., Ranjan, R., Beloglazov, A., De Rose, C.A.F., Buyya, R.: CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Softw.: Pract. Exp. 41(1), 23–50 (2011)Google Scholar
  16. 16.
    Jia, Y., Buyya, R., Tham, C.K.: Cost-based scheduling of scientific workflow applications on utility grids. In: Proceedings of the First International Conference on e-Science and Grid Computing, e-Science 2005, pp. 140–147 (2005)Google Scholar

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Yisel Garí
    • 1
    Email author
  • David A. Monge
    • 1
    • 2
  • Cristian Mateos
    • 4
  • Carlos García Garino
    • 1
    • 3
  1. 1.ITIC-CONICETUniversidad Nacional de Cuyo (UNCuyo)MendozaArgentina
  2. 2.Facultad de Ciencias Exactas y NaturalesUNCuyoMendozaArgentina
  3. 3.Facultad de IngenieríaUNCuyoMendozaArgentina
  4. 4.ISISTAN-UNICEN-CONICETTandilArgentina

Personalised recommendations