Skip to main content
SpringerLink
Log in

SHYAM: A System for Autonomic Management of Virtual Clusters in Hybrid Clouds

  • Conference paper
  • First Online:
Advances in Service-Oriented and Cloud Computing (ESOCC 2015)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 567))

Included in the following conference series:

  • 1933 Accesses

Abstract

While the public cloud model has been vastly explored over the last few years to face the demand for large-scale distributed computing capabilities, many organizations are now focusing on the hybrid cloud model, where the classic scenario is enriched with a private (company owned) cloud – e.g., for the management of sensible data. In this work, we propose SHYAM, a software layer for the autonomic deployment and configuration of virtual clusters on a hybrid cloud. This system can be used to face the temporary (or permanent) lack of computational resources on the private cloud, allowing cloud bursting in the context of big data applications. We firstly provide an empirical evaluation of the overhead introduced by SHYAM provisioning mechanism. Then we show that, although the execution time is significantly influenced by the inter-cloud bandwidth, an autonomic off-premise provisioning mechanism can significantly improve the application performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Institutional subscriptions

References

  1. Apache hadoop. https://hadoop.apache.org/

  2. Openstack: Opensource cloud computing software. https://www.openstack.org/

  3. Openstack sahara. https://wiki.openstack.org/wiki/Sahara

  4. Puma datasets. https://engineering.purdue.edu/puma/datasets.htm

  5. Armbrust, M., Fox, O.: Above the clouds: a Berkeley view of cloud computing. Electrical Engineering and CS University of California, Technical report (2009)

    Google Scholar 

  6. Beloglazov, A., Abawajy, J., Buyya, R.: Energy-aware resource allocation heuristics for efficient management of data centers for cloud computing. Future Gener. Comput. Syst. 28(5), 755–768 (2012)

    Article  Google Scholar 

  7. Bicer, T., Chiu, D., Agrawal, G.: A framework for data-intensive computing with cloud bursting. In: IEEE International Conference on Cluster Computing (2011)

    Google Scholar 

  8. Cardosa, M., Wang, C., Nangia, A., Chandra, A., Weissman, J.: Exploring mapreduce efficiency with highly-distributed data. In: Proceedings of the Second International Workshop on MapReduce and Its Applications. ACM (2011)

    Google Scholar 

  9. Chen, K., Powers, J., Guo, S., Tian, F.: Cresp: towards optimal resource provisioning for mapreduce computing in public clouds. IEEE Trans. Parallel Distrib. Syst. 25(6), 1403–1412 (2014)

    Article  Google Scholar 

  10. Chen, M., Mao, S., Liu, Y.: Big data: a survey. Mob. Netw. Appl. 19(2), 171–209 (2014)

    Article  Google Scholar 

  11. Collins, E.: Intersection of the cloud and big data. IEEE Cloud Comput. 1(1), 84–85 (2014)

    Article  Google Scholar 

  12. Dean, J., Ghemawat, S.: Mapreduce: simplified data processing on large clusters. Commun. ACM 51(1), 107–113 (2008)

    Article  Google Scholar 

  13. Guo, T., Sharma, U., Shenoy, P., Wood, T., Sahu, S.: Cost-aware cloud bursting for enterprise applications. ACM Trans. Internet Technol. 13(3), 10 (2014)

    Article  Google Scholar 

  14. Kailasam, S., Dhawalia, P., Balaji, S.: Extending mapreduce across clouds with bstream. IEEE Trans. Cloud Comput. 2(3), 362–376 (2014)

    Article  Google Scholar 

  15. Mattess, M., Calheiros, R., Buyya, R.: Scaling mapreduce applications across hybrid clouds to meet soft deadlines. In: IEEE 27th International Conference on Advanced Information Networking and Applications, pp. 629–636 (2013)

    Google Scholar 

  16. Nagin, K., Hadas, D.: Inter-cloud mobility of virtual machines. In: Proceedings of the 4th Annual International Conference on Systems and Storage. ACM (2011)

    Google Scholar 

  17. Palanisamy, B., Singh, A., Liu, L.: Cost-effective resource provisioning for mapreduce in a cloud. IEEE Trans. Parallel Distrib. Syst. 26(5), 1265–1279 (2015)

    Article  Google Scholar 

  18. Rizvandi, N., Taheri, J.: A study on using uncertain time series matching algorithms for mapreduce applications. Concurrency Comput. 25(12), 1699–1718 (2013)

    Article  Google Scholar 

  19. Toosi, A.N., Calheiros, R.N., Buyya, R.: Interconnected cloud computing environments: challenges, taxonomy, and survey. ACM Comput. Surv. 47(1), 7 (2014)

    Article  Google Scholar 

  20. Verma, A., Cherkasova, L., Campbell, R.H.: Resource provisioning framework for mapreduce jobs with performance goals. In: Kon, F., Kermarrec, A.-M. (eds.) Middleware 2011. LNCS, vol. 7049, pp. 165–186. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  21. Zhang, H., Jiang, G., Yoshihira, K.: Proactive workload management in hybrid cloud computing. IEEE Trans. Netw. Serv. Manage. 11(1), 90–100 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. DISI - Department of Computer Science and Engineering, Università di Bologna, Viale del Risorgimento 2, Bologna, Italy

    Daniela Loreti & Anna Ciampolini

Authors
  1. Daniela Loreti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Anna Ciampolini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Daniela Loreti .

Editor information

Editors and Affiliations

  1. DICIEAMA, University of Messina, Messina, Italy

    Antonio Celesti

  2. Software Evolution and Architecture Lab, University of Zürich Software Evolution and Architecture Lab, Zürich, Switzerland

    Philipp Leitner

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this paper

Cite this paper

Loreti, D., Ciampolini, A. (2016). SHYAM: A System for Autonomic Management of Virtual Clusters in Hybrid Clouds. In: Celesti, A., Leitner, P. (eds) Advances in Service-Oriented and Cloud Computing. ESOCC 2015. Communications in Computer and Information Science, vol 567. Springer, Cham. https://doi.org/10.1007/978-3-319-33313-7_28

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-33313-7_28

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-33312-0

  • Online ISBN: 978-3-319-33313-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation