Skip to main content

Resource and Scheduling Management in Cloud Computing Application Paradigm

  • Chapter
  • First Online:
Cloud Computing

Abstract

In the ‘Era of Peta’ processing level, which supports several concepts and practices in order to build highly scalable applications, there is a great need to have the offered services provided to the end-users, with the minimum possible reduction in quality in terms of time and availability. This chapter addresses some of these traditional concepts combined in a ‘multi-sharing’ cloud application environment and discusses how these concepts evolve in the context of cloud computing. The chapter also presents some unprecedented issues, such as resource allocation and management and the potential inefficiencies in the currently utilised APIs in the cloud computing application paradigm that have emerged through time. As the size of the cloud environment increases, efficient resource allocation and management become even more challenging, whereas the problem of optimisation in a large distributed environment under QoS constraints needs a potentially utility-oriented solution. Current methods, although efficient, need to be re-engineered encompassing methods suitable for distributed system optimisation for managing the future clouds. It also exposes the state-of-the-art techniques to provide efficient replicated storage according to the data semantic context and resource batching for satisfying users’ requests originating from anywhere anytime using both static and moving environments. The upcoming and current computing paradigm is envisioned to be offering synchronous and asynchronous services in the context of the cloud computing services paradigm. Cloud computing has evolved through the creation of a new service paradigm by utilising data centres and assembling services of networked virtual machines. Therefore, the availability of the requested resources by users poses a crucial parameter for the adequacy of the service provided. One of the major deployments of the cloud application paradigm is the virtual data centres (VDC). These are utilised by service providers which enable a virtual infrastructure in a distributed manner in various remotely hosted locations worldwide to provide accessibility and backup services in order to ensure reliability. This chapter also presents resource considerations and paradigms in the cloud environment describing the fundamental operations that are required for faster response time by distributing workload requests to multiple VCDs using certain resource manipulation techniques such as the Virtual Engine Migration (VEM) for resource availability and the associated resource management in VDCs using user-based VEM resource migration or virtual-to-virtual (V2V) resource migration.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Yeo, C.S., Buyya, R., Dias de Assuncao, M., Yu, J., Sulistio, A., Venugopal, S., Placek, M.: Utility computing on global grids. In: Bidgoli, H. (ed.) Handbook of Computer Networks, p. 2008. Wiley, Hoboken (2008)

    Google Scholar 

  2. Mell, P., Grance, T.: The NIST definition of cloud computing. Technical Report Version 15, Information Technology Laboratory Newsletter, NIST (2009)

    Google Scholar 

  3. VMWare Inc.: VMware vSphere. In: The First Cloud Operating, White Paper (2009)

    Google Scholar 

  4. Sotomayor, B., Montero, R.S., Llorente, I.M., Foster, I.: Virtual infrastructure management in private and hybrid clouds. IEEE Internet Comput. 13(5), 1422 (2009)

    Article  Google Scholar 

  5. De Assuncao, M.D., Di Costanzo, A., Buyya, R.: Evaluating the cost benefit of using cloud computing to extend the capacity of clusters. In: Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing (HPDC 2009), Munich, 2009, pp. 141–150 (2009)

    Google Scholar 

  6. Rimal, B.P., Eunmi, C., Lumb, I.: A taxonomy and survey of cloud computing systems. Proceedings of Fifth International IEEE INC, IMS and IDC, Joint Conferences 25–27 Aug 2009 (NCM 2009), pp. 44–51. Seoul Korea (2009)

    Google Scholar 

  7. Google: Google Chrome OS: http://www.google.com/chrome (2012). Accessed 19 Apr 2012

  8. Bolchini, C., Curino, C.A., Quintarelli, E., Schreiber, F., Tanca, L.: A dataoriented survey of context models. SIGMOD Rec. 36(4), 1926 (2007)

    Article  Google Scholar 

  9. Salehi, A.M., Javadi, B., Buyya, R.: QoS and preemption aware scheduling in federated and virtualized grid computing environments. J. Parallel Distrib. Comput. 72(2), 231–245 (2012). ISSN: 0743–7315

    Article  Google Scholar 

  10. Redhat http://www.redhat.com/. Accessed 27 Apr 2012

  11. Salesforce.com: http://www.salesforce.com, Accessed 27 Apr 2012

  12. Warrior, P.: CISCO CIO on cloud computing. http://blogs.cisco.com/news/comments/cisco_cto_on_cloud_computing/. Accessed 7 May 2012

  13. Drepper, U.: Cost of the virtualization. ACM Queue, ACM, Feb (2008)

    Google Scholar 

  14. Kotsovinos, E.: Virtualization: Blessing or Curse? ACM Queue, ACM, Jan (2011)

    Google Scholar 

  15. OpenNebula: OpenNebula Project Leads: http://www.opennebula.org/. Accessed Feb 2012

  16. OpenStack LLC: http://www.openstack.org. Accessed Feb 2012

  17. Eucalyptus Systems, Inc.: http://www.eucalyptus.com/. Accessed Feb 2012

  18. UC Santa Barbara: http://appscale.cs.ucsb.edu/. Accessed Feb 2012

  19. IBM: IBM WebSphere Application Server: http://www.ibm.com/software/webservers/appserv/extend/virtualenterprise/. Accessed 17 Feb 2012

  20. VMWare: http://www.cloudfoundry.com/. Accessed 17 Feb 2012

  21. Varia, J.: Best practices in architecting cloud applications in the AWS cloud (ch. 18). In: Buyya, R., Broberg, J., Gościński, A. (eds.) Cloud Computing: Principles and Paradigms, pp. 459–490. Wiley, Hoboken (2011)

    Google Scholar 

  22. Gulati, A., Shanmuganathan, G., Ahmad, A., Holler, A.: Cloud-scale resource management: challenges and techniques. In: HotCloud, 2011, Portland, 14–15 June 2011

    Google Scholar 

  23. Epping, D., Denneman, F.: VMware vSphere HA and DRS technical deepdive. CreateSpace, Seattle (2010)

    Google Scholar 

  24. Saripalli, P., Kiran, G.V.R., Shankar, R.R., Narware, H., Bindal, N.: Load prediction and hot spot detection models for autonomic cloud computing. Proceedings of 2011 Fourth IEEE International Conference on Utility and Cloud Computing (UCC), 5–8 Dec, 2011, pp. 397–402 (2011)

    Google Scholar 

  25. Wang, G., Wang, K.: An efficient hybrid P2P MMOG cloud architecture for dynamic load management. Proceedings of 2012 International Conference on Information Networking (ICOIN), 1–3 Feb 2012, pp. 199–204 (2012)

    Google Scholar 

  26. Doyle, J., Shorten, R., O’Mahony, D.: “Fair-Share” for fair bandwidth allocation in cloud computing. Commun. Lett. IEEE 16(4), 550–553 (2012)

    Article  Google Scholar 

  27. Barroso, L.A., Dean, J., Hlzle, U.: Web search for a planet: the Google cluster architecture. IEEE Micro 23(2), 22–28 (2003)

    Article  Google Scholar 

  28. Platform Computing: LSF Version 4.1 Administrator’s Guide. http://www.platform.com/services/support/ (2003). Accessed Mar 2012

  29. Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor: a distributed job scheduler. In: Gropp, W., Lusk, E., Sterling, T.L. (eds.) Beowulf Cluster Computing with Linux, pp. 307–350. MIT Press, Cambridge, MA (2001)

    Google Scholar 

  30. Kannan, S., Roberts, M., Mayes, P., Brelsford, D., Skovira, J.F.: Workload Management with LoadLeveler. IBM Redbooks, Poughkeepsie (2001). 2001

    Google Scholar 

  31. Yuan, D., Yang, Y., Liu, Y., Chen, J.: A data placement strategy in scientific cloud workflows. Futur. Gener. Comput. Syst. 26(8), 1200–1214 (2010)

    Article  Google Scholar 

  32. Liu, X., Heo, J., Sha, L.: Modeling 3-tiered web applications. Proceedings of the International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems, 27–29 Sept 2005, pp. 307–310 (2005)

    Google Scholar 

  33. Urgaonkar, B., Paci, G., Shenoy, P., Spreitzer, M., Tantawi, A.: An analytical model for multi-tier internet services and its applications. Proceedings of the ACM SIGMETRICS International Conference on Measurement and Modelling of Computer Systems, 2005, pp. 291–302 (2005)

    Google Scholar 

  34. Zhang, Q., Cherkasova, L., Smirni, E.: A regression-based analytical model for dynamic resource provisioning of multi-tier applications. In: Proceedings of the 4th International Conference on Autonomic Computing, Jacksonville, 11–15 June 2007

    Google Scholar 

  35. Patterson, D.A.: A simple way to estimate the cost of downtime. Proceedings of the 16th USENIX Systems Administration Conference, Nov 2002, pp. 185–188 (2002)

    Google Scholar 

  36. Vishwanath, K.V., Nagappan, N.: Characterizing cloud computing hardware reliability. Proceedings of the 1st ACM Symposium on Cloud Computing, June 2010, pp. 193–204 (2010)

    Google Scholar 

  37. Chester, A.P., Leeke, M., Al-Ghamdi, M., Jarvis, S.A., Jhumka, A.: A modular failure-aware resource allocation architecture for cloud computing. In: Proceedings of the UK Performance Engineering Workshop (UKPEW’11), Bradford, 7–8 July 2011

    Google Scholar 

  38. Semeraro, G., Magklis, G., Balasubramonan, R., Albonesi, D.H., Dwarkadas, S., Scott, M.L.: Energy-efficient processor design using multiple clock domains with dynamic voltage and frequency scaling. Proceedings of the 8th International Symposium on High-Performance Computer Architecture, 2002, pp. 29–42 (2002)

    Google Scholar 

  39. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the art of virtualization. Proceedings of the 19th ACM Symposium on Operating Systems Principles, 2003, p. 177 (2003)

    Google Scholar 

  40. Kusic, D., Kephart, J.O., Hanson, J.E., Kandasamy, N., Jiang, G.: Power and performance management of virtualized computing environments via lookahead control. Clust. Comput. 12(1), 1–15 (2009)

    Article  Google Scholar 

  41. Srikantaiah, S., Kansal, A., Zhao, F.: Energy aware consolidation for cloud computing. Clust. Comput. 12, 1–15 (2009)

    Article  Google Scholar 

  42. Song, Y., Wang, H., Li, Y., Feng, B., Sun, Y.: Multi-tiered n-demand resource scheduling for VM-based data center. Proceedings of the 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid-Volume 00, 2009, pp. 148–155 (2009)

    Google Scholar 

  43. Cardosa, M., Korupolu, M., Singh, A.: Shares and utilities based power consolidation in virtualized server environments. In: Proceedings of IFIP/IEEE Integrated Network Management (IM), Hofstra University, Long Island, 1–5 June 2009

    Google Scholar 

  44. Beloglazov, A., Buyya, R. (2010) Energy efficient resource management in virtualized cloud data centers. Proceedings of CCGRID 2010, pp. 826–831 (2010)

    Google Scholar 

  45. Sotomayor, R., Montero, S., Llorente, I.M., Foster, I.: Capacity leasing in cloud systems using the OpenNebula engine. In: Workshop on Cloud Computing and its Applications 2008 (CCA08), Chicago, Oct 2008 [Online publication]

    Google Scholar 

  46. Enormaly Inc.: http://www.enomaly.com. Accessed 14 May 2012

  47. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L., Zagorodnov, D.: The Eucalyptus open-source cloud-computing system. Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2009), May 2009, pp. 124–131 (2009)

    Google Scholar 

  48. Keahey, K., Foster, I.T., Freeman, T., Zhang, X.: Virtual workspaces: achieving quality of service and quality of life in the grid. Sci. Program. 4(13), 265–275 (2005)

    Google Scholar 

  49. Keahey, K., Freeman, T.: Contextualization: providing one-click virtual clusters. In: eScience 2008, Indianapolis, Dec 2008

    Google Scholar 

  50. Mavromoustakis, C.X., Karatza, H.D. Embedded socio-oriented model for end-to-end reliable stream schedules by using collaborative outsourcing in MP2P systems. Comput. J. 54(4), 19pp (2011)

    Google Scholar 

  51. Mavromoustakis, C.X.: Synchronized cooperative schedules for collaborative resource availability using population-based algorithm. Simul. Pract. Theory J. 19(2), 762–776 (2011)

    Article  Google Scholar 

  52. Mavromoustakis, C.X., Karatza, H.D.: Performance evaluation of opportunistic resource sharing scheme using socially-oriented outsourcing in wireless devices. Comput. J. 56(2), 184–197 (2013)

    Article  Google Scholar 

  53. Mavromoustakis, C.X., Dimitriou, C.D.: Using social interactions for opportunistic resource sharing using mobility-enabled contact-oriented replication. In: International Conference on Collaboration Technologies and Systems (CTS 2012). In Cooperation with ACM/IEEE, Internet of Things, Machine to Machine and Smart Services Applications (IoT 2012), Denver, 21–25 May 2012

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Constandinos Mavromoustakis .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag London

About this chapter

Cite this chapter

Papanikolaou, K., Mavromoustakis, C. (2013). Resource and Scheduling Management in Cloud Computing Application Paradigm. In: Mahmood, Z. (eds) Cloud Computing. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-1-4471-5107-4_6

Download citation

  • DOI: https://doi.org/10.1007/978-1-4471-5107-4_6

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-1-4471-5106-7

  • Online ISBN: 978-1-4471-5107-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics