Skip to main content
SpringerLink
Log in
SpringerLink
Log in

Integrated Cloud Broker System and Its Experimental Evaluation

  • Chapter
  • First Online:
Cloud Broker and Cloudlet for Workflow Scheduling

Part of the book series: KAIST Research Series ((KAISTRS))

  • 821 Accesses

Abstract

In distributed computing environment, there are a large number of similar or equivalent resources provided by different service providers. These resources may provide the same functionality, but optimize different Quality of Service (QoS) metrics. These computing resources are managed and sold by many different service providers [1]. Service providers offer necessary information about their services such as the service capability, and the utility measuring methods and charging policies, which will be later referred to as the “resource policy” in this book. Each resource policy bears a tuple of two components, such as (capability, price). For capability, we model the resource capability as a set of QoS metrics which include the CPU type, the memory size, and the storage/hard disk size.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. J. Yu, R. Buyya, C.C.K. Tham, Cost-based scheduling of scientific workflow applications on utility grids. e-Science Grid Comput. 2005, 1–8 (2005)

    Google Scholar 

  2. Amazon EC2 Pricing. [Online]. Available: http://aws.amazon.com/ec2/pricing/

  3. Y. Han, A Study on Adaptive Resource Management System based on Active Workflow Control Scheme in Distributed Computing (KAIST, Daejeon, South Korea, 2011)

    Google Scholar 

  4. C. Kenyon, G. Cheliotis, Architecture Requirements for Commercializing Grid Resources. Proceedings of 11th IEEE International Symposium on High Performance Distributed Computing (2002)

    Google Scholar 

  5. Document for web services agreement specification. [Online]. Available: http://www.ogf.org

  6. D.-S. Nam, C.-H. Youn, B.-H. Lee, G. Clifford, J. Healey, QoS-constrained resource allocation for a grid-based multiple source electrocardiogram application. Lect Notes Comput Sci 3043, 352–359 (2004)

    Article  Google Scholar 

  7. C.-H. Youn, B. Kim, D. S. Nam, B.-H. Lee, E.B. Shim, G. Clifford, J. Healey, Resource reconfiguration scheme based on temporal quorum status estimation in computational grids. International Conference on Information Networking, 699–707 (2004)

    Google Scholar 

  8. S. Deng, A Study on Policy Adjuster Integrated Grid Workflow Management System (Information and Communication University, Daejeon, Republic of Korea, 2008)

    Google Scholar 

  9. H. AlHakami, H. Aldabbas, T. Alwada’n, Comparison between cloud and grid computing: review paper, Int. J. Cloud Comput. Serv. Archit., 2(4), 1–21, 2012

    Google Scholar 

  10. Top 10 Strategic technology trends for 2014, (2014) [Online]. Available: http://www.gartner.com

  11. F. Liu, J. Tong, J. Mao, R. Bohn, J. Messina, L. Badger, D. Leaf, NIST cloud computing reference architecture recommendations of the National Institute of Standards. Nist. Spec. Publ. 292(9), 35 (2011)

    Google Scholar 

  12. H. Kim, Y. Ha, Y. Kim, K. Joo, C.-H. Youn, A VM Reservation-Based Cloud Service Broker and Its Performance Evaluation, in Cloud Computing: 5th International Conference, CloudComp 2014, Guilin, China, 19-21 Oct 2014, Revised Selected Papers, ed. by V.C.M. Leung, R.X. Lai, M. Chen, J. Wan (Springer International Publishing, Cham, 2015), pp. 43–52

    Google Scholar 

  13. W.-J. Kim, An Integrated Broker System for Policy-based Application Service Management in Mobile Cloud (KAIST, Daejeon, 2014)

    Google Scholar 

  14. M. Chen, S. Mao, Y. Zhang, V. C. M. Leung, Big Data: Related Technologies, Challenges And Future Prospects. Springer, Berlin (2014)

    Google Scholar 

  15. M. Chen, S. Mao, Y. Liu, Big data: a survey. Mob. Netw. Appl. 19(2), 171–209 (2014)

    Article  Google Scholar 

  16. Y. Ren, A Cloud Collaboration System with Active Application Control Scheme and Its Experimental Performance Analysis (Korea Advanced Institute of Science and Technology, Daejeon, 2012)

    Google Scholar 

  17. B. Kim, A Study on Cost Adaptive Cloud Resource Broker System for Bioworkflow Computing (Korea Advanced Institute of Science and Technology, Daejeon, 2013)

    Google Scholar 

  18. M. Mao, M. Humphrey, Scaling and Scheduling to Maximize Application Performance Within Budget Constraints in Cloud Workflows. In Proceedings of IEEE 27th International Parallel and Distributed Processing Symposium, IPDPS 2013, pp. 67–78 (2013)

    Google Scholar 

  19. M. Mao, M. Humphrey, Auto-scaling to Minimize Cost and Meet Application Deadlines in Cloud Workflows. In 2011 International Conference for High Performance Computing Networking Storage and Analysis SC, pp. 1–12 (2011)

    Google Scholar 

  20. Science Gateway. [Online]. Available: http://www.sciencegateway.org

  21. S.F. Altschul, W. Gish, W. Miller, E.W. Myers, D.J. Lipman, Basic local alignment search tool. J. Mol. Biol. 215(3), 403–410 (1990)

    Article  Google Scholar 

  22. K. Byungsang, A study on cost adaptive cloud resource broker system for bioworkflow computing (Korea Advanced Institute of Science and Technology, Daejeon, 2013)

    Google Scholar 

  23. BLAST. [Online]. Available: http://blast.ncbi.nlm.nih.gov

  24. BWA. [Online]. Available: http://bio-bwa.sourceforge.net

  25. A. Matsunaga, M. Tsugawa, J. Fortes, CloudBLAST: combining MapReduce and virtualization on distributed resources for bioinformatics applications, In Proceedings of 4th IEEE International Conference on eScience, eScience 2008, pp. 222–229 (2008)

    Google Scholar 

  26. C. Vecchiola, S. Pandey, R. Buyya, High-Performance Cloud Computing: A View of Scientific Applications. In I-SPAN 2009—The 10th International Symposium on Pervasive Systems, Algorithms, and Networks, pp. 4–16 (2009)

    Google Scholar 

  27. S.-H. Kim, D.-K. Kang, W.-J. Kim, M. Chen, C.-H. Youn, A science gateway cloud with cost-adaptive VM management for computational science and applications. IEEE Syst. J. 11(1), 1–13 (2016)

    Google Scholar 

  28. Z. Su, B. Ning, H. Fang, H. Hong, R. Perkins, W. Tong, L. Shi, Next-generation sequencing and its applications in molecular diagnostics. Expert Rev. Mol. Diagn. 11(3), 333–343 (2011)

    Google Scholar 

  29. 종필최, “차세대 염기서열 정렬 도구 소개,” 질병관리본부 유전체센터 바이오과학정보과. [Online]. Available: http://www.cdc.go.kr/CDC/cms/content/30/12630_view.html

  30. H. Li, N. Homer, A survey of sequence alignment algorithms for next-generation sequencing. Brief. Bioinform. 11(5), 473–483 (2010)

    Article  Google Scholar 

  31. SAMtools. [Online]. Available: http://sourceforge.net/mailarchive/forum.php?thread_name_2F0E69A8-A2DD-4D6E-9EDE-2A9C0506DA0F%2540sanger.ac.uk&forum_name=samtools-devel

  32. D. Sulakhe, M. D’Souza, M. Syed, A. Rodriguez, Y. Zhang, E.M. Glass, M.F. Romine, N. Maltsev, GNARE—a grid-based server for the analysis of user submitted genomes. NAR 00335 (2007)

    Google Scholar 

  33. N. Maltsev, E. Glass, D. Sulakhe, A. Rodriguez, M.H. Syed, T. Bompada, Y. Zhang, M. D’Souza, PUMA2–grid-based high-throughput analysis of genomes and metabolic pathways. Nucleic Acids Res. 34, D369–D372 (2006) (Database issue)

    Google Scholar 

  34. J. Zhang, J. Yao, S. Chen, D. Levy, Facilitating biodefense research with mobile-cloud computing. Int. J. Syst. Serv.-Oriented Eng., 2(3), 18–31 (2011)

    Google Scholar 

  35. B. Kim, C.-H. Youn, An Adaptive Resource Provisioning Scheme for Distributed Bio-workflow Broker with Stream-Based NGS in Cloud. In the 6th International Conference on Ubiquitous Information Technologies and Applications (2011)

    Google Scholar 

  36. S. Chaisiri, S. Member, B. Lee, D. Niyato, Optimization of resource provisioning cost in cloud computing. Computer (Long. Beach. Calif)., 5(2), 1–32 (2012)

    Google Scholar 

  37. B. Jennings, R. Stadler, Resource Management in clouds: survey and research challenges. J. Netw. Syst. Manag. 23(3), 567–619 (2014)

    Article  Google Scholar 

  38. Z. Xiao, Z. Ming, A method of workflow scheduling based on colored Petri nets. Data Knowl. Eng. 70(2), 230–247 (2011)

    Article  Google Scholar 

  39. N.J. Malawki M., Juve G., Deelman E, Cost and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds. IEEE Int. Conf. High Perform. Comput. Networking, Storage Anal. 48, 1–11 (2012)

    Google Scholar 

  40. OpenStack. [Online]. Available: http://www.openstack.org/

  41. Cloudstack. [Online]. Available: http://cloudstack.apache.org

  42. Z. Su, B. Ning, H. Fang, H. Hong, R. Perkins, W. Tong, L. Shi, Next-generation sequencing and its applications in molecular diagnostics. Expert Rev. Mol. Diagn. 11(3), 333–343 (2011)

    Google Scholar 

  43. D.-S. Kim, Adaptive Workflow Scheduling Scheme Based on the Colored Petri-net Model in Cloud (KAIST, Daejeon, 2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of Electrical Engineering, KAIST, Daejeon, Korea (Republic of)

    Chan-Hyun Youn

  2. Embedded and Pervasive Computing (EPIC) Lab, Huazhong University of Science and Technology, Wuhan, Hubei, China

    Min Chen

  3. Area della Ricerca di Pisa, ISTI-CNR, Pisa, Italy

    Patrizio Dazzi

Authors
  1. Chan-Hyun Youn
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Min Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Patrizio Dazzi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chan-Hyun Youn .

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this chapter

Cite this chapter

Youn, CH., Chen, M., Dazzi, P. (2017). Integrated Cloud Broker System and Its Experimental Evaluation. In: Cloud Broker and Cloudlet for Workflow Scheduling. KAIST Research Series. Springer, Singapore. https://doi.org/10.1007/978-981-10-5071-8_1

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-5071-8_1

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-5070-1

  • Online ISBN: 978-981-10-5071-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation