Abstract
Now people can run HPC applications on cloud platform and they do not need to own or maintain physical infrastructure. However, they have the burden of managing large pools of virtual machines (VMs), because cloud users today must manually instantiate, configure and maintain the virtual hosts. In this paper, a novel approach is proposed to deploy HPC applications on cloud platform easily which integrates a message passing interface (MPI) based simple programming model and single system image (SSI) technology. By hiding the details of MPI applications and VMs cluster, the approach allows cloud users to execute MPI applications on VMs cluster as normal multi-process applications on a single machine. So cloud users are promised to create and maintain a single VM only to deploy and execute HPC applications on hundreds of VMs. The experimental results show that the approach can reduce the burden of deploying HPC applications on cloud platform greatly.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Armbrust M, Fox A, Grith R et al (2009) Above the clouds: a Berkeley view of cloud computing. Technical report. UC Berkeley
Ostermann S, Yigitbasi M, Prodan R et al (2011) Performance analysis of cloud computing services for many-tasks scientific computing [J]. IEEE Trans Parallel Distrib Syst 22(6):931–945
Youseff L, Wolski R, Krintz C (2006) Evaluating the performance impact of Xen on MPI and process execution for HPC systems [C]. The first international workshop on Virtualization Technology in Distributed Computing (VTDC), p 1
Gabriel E, Fagg E, Bosilca G et al (2004) Open MPI: goals, concept, and design of a next generation MPI implementation [C]. 11th European PVM/MPI users’ group meeting, pp 97–104
Chase J, Irwin D, Grit LE et al (2003) Dynamic virtual clusters in a grid site manager. In: Proceeding 12th IEEE international symposium on High Performance Distributed Computing (HPDC), IEEE, Berlin, Germany, pp 90–100
Clark C, Fraser K, Hand S et al (2005) Live migration of virtual machines. In: Proceeding 2nd symposium on Networked Systems Design and Implementation (NSDI), ACM, vol 2. Washington DC, USA, pp 273–286
Lagar-Cavilla H, Whitney J, Scannell A et al (2009) SnowFlock: rapid virtual machine cloning for cloud computing. In: Proceeding of Eurosys 2009, ACM, Boston, MA, USA, pp 1–12
Vrable M, Ma J, Chen J et al (2005) Scalability, fidelity and containment in the potemkin virtual honeyfarm. In: Proceeding 20th Symposium on Operating Systems Principles (SOSP), ACM, Nüremberg, Germany, 39(5):148–162
Dean J, Ghemawat S (2004) MapReduce: simplified data processing on large clusters. In: Proceeding 6th symposium on Operating System Design and Implementation (OSDI), ACM, New York, USA, pp 137–149
Whitaker A, Shaw M, Gribble S (2002) Scale and performance in the Denali Isolation Kernel. In: Proceeding 5th symposium on Operating System Design and Implementation (OSDI), ACM, New York, USA, pp 195–209
Acknowledgements
This work was supported by Natural Science Foundation for Young Scholars of Jiangsu Province of China (BK2012237).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Yin, J., Yuan, L., Xu, Z., Zeng, W. (2014). A Novel Approach to Deploying High Performance Computing Applications on Cloud Platform. In: Wang, W. (eds) Mechatronics and Automatic Control Systems. Lecture Notes in Electrical Engineering, vol 237. Springer, Cham. https://doi.org/10.1007/978-3-319-01273-5_39
Download citation
DOI: https://doi.org/10.1007/978-3-319-01273-5_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-01272-8
Online ISBN: 978-3-319-01273-5
eBook Packages: EngineeringEngineering (R0)