Abstract
QosCosGrid (QCG) is an integrated system offering leading job and resource management capabilities in order to deliver supercomputer-like performance and structure to end users. By combining many distributed computing resources together, QCG offers highly efficient mapping, execution and monitoring capabilities for a variety of applications, such as parameter sweep, workflows, multi-scale, MPI or hybrid MPI-OpenMP. The QosCosGrid middleware also provides a set of unique features, such as advance reservation, co-allocation of distributed computing resources, support for interactive tasks and monitoring of a progress of running applications. The middleware is offered to end users by well-designed and easy-to-use client tools. At the time of writing, QosCosGrid is the most popular middleware within the PL-Grid Infrastructure. After its successful adoption within the Polish research communities, it has been integrated with the EGI infrastructure and through a release in UMD and EGI-AppDB it is also available at European level. In this article, we focus on the extensions that were introduced to QosCosGrid during the period of the PL-Grid and PLGrid Plus projects in order to support advanced user scenarios and to integrate the stack with the Polish and European e-Infrastructures.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Alfieri, R., Cecchini, R.L., Ciaschini, V., dell’Agnello, L., Frohner, A., Gianoli, A., Lõrentey, K., Spataro, F.: VOMS, an Authorization System for Virtual Organizations. In: Fernández Rivera, F., Bubak, M., Gómez Tato, A., Doallo, R. (eds.) Across Grids 2003. LNCS, vol. 2970, pp. 33–40. Springer, Heidelberg (2004)
Alfieri, R., Cecchini, R., Ciaschini, V., Gianoli, A., Spataro, F., Bonnassieux, F., Broadfoot, P., Lowe, G., Cornwall, L., Jensen, J., et al.: Managing dynamic user communities in a grid of autonomous resources. arXiv preprint cs/0306004 (2003)
Belgacem, M.B., Chopard, B., Borgdorff, J., Mamoński, M., Rycerz, K., Harężlak, D.: Distributed multiscale computations using the mapper framework. In: Alexandrov, V.N., Lees, M., Krzhizhanovskaya, V.V., Dongarra, J., Sloot, P.M.A. (eds.) ICCS. Procedia Computer Science, vol. 18, pp. 1106–1115. Elsevier (2013)
Benedyczak, K., Stolarek, M., Rowicki, R., Kluszczyński, R., Borcz, M., Marczak, G., Filocha, M., Bała, P.: Seamless Access to the PL-Grid e-Infrastructure Using UNICORE Middleware. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 56–72. Springer, Heidelberg (2012)
Borcz, M., Kluszczyński, R., Skonieczna, K., Grzybowski, T., Bała, P.: Processing the biomedical data on the grid using the UNICORE workflow system. In: Caragiannis, I., et al. (eds.) Euro-Par Workshops 2012. LNCS, vol. 7640, pp. 263–272. Springer, Heidelberg (2013)
Borgdorff, J., Bona-Casas, C., Mamoński, M., Kurowski, K., Piontek, T., Bosak, B., Rycerz, K., Ciepiela, E., Gubała, T., Harężlak, D., Bubak, M., Lorenz, E., Hoekstra, A.G.: A distributed multiscale computation of a tightly coupled model using the multiscale modeling language. In: Ali, H.H., Shi, Y., Khazanchi, D., Lees, M., van Albada, G.D., Dongarra, J., Sloot, P.M.A. (eds.) ICCS. Procedia Computer Science, vol. 9, pp. 596–605. Elsevier (2012)
Borgdorff, J., Mamoński, M., Bosak, B., Kurowski, K., Belgacem, M.B., Chopard, B., Groen, D., Coveney, P.V., Hoekstra, A.G.: Distributed multiscale computing with muscle 2, the multiscale coupling library and environment. CoRR abs/1311.5740 (2013)
Bosak, B., Komasa, J., Kopta, P., Kurowski, K., Mamoński, M., Piontek, T.: New Capabilities in QosCosGrid Middleware for Advanced Job Management, Advance Reservation and Co-allocation of Computing Resources – Quantum Chemistry Application Use Case. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 40–55. Springer, Heidelberg (2012)
Ciepiela, E., et al.: Managing Entire Lifecycles of e-Science Applications in the GridSpace2 Virtual Laboratory – From Motivation through Idea to Operable Web-Accessible Environment Built on Top of PL-Grid e-Infrastructure. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 228–239. Springer, Heidelberg (2012)
Demuth, B., Schuller, B., Holl, S., Daivandy, J.M., Giesler, A., Huber, V., Sild, S.: The Unicore rich client: Facilitating the automated execution of scientific workflows. In: eScience, pp. 238–245. IEEE Computer Society (2010)
Dziubecki, P., Grabowski, P., Krysiński, M., Kuczyński, T., Kurowski, K., Piontek, T., Szejnfeld, D.: Online Web-Based Science Gateway for Nanotechnology Research. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 205–216. Springer, Heidelberg (2012)
Kurowski, K., Dziubecki, P., Grabowski, P., Krysiński, M., Piontek, T., Szejnfeld, D.: Easy Development and Integration of Science Gateways with Vine Toolkit. In: Bubak, M., Kitowski, J., Wiatr, K. (eds.) PLGrid Plus. LNCS, vol. 8500, pp. 147–163. Springer, Heidelberg (2014)
Furlani, J.L.: Modules: Providing a flexible user environment. In: Proceedings of the Fifth Large Installation Systems Administration Conference (LISA V), pp. 141–152 (1991)
Groen, D., Borgdorff, J., Bona-Casas, C., Hetherington, J., Nash, R.W., Zasada, S.J., Saverchenko, I., Mamoński, M., Kurowski, K., Bernabeu, M.O., Hoekstra, A.G., Coveney, P.V.: Flexible composition and execution of high performance, high fidelity multiscale biomedical simulations. CoRR abs/1211.2963 (2012)
Jiang, M., Novales, C.D.C., Mathieu, G., Casson, J., Rogers, W., Gordon, J.: An apel tool based cpu usage accounting infrastructure for large scale computing grids. In: Data Driven e-Science, pp. 175–186. Springer (2011)
Krabbenhöft, H.N., Möller, S., Bayer, D.: Integrating ARC grid middleware with taverna workflows. Bioinformatics 24(9), 1221–1222 (2008)
Laure, E., Gr, C., Fisher, S., Frohner, A., Kunszt, P., Krenek, A., Mulmo, O., Pacini, F., Prelz, F., White, J., Barroso, M., Buncic, P., Byrom, R., Cornwall, L., Craig, M., Meglio, A.D., Djaoui, A., Giacomini, F., Hahkala, J., Hemmer, F., Hicks, S., Edlund, A., Maraschini, A., Middleton, R., Sgaravatto, M., Steenbakkers, M., Walk, J., Wilson, A.: Programming the Grid with gLite. In: Computational Methods in Science and Technology (2006)
MacLaren, J.: HARC: The highly-available resource co-allocator. In: Meersman, R., Tari, Z. (eds.) OTM 2007, Part II. LNCS, vol. 4804, pp. 1385–1402. Springer, Heidelberg (2007)
Palak, B., Wolniewicz, P., Płóciennik, M., Owsiak, M., Żok, T.: User-Friendly Frameworks for Accessing Computational Resources. In: Bubak, M., Szepieniec, T., Wiatr, K. (eds.) PL-Grid 2011. LNCS, vol. 7136, pp. 191–204. Springer, Heidelberg (2012)
Rajasekar, A., Moore, R., Hou, C.Y., Lee, C.A., Marciano, R., de Torcy, A., Wan, M., Schroeder, W., Chen, S.Y., Gilbert, L., Tooby, P., Zhu, B.: iRODS Primer: Integrated Rule-Oriented Data System. Synthesis Lectures on Information Concepts, Retrieval, and Services. Morgan & Claypool Publishers (2010)
Streit, A., Bala, P., Beck-Ratzka, A., Benedyczak, K., Bergmann, S., Breu, R., Daivandy, J.M., Demuth, B., Eifer, A., Giesler, A., Hagemeier, B., Holl, S., Huber, V., Lamla, N., Mallmann, D., Memon, A.S., Memon, M.S., Rambadt, M., Riedel, M., Romberg, M., Schuller, B., Schlauch, T., Schreiber, A., Soddemann, T., Ziegler, W.: Unicore 6 – recent and future advancements. Annales des Télécommunications 65(11-12), 757–762 (2010)
Takefusa, A., Nakada, H., Takano, R., Kudoh, T., Tanaka, Y.: Gridars: A grid advanced resource management system framework for intercloud. In: Lambrinoudakis, C., Rizomiliotis, P., Wlodarczyk, T.W. (eds.) CloudCom, pp. 705–710. IEEE (2011)
Troger, P., Rajic, H., Haas, A., Domagalski, P.: Standardization of an API for Distributed Resource Management Systems. In: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGRID 2007), pp. 619–626. IEEE Computer Society, Washington, DC (2007), http://dx.doi.org/10.1109/CCGRID.2007.109
Distributed Resource Management Application API Version 2 (DRMAA), http://www.ogf.org/documents/GFD.194.pdf
Radecki, M., Szymocha, T., Piontek, T., Bosak, B., Mamoński, M., Wolniewicz, P., Benedyczak, K., Kluszczyński, R.: Reservations for Compute Resources in Federated e-Infrastructure. In: Bubak, M., Kitowski, J., Wiatr, K. (eds.) PLGrid Plus. LNCS, vol. 8500, pp. 80–93. Springer, Heidelberg (2014)
EGI Application Database (AppDB), http://appdb.egi.eu/
Grid-SAFE accounting framework, http://gridsafe.sourceforge.net
HPC Basic Profile Version 1.0, http://www.ogf.org/documents/GFD.114.pdf
iDrop – the client tool for iRODS, https://code.renci.org/gf/project/irodsidrop
Jargon library for iRODS, https://code.renci.org/gf/project/jargon
OASIS Web Services Notification, http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wsn
SAGA project, http://saga-project.org
Unified Middleware Distribution (UMD), http://repository.egi.eu/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Bosak, B., Kopta, P., Kurowski, K., Piontek, T., Mamoński, M. (2014). New QosCosGrid Middleware Capabilities and Its Integration with European e-Infrastructure. In: Bubak, M., Kitowski, J., Wiatr, K. (eds) eScience on Distributed Computing Infrastructure. Lecture Notes in Computer Science, vol 8500. Springer, Cham. https://doi.org/10.1007/978-3-319-10894-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-10894-0_3
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-10893-3
Online ISBN: 978-3-319-10894-0
eBook Packages: Computer ScienceComputer Science (R0)