Skip to main content

Efficient Workload Distribution Bridging HTC and HPC in Scientific Computing

  • Conference paper
Computational Science and Its Applications – ICCSA 2012 (ICCSA 2012)

Abstract

GriF is a Workflow Management System designed to support users of the Molecular and Materials Sciences and Technologies COMPCHEM Virtual Organization. In particular, GriF manages the results of the parameter sweeping studies submitted to the Grid. This service has been recently extended to implement seamless access to both High Performance and High Throughput Computing architectures. To this end, the Workflow execution is splitted into single blocks whose execution is most suited to one or the other platform. This has been obtained by implementing a communication channel allowing interoperability between the gLite middleware operating on the Italian Grid Initiative segment accessible to COMPCHEM and the software stack operating on the CINECA machines. As a prototype application a high level ab initio calculation of the potential energy surface of few atom system has been implemented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. PRACE Research Infrastructure, http://www.prace-project.eu (cited February 13, 2012)

  2. TeraGrid Archives, https://www.xsede.org/tg-archives (cited February 13, 2012)

  3. The Message Passing Interface (MPI) standard, http://www.mcs.anl.gov/research/projects/mpi (cited February 13, 2012)

  4. European Grid Infrastructure, http://www.egi.eu (cited February 13, 2012)

  5. ICT research in FP7, http://cordis.europa.eu/fp7/ict/e-infrastructure/calls_en.html (cited February 13, 2012)

  6. Manuali, C., Rampino, S., Laganà, A.: GriF: A Grid Framework for a Web Service Approach to Reactive Scattering. Comp. Phys. Comm. 181, 1179–1185 (2010)

    Article  MATH  Google Scholar 

  7. Manuali, C., Laganà, A.: GriF: A New Collaborative Framework for a Web Service Approach to Grid Empowered Calculations. Future Generation Computer Systems 27, 315–318 (2011)

    Article  Google Scholar 

  8. CompChem Virtual Organization, http://www3.compchem.unipg.it (cited February 13, 2012)

  9. Italian Grid Infrastructure, http://grid.infn.it (cited February 13, 2012)

  10. CINECA, http://www.cineca.it (cited February 13, 2012)

  11. Costantini, A., Gervasi, O., Manuali, C., Faginas Lago, N., Rampino, S., Laganà, A.: COMPCHEM: progress towards GEMS a Grid Empowered Molecular Simulator and beyond. Journal of Grid Computing 8(4), 571–586 (2010)

    Article  Google Scholar 

  12. The General Atomic and Molecular Electronic Structure System (GAMESS) ab initio quantum chemistry package, http://www.msg.ameslab.gov/gamess (cited February 13, 2012)

  13. European Middleware Initiative, http://www.eu-emi.eu (cited February 13, 2012)

  14. EMI Execution Service page, https://twiki.cern.ch/twiki/bin/view/EMI/EmiExecutionService (cited February 13, 2012)

  15. Costantini, A., Faginas Lago, N., Laganà, A., Huarte Larranaga, F.: A Grid Implementation of MCTDH Rate Coefficients. In: Gervasi, O., Taniar, D., Murgante, B., Laganà, A., Mun, Y., Gavrilova, M.L. (eds.) ICCSA 2009. LNCS, vol. 5593, pp. 104–114. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

  16. Manuali, C.: A Grid Knowledge Management System aimed at Virtual Research Communities Sustainability based on Quality Evaluation. Ph.D. Thesis, Department of Mathematics and Informatics, University of Perugia (IT), February 14 (2011), http://www.unipg.it/carlo/PhD_Thesis.pdf (cited February 13, 2012)

  17. SOA and Web Services, http://www.oracle.com/technetwork/articles/javase/index-142519.html (cited February 13, 2012)

  18. Web Service Description Language (WSDL) 1.1, http://www.w3.org/TR/wsdl (cited February 13, 2012)

  19. Simple Object Access Protocol (SOAP) 1.2, http://www.w3.org/TR/soap (cited February 13, 2012)

  20. Universal Description, Discovery and Integration (UDDI) 3.0.2, http://www.oasis-open.org/standards#uddiv3.0.2 (cited February 13, 2012)

  21. Apache Tomcat, http://tomcat.apache.org (cited February 13, 2012)

  22. Web Services Activity, http://www.w3.org/2002/ws (cited February 13, 2012)

  23. Foster, I., Kesselman, C., Nick, J.M., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration, Open Grid Service Infrastructure WG, Global Grid Forum (GGF), http://www.globus.org/alliance/publications/papers/ogsa.pdf (cited February 13, 2012)

  24. The Open Grid Forum (OGF), http://www.ogf.org (cited February 13, 2012)

  25. What is a Grid Service?, http://gdp.globus.org/gt3-tutorial/multiplehtml/ch01s03.html (cited February 13, 2012)

  26. OASIS Web Service Resource Framework (WSRF) TC, http://www.oasis-open.org/committees/tc_home.php?wg_abbrev=wsrf (cited February 13, 2012)

  27. OASIS: Advancing Open Standards for the Global Information Society, http://www.oasis-open.org (cited February 13, 2012)

  28. Manuali, C., Garcia, E., Laganà, A.: On the Enhancing of GriF a Workflow-oriented Grid Framework combining High-level Services. Journal of Grid Computing (submitted)

    Google Scholar 

  29. Job Collection - EGEE SEE ROC Wiki, http://wiki.egee-see.org/index.php/Job_Collection (cited February 13, 2012)

  30. Gervasi, O., Dittamo, C., Laganá, A.: A Grid Molecular Simulator for E-Science. In: Sloot, P.M.A., Hoekstra, A.G., Priol, T., Reinefeld, A., Bubak, M. (eds.) EGC 2005. LNCS, vol. 3470, pp. 16–22. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  31. Laganà, A., Gervasi, O.: A Priori Molecular Virtual Reality on EGEE Grid. International Journal of Quantum Chemistry 110, 446–453 (2009)

    Article  Google Scholar 

  32. Marco, C., Fabio, C., Alvise, D., Antonia, G., Francesco, G., Alessandro, M., Moreno, M., Salvatore, M., Fabrizio, P., Luca, P., Francesco, P.: The gLite Workload Management System. In: Abdennadher, N., Petcu, D. (eds.) GPC 2009. LNCS, vol. 5529, pp. 256–268. Springer, Heidelberg (2009)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Manuali, C. et al. (2012). Efficient Workload Distribution Bridging HTC and HPC in Scientific Computing. In: Murgante, B., et al. Computational Science and Its Applications – ICCSA 2012. ICCSA 2012. Lecture Notes in Computer Science, vol 7333. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31125-3_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-31125-3_27

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-31124-6

  • Online ISBN: 978-3-642-31125-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics