Skip to main content

OGSA-DAI Extension for Executing External Jobs in Workflows

  • Conference paper
  • 1008 Accesses

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 207))

Abstract

Because of the nature of Grid to be heterogeneous and distributed environment, the database systems which should works on Grid must support this architecture. OGSA-DAI is an example of such extensible service based framework that allow data resources to be incorporated into Grid fabrics. On the other side, many algorithms (for example, for data mining) are not built in Java, they aren’t open source projects and can’t be easily incorporated in OGSA-DAI workflows. For that reason, we propose OGSA-DAI extension with new computational resources and activities that allow executing of external jobs, and returning data into OGSA DAI workflow. In this paper, we introduce heterogeneous and distributed databases, then we discuss our proposed model, and finally, we report our initial implementation.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Foster, I., Kesselman, C.: The Grid: Blueprint for a New Computing Infrastructure. Elsevier (2004)

    Google Scholar 

  2. Taylor, J.: Defining e-Science, http://www.nesc.ac.uk/nesc/define.html

  3. Kakasevski, G., et al.: Grid enabled system for gathering and retrieving images from WEB. In: ETAI 2007 (2007)

    Google Scholar 

  4. The Large Hadron Collider Homepage, http://lhc.web.cern.ch/lhc/

  5. Balaz, A., Prnjat, O., Vudragovic, D., Slavnic, V., Liabotis, I., Atanassov, E., Jakimovski, B., Savic, M.: Development of Grid E-Infrastructure in South-Eastern Europe. J. Grid Comput. 9, 135–154 (2011)

    Article  Google Scholar 

  6. Hong, N.P.C., et al.: Grid Database Service Specification. GGF Informational Document (February 2003)

    Google Scholar 

  7. Antonioletti, M., Atkinson, M., Baxter, R., Borley, A., Hong, N., Collins, B., Hardman, N., Hume, A., Knox, A., Jackson, M., et al.: The design and implementation of Grid database services in OGSA-DAI. Concurrency and Computation: Practice and Experience 17(2-4), 357–376 (2005)

    Article  Google Scholar 

  8. Holmes, G., Donkin, A., Witten, I.H.: Weka: A machine learning workbench. In: Proc. Second Australia and New Zealand Conference on Intelligent Information Systems, Brisbane, Australia (1994)

    Google Scholar 

  9. The University of Waikato; WEKA - Open source datamining software (2012), http://www.cs.waikato.ac.nz/ml/weka/

  10. Foster, I., Kesselman, C., Nick, J.M., Tuecke, S.: The physiology of the grid: An open grid services architecture for distributed systems integration. Open Grid Service Infrastructure WG, Global Grid Forum 22, 1–5 (2002)

    Google Scholar 

  11. Open Grid Forum - community of users, developers, and vendors for standardization of Grid computing (2012), http://www.ogf.org/

  12. Atkinson, M.P., Dialani, V., Guy, L., Narang, I., Paton, N.W., Pearson, D., Storey, T., Watson, P.: Grid Database Access and Integration: Requirements and Functionalities. DAIS-WG, Global Grid Forum Informational Document, GFD.13 (March 2003)

    Google Scholar 

  13. Lee, A., Magowan, J., Dantressangle, P., Bannwart, F.: Bridging the Integration Gap, Part 1: Federating Grid Data. IBM Developer Works (August 2005)

    Google Scholar 

  14. Watson, P.: Databases in Grid Applications: Locality and Distribution. In: Jackson, M., Nelson, D., Stirk, S. (eds.) BNCOD 2005. LNCS, vol. 3567, pp. 1–16. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  15. Jackson, M., et al.: OGSA-DAI 3.0–the whats and the whys. In: Proc. UK e-Science All Hands Q6 Meeting, pp. 158–165 (2007)

    Google Scholar 

  16. Abhinav, K.: Evaluation of Grid Middleware OGSA-DAI. School of Computing Science. Vellore Institute of Technology, Deemed University (May 2006)

    Google Scholar 

  17. Tanimura, Y., Yamamoto, N., Tanaka, Y., Iwao, K., Kojima, I., Nakamura, R., Tsuchida, S., Sekiguchi, S.: Evaluation of Large-Scale Storage Systems for Satellite Data in GEO GRID. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Beijing, vol. XXXVII(Pt. B4), pp. 1567–1574 (2008)

    Google Scholar 

  18. MESSAGE (Mobile Environmental Sensing System Across Grid Environments) Project (2010), http://bioinf.ncl.ac.uk/message/

  19. Garcia Ruiz, M., Garcia Chaves, A., Ruiz Ibañez, C., Gutierrez Mazo, J.M., Ramirez Giraldo, J.C., Pelaez Echavarria, A., Valencia Diaz, E., Pelaez Restrepo, G., Montoya Munera, E.N., Garcia Loaiza, B., Gomez Gonzalez, S.: mantisGRID: A Grid Platform for DICOM Medical Images Management in Colombia and Latin America. J. Digit. Imaging (Febuary 2010)

    Google Scholar 

  20. OGSA-DAI open source project publications (2012), http://sourceforge.net/apps/trac/ogsa-dai/wiki/Publications

  21. OGSA-DAI user documentation (2012), http://sourceforge.net/apps/trac/ogsa-dai/wiki/UserDocumentation

  22. Singh, G., Kesselman, C., Deelman, E.: Optimizing Grid-Based Workflow Execution. J. Grid Comput. 3(3-4), 201–219 (2005)

    Article  Google Scholar 

  23. Luckow, A., Lacinski, L., Jha, S.: SAGA BigJob: An Extensible and Interoperable Pilot-Job Abstraction for Distributed Applications and Systems. In: CCGRID 2010, pp. 135–144 (2010)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ǧorgi Kakaševski .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Kakaševski, Ǧ., Mishev, A., Krause, A., Grčeva, S. (2013). OGSA-DAI Extension for Executing External Jobs in Workflows. In: Markovski, S., Gusev, M. (eds) ICT Innovations 2012. ICT Innovations 2012. Advances in Intelligent Systems and Computing, vol 207. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-37169-1_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-37169-1_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37168-4

  • Online ISBN: 978-3-642-37169-1

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics