Advertisement

Towards a Light-weight Workflow Engine in the Asklon Grid Environment

  • Jun Qin
  • Marek Wieczorek
  • Kassia Plankensteiner
  • Thomas Fahringer
Conference paper

Workflow scheduling and execution belong to the most difficult problems in the Grid computing research area. Instead of using a full-ahead planning to schedule workflows, which requires precise predictions of task execution time, file transfer time and Grid site status during the workflow execution, we propose a lightweight workflow engine for the ASKALON Grid environment, which uses just in-time scheduling based on automatically generated performance predictions and task prioritization. An extensive survey of the related work is discussed. The architecture of the proposed workflow engine and some preliminary results are presented.

Keywords

Execution Time Grid Environment Schedule Decision Advance Reservation Task Execution Time 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. [1]
    The Austrian Grid Project. http://www.austriangrid.at.
  2. [2]
    A. H. Alhusaini, V. K. Prasanna, and C. S. Raghavendra. A Unified Resource Scheduling Framework for Heterogeneous Computing Environments. In Heterogeneous Computing Workshop, pages 156-165, 1999.Google Scholar
  3. [3]
    E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.-H. Su, K. Vahi, and M. Livny. Pegasus: Mapping Scientific Workflows onto the Grid. In European Across Grids Conference, pages 11-20, 2004.Google Scholar
  4. [4]
    T. Fahringer, R. Prodan, R. Duan, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H.-L. Truong, A. Villazon, and M. Wieczorek. ASKALON: A Grid Application Development and Computing Environment. In 6th International Workshop on Grid Computing (Grid 2005), Seattle, USA, November 2005. IEEE Computer Society Press.Google Scholar
  5. [5]
    T. Fahringer, J. Qin, and S. Hainzer. Specification of Grid Workflow Applications with AGWL: An Abstract Grid Workflow Language. In Proceedings of IEEE International Symposium on Cluster Computing and the Grid 2005 (CCGrid 2005), Cardiff, UK, May 9-12, 2005. IEEE Computer Society Press.Google Scholar
  6. [6]
    M. R. Garey and D. S. Johnson. Computers and Intractability: A Guide to the Theory of NP-Completeness. W. H. Freeman And Company, New York, 1979.MATHGoogle Scholar
  7. [7]
    M. Iverson and F. Ozguner. Dynamic, Competitive Scheduling of Multiple DAGs in a Distributed Heterogeneous Environment. In HCW ’98: Proceedings of the Seventh Heterogeneous Computing Workshop, page 70, Washington, DC, USA, 1998. IEEE Computer Society.Google Scholar
  8. [8]
    T. Ma and R. Buyya. Critical-Path and Priority based Algorithms for Scheduling Workflows with Parameter Sweep Tasks on Global Grids. In Proceedings of the 17th International Symposium on Computer Architecture and High Performance Computing (SBACPAD 2005), Rio de Janeiro, Brazil, Oct. 24-27 2005. IEEE Computer Society Press.Google Scholar
  9. [9]
    A. Radulescu and A. J. C. van Gemund. On the complexity of list scheduling algorithms for distributed-memory systems. In Proceeding of the ICS 1999, pages 68-75, 1999.Google Scholar
  10. [10]
    K. Ranganathan and I. Foster. Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications.Google Scholar
  11. [11]
    F. Sch üller and J. Qin. Towards a Workflow Model for Meteorological Simulations on the AustrianGrid. In 1st Austrian Grid Symposium, Schloss Hagenberg, Austria, December 01-02, 2005. OCG Verlag.Google Scholar
  12. [12]
    N. T. Spring and R. Wolski. Application Level Scheduling of Gene Sequence Comparison on Metacomputers. In International Conference on Supercomputing, pages 141-148, 1998.Google Scholar
  13. [13]
    D. Theiner and M. Wieczorek. Reduction of Calibration Time of Distributed Hydrological Models by Use of Grid Computing and Nonlinear Optimisation Algorithms. In 7th International Conference on Hydroinformatics (HIC 2006), Nice, France, Sep. 2006.Google Scholar
  14. [14]
    M. Wieczorek, R. Prodan, and T. Fahringer. Scheduling of Scientific Work-flows in the ASKALON Grid Environment. ACM SIGMOD Record, 35(3), 2005. http://dps.uibk.ac.at/marek/publications/acm-sigmod-2005.pdf.
  15. [15]
    M. Wieczorek, M. Siddiqui, A. Villazon, R. Prodan, and T. Fahringer. Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid. e-science, 0:82, 2006.Google Scholar
  16. [16]
    R. Wolski, N. T. Spring, and J. Hayes. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems, 15(5-6):757-768, 1999.CrossRefGoogle Scholar
  17. [17]
    Z. Yu and W. Shi. An Adaptive Rescheduling Strategy for Grid Workflow Applications. In Proceedings of the 21st IPDPS 2007, Mar 26-30 2007. IEEE Computer Society Press.Google Scholar

Copyright information

© Springer Science+Business Media, LLC 2007

Authors and Affiliations

  • Jun Qin
    • 1
  • Marek Wieczorek
    • 1
  • Kassia Plankensteiner
    • 1
  • Thomas Fahringer
    • 1
  1. 1.Institute of Computer ScienceUniversity of InnsbruckAustria

Personalised recommendations