Towards a Light-weight Workflow Engine in the Asklon Grid Environment
Workflow scheduling and execution belong to the most difficult problems in the Grid computing research area. Instead of using a full-ahead planning to schedule workflows, which requires precise predictions of task execution time, file transfer time and Grid site status during the workflow execution, we propose a lightweight workflow engine for the ASKALON Grid environment, which uses just in-time scheduling based on automatically generated performance predictions and task prioritization. An extensive survey of the related work is discussed. The architecture of the proposed workflow engine and some preliminary results are presented.
KeywordsExecution Time Grid Environment Schedule Decision Advance Reservation Task Execution Time
Unable to display preview. Download preview PDF.
- The Austrian Grid Project. http://www.austriangrid.at.
- A. H. Alhusaini, V. K. Prasanna, and C. S. Raghavendra. A Unified Resource Scheduling Framework for Heterogeneous Computing Environments. In Heterogeneous Computing Workshop, pages 156-165, 1999.Google Scholar
- E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.-H. Su, K. Vahi, and M. Livny. Pegasus: Mapping Scientific Workflows onto the Grid. In European Across Grids Conference, pages 11-20, 2004.Google Scholar
- T. Fahringer, R. Prodan, R. Duan, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H.-L. Truong, A. Villazon, and M. Wieczorek. ASKALON: A Grid Application Development and Computing Environment. In 6th International Workshop on Grid Computing (Grid 2005), Seattle, USA, November 2005. IEEE Computer Society Press.Google Scholar
- T. Fahringer, J. Qin, and S. Hainzer. Specification of Grid Workflow Applications with AGWL: An Abstract Grid Workflow Language. In Proceedings of IEEE International Symposium on Cluster Computing and the Grid 2005 (CCGrid 2005), Cardiff, UK, May 9-12, 2005. IEEE Computer Society Press.Google Scholar
- M. Iverson and F. Ozguner. Dynamic, Competitive Scheduling of Multiple DAGs in a Distributed Heterogeneous Environment. In HCW ’98: Proceedings of the Seventh Heterogeneous Computing Workshop, page 70, Washington, DC, USA, 1998. IEEE Computer Society.Google Scholar
- T. Ma and R. Buyya. Critical-Path and Priority based Algorithms for Scheduling Workflows with Parameter Sweep Tasks on Global Grids. In Proceedings of the 17th International Symposium on Computer Architecture and High Performance Computing (SBACPAD 2005), Rio de Janeiro, Brazil, Oct. 24-27 2005. IEEE Computer Society Press.Google Scholar
- A. Radulescu and A. J. C. van Gemund. On the complexity of list scheduling algorithms for distributed-memory systems. In Proceeding of the ICS 1999, pages 68-75, 1999.Google Scholar
- K. Ranganathan and I. Foster. Decoupling Computation and Data Scheduling in Distributed Data-Intensive Applications.Google Scholar
- F. Sch üller and J. Qin. Towards a Workflow Model for Meteorological Simulations on the AustrianGrid. In 1st Austrian Grid Symposium, Schloss Hagenberg, Austria, December 01-02, 2005. OCG Verlag.Google Scholar
- N. T. Spring and R. Wolski. Application Level Scheduling of Gene Sequence Comparison on Metacomputers. In International Conference on Supercomputing, pages 141-148, 1998.Google Scholar
- D. Theiner and M. Wieczorek. Reduction of Calibration Time of Distributed Hydrological Models by Use of Grid Computing and Nonlinear Optimisation Algorithms. In 7th International Conference on Hydroinformatics (HIC 2006), Nice, France, Sep. 2006.Google Scholar
- M. Wieczorek, R. Prodan, and T. Fahringer. Scheduling of Scientific Work-flows in the ASKALON Grid Environment. ACM SIGMOD Record, 35(3), 2005. http://dps.uibk.ac.at/marek/publications/acm-sigmod-2005.pdf.
- M. Wieczorek, M. Siddiqui, A. Villazon, R. Prodan, and T. Fahringer. Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid. e-science, 0:82, 2006.Google Scholar
- Z. Yu and W. Shi. An Adaptive Rescheduling Strategy for Grid Workflow Applications. In Proceedings of the 21st IPDPS 2007, Mar 26-30 2007. IEEE Computer Society Press.Google Scholar