Skip to main content
SpringerLink
Log in

A Taxonomy of Workflow Management Systems for Grid Computing

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

With the advent of Grid and application technologies, scientists and engineers are building more and more complex applications to manage and process large data sets, and execute scientific experiments on distributed resources. Such application scenarios require means for composing and executing complex workflows. Therefore, many efforts have been made towards the development of workflow management systems for Grid computing. In this paper, we propose a taxonomy that characterizes and classifies various approaches for building and executing workflows on Grids. We also survey several representative Grid workflow systems developed by various projects world-wide to demonstrate the comprehensiveness of the taxonomy. The taxonomy not only highlights the design and engineering similarities and differences of state-of-the-art in Grid workflow systems, but also identifies the areas that need further research.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. W.M.P. van der Aalst, K.M. van Hee and G.J. Houben, “Modelling and Analysing Workflow using a Petri-net Based Approach”, in 2nd Workshop on Computer-supported Coop-erative Work, Petri Nets Related Formalisms, pp. 31–50, 1994. http://citeseer.ist.psu.edu/vanderaalst94modelling.html [December 2004].

  2. W.M.P. van der Aalst, A.H.M. ter Hofstede, B. Kiepuszewski and A.P. Barros, “Workflow Patterns”, Technical Report, Eindhoven University of Technology, 2000.

  3. W.M.P. van der Aalst, A.H.M ter Hofstede, B. Kiepuszewski and A.P. Barros, “Advanced Workflow Patterns”, in CoopIS 2000, Lecture Notes in Computer Science (LNCS) 1901, Springer, Berlin, Heidelberg, New York, pp. 18–29, 2000.

    Google Scholar 

  4. W.M.P. van der Aalst and A.H.M. ter Hofstede, “YAWL: Yet Another Workflow Language”, Technical Report, Queensland University of Technology, Brisbane, 2002.

  5. W.M.P. van der Aalst and K.M. van Hee. Workflow Management: Models, Methods, and Systems. MIT Press, Cambridge, MA, USA, 2002.

    Google Scholar 

  6. W.M.P. van der Aalst, A.H.M. ter Hofstede, B. Kiepuszewski and A.P. Barros, “Workflow Patterns”, URL: http://tmitwww.tm.tue.nl/research/patterns/ [December 2004].

  7. J.H. Abawajy, “Fault-Tolerant Scheduling Policy for Grid Computing Systems”, in 18th International Parallel and Distributed Processing Symposium (IPDPS'04), Santa Fe, New Mexico, IEEE Computer Society (CS), Los Alamitos, CA, USA, pp. 238–244, April 26–30, 2004.

  8. D. Abramson, J. Giddy and L. Kotler, “High Performance Parametric Modeling with Nimrod/G: Killer Application for the Global Grid?” in 14th International Parallel and Distributed Processing Symposium (IPDPS 2000), Cancun, Mexico, IEEE CS, Los Alamitos, CA, USA, May 1–5, 2000.

  9. M. Addis, J. Ferris, M. Greenwood, P. Li, D. Marvin, T. Oinn and A. Wipat, “Experiences with e-Science Workflow Specification and Enactment in Bioinformatics”, in UK e-Science All Hands Meeting 2003, IOP Publishing Ltd., Bristol, UK, pp. 459–467, 2003.

    Google Scholar 

  10. G. Allen, K. Davis, K.N. Dolkas, N.D. Doulamis, T. Goodale, T. Kielmann, A. Merzky, J. Nabrzyski, J. Pukacki, T. Radke, M. Russell, E. Seidel, J. Shalf and I. Taylor, “Enabling Applications on the Grid – A GridLab Overview”, in International Journal of High Performance Computing Applications (JHPCA), Special Issue on Grid Computing: Infrastructure and Applications, SAGE Publications Inc., London, UK, August 2003.

  11. J. Almond and D. Snelling, “Unicore: Secure and Uniform Access to Distributed Resources via the World Wide Web”, White Paper, October 1998, http://www.fz-juelich.de/zam/RD/coop/unicore/whitepaper.ps [December 2004].

  12. I. Altintas, A. Birnbaum, K. Baldridge, W. Sudholt, M. Miller, C. Amoreira, Y. Potier and B. Ludaescher, “A Framework for the Design and Reuse of Grid Workflows”, in International Workshop on Scientific Applications on Grid Computing (SAG'04), LNCS 3458, Springer, Berlin, Heidelberg, New York, 2005.

  13. K. Amin and G. von Laszewski, “GridAnt: A Grid Workflow System”, Manual, February 2003, http://www-unix.globus.org/cog/projects/gridant/gridant-manual.pdf [December 2004].

  14. T. Andrews, F. Curbera, H. Dholakia, Y. Goland, J. Klein, J. Klein, F. Leymann, K. Liu, D. Roller, D. Smith, S. Thatte, I. Trickovic and S. Weerawarana, “Business Process Execution Language for Web Services Version 1.1”, 05 May 2003, http://www-128.ibm.com/developerworks/library/ws-bpel/ [Feb 2005].

  15. The Apache Ant Project. http://ant.apache.org/ [December 2004].

  16. D.A. Bacigalupo, S.A. Jarvis, L. He and G.R. Nudd, “An Investigation into the Application of Different Performance Techniques to E-Commerce Applications”, in Workshop on Performance Modelling, Evaluation and Optimization of Parallel and Distributed Systems, 18th IEEE International Parallel and Distributed Processing Symposium (IPDPS), Santa Fe, New Mexico, IEEE CS, Los Alamitos, CA, USA, April 26–30, 2004.

  17. R. Bastos, D. Dubugras and A. Ruiz, “Extending UML Activity Diagram for Workflow Modeling in Production Systems”, in 35th Annual Hawaii International Conference on System Sciences (HICSS'02), Big Island, Hawaii, IEEE CS, Los Alamitos, CA, USA, January 07–10, 2002.

  18. F. Berman, A. Chien, K. Cooper, J. Dongarra, I. Foster, D. Gannon, L. Johnsson, K. Kennedy, C. Kesselman, J. Mellor-Crummey, D. Reed, L. Torczon and R. Wolski, “The GrADS Project: Software Support for High-Level Grid Application Development”, International Journal of High Performance Computing Applications (JHPCA), Vol. 15, No. 4, pp. 327–344, SAGE Publications Inc., London, UK, Winter 2001.

  19. I. Brandic, S. Benkner, G. Engelbrecht and R. Schmidt, Towards Quality of Service Support for Grid Workflows, First European Grid Conference (EGC 2005), Amsterdam, The Netherlands, Feb 2005.

  20. T.D. Braun, H.J. Siegel, N. Beck, L. Bölöni, M. Maheswaran, A.I. Reuther, J.P. Robertson, M.D. Theys and B. Yao, “A Taxonomy for Describing Matching and Scheduling Heuristics for Mixed-Machine Heterogeneous Computing Systems”, in 17th Symposium on Reliable Distributed Systems, West Lafayette, IN, IEEE CS, Los Alamitos, CA, pp. 330–335, October 1998.

  21. R. Buyya, D., Abramson and J. Giddy, “Nimrod/G: An Architecture of a Resource Management and Scheduling System in a Global Computational Grid”, HPC Asia 2000, Beijing, China, IEEE CS, Los Alamitos, CA, USA, pp. 283–289, May 14–17, 2000.

  22. R. Buyya, D. Abramson and J. Giddy, “A Case for Economy Grid Architecture for Service-Oriented Grid Computing”, in 10th IEEE International Heterogeneous Computing Workshop (HCW 2001), San Francisco, CA, USA, IEEE CS, Los Alamitos, CA, USA, April 2001.

  23. R. Buyya and S. Venugopal, “The Gridbus Toolkit for Service Oriented Grid and Utility Computing: An Overview and Status Report”, in 1st IEEE International Workshop on Grid Economics and Business Models, GECON 2004, Seoul, Korea, IEEE CS, Los Alamitos, CA, USA, pp. 19–36, April 23, 2004.

  24. J. Cao, S.A. Jarvis, S. Saini, D.J. Kerbyson and G.R. Nudd, “ARMS: An Agent-based Resource Management System for Grid Computing”, Scientific Programming. Special Issue on Grid Computing, Vol. 10, No. 2, pp. 135–148, IOS, Amsterdam, Netherlands, 2002.

  25. J. Cao, S.A. Jarvis, S. Saini, G.R. Nudd, “GridFlow:Workflow Management for Grid Computing”, in 3rd International Symposium on Cluster Computing and the Grid (CCGrid), Tokyo, Japan, IEEE CS, Los Alamitos, May 12–15, 2003.

  26. J. Cardoso, “Stochastic Workflow Reduction Algorithm”, Technical Report, LSDIS Lab, Department of Computer Science University of Georgia, 2002.

  27. J. Cardoso and A. Sheth, “Semantic E-Workflow Composition”, Journal of Intelligent Information Systems”, Vol. 21, No. 3, pp. 191–225, Kluwer, Netherlands, 2003.

  28. J. Cardoso, J. Miller, A. Sheth and J. Arnold, “Modeling Quality of Service for Workflows and Web Service Processes”, Web Semantics Journal: Science, Services and Agents on the World Wide Web, Vol. 1, No. 3, pp. 281–308, Elsevier Inc., Massachussetts, USA, 2004.

  29. T.L. Casavant and J.G. Kuhl, “A Taxonomy of Scheduling in General-purpose Distributed Computing Systems”, IEEE Transactions on Software Engineering, Vol. 14, No. 2, pp. 141–154, IEEE CS, Los Alamitos, Feb. 1988.

  30. A. Chervenak, E. Deelman, I. Foster, L. Guy, W. Hoschek, A. Lamnitchi, C. Kesselman, P. Kunst, M. Ripeanu, B. Schwartzkopf, H. Stockinger, K. Stockinger and B. Tierney, “Giggle: A Framework for Constructing Scalable Replica Location Services”, in Supercomputing (SC2002), Baltimore, USA, IEEE Computer Society, Washington, DC, USA, November 16–22, 2002.

  31. G. Clemm, J.F. Reschke, E. Sedlar and J. Whitehead, “Web Distributed Authoring and Versioning (WebDAV) Access Control Protocol”, The Internet Society, May 2004.

  32. K. Cooper, A. Dasgupata, K. Kennedy, C. Koelbel, A. Mandal, G. Marin, M. Mazina, J. Mellor-Crummey, F. Berman, H. Casanova, A. Chien, H. Dail, X. Liu, A. Olugbile, O. Sievert, H. Xia, L. Johnsson, B. Liu, M. Patel, D. Reed, W. Deng, C. Mendes, Z. Shi, A. YarKhan and J. Dongarra, “New Grid Scheduling and Rescheduling Methods in the GrADS Project”, NSF Next Generation Software Workshop, International Parallel and Distributed Processing Symposium, Santa Fe, IEEE CS, Los Alamitos, CA, USA, April 2004.

  33. D. Crichton, J.S. Hughes and S. Kelly, “A Science Data System Architecture for Information Retrieval”, in Clustering and Information Retrieval, Kluwer, December 2003.

  34. K. Czajkowski, S. Fitzgerald, I. Foster and C. Kesselman, “Grid Information Services for Distributed Resource Sharing”, in 10th IEEE International Symposium on High Performance Distributed Computing, San Francisco, CA, USA: IEEE CS, Los Alamitos, CA, USA, 7–9 August 2001.

  35. D. Hollinsworth. The Workflow Reference Model, Workflow Management Coalition, TC00-1003, 1994.

  36. DAGMan Application. http://www.cs.wisc.edu/condor/manual/v6.4/2_11DAGman_Applicaitons.html [December 2004].

  37. H.J. Dail, “A Modular Framework for Adaptive Scheduling in Grid Application Development Environments”, Master's Thesis, UCSD Technical Report CS2002-0698, University of California at San Diego, March 2002.

  38. H. Dail, H. Casanova and F. Berman, “A Decoupled Scheduling Approach for the GrADS Program Development Environment”, Journal of Parallel Distributed Computing, Vol. 63, No. 5, pp. 505–524, Elsevier Inc., MA, USA, 2003.

  39. E. Deelman, C. Kesselman and G. Mehta, “Transformation Catalog Design for GriPhyN”, Technical Report GriPhN-2001-17, 2001.

  40. E. Deelman, J. Blythe, Y. Gil and C. Kesselman, “Workflow Management in GriPhyN”, The Grid Resource Management, Kluwer, Netherlands, 2003.

    Google Scholar 

  41. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta and K. Vahi, “Mapping Abstract Complex Workflows onto Grid Environments”, Journal of Grid Computing, Vol. 1, pp. 25–39, Kluwer, Netherlands, 2003.

  42. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, S. Patil, M.H. Su, K. Vahi and M. Livny, “Pegasus: Mapping Scientific Workflow onto the Grid”, in Across Grids Conference 2004, Nicosia, Cyprus, 2004.

  43. P.A. Dinda, “Online Prediction of the Running Time of Tasks”, Cluster Computing, Vol. 5, No. 3, pp. 225–236, Kluwer, Netherlands, 2002.

  44. dom4j. http://www.dom4j.org [December 2004].

  45. M. Dumas and A.H.M. ter Hofstede, “UML Activity Diagrams as a Workflow Specification Language”, in UML'2001 Conference, Toronto, Ontario, Canada, Lecture Notes in Computer Science (LNCS), Springer, Berlin, Heidelberg, New York, October 1–5, 2001.

  46. R. Eshuis and R. Wieringa, “Comparing Petri Net and Activity Diagram Variants for Workflow Modelling – A Quest for Reactive Petri Nets”, Advances in Petri Nets: Petri Net Technology for Communication Based Systems; Lecture Notes in Computer Science (LNCS), Vol. 2472, pp. 321–351, Springer, Berlin, Heidelberg, New York, 2003.

  47. T. Fahringer, S. Pllana and A. Villazon, “AGWL: Abstract Grid Workflow Language”, in International Conference on Computational Science, Programming Paradigms for Grids and Meta-computing Systems, Krakow, Poland, Springer, Berlin, Heidelberg, New York, June 2004.

  48. T. Fahringer, S. Pllana and J. Testori, “Teuta: Tool Support for Performance Modeling of Distributed and Parallel Applications”, in International Conference on Computational Science, Tools for Program Development and Analysis in Computational Science, Krakow, Poland, Springer, Berlin, Heidelberg, New York, Heidelberg, June 2004.

  49. T. Fahringer, A. Jugravu, S. Pllana, R. Prodan, C.S. Jr. and H.L. Truong, “ASKALON: A Tool Set for Cluster and Grid Computing”, Concurrency and Computation: Practice and Experience, Vol. 17, pp. 143–169, Wiley, 2005.

  50. D. Fernández-Baca, “Allocating Modules to Processors in a Distributed System”, IEEE Transactions on Software Engineering, Vol. 15, No. 11, pp. 1427–1436, November 1989.

    Article  Google Scholar 

  51. I. Foster and C. Kesselman (eds). The Grid: Blueprint for a Future Computing Infrastructure, Morgan Kaufmann, USA, 1999.

    Google Scholar 

  52. I. Foster, C. Kesselman and S. Tuecke, “The Anatomy of the Grid: Enabling Scalable Virtual Organizations”, International Journal of Supercomputing Applications, Vol. 15, No. 3, 2001.

  53. I. Foster, J. Vöckler, M. Wilde, Y. Zhao, “Chimera: A Virtual Data System for Representing, Querying, and Automating Data Derivation”, in 14th International Conference on Scientific and Statistical Database Management (SSDBM), Edinburgh, Scotland, UK: IEEE CS, Los Alamitos, CA, USA, July 24–26, 2002.

  54. I. Foster, C. Kesselman, J.M. Nick and S. Tuecke, “The Physiology of the Grid”, Technical Report, Globus Project, http://www.globus.org/research/papers/ogsa.pdf [December 2004].

  55. Freefluo Overview. http://freefluo.sourceforge.net/ [December 2004].

  56. D. Gelernter, “Generative Communication in Linda”, ACM Computing Surveys, Vol. 7, No. 1, pp. 80–112, 1985.

    MATH  Google Scholar 

  57. A. Galstyan, K. Czajkowski and K. Lerman, “Resource Allocation in the Grid Using Reinforcement Learning”, in 3rd International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS'03), New York City, NY, USA, IEEE CS, Los Alamitos, CA, USA, July 19–23, 2004.

  58. A. Geppert, M. Kradolfer and D. Tombros, “Market-based Workflow Management”, International Journal of Cooperative Information Systems, World Scientific, New Jersey, USA, 1998.

    Google Scholar 

  59. Globus Project. http://www.globus.org [December 2004].

  60. Grid Resource Allocation Agreement Protocol. https://forge.gridforum.org/projects/graap-wg [December 2004].

  61. GriPhyN. http://www.griphyn.org [December 2004].

  62. Z. Guan, F. Hernandez, P. Bangalore, J. Gray, A. Skjellum, V. Velusamy and Y. Liu, “Grid-Flow: A Grid-Enabled Scientific Workflow System with a Petri Net-based Interface”, Technical Report, http://http://www.cis.uab.edu/gray/Pubs/grid-flow.pdf [December 2004].

  63. V. Hamscher, U. Schwiegelshohn, A. Streit and R. Yahyapour, “Evaluation of Job-Scheduling Strategies for Grid Computing”, in 1st IEEE/ACM International Workshop on Grid Computing (Grid 2000), Berlin, Lecture Notes in Computer Science (LNCS), Springer, Berlin, Heidelberg, New York, pp. 191–202, 2000.

  64. F. Hernández, P. Bangalore, J. Gray and K. Reilly, “A Graphical Modeling Environment for the Generation of Workflows for the Globus Toolkit”, in Workshop on Component Models and Systems for Grid Applications, 18th Annual ACM International Conference on Supercomputing (ICS 2004), Saint-Malo, France, ACM, New York, NY, USA, June 2004.

  65. A. Hoheisel. User Tools and Languages for Graph-based Grid Workflows. Grid Workflow Workshop, GGF10, Berlin, March 9, 2004.

  66. S. Hwang and C. Kesselman, “Grid Workflow: A Flexible Failure Handling Framework for the Grid”, in 12th IEEE International Symposium on High Performance Distributed Computing (HPDC'03), Seattle, Washington, USA, IEEE CS, Los Alamitos, CA, USA, June 22–24, 2003.

  67. I. Horrocks, “DAML+OIL: A Reason-able Web Ontology Language”, in International Conference on Extending Database Technology (EDBT 2002), Lecture Notes in Computer Science (LNCS), pp. 11–28, Vol. 1091, Springer, Berlin, Heidelberg, New York, pp. 2–13, March 24–28, 2002.

  68. S. Jang, X. Wu, V. Taylor, G. Mehta, K. Vahi and E. Deelman, “Using Performance Prediction to Allocate Grid Resources”, Technical Report 2004-25, GriPhyN Project, USA.

  69. JDOM. http://www.jdom.org [December 2004].

  70. JXTA Project. http://www.jxta.org [Feb 2005].

  71. P. Kacsuk, G. Dózsa, J. Kovács, R. Lovas, N. Podhorszki, Z. Balaton and G. Gombás, “P-GRADE: a Grid Programming Environment”, Journal of Grid Computing, Vol. 1, No. 2, pp. 171–197, Kluwer, Netherlands, 2003.

  72. B. Kao and H. Garcia-Molina, “Deadline Assignment in a Distributed Soft Real-Time System”, IEEE Transactions on Parallel and Distributed Systems, Vol. 8, No. 12, pp. 1268–1274, IEEE CS, Los Alamitos, CA, USA, 1997.

  73. K. Krauter, R. Buyya and M. Maheswaran, “A Taxonomy and Survey of Grid Resource Management Systems for Distributed Computing”, Software: Practice and Experience, Vol. 32, No. 2, pp. 135–164, Wiley, NJ, USA, February 2002.

  74. G. von Laszewski, I. Foster, J. Gawor and P. Lane, “A Java Commodity Grid Kit”, Concurrency and Computation: Practice and Experience, Vol. 13, No. 8–9, pp. 643–662, Wiley, Chichester, UK, 2001.

  75. G. von Laszewski, K. Amin, M. Hategan, N.J. Zaluzec, S. Hampton and A. Rossi, “GridAnt: A Client-Controllable Grid Workflow System”, in 37th Annual Hawaii International Conference on System Sciences (HICSS'04), Big Island, Hawaii: IEEE CS, Los Alamitos, CA, USA, January 5–8, 2004.

  76. G. Von Laszewski, “Java CoG Kit Workflow Concepts for Scientific Experiments”, Technical Report, Argonne National Laboratory, Argonne, IL, USA, 2005.

  77. G. von Laszewski and M. Hategan, “Java CoG Kit Karajan/GridAnt Workflow Guide”, Technical Report, Argonne National Laboratory, Argonne, IL, USA, 2005.

  78. A. Lerina, C. Aniello, G. Pierpaolo and V.M. Luisa, “FlowManager: A Workflow Management System Based on Petri Nets”, in 26th Annual International Computer Software and Applications Conference, Oxford, England, IEEE CS, Los Alamitos, CA, USA, pp. 1054–1059, August 2002.

  79. F. Leymann. Web Services Flow Language (WSFL 1.0), May 2001, http://www-306.ibm.com/software/solutions/webservices/pdf/WSFL.pdf [December 2004].

  80. D.C. Li and N. Ishii, “Scheduling Task Graphs onto Heterogeneous Multiprocessors”, TENCON'94, IEEE Region 10's Ninth Annual International Conference, Theme: Frontiers of Computer Technology, IEEE CS, Los Alamitos, CA, USA, 1994.

  81. M. Litzkow, M. Livny and M. Mutka, “Condor – A Hunter of Idle Workstations”, in 8th International Conference of Distributed Computing Systems (ICDCS), IEEE CS, Los Alamitos, CA, USA, pp. 104–111, June 1988.

  82. X. Liu, J. Liu, J. Eker and E.A. Lee, “Heterogeneous Modeling and Design of Control Systems”, in Tariq Samad and Gary Balas (eds.), Software-Enabled Control: Information Technology for Dynamical Systems, Wiley-IEEE, April 2003.

  83. R. Lovas, G. Dózsa, P. Kacsuk, N. Podhorszki and D. Drótos, “Workflow Support for Complex Grid Applications: Integrated and Portal Solutions”, in 2nd European Across Grids Conference, Nicosia, Cyprus, 2004.

  84. B. Ludäscher, I. Altintas and A. Gupta, “Compiling Abstract Scientific Workflows into Web Service Workflows”, in 15th International Conference on Scientific and Statistical Database Management, Cambridge, MA, USA, IEEE CS, Los Alamitos, CA, USA, pp. 241–244, July 09–11, 2003.

  85. B. Ludäscher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E.A. Lee, J. Tao and Y. Zhao, “Scientific Workflow Management and the KEPLER System”, Concurrency and Computation: Practice & Experience, 2005 (in press), Published online in Wiley Interscience (http://www.interscience.wiley.com). DOI: "10.1002/cpe.994"

  86. A. Luther, R. Buyya, R. Ranjan and S. Venugopal, “Peer-to-Peer Grid Computing and a .NET-based Alchemi Framework”, in Laurence Yang and Minyi Guo (eds.), High Performance Computing: Paradigm and Infrastructure, ISBN: 0-471-65471-X, Wiley, NJ, USA, June 2005.

  87. M. Maheswaran, S. Ali, H.J. Siegel, D. Hensgen and R. Freund, “Dynamic Matching and Scheduling of a Class of Independent Tasks onto Heterogeneous Computing Systems”, in 8th Heterogeneous Computing Workshop (HCW'99), Juan, Puerto Rico, IEEE Computer Society, Los Alamitos, April 12, 1999.

  88. A. Mani and A. Nagarajan, “Understanding Quality of Service for Web Services”, http://www-106.ibm.com/developerworks/library/ws-quality.html [December 2004].

  89. D.C. Marinescu, “A Grid Workflow Management Architecture”, GGF White Paper, 2002.

  90. G. Mateescu, “Quality of Service on the Grid via Metascheduling with Resource Co-scheduling and Co-reservation”, International Journal of High Performance Computing Applications, Vol. 17, No. 3, pp. 209–218, SAGE Publications Inc, London, UK, August 2003.

  91. A. Mayer, S. McGough, N. Furmento, W. Lee, S. Newhouse and J. Darlington, “ICENI Dataflow and Workflow: Composition and Scheduling in Space and Time”, in UK e-Science All Hands Meeting, Nottingham, UK, IOP, Bristol, UK, pp. 627–634, September 2003.

  92. A. Mayer, S. McGough, N. Furmento, W. Lee, M. Gulamali, S. Newhouse and J. Darlington, “Workflow Expression: Comparison of Spatial and Temporal Approaches”, in Workflow in Grid Systems Workshop, GGF-10, Berlin, March 9, 2004.

  93. S. McGough, L. Young, A. Afzal, S. Newhouse and J. Darlington, “Workflow Enactment in ICENI”, in UK e-Science All Hands Meeting, Nottingham, UK, IOP, Bristol, UK, pp. 894–900, Sep. 2004.

  94. S. McGough, L. Young, A. Afzal, S. Newhouse and J. Darlington, “Performance Architecture within ICENI”, in UK e-Science All Hands Meeting, Nottingham, UK, IOP, Bristol, UK, pp. 906–911, Sep. 2004.

  95. Message Passing Interface Forum, http://www.mpi-forum.org/ [Feb 2005].

  96. R.A. Moreno, “Job Scheduling and Resource Management Techniques in Dynamic Grid Environment”, in 1st European Across Grids Conference, Spain, Lecture Notes in Computer Science (LNCS), Springer, Berlin, Heidelberg, New York, February 2003.

  97. T. Murata, “Temporal Uncertainty and Fuzzy-Timing High-Level Petri Nets”, in Application and Theory of Petri Nets, Lecture Notes in Computer Science (LNCS), Vol. 1091, pp. 11–28, Springer, Berlin, Heidelberg, New York, 1996.

  98. G.R. Nudd, D.J. Kerbyson, E. Papaefstathiou, S.C. Perry, J.S. Harper and D.V. Wilcox, “PACE-A Toolset for the Performance Prediction of Parallel and Distributed Systems”, International Journal of High Performance Computing Applications (JHPCA), Special Issues on Performance Modelling-Part I, Vol. 14, No. 3, pp. 228–251, SAGE, London, UK, 2000.

  99. Object Management Group. Unified Modeling Language (UML), http://www.uml.org/ [Feb 2005].

  100. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver and K. Glover, M.R. Pocock, A. Wipat and P. Li, “Taverna: A Tool for the Composition and Enactment of Bioinformatics Workflows”, Bioinformatics, Vol. 20, No. 17, pp. 3045–3054, Oxford University Press, London, UK, 2004.

  101. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Greenwood, T. Carver, A. Wipat and P. Li. Taverna, “Lessons in Creating a Workflow Environment for the Life Sciences”, GGF10, Berlin, 2004.

  102. OMG. Unified Modeling Language Version 1.3., July 1999.

  103. C. Patel, K. Supekar and Y. Lee, “A QoS Oriented Framework for Adaptive Management of Web Service based Workflows”, Lecture Notes in Computer Science, Vol. 2736, pp. 826–835, Springer, Berlin, Heidelberg, New York, 2003.

  104. C.A. Petri, “Kommunikation mit Automaten”, PhD Thesis, Institut für instrumentelle Mathematik, Bonn, 1962.

  105. S. Pllana, T. Fahringer, J. Testori, S. Benkner and I. Brandic, “Towards an UML Based Graphical Representation of Grid Workflow Applications”, in 2nd European AcrossGrids Conference (AxGrids 2004), Nicosia, Cyprus, LNCS, Springer, Berlin, Heidelberg, New York, January 28–30, 2004.

  106. R. Prodan and T. Fahringer, “Dynamic Scheduling of Scientific Workflow Applications on the Grid: A Case Study”, in 20th Annual ACM Symposium on Applied Computing (SAC 2005), New Mexico, USA, ACM, New York, NY, USA, March 2005.

  107. R.L. Ribler, H. Simitci and D.A. Reed, “The Autopilot Performance-directed Adaptive Control System”, Future Generation Computer Systems, Vol. 18, No, 1, pp. 175–187, Elsevier Inc., MA, USA, 2001.

  108. H.G. Rotithor, “Taxonomy of Dynamic Task Scheduling Schemes in Distributed Computing Systems”, IEE Proceedings of Computers and Digital Techniques, Vol. 141, No. 1, pp. 1–10, London, UK, January 1994.

  109. S. Fitzgerald, I. Foster, C. Kesselman, G. Von Laszewski, W. Smith and S. Tuecke, “A Directory Service for Configuring High-Performance Distributed Computations”, in 6th IEEE Symposium on High-Performance Distributed Computing, Portland, OR, IEEE CS, Los Alamitos, pp. 365–375, August 1997.

  110. R. Sakellariou and H. Zhao, “A Low-Cost Rescheduling Policy for Efficient Mapping of Workflows on Grid Systems”, Scientific Programming, Vol. 12, No. 4, pp. 253–262, IOS, Netherlands, December 2004.

  111. M. Senger, P. Rice and T. Oinn, “Soaplab – A Unified Sesame Door to Analysis Tools”, in UK e-Science All Hands Meeting, pp. 509–513, September 2003.

  112. A. Slominski, D. Gannon and G. Fox, “Introduction to Workflows and Use of Workflows in Grids and Grid Portals”, GGF 9, Chicago, USA, 7 Oct, 2004.

  113. W. Smith, I. Foster and V. Taylor, “Predicting Application Run Times Using Historical Information”, in Workshop on Job Scheduling Strategies for Parallel Processing, 12th International Parallel Processing Symposium & 9th Symposium on Parallel and Distributed Processing (IPPS/SPDP '98), IEEE CS, Los Alamitos, CA, USA, 1998.

  114. S.S. Song and K. Hwang, “Security Binding for Trusted Job Outsourcing in Open Computational Grids”, IEEE Transactions on Parallel and Distributed Systems (TPDS), submitted May 2004, revised Dec. 2004.

  115. S.S. Song, Y.K. Kwok and K. Hwang, “Trusted Job Scheduling in Open computational Grids: Security-Driven heuristics and A Fast Genetic Algorithm”, in 19th IEEE International Parallel & Distributed Processing Symposium (IPDPS-2005), Denver, CO, USA, IEEE Computer Society, Los Alamitos, CA, USA, April 4–8, 2005.

  116. D.P. Spooner, J. Cao, J.D. Turner, H.N. Lin Chio Keung, S.A. Jarvis and G.R. Nudd, “Localized Workload Management Using Performance Prediction and QoS Contracts”, in 18th Annual UK Performance Engineering Workshop, Glasgow, UK, pp. 69–80, 2002.

  117. D.P. Spooner, J. Cao, S.A. Jarvis, L. He and G.R. Nudd, “Performance-aware Workflow Management for Grid Computing”, The Computer Journal, Oxford University Press, London, UK, 2004.

  118. R.D. Stevens, A.J. Robinson and C.A. Goble, “myGrid: Personalized Bioinformatics on the Information Grid”, Bioinformatics, Vol. 19, Suppl. 1, pp. i302–i304, Oxford University Press, London, UK, 2003.

  119. A. Sulistio and R. Buyya, “A Grid Simulation Infrastructure Supporting Advance Reservation”, in 16th International Conference on Parallel and Distributed Computing and Systems (PDCS 2004), MIT Cambridge, Boston, USA, ACTA, CA, USA, November 9–11, 2004.

  120. T. Tannenbaum, D. Wright, K. Miller and M. Livny, “Condor – A Distributed Job Scheduler”, Beowulf Cluster Computing with Linux, MIT, MA, USA, 2002.

  121. Taverna User Manual. http://taverna.sourceforge.net/manual/docs.word.html [December 2004].

  122. I. Taylor, R. Philp, M. Shields, O. Rana and B. Schutz, “The Consumer Grid”, in Global Grid Forum (2002), Toronto, Ontario, Canada, February 17–20, 2002.

  123. I. Taylor, M. Shields and I. Wang”, Resource Management of Triana P2P Services”, Grid Resource Management, Kluwer, Netherlands, June 2003.

    Google Scholar 

  124. D. Thain, T. Tannenbaum and M. Livny, “Condor and the Grid”, Grid Computing: Making the Global Infrastructure a Reality, Wiley, New Jersey, USA, 2003.

    Google Scholar 

  125. S. Thatte. XLANG-Web Services for Business Process Design, Microsoft Corporation, 2001, http://www.gotdotnet.com/team/xml_wsspecs/xlang-c/default.htm [Feb 2005].

  126. S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham, C. Kesselman, T. Maguire, T. Sandholm, P. Vanderbilt and D. Snelling, “Open Grid Services Infrastructure (OGSI) Version 1.0”, Global Grid Forum Draft Recommendation, June 27, 2003.

  127. UDDI Technical White Paper, September 2000, http://www.uddi.org [December 2004].

  128. Unicore Forum. Unicore Plus Final Report: Uniform Interface to Computing Resource. 2003, http://www.unicore.org/documents/UNICOREPlus-Final-Report.pdf [December 2004].

  129. S. Vadhiyar and J. Dongarra, “A Performance Oriented Migration Framework for the Grid”, in IEEE Computing Clusters and the Grid (CCGrid), Tokyo, Japan, IEEE CS, Los Alamitos, May 12–15, 2003.

  130. S. Venugopal, R. Buyya and L. Winton, “A Grid Service Broker for Scheduling Distributed Data-Oriented Applications on Global Grids”, in 2nd International Workshop on Middleware for Grid Computing, Middleware 2004, Toronto, Ontario-Canada, ACM, New York, NY, USA, October 18, 2004.

  131. H.M.W. Verbeek, A. Hirnschall and W.M.P. van der Aalst, “XRL/Flower: Supporting Inter-Organizational Workflows Using XML/Petri-nets Technology”, in Workshop on Web Services, e-Business, and the Semantic Web (WES): Foundations, Models, Architecture, Engineering and Applications, The Fourteenth International Conference on Advanced Information Systems Engineering (CAiSE 2002), Toronto, Ontario, Canada, Lecture Notes in Computer Science (LNCS), Springer, Berlin, Heidelberg, New York, pp. 535–552, May 27–28, 2002.

  132. W3C. Extensible Markup Language (XML) 1.0 (Third Edition), http://www.w3.org/TR/REC-xml/ [Feb 2005].

  133. W3C. Web Services, 2002, http://www.w3.org/2002/ws/ [Feb 2005].

  134. W3C. XML Schema, http://www.w3.org/XML/Schema [Feb 2005].

  135. W3C. XML Pipeline Definition Language Version 1.0, http://www.w3.org/TR/2002/NOTE-xml-pipeline-20020228/ [Feb 2005].

  136. R. Wolski, N.T. Spring and J. Hayes, “The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing”, Future Generation Computer Systems, Vol. 15, No. 5–6, pp. 757–768, 1999.

    Article  Google Scholar 

  137. Workflow Management Coalition, http://www.wfmc.org/ [December 2004].

  138. World Wide Web Consortium. Web Services Description Language (WSDL) Version 1.2, http://www.w3.org/TR/wsdl12 [December 2004].

  139. C. Wroe, R. Stevens, C. Goble, A. Roberts and M. Greenwood, “A Suite of DAML+OIL Ontologies to Describe Bioinformatics Web Services and Data”, International Journal of Cooperative Information Systems, Vol. 12, No. 2, pp. 197–224, World Scientific Publishing Co., NJ, USA, 2003.

  140. X.F. Wu, V. Taylor and R. Stevens, “Design and Implementation of Prophesy Automatic Instrumentation and Data Entry System”, in 13th IASTED International Conference on Parallel and Distributed Computing and Systems (PDCS2001), Anaheim, CA, IASTED, Philadelphia, PA, USA, August 2001.

  141. R. Yahyapour, P. Wieder, A. Pugliese, D. Talia and J. Hahm, “Grid Scheduling Use Cases”, White Paper, Global Grid Forum, 19 July, 2004.

  142. L. Young and J. Darlington, “Scheduling Componentized Applications on a Computational Grid”, MPhil/PhD Transfer Report, Imperial College London, University of London, UK, 2004.

  143. L. Young, S. McGough, S. Newhouse and J. Darlington, “Scheduling Architecture and Algorithms within the ICENI Grid Middleware”, in UK e-Science All Hands Meeting, IOP, Bristol, UK, Nottingham, UK, pp. 5–12, Sep. 2003.

  144. J. Yu and R. Buyya, “A Novel Architecture for Realizing Grid Workflow using Tuple Spaces”, in 5th IEEE/ACM International Workshop on Grid Computing (Grid 2004), Pittsburgh, USA, IEEE CS, Los Alamitos, CA, USA, Nov. 8, 2004.

  145. J. Yu, S. Venugopal and R. Buyya, “A Market-Oriented Grid Directory Service for Publication and Discovery of Grid Service Providers and their Services”, Technical Report, GRIDS-TR-2003-0, Grid Computing and Distributed Systems (GRIDS) Laboratory, The University of Melbourne, Australia, January 2003.

  146. J. Yu, R. Buyya and C.K. Tham, “QoS-based Scheduling of Workflow Applications on Service Grids”, Technical Report, GRIDS-TR-2005-8, Grid Computing and Distributed Systems Laboratory, University of Melbourne, Australia, June 9, 2005.

  147. S.Y. Zhao and V. Lo, “Result Verification and Trust-based Scheduling in Open Peer-to-Peer Cycle Sharing Systems”, Technical Report, University of Oregon, USA, 2005.

  148. G. Zheng, T. Wilmarth, P. Jagadishprasad and L.V. Kalé, “Simulation-based Performance Prediction for Large Parallel Machines”, International Journal of Parallel Programming, Vol. 33, No. 2–3, pp. 183–207, Springer, The Netherlands, 2005.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Grid Computing and Distributed Systems (GRIDS) Laboratory, Department of Computer Science and Software Engineering, The University of Melbourne, Melbourne, Australia

    Jia Yu & Rajkumar Buyya

Authors
  1. Jia Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rajkumar Buyya
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Rajkumar Buyya.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Yu, J., Buyya, R. A Taxonomy of Workflow Management Systems for Grid Computing. J Grid Computing 3, 171–200 (2005). https://doi.org/10.1007/s10723-005-9010-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10723-005-9010-8

Key words

Search

Navigation