Advertisement

Increasing Parallelism for Workflows in the Grid

  • Jonathan Martí
  • Jesús Malo
  • Toni Cortes
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4641)

Abstract

Workflow applications executed in Grid environments are not able to take advantage of all the potential parallelism they might have. This limitation in the usage of parallelism comes from the fact that when there is a producer/consumer situation communicating using files, the consumer does not start its execution till the producer has finished creating the file to be consumed, and the file has been copied to the consumer (if needed).

In this paper, we propose a publish/subscribe mechanism that allows consumers to read the file at the same time it is being produced. In addition, this mechanism is implemented in a transparent way to the application, so does not require any special feature from the local filesystems.

Finally, we show that our mechanisms can speedup applications significantly. In our best test we divided by two the execution time of some applications, but other applications may have even higher benefits.

Keywords

Grid Workflow Parallelism Storage 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Badia, R., Labarta, J., Sirvent, R., Prez, J., Cela, J., Grima, R.: Programming Grid Applications with GRID superscalar. Journal of Grid Computing 1(2), 151–170 (2003)CrossRefGoogle Scholar
  2. 2.
    Obtain detailed information from raw performance traces, http://www.cepba.upc.es/paraver/
  3. 3.
    Castro, M., Druschel, P., Kermarrec, A., Rowstron, A.: SCRIBE: A large-scale and decentralized application-level multicast infrastructure. IEEE Journal on Selected Areas in communications (JSAC) 20(8), 1489–1499 (2002)CrossRefGoogle Scholar
  4. 4.
    Zhuang, S.Q., Zhao, B.Y., Joseph, A.D., Katz, R.H., Kubiatowicz, J.D.: Bayeux: An architecture for scalable and fault-tolerant wide-area data dissemination. In: Proceedings of NOSSDAV (June 2001)Google Scholar
  5. 5.
    Rss advisory board announcements and really simple syndication news, http://www.rssboard.org/
  6. 6.
    Lua, K., Crowcroft, J., Pias, M., Sharma, R., Lim, S.: A survey and comparison of peer-to-peer overlay network schemes. Communications Surveys & Tutorials, IEEE, 72–93 (2005)Google Scholar
  7. 7.
    Chen, K., Huang, Z., Li, B., Huang, E., Rajic, H., Kuhn, R., Chen, W.: Distributed File Streamer: A Framework for Distributed Application Data Coupling. In: 7th IEEE/ACM Grid, pp. 168–175. ACM Press, New York (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Jonathan Martí
    • 1
  • Jesús Malo
    • 1
  • Toni Cortes
    • 1
    • 2
  1. 1.Barcelona Supercomputing Center 
  2. 2.Universitat Politècnica de Catalunya 

Personalised recommendations