Skip to main content
SpringerLink
Log in

Resource Aggregation and Workflow with Webcom

  • Conference paper
High Performance Computing and Communications (HPCC 2007)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4782))

  • 907 Accesses

Abstract

Efficient exploitation of the aggregate resources available to a researcher is a challenging and real problem. The challenge becomes all the greater when researchers who collaborate across functional or administrative domains need to pool their disjoint heterogeneous resources to achieve their objectives. Support tools are becoming available for these ad hoc resource integration and sharing scenarios. The focus of this paper is the identification of suitable deployment and usage strategies when using the workflow approach with these tools. In particular, we present a novel two-level peer-to-peer model for dynamic resource aggregation that operates entirely at the user level. This sidesteps the need for system level middleware and administrative support. This paper presents our strategy, the underlying framework and the workflow expression and evaluation semantics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Foster, I., Kesselman, C. (eds.): The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann, Los Altal, CA (1999)

    Google Scholar 

  2. Morrison, J.P., Power, D.A., Kennedy, J.J.: Webcom: A volunteer-based metacomputer. The Journal of Supercomputing 18(1), 47–61 (2001)

    Article  MATH  Google Scholar 

  3. Morrison, J.P., Power, D.A., Kennedy, J.J.: An evolution of the Webcom metacomputer. The Journal of Mathematical Modelling and Algorithms, Special Issue on Computational Science and Applications 23(2), 263–276 (2003)

    Google Scholar 

  4. Morrison, J., Coghlan, B., Shearer, A., Foley, S., Power, D., Perrot, R.: WebCom-G: A candidate middleware for Grid-Ireland. International Journal of High Performance Computing Applications 20(3), 409–422 (2006)

    Article  Google Scholar 

  5. Morrison, J.P.: Condensed Graphs: Unifying Availability-Driven, Coercion-Driven and Control-Driven Computing. PhD thesis, Technische Universiteit Eindhoven (1996)

    Google Scholar 

  6. Litzkow, M., Livny, M., Mutka, M.: Condor - a hunter of idle workstations. In: Proceedings of the 8th International Conference of Distributed Computing Systems (June 1988)

    Google Scholar 

  7. Thain, D., Tannenbaum, T., Livny, M.: Distributed computing in practice: the Condor experience. Concurrency - Practice and Experience 17(2-4), 323–356 (2005)

    Article  Google Scholar 

  8. Butt, A.R., Zhang, R., Hu, C.Y.: A self-organising flock of Condors. Journal of Parallel and Distributed Computing 66, 145–161 (2006)

    MATH  Google Scholar 

  9. Stoica, I., Morris, R., Karger, D., Kaashoek, M.F., Balakrishnan, H.: Chord: A scalable peer-to-peer lookup service for internet applications. In: Proceedings of the ACM SIGCOMM 2001 Conference, San Diego, California (August 2001)

    Google Scholar 

  10. Zhao, B.Y., Stribling, L.H., Rhea, J., Joesph, S.C., Kubiatowicz, A.D.J.D.: Tapestry: A resilient global-scale overlay for service deployment. IEEE Journal on Selected Areas in Communications 22(1) (2004)

    Google Scholar 

  11. Celaya, J., Arronategui, U.: Scalable architecture for allocation of idle CPUs in a P2P network. In: Gerndt, M., Kranzlmüller, D. (eds.) HPCC 2006. LNCS, vol. 4208, pp. 240–249. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  12. Stioca, I., et al.: Chord: a scalable peer-to-peer lookup protocol for internet applications. IEEE/ACM Trans. Netw. 11(1), 17–32 (2003)

    Article  Google Scholar 

  13. Rowstron, A., Druschel, P.: Pastry: scalable, decnetralized object location and routing for large-scale peer-to-peer systems. In: Proceedings of the Middleware 2001, IFIP/ACM International Conference on Distributed Systems Platforms, pp. 329–350 (2001)

    Google Scholar 

  14. Jagadish, H., Ooi, B., Vu, Q.: Baton: A balanced tree structure for peer-to-peer networks. In: Proceedings of the 31st VLDB Conference, pp. 661–672 (2005)

    Google Scholar 

  15. Fahringer, T., Qin, J., Hainzer, S.: Specification of grid workflow applications with AGWL: An abstract grid workflow language. In: CCGrid 2005. EEE International Symposium on Cluster Computing and the Grid 2005 (May 2005)

    Google Scholar 

  16. Alt, M., Hoheisel, A., Pohl, H.W., Gorlatch, S.: Using high level petri-nets for describing and analysing hierarchical grid workflows. In: Proceedings of the CoreGRID Integration Workshop 2005 (2005)

    Google Scholar 

  17. Hoheisel, A., Der, U.: An XML-based framework for loosely coupled applications on grid environments. In: Sloot, P., et al. (eds.) International Conference on Computational Science, pp. 245–254. Springer, Heidelberg (2003)

    Google Scholar 

  18. Mohan, R.: Why Monte Carlo? In: Leavitt, D.D., Starkschall, D. (eds.) Proc. XII Int. Conf. on the Use of Computers in Radiation Therapy, vol. XII, pp. 16–18. Medical Physics Publishing, Salt Lake City, Madison (1997)

    Google Scholar 

  19. Andreo, P.: Monte Carlo techniques in medical radiation physics. Physics in Medicine and Biology 36(7), 861–920 (1991)

    Article  Google Scholar 

  20. Ma, C.M., Jiang, S.B.: Monte Carlo modelling of electron beams from medical accelerators. Physics in Medicine and Biology 44(12), 157–189 (1999)

    Article  Google Scholar 

  21. Rogers, D.W.O.: Fifty years of Monte Carlo simulations for medical physics. Physics in Medicine and Biology 51(13), R287–R301 (2006)

    Article  Google Scholar 

  22. Krieger, T., Sauer, O.A.: Monte Carlo- versus pencil-beam-/collapsed-cone-dose calculation in a heterogeneous multi-layer phantom. Physics in Medicine and Biology 50(5), 859–868 (2005)

    Article  Google Scholar 

  23. Ahnesjo, A., Saxner, M., Trepp, A.: A pencil beam model for photon dose calculation. Medical Physics 19(2), 263–273 (1992)

    Article  Google Scholar 

  24. Ahnesjo, A.: Collapsed cone convolution of radiant energy for photon dose calculation in heterogeneous media. Medical Physics 16(4), 577–592 (1989)

    Article  Google Scholar 

  25. Bayucan, A., Henderson, R.L., Lesiak, C., Mann, B., Proett, T., Tweten, D.: Portable Batch System: External reference specification. Technical report, MRJ Technology Solutions, 2672 Bayshore Parkway, Suite 810, Mountain View, CA 94043 (July 2005)

    Google Scholar 

  26. Henderson, R.L.: Job scheduling under the portable batch system. In: IPPS 1995. Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, pp. 279–294. Springer, London (1995)

    Google Scholar 

  27. Jackson, D., Snell, Q., Clement, M.: Core algorithms of the Maui scheduler. In: Feitelson, D.G., Rudolph, L. (eds.) JSSPP 2001. LNCS, vol. 2221, pp. 87–102. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  28. Pinchak, C., Lu, P., Goldenberg, M.: Practical heterogeneous placeholder scheduling in overlay metacomputers: Early experiences. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2002. LNCS, vol. 2537, pp. 205–228. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  29. Goldenberg, M., Lu, P., Schaeffer, J.: TrellisDAG: A system for structured DAG scheduling. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 21–43. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  30. Aida, K., Natsume, W., Futakata, Y.: Distributed computing with hierarchical master-worker paradigm for parallel branch and bound algorithm. In: CCGRID 2003. Proceedings of the Third IEEE/ACM International Symposium on Cluster Computing and the Grid, pp. 156–163 (May 2003)

    Google Scholar 

  31. Iverson, M.A., Özgüner, F.: Hierarchical, competitive scheduling of multiple DAGs in a dynamic heterogeneous environment. Distributed Systems Engineering 6, 112–120 (1999)

    Article  Google Scholar 

  32. Milojicic, D.S., et al.: Peer-to-peer computing. Technical Report HPL-2002-57, HP Laboratories Palo Alto (March 2002)

    Google Scholar 

  33. von Laszewski, G., Hategan, M.: Workflow concepts of the Java CoG Kit. Journal of Grid Computing 3(3-4), 239–258 (2006)

    Article  Google Scholar 

  34. Foster, I.: Globus toolkit version 4: Software for service-oriented systems. In: IFIP International Conference on Network and Parallel Computing, pp. 2–13. Springer, Heidelberg (2005)

    Google Scholar 

  35. Ylonen, T.: The Secure Shell (SSH) protocol architecture (January 2006) Status: Proposed Standard

    Google Scholar 

  36. Livny, M., Basney, J., Raman, R., Tannenbaum, T.: Mechanisms for high throughput computing. SPEEDUP Journal 11(1) (June 1997)

    Google Scholar 

  37. Basney, J., Livny, M.: Deploying a high throughput computing cluster. In: Buyya, R. (ed.) High Performance Cluster Computing: Architectures and Systems, vol. 1, Prentice Hall PTR, Englewood Cliffs (1999)

    Google Scholar 

  38. Raman, R., Livny, M., Solomon, M.: Resource management through multilateral matchmaking. In: Proceedings of the Ninth IEEE Symposium on High Performance Distributed Computing (HPDC9), Pittsburgh, PA, pp. 290–291. IEEE Computer Society Press, Los Alamitos (2000)

    Chapter  Google Scholar 

  39. Tannenbaum, T., Wright, D., Miller, K., Livny, M.: Condor – a distributed job scheduler. In: Sterling, T. (ed.) Beowulf Cluster Computing with Linux, MIT Press, Cambridge (2001)

    Google Scholar 

  40. Blythe, J., Jain, S., Deelman, E., Gil, Y., Vahi, K., Mandal, A., Kennedy, K.: Task scheduling strategies for workflow-based applications in grids. In: Proceedings of CCGrid 2005. Cardiff, Wales, vol. 2, pp. 759–767 (May 2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Dept of Information Technology, National University of Ireland, Galway, Galway, Ireland

    Oisín Curran, Paddy Downes & John Cunniffe

  2. Dept of Physics, National University of Ireland, Galway, Galway, Ireland

    Andy Shearer

  3. Centre for Unified Computing, University College Cork, Cork, Ireland

    John P. Morrison

Authors
  1. Oisín Curran
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paddy Downes
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. John Cunniffe
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andy Shearer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. John P. Morrison
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Ronald Perrott Barbara M. Chapman Jaspal Subhlok Rodrigo Fernandes de Mello Laurence T. Yang

Rights and permissions

Reprints and permissions

Copyright information

© 2007 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Curran, O., Downes, P., Cunniffe, J., Shearer, A., Morrison, J.P. (2007). Resource Aggregation and Workflow with Webcom. In: Perrott, R., Chapman, B.M., Subhlok, J., de Mello, R.F., Yang, L.T. (eds) High Performance Computing and Communications. HPCC 2007. Lecture Notes in Computer Science, vol 4782. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-75444-2_16

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-75444-2_16

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-75443-5

  • Online ISBN: 978-3-540-75444-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation