Skip to main content
SpringerLink
Log in

Implementing a Grid/Cloud eScience Infrastructure for Hydrological Sciences

  • Chapter
  • First Online:
Book cover Guide to e-Science

Part of the book series: Computer Communications and Networks ((CCN))

Abstract

The objective of this chapter is to describe building an eScience infrastructure suitable for use with environmental sciences and especially with hydrological science applications. The infrastructure allows a wide range of hydrological problems to be investigated and is particularly suitable for either computationally intensive or multiple scenario applications. To accomplish this objective, this research discovered the shortcomings of current grid infrastructures for hydrological science and developed missing components to fill this gap. In particular, there were three primary areas which needed work: first, integrating data and computing grids; second, visualization of geographic information from grid outputs; and third, implementing hydrological simulations based on this infrastructure. This chapter focuses on the first area, which is focusing on grid infrastructure system integration and development. A grid infrastructure, which consists of a computing and a data grid, has been built. In addition, the computing grid has been extended to utilize the Amazon EC2 cloud computing resources. Users can conduct a complete simulation job life cycle from job submission, and data management to metadata management based on the tools available in the infrastructure.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    CUAHSI, visited January 13, 2010 http://www.cuahsi.org/

References

  1. Hey T, Trefethen A (2003) e-Science and its implications. Phil. Trans. Roy Soc (A) 361:1809–1825.

    Article  Google Scholar 

  2. zalay A, Gray J (2006) 2020 Computing: Science in an exponential world. Nature 440:413–414.

    Article  Google Scholar 

  3. Clery D (2006) Can Grid Computing Help Us Work Together. Science 303:433–434.

    Article  Google Scholar 

  4. Foster I, Kesselman C, Tuecke S (2001) The Anatomy of the Grid: Enabling Scalable Virtual Organizations. The International Journal of Supercomputer Applications 15(3):200–222.

    Article  Google Scholar 

  5. Dove, M., Walker, A., White, T., Bruin, R., Austen, K., Frame, I., Chiang, GT., Murray-Rust, P., Tyer, R., Couch, P., Kleese van Dam, K., Parker, SC., Marmier, C., Arrouvel, C. Usable grid infrastructures: practical experiences from the eMinerals project. in UK e-Science All Hands Meeting. 2007. Nottingham, UK. pp. 48–55.

    Google Scholar 

  6. Google Trend (2010) Available via Google. {http://www.google.co.uk/trends?q=cloud+com­puting. Cited 10 Feb 2010}.

  7. Renard P, Badoux V (2009) Grid Computing for Earth Science. Eos Trans. AGU 90(14):117–119.

    Article  Google Scholar 

  8. Anderson D (2004) BOINC: A System for Public-Resource Computing and Storage, in 5th IEEE/ACM Inernational Workshop on Grid Computing. 2004: Pittsburgh, USA.

    Google Scholar 

  9. Allen M (1999) Do-it-yourself climate prediction. Nature 401:642.

    Article  Google Scholar 

  10. Frame DJ, Aina T, Christensen CM, Faull NE, Knight, SHE, Piani, C, Rosier, SM, Yamazaki, K, Yamazaki, Y, Allen, M (2009) The climateprediction.net BBC climate change experimnet: dedsign of the coupled model ensemble. Phil. Trans. R.Soc. A 367(1890):855–870.

    Article  MathSciNet  MATH  Google Scholar 

  11. Lawrence, B.N., Cramer, R., Gutierrez, M., Kleese van Dam, K., Kondapalli, S., Latham, S., Lowry, R., O’Neill, K., and Woolf, A. The NERC DataGrid Prototype. in UK e-Science All Hands Meeting 2003. Notingham, UK. http://ndg.nerc.ac.uk/public_docs/AHM-2003-BNL.pdf.

  12. Gahegana, M., Luob, J., Weaver, S.D., Pike, W., Banchuenb, T., (2009) Connecting GEON: Making sense of the myriad resources, researchers and concepts that comprise a geoscience cyberinfrastructure. Computers & Geosciences 35: pp. 836–854.

    Article  Google Scholar 

  13. Dove M, De Leeuw NH (2005) Grid computing and molecular simulations: the vision of the eMinerals project. Molecular Simulation 31(5):297–301.

    Article  Google Scholar 

  14. Mechoso C, Ma C-C, Farrara J, Spahr J, Moore R (1993) Parallization and distribution of a coupled atmosphere-ocean general circulation model. Monthly Weather Review 121:2062

    Article  Google Scholar 

  15. Saltelli A, Ratoo M, Andres T, Campolongo F, Cariboni J, Gatelli D, Saisana M, Tarantola S (2008) Global Sensitivity Analysis. In: Saltelli A (ed) Global Sensitivity Analysis, John Willey & Sons, New York.

    Google Scholar 

  16. Papakhian, M., (1998) Comparing Job-Management Systems: The User’s Perspective. IEEE Computational Science & Engineering 5(2): pp. 4–9.

    Article  Google Scholar 

  17. Thain D, Tannenbaum T, Livny M (2005) Distributed Computing in Practice: The Condor Experience. Concurrency - Practice and Experience 17(2–4):323–356.

    Article  Google Scholar 

  18. Foster I, Kesselman C (1997) Globus:A Metacomputing Infrastructure Tookit. International Journal of Supercomputer Applications 11(2):115–128.

    Article  Google Scholar 

  19. Butler R, Engert D, Foster I, Kesselman I, Tuecke S (2000) A National-Scale Authentication Infrastructure. IEEE Computer 33(12):60–66.

    Google Scholar 

  20. Montero, R.S., Huedo, E., Llorente, I.M., (2006) Grid Scheduling Infrastucture based on the GridWay Meta-scheduler. IEEE Technical Committee on Scalable Computing (TCSC).

    Google Scholar 

  21. Bruin R, White TOH, Walker AM, Austen KF, Dove MT, Tyer RP, Couch PA, Todorov IT, Blanchard MO (2006) Job submission to grid computing environment. in UK e-Science All Hands Meeting 2006. Nottingham, UK. pp. 754–761.

    Google Scholar 

  22. Bruin R (2006) Development of a grid computing infrastructure to support combinatorial simulation studies of pollutant organic molecules on mineral surfaces, PhD Thesis, Department of Earth Sciences, University of Cambridge.

    Google Scholar 

  23. Couch, P., Sherwood, P., Sufi, S., Todorov, I., Allan, R., Knowles, P., Bruin, R., Dove, M., and Murray-rust, P. Towards data integration for computational chemistry. in UK e-Science All Hands Meeting 2005. Nottingham, UK pp. 19–22.

    Google Scholar 

  24. Chervenak A, Foster I, Kesselman C, Salisbury C, Tuecke S (2001) The Data Grid: Towards and Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23:187–200.

    Article  Google Scholar 

  25. Baru, C., Moore, R., Rajasekar, A., Wan, M. The SDSC Storage Resource Broker. in IBM Toronto Centre for Advanced Studies Conference (CASCON’98) 1998. Toronto, Canada pp. 1–12. https://www-927.ibm.com/ibm/cas/cascon/welcome.shtml

  26. Ewen J, Parkin G, O’Connell PE (2000) SHETRAN: distributed river basin flow and transport modeling system. American Society of Civil Engineers Journal of Hydrologic Engineering 5(3):250–258.

    Google Scholar 

  27. Chiang G-T, White TO, Dove MT, Bovolo CI, Ewen J (2011) Geo-visualization Fortran Library. Computers & Geosciences, doi:10.1016/j.cageo.2010.04.012

    Google Scholar 

  28. Chiang G-T, White TO, Dove MT (2009) Geospatial visualization tool kit for scientists using Fortran. Eos Trans. AGU 90(29):249–250.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Wellcome Trust Sanger Institute, Wellcome Trust Genome Campus, Hinxton, Cambridge, CB10 1SA, UK

    Gen-Tao Chiang

  2. Department of Earth Sciences, University of Cambridge, Cambridge, CB2 3EQ, UK

    Martin T. Dove

  3. School of Civil Engineering and Geosciences, University of Newcastle upon Tyne, Newcastle upon Tyne, NE7 7RU, UK

    C. Isabella Bovolo & John Ewen

Authors
  1. Gen-Tao Chiang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Martin T. Dove
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. C. Isabella Bovolo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. John Ewen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Gen-Tao Chiang .

Editor information

Editors and Affiliations

  1. Reading e-Science Centre, Harry Pitt Building, University of Reading, Earley Gate, Whiteknights 3, Reading, RG6 6AL, United Kingdom

    Xiaoyu Yang

  2. Pervasive Technology Institute, Indiana University, East 10th Street 2719, Bloomington, 47408, Indiana, USA

    Lizhe Wang

  3. Fac. Professional Studies, School of Computing, Thames Valley University, St. Mary's Road TC372, Ealing, London, W5 5RF, United Kingdom

    Wei Jie

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag London Limited

About this chapter

Cite this chapter

Chiang, GT., Dove, M.T., Bovolo, C.I., Ewen, J. (2011). Implementing a Grid/Cloud eScience Infrastructure for Hydrological Sciences. In: Yang, X., Wang, L., Jie, W. (eds) Guide to e-Science. Computer Communications and Networks. Springer, London. https://doi.org/10.1007/978-0-85729-439-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-0-85729-439-5_1

  • Published:

  • Publisher Name: Springer, London

  • Print ISBN: 978-0-85729-438-8

  • Online ISBN: 978-0-85729-439-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation