Advertisement

Journal of Grid Computing

, Volume 5, Issue 3, pp 295–302 | Cite as

Managing Large Scale Data for Earthquake Simulations

  • Marcio Faerman
  • Reagan Moore
  • Yifeng Cui
  • Yuanfang Hu
  • Jing Zhu
  • Bernard Minster
  • Philip Maechling
Article

Abstract

The Southern California Earthquake Center digital library publishes scientific data generated by seismic wave propagation simulations. The output from a single simulation may be as large as 50 Terabytes of data and 400,000 files. The total size of the digital library is over 130 Terabytes with nearly three million files. We examine the data Grid capabilities required to manage this scale of simulation output, and the implementation of these capabilities in a digital library built on top of the Storage Resource Broker data Grid. We also examine the capabilities that will be needed in the future as the scale of simulation output increases to petabytes of data.

Key words

data Grid digital library seismology earthquake seismic wave propagation simulation 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    SCEC Community Modeling Environment Project: http://www.scec.org/cme
  2. 2.
    Rajasekar, A., Wan, M., Moore, R., Schroeder, W.: A prototype rule-based distributed data management system. In: HPDC workshop on “Next Generation Distributed Data Management,” May, Paris, France (2006)Google Scholar
  3. 3.
    GridSphere portal technology: http://www.gridsphere.org/
  4. 4.
    The SDSC Storage Resource Broker, http://www.sdsc.edu/srb/
  5. 5.
    Moore, R., Rajasekar, A., Wan, M.: Data Grids, digital libraries and persistent archives: An integrated approach to publishing, sharing and archiving data. Special issue of the Proceedings of the IEEE on Grid Computing. 93(3), 578–588 (2005)Google Scholar
  6. 6.
    DSpace digital library, http://www.dspace.org/
  7. 7.
    Fedora digital object repository middleware, http://www.fedora.info/
  8. 8.
    Olsen, K.B.: Simulation of three-dimensional wave propagation in the Salt Lake Basin. PhD Thesis, University of Utah (1994)Google Scholar
  9. 9.
    Minster, J.-B., Olsen, K. B., Moore, R. W., Day, S., Maechling, P., Jordan, T. H., Faerman, M., Cui, Y., Ely, G., Hu, Y., Shkoller, B., Marcinkovich, C., Bielak, J., Okaya, D., Archuleta, R., Wilkins-Diehr, N., Cutchin, S., Chourasia, A., Kremenek, G., Jagatheesan, A., Brieger, L., Majumdar, A., Chukkapalli, G., Xin, Q., Moore, R. L., Banister, B., Thorp, D., Kovatch, P., Diegel, L., Sherwin, T., Jordan, C., Thiebaux, M., Lopez, J.: The SCEC TeraShake Earthquake Simulation. Eos Trans. AGU, 85, 46, Fall Meet. Suppl., Abstract SF31B-05 (2004)Google Scholar
  10. 10.
    Scalable Visualization Toolkit, http://visservices.sdsc.edu/vistools/
  11. 11.
    HDF5 – Hierarchical Data Format version 5, http://hdf.ncsa.uiuc.edu/HDF5/
  12. 12.
    Open Grid Forum, http://www.ogf.org/

Copyright information

© Springer Science + Business Media B.V. 2007

Authors and Affiliations

  • Marcio Faerman
    • 4
  • Reagan Moore
    • 1
  • Yifeng Cui
    • 1
  • Yuanfang Hu
    • 1
  • Jing Zhu
    • 1
  • Bernard Minster
    • 2
  • Philip Maechling
    • 3
  1. 1.San Diego Supercomputer CenterLa JollaUSA
  2. 2.Scripps Institution of OceanographyLa JollaUSA
  3. 3.University of Southern CaliforniaLos AngelesUSA
  4. 4.Brazilian National Education and Research NetworkRNPRio de JaneiroBrazil

Personalised recommendations