Skip to main content
SpringerLink
Log in

A Profiling Approach for the Management of Writing in Irregular Applications

  • Conference paper
Book cover Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops (ISPA 2006)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 4331))

  • 508 Accesses

Abstract

Parallel file systems often work guided by APIs which provide hints to access storage in a coordinated manner. Nevertheless, the current APIs do not offer the expressiveness necessary to specify I/O operations conveniently in irregular applications. We characterize the state of irregular applications that precedes the performance degradation of the parallel file system and we propose a schedule based on profile information.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Carns, P.H., Ligon III, W.B., Ross, R.B., Thakur, R.: PVFS: A Parallel File System for Linux Clusters. In: 4th Annual Linux Showcase and Conference, pp. 317–327 (2000)

    Google Scholar 

  2. Centro de Supercomputación y Visualización de Madrid (CeSViMa): http://www.cesvima.upm.es

  3. Ching, A., Choudgary, A., Liao, W.: Noncontiguous I/O through PVFS. In: Proceedings of the IEEE International Conference on Cluster Computing, pp. 405–414 (2002)

    Google Scholar 

  4. IBM.: IBM General Parallel File System High Performance Cluster File System, http://www-03.ibm.com/servers/eserver/clusters/software/gpfs.html

  5. The MPI Forum: MPI-2: Extensions to the Message-Passing Interface (1997)

    Google Scholar 

  6. Prost, J.-P., Treumann, R., Blackmore, R., Hartman, C., Hedges, R., Jia, B., Koniges, A., White, A.: Towards a High-Performance Implementation of MPI-IO on Top of GPFS. In: Bode, A., Ludwig, T., Karl, W.C., Wismüller, R. (eds.) Euro-Par 2000. LNCS, vol. 1900, pp. 1253–1262. Springer, Heidelberg (2000)

    Chapter  Google Scholar 

  7. Purakayastha, A., Ellis, C.S., Kotz, D.: ENWRICH: A Compute-Processor Write Caching Scheme for Parallel File Systems. In: The Fourth Workshop on Input/Output in Parallel and Distributed Systems (IOPADS), pp. 55–68 (1996)

    Google Scholar 

  8. Schmuck, F., Haskin, R.: GPFS: A Shared-Disk File System for Large Computing Clusters. In: FAST 2002 Conference on File and Storage Technologies, pp. 231–244 (2002)

    Google Scholar 

  9. Thakur, R., Lusk, E., Gropp, W.: I/O in Parallel Applications: The Weakest Link. The International Journal of High Performance Computing Applications 12(4), 389–395 (1998)

    Article  Google Scholar 

  10. Thakur, R., Gropp, W., Lusk, E.: Data Sieving and Collective I/O in ROMIO. In: Proc. of the 7th Symposium on the Frontiers of Massively Parallel Computation, pp. 182–189 (1999)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Departamento de Informática, Universidad Carlos III de Madrid, Av. Universidad 30, 28911, Leganés (Madrid), Spain

    M. B. Ibáñez, F. García & J. Carretero

Authors
  1. M. B. Ibáñez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. F. García
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Carretero
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computing, School of Informatics, University of Bradford, BD7 1DP, Bradford, U.K.

    Geyong Min

  2. Dipartimento di Ingegneria dell’ Informazione - Second, University of Naples - Italy, Real Casa dell’Annunziata - via Roma, 29 81031, Aversa (CE), Italy

    Beniamino Di Martino

  3. Department of Computer Science, St. Francis Xavier University, Antigonish, Canada

    Laurence T. Yang

  4. Department of Computer Science and Engineering, Shanghai Jiao Tong University, 200030, Shanghai, China

    Minyi Guo

  5. Department of Computer Science, Chemnitz University of Technology, Germany

    Gudula Rünger

Rights and permissions

Reprints and permissions

Copyright information

© 2006 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ibáñez, M.B., García, F., Carretero, J. (2006). A Profiling Approach for the Management of Writing in Irregular Applications. In: Min, G., Di Martino, B., Yang, L.T., Guo, M., Rünger, G. (eds) Frontiers of High Performance Computing and Networking – ISPA 2006 Workshops. ISPA 2006. Lecture Notes in Computer Science, vol 4331. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11942634_27

Download citation

  • DOI: https://doi.org/10.1007/11942634_27

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-49860-5

  • Online ISBN: 978-3-540-49862-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation