Skip to main content

In-Memory Runtime File Systems for Many-Task Computing

  • Conference paper
  • First Online:
Adaptive Resource Management and Scheduling for Cloud Computing (ARMS-CC 2014)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 8907))

  • 762 Accesses

Abstract

Many scientific computations can be expressed as Many-Task Computing (MTC) applications. In such scenarios, application processes communicate by means of intermediate files, in particular input, temporary data generated during job execution (stored in a runtime file system), and output.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Aker, B.: Libmemcached (2014). http://libmemcached.org/libMemcached.html

  2. Fitzpatrick, B.: Distributed caching with memcached. Linux J. 2004(124), 5 (2004)

    Google Scholar 

  3. Jacob, J.C., Katz, D.S., Berriman, G.B., Good, J.C., Laity, A., Deelman, E., Kesselman, C., Singh, G., Su, M.-H., Prince, T., et al.: Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking. Int. J. Comput. Sci. Eng. 4(2), 73–87 (2009)

    Google Scholar 

  4. Szeredi, M., et al.: FUSE: Filesystem in userspace (2014). http://fuse.sourceforge.net/

  5. Uta, A., Sandu, A., Kielmann, T.: MemFS: An In-memory runtime file system with symmetrical data distribution. In: IEEE Cluster 2014, Madrid, Spain, September 2014 (poster paper)

    Google Scholar 

  6. Zhang, Z., Katz, D.S., Armstrong, T.G., Wozniak, J.M., Foster, I.: Parallelizing the execution of sequential scripts. In: 2013 International Conference for IEEE High Performance Computing, Networking, Storage and Analysis (SC) (2013)

    Google Scholar 

Download references

Acknowledgments

This work is partially funded by the Dutch public-private research community COMMIT/.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Thilo Kielmann .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Uta, A., Sandu, A., Morozan, I., Kielmann, T. (2014). In-Memory Runtime File Systems for Many-Task Computing. In: Pop, F., Potop-Butucaru, M. (eds) Adaptive Resource Management and Scheduling for Cloud Computing. ARMS-CC 2014. Lecture Notes in Computer Science(), vol 8907. Springer, Cham. https://doi.org/10.1007/978-3-319-13464-2_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-13464-2_1

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-13463-5

  • Online ISBN: 978-3-319-13464-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics