Abstract
The emergence of high-performance open-source storage systems is allowing application and middleware developers to consider non-standard storage system interfaces. In contrast to the practice of virtually always designing for file-like byte-stream interfaces, co-designed domain-specific storage system interfaces are becoming increasingly common. However, in order for developers to evolve interfaces in high-availability storage systems, services are needed for in-vivo interface evolution that allows the development of interfaces in the context of a live system. Current clustered storage systems that provide interface customizability expose primitive services for managing ad-hoc interfaces. For maximum utility, the ability to create, evolve, and deploy dynamic storage interfaces is needed. However, in large-scale clusters, dynamic interface instantiation will require system-level support that ensures interface version consistency among storage nodes and client applications. We propose that storage systems should provide services that fully manage the life-cycle of dynamic interfaces that are aligned with the common branch-and-merge form of software maintenance, including isolated development workspaces that can be combined into existing production views of the system.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Piernas, J., Nieplocha, J., Felix, E.J.: Evaluation of active storage strategies for the lustre parallel file system. In: SC 2007 (2007)
Son, S.W., Lang, S., Carns, P., Ross, R., Thakur, R., Ozisikyilmaz, B., Kumar, P., Liao, W.K., Choudhary, A.: Enabling active storage on parallel i/o software stacks. In: MSST 2010 (2010)
Xie, Y., Muniswamy-Reddy, K.K., Feng, D., Long, D.D.E., Kang, Y., Niu, Z., Tan, Z.: Design and evaluation of oasis: An active storage framework based on t10 osd standard. In: MSST 2011 (2011)
Lim, H., Kapoor, V., Wighe, C., Du, D.H.C.: Active disk file system: A distributed, scalable file system. In: MSST 2008 (2008)
Gkantsidis, C., Vytiniotis, D., Hodson, O., Narayanan, D., Dinu, F., Rowstron, A.: Rhea: automatic filtering for unstructured cloud storage. In: NSDI 2013 (2013)
Calder, B., et al.: Windows azure storage: A highly available cloud storage service with strong consistency. In: SOSP 2011 (2011)
DOE Extreme-Scale Technology Acceleration: Fastforward
Weil, S., Leung, A., Brandt, S.A., Maltzahn, C.: Rados: A fast, scalable, and reliable storage service for petabyte-scale storage clusters. In: PDSW 2007 (2007)
Weil, S., Brandt, S.A., Miller, E.L., Long, D.D.E., Maltzahn, C.: Ceph: A scalable, high-performance distributed file system. In: OSDI 2006 (2006)
Lua language
Runde, M.T., Stevens, W.G., Wortman, P.A., Chandy, J.A.: An active storage framework for object storage devices. In: MSST 2012 (2012)
Glusterfs clustered file system, http://www.gluster.org
Grawinkel, M., Suß, T., Best, G., Popov, I., Brinkmann, A.: Towards dynamic scripted pnfs layouts. In: PDSW 2012 (2012)
Santry, D.S., Feeley, M.J., Hutchinson, N.C., Veitch, A.C., Carton, R.W., Ofir, J.: Deciding when to forget in the elephant file system. In: SOSP 1999 (1999)
Grant, R.: Filesystem interface for the git version control system. Technical report, University of Pennsylvania (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Watkins, N., Maltzahn, C., Brandt, S., Pye, I., Manzanares, A. (2014). In-vivo Storage System Development. In: an Mey, D., et al. Euro-Par 2013: Parallel Processing Workshops. Euro-Par 2013. Lecture Notes in Computer Science, vol 8374. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-54420-0_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-54420-0_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-54419-4
Online ISBN: 978-3-642-54420-0
eBook Packages: Computer ScienceComputer Science (R0)