Abstract
Over the last few years, micro-services are becoming the dominant architectural approach in designing software applications environments. This new paradigm is based on developing small, independently deployable services communicating using lightweight mechanisms and being consumed by other services or end user applications. Containers have proven to be a convenient runtime platform with container frameworks enabling elastic horizontal scaling if container workloads are designed as so-called 12 factor applications (https://12factor.net/), foregoing file or block storage use for persistence. Persistence services such as databases are typically deployed in traditional runtime platforms such as virtual machines or bare metal servers. To use container frameworks to manage stateful services in a scalable way is not well supported, in particular in scenarios where state is accessed from workloads in different deployment platforms. In this paper, we present the Ubiquity framework, which provides seamless access to persistent storage across different container orchestrators (CloudFoundry, Openshift, Kubernetes, Docker and Mesos). Ubiquity is extensible to other container frameworks and different types of file and block storage systems, which can be managed independently of the container orchestrator. Ubiquity makes it easy to onboard stateful services in containerized and hybrid environments, extending the efficiency gains of containerization.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Azab, A.: Enabling docker containers for high-performance and many-task computing. In: 2017 IEEE International Conference on Cloud Engineering (IC2E), pp. 279–285, April 2017
bosh.io: bosh (2017). https://bosh.io/docs. Accessed 19 June 2017
CloudFoundry Foundation: Diego architecture (2017). https://docs.cloudfoundry.org/concepts/diego/diego-architecture.html. Accessed 19 June 2017
CloudFoundry Foundation: Nfsv3 volume driver (2017). https://github.com/cloudfoundry/nfsv3driver. Accessed 18 June 2017
cloudfoundry.org: Volume services, June 2017. http://docs.cloudfoundry.org/services/volume-services.html. Accessed 18 June 2017
Dell EMC: Rex-ray openly serious about storage (2017). https://rexray.readthedocs.io/en/stable/. Accessed 20 June 2017
Diaz, J., von Laszewski, G., Wang, F., Younge, A.J., Fox, G.: Futuregrid image repository: a generic catalog and storage system for heterogeneous virtual machine images. In: 2011 IEEE Third International Conference on Cloud Computing Technology and Science, pp. 560–564, November 2011
Docker Inc.: A better way to build apps (2017). https://www.docker.com/. Accessed 19 June 2017
Docker Inc.: Volume plugins (2017). https://docs.docker.com/engine/extend/plugins_volume/. Accessed 18 June 2017
Giles, E.R.: Container-based virtualization for byte-addressable NVM data storage. In: 2016 IEEE International Conference on Big Data (Big Data), pp. 2754–2763, December 2016
Harter, T., Salmon, B., Liu, R., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Slacker: fast distribution with lazy docker containers. In: 14th USENIX Conference on File and Storage Technologies (FAST 2016), pp. 181–195. USENIX Association, Santa Clara (2016). https://www.usenix.org/conference/fast16/technical-sessions/presentation/harter
Michener, B.: Presenting torus: a modern distributed storage system by coreos (2017). https://coreos.com/blog/torus-distributed-storage-by-coreos.html. Accessed 20 June 2017
Nathan, S., Ghosh, R., Mukherjee, T., Narayanan, K.: Comicon: a co-operative management system for docker container images. In: 2017 IEEE International Conference on Cloud Engineering (IC2E), pp. 116–126, April 2017
Nelluri, C.: FlexVolume explored (2017). https://www.diamanti.com/blog/flexvolume-explored/. Accessed 20 June 2017
Open Service Broker: Open service broker API specification (2017). https://github.com/openservicebrokerapi/servicebroker/blob/v2.12/spec.md. Accessed 18 June 2017
Sullivan, A.: Introducing trident: a dynamic persistent volume provisioner for kubernetes (2017). http://netapp.io/2016/12/23/introducing-trident-dynamic-persistent-volume-provisioner-kubernetes/. Accessed 20 June 2017
The Kubernetes Authors: Dynamic provisioning and storage classes in kubernetes (2017). http://blog.kubernetes.io/2016/10/dynamic-provisioning-and-storage-in-kubernetes.html. Accessed 19 June 2017
The Kubernetes Authors: Persistent volumes (2017). https://kubernetes.io/docs/concepts/storage/persistent-volumes/. Accessed 19 June 2017
The Kubernetes Authors: Production-grade container orchestration (2017). https://kubernetes.io/. Accessed 19 June 2017
Uehara, M.: Performance evaluations of LXC based educational cloud in Amazon EC2. In: 2016 30th International Conference on Advanced Information Networking and Applications Workshops (WAINA), pp. 638–643, March 2016
Walker-Morgan, D.: etcd introduced (2017). https://www.compose.com/articles/etcd-introduced/. Accessed 20 June 2017
Xie, W., Zhou, J., Reyes, M., Noble, J., Chen, Y.: Two-mode data distribution scheme for heterogeneous storage in data centers. In: 2015 IEEE International Conference on Big Data (Big Data), pp. 327–332, October 2015
Yu, J., Ali, S., DeFelice, J.: Container storage interface (CSI) (2017). https://github.com/container-storage-interface/spec/blob/master/spec.md. Accessed 19 June 2017
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Mohamed, M., Warke, A., Hildebrand, D., Engel, R., Ludwig, H., Mandagere, N. (2017). Ubiquity: Extensible Persistence as a Service for Heterogeneous Container-Based Frameworks. In: Panetto, H., et al. On the Move to Meaningful Internet Systems. OTM 2017 Conferences. OTM 2017. Lecture Notes in Computer Science(), vol 10573. Springer, Cham. https://doi.org/10.1007/978-3-319-69462-7_45
Download citation
DOI: https://doi.org/10.1007/978-3-319-69462-7_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-69461-0
Online ISBN: 978-3-319-69462-7
eBook Packages: Computer ScienceComputer Science (R0)