Abstract
Deploying a cloud-based distributed application created from the composition of micro-services is a challenging problem. It mandates the resolution of a resource allocation problem accounting for resource utilization and network load. But it also imposes security requirements such as the selection of suitable technology stacks to protect the communication channels. Both sets of decisions are intimately related as hosting decisions affect the cost or feasibility of security measures under consideration. This paper revisits the problem and focuses on a scalable approach suitable to deploy large distributed applications. Specifically, it introduces a counting-based model to deliver solutions for hundreds of services within short computation times. The essence is to side-step some of the difficulties by focusing first and foremost on deciding how many services of each type need to be deployed at each location and postponing the instance connectivity problem to a post-optimization phase. Empirical results demonstrate the scope of the improvements and illustrate the performance to expect as a function of instance sizes.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Armant, V., Cauwer, M.D., Brown, K.N., O’Sullivan, B.: Semi-online task assignment policies for workload consolidation in cloud computing systems. Future Gener. Comput. Syst. 82, 89–103 (2018). http://www.sciencedirect.com/science/article/pii/S0167739X17319143
Cambazard, H., Mehta, D., O’Sullivan, B., Simonis, H.: Bin packing with linear usage costs – an application to energy management in data centres. In: Schulte, C. (ed.) CP 2013. LNCS, vol. 8124, pp. 47–62. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-40627-0_7
Cauwer, M.D., Mehta, D., O’Sullivan, B.: The temporal bin packing problem: an application to workload management in data centres. In: 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 157–164, November 2016
Chisca, D.S., Castineiras, I., Mehta, D., OSullivan, B.: On energy- and cooling-aware data centre workload management. In: 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing, pp. 1111–1114, May 2015
Cruz, W., Liu, F., Michel, L.: Securely and automatically deploying micro-services in an hybrid cloud infrastructure. In: Hooker, J. (ed.) CP 2018. LNCS, vol. 11008, pp. 613–628. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-98334-9_40
Fontaine, D., Michel, L., Van Hentenryck, P.: Parallel composition of scheduling solvers. In: Quimper, C.-G. (ed.) CPAIOR 2016. LNCS, vol. 9676, pp. 159–169. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-33954-2_12
Greenberg, A., Hamilton, J., Maltz, D.A., Patel, P.: The cost of a cloud: research problems in data center networks. SIGCOMM Comput. Commun. Rev. 39(1), 68–73 (2008). https://doi.org/10.1145/1496091.1496103
Gutin, G., Jensen, T., Yeo, A.: Batched bin packing. Discret. Optim. 2(1), 71–82 (2005). http://www.sciencedirect.com/science/article/pii/S1572528605000058
Hermenier, F., Demassey, S., Lorca, X.: Bin repacking scheduling in virtualized datacenters. In: Lee, J. (ed.) CP 2011. LNCS, vol. 6876, pp. 27–41. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-23786-7_5
Hermenier, F., Lawall, J., Muller, G.: BtrPlace: a flexible consolidation manager for highly available applications. IEEE Trans. Dependable Secure Comput. 10(5), 273–286 (2013)
Kadioglu, S., Colena, M., Sebbah, S.: Heterogeneous resource allocation in cloud management. In: 2016 IEEE 15th International Symposium on Network Computing and Applications (NCA), pp. 35–38. IEEE (2016)
King, V., Rao, S., Tarjan, R.: A faster deterministic maximum flow algorithm. In: Proceedings of the Third Annual ACM-SIAM Symposium on Discrete Algorithms, SODA 1992, pp. 157–164. Society for Industrial and Applied Mathematics, Philadelphia, PA, USA (1992). http://dl.acm.org/citation.cfm?id=139404.139438
Sebbah, S., Bagley, C., Colena, M., Kadioglu, S.: Availability optimization in cloud-based in-memory data grids. In: Rueher, M. (ed.) CP 2016. LNCS, vol. 9892, pp. 666–679. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-44953-1_42
Srikantaiah, S., Kansal, A., Zhao, F.: Energy aware consolidation for cloud computing. In: Proceedings of the 2008 Conference on Power Aware Computing and Systems, HotPower 2008, pp. 10–10. USENIX Association, Berkeley, CA, USA (2008). http://dl.acm.org/citation.cfm?id=1855610.1855620
Acknowledgment
This work was supported under the award SOW BL 11568 and project CSI Selected Projects 2018: Securing Virtualization Configuration and Managing the Attack Surfaces funded by Comcast Corporation. Special thanks to Vaibhav Garg from Comcast.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Cruz, W., Liu, F., Michel, L. (2019). A Counting-Based Approach to Scalable Micro-service Deployment. In: Rousseau, LM., Stergiou, K. (eds) Integration of Constraint Programming, Artificial Intelligence, and Operations Research. CPAIOR 2019. Lecture Notes in Computer Science(), vol 11494. Springer, Cham. https://doi.org/10.1007/978-3-030-19212-9_13
Download citation
DOI: https://doi.org/10.1007/978-3-030-19212-9_13
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-19211-2
Online ISBN: 978-3-030-19212-9
eBook Packages: Computer ScienceComputer Science (R0)