Advertisement

Containers Scheduling Consolidation Approach for Cloud Computing

  • Tarek MenouerEmail author
  • Patrice Darmon
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 1080)

Abstract

Containers are increasingly gaining popularity and are going to be a major deployment model in cloud computing. However, consolidation technique is also used extensively in the cloud context to optimize resources utilization and reduce the power consumption. In this paper, we present a new containers scheduling consolidation approach for cloud computing environment based on a machine learning technique. Our approach is proposed to address the problem of a company that aims to adapt dynamically the number of active nodes to reduce the power consumption when several containers are submitted online each day by their users. In our context, the frequency of containers submission varies within one hour. However, for each hour, the submission frequency is essentially the same each day. The principle of our approach consists into applying a machine learning technique to detect, from a previous containers submission historical, three submission periods (high, medium and low). Each submission period represents a time slot of one day. For instance, the high submission period represents the slot time where the number of submitted containers is the highest compared to other periods. Then, according to the submission periods slot time, our approach dynamically adapts the number of active nodes that must be used to execute each new submitted container. Our proposed consolidation approach is implemented inside Docker Swarmkit which is a well-known container scheduler framework developed by Docker. Experiments demonstrate the potential of our approach under different scenarios.

Keywords

Container technology Cloud computing Resource management Scheduling 

Notes

Acknowledgments

We thank the Grid5000 team for their help to use the testbed. Grid’5000 is supported by a scientific interest group (GIS) hosted by Inria and including CNRS, RENATER and several universities as well as other organizations.

References

  1. 1.
    Ahmad, R.W., Gani, A., Hamid, S.H.A., Shiraz, M., Yousafzai, A., Xia, F.: A survey on virtual machine migration and server consolidation frameworks for cloud data centers. J. Netw. Comput. Appl. 52, 11–25 (2015). http://www.sciencedirect.com/science/article/pii/S1084804515000284CrossRefGoogle Scholar
  2. 2.
    Beloglazov, A., Buyya, R.: Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers. In: Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science, MGC 2010, pp. 4:1–4:6. ACM, New York (2010). http://doi.acm.org/10.1145/1890799.1890803
  3. 3.
    Ben Maaouia, O., Fkaier, H., Cerin, C., Jemni, M., Ngoko, Y.: On optimization of energy consumption in a volunteer cloud. In: Vaidya, J., Li, J. (eds.) ICA3PP 2018, Part II. LNCS, vol. 11335, pp. 388–398. Springer, Cham (2018).  https://doi.org/10.1007/978-3-030-05054-2_31CrossRefGoogle Scholar
  4. 4.
    Catuogno, L., Galdi, C., Pasquino, N.: An effective methodology for measuring software resource usage. IEEE Trans. Instrum. Measur. 67(10), 2487–2494 (2018)CrossRefGoogle Scholar
  5. 5.
    Clouet, F., et al.: A unified monitoring framework for energy consumption and network traffic. In: TRIDENTCOM - International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, Vancouver, Canada, p. 10, June 2015. https://hal.inria.fr/hal-01167915
  6. 6.
    Dong, Z., Zhuang, W., Rojas-Cessa, R.: Energy-aware scheduling schemes for cloud data centers on Google trace data. In: 2014 IEEE Online Conference on Green Communications (OnlineGreenComm), pp. 1–6, November 2014Google Scholar
  7. 7.
    Grid5000. https://www.grid5000.fr/. Accessed 25 Jan 2019
  8. 8.
    Han, J., Kamber, M., Pei, J.: Data Mining: Concepts and Techniques, 3rd edn. Elsevier, New York (2011)zbMATHGoogle Scholar
  9. 9.
    Hirofuchi, T., Nakada, H., Itoh, S., Sekiguchi, S.: Reactive consolidation of virtual machines enabled by postcopy live migration. In: Proceedings of the 5th International Workshop on Virtualization Technologies in Distributed Computing, VTDC 2011, pp. 11–18. ACM, New York (2011). http://doi.acm.org/10.1145/1996121.1996125
  10. 10.
    Le, Q.V., et al.: Building high-level features using large scale unsupervised learning. In: Proceedings of the 29th International Coference on International Conference on Machine Learning, ICML 2012, USA, pp. 507–514. Omnipress (2012). http://dl.acm.org/citation.cfm?id=3042573.3042641
  11. 11.
    Medel, V., Tolón, C., Arronategui, U., Tolosana-Calasanz, R., Bañares, J.Á., Rana, O.F.: Client-side scheduling based on application characterization on kubernetes. In: Pham, C., Altmann, J., Bañares, J.Á. (eds.) GECON 2017. LNCS, vol. 10537, pp. 162–176. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-68066-8_13CrossRefGoogle Scholar
  12. 12.
    Menouer, T., Darmon, P.: New scheduling strategy based on multi-criteria decision algorithm. In: 2019 27th Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), pp. 101–107, February 2019Google Scholar
  13. 13.
    Piraghaj, S.F., Dastjerdi, A.V., Calheiros, R.N., Buyya, R.: A framework and algorithm for energy efficient container consolidation in cloud data centers. In: 2015 IEEE International Conference on Data Science and Data Intensive Systems, pp. 368–375, December 2015Google Scholar
  14. 14.
    Silver, D.L., Yang, Q., Li, L.: Lifelong machine learning systems: beyond learning algorithms. In: AAAI Spring Symposium: Lifelong Machine Learning, vol. 13, p. 05 (2013)Google Scholar
  15. 15.
    Menouer, T., Cérin, C., Saad, W., Shi, X.: A resource allocation framework with qualitative and quantitative SLA classes. In: Mencagli, G., et al. (eds.) Euro-Par 2018. LNCS, vol. 11339, pp. 69–81. Springer, Cham (2019).  https://doi.org/10.1007/978-3-030-10549-5_6CrossRefGoogle Scholar
  16. 16.
    Zheng, K., Wang, X., Li, L., Wang, X.: Joint power optimization of data center network and servers with correlation analysis. In: IEEE INFOCOM 2014 - IEEE Conference on Computer Communications, pp. 2598–2606, April 2014Google Scholar
  17. 17.
    The apache software foundation. Mesos, apache. http://mesos.apache.org/. Accessed 25 Jan 2019
  18. 18.
    Docker swarmkit. https://github.com/docker/swarmkit/. Accessed 25 Jan 2019
  19. 19.
    Kubernetes scheduler. https://kubernetes.io/. Accessed 25 Jan 2019

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.UMANISLevallois-PerretFrance

Personalised recommendations