Abstract
Motivated by a data center setting, we study the problem of joint dispatching and server sleep state control in a system consisting of two queues in parallel. Using the theory of Markov decision processes and a novel lookahead approach, we explicitly determine near-optimal control policies that minimize a combination of QoE costs, energy costs, and wear and tear costs due to switching. Guidelines are provided as to when these combined policies are most effective.
This work was supported by the Academy of Finland in the FQ4BD and TOP-Energy projects (grant nos. 296206 and 268992).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Barroso, L., Hölzle, U.: The case for energy-proportional computing. IEEE Comput. 40(12), 33–37 (2007)
Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., Gautam, N.: Managing server energy and operational costs in hosting centers. In: Proceedings of ACM Sigmetrics 2005, pp. 303–314 (2005)
Crovella, M., Harchol-Balter, M., Murta, C.: Task assignment in a distributed system: Improving performance by unbalancing load. In: Proceedings of ACM Sigmetrics 1998, pp. 268–269 (1998)
Gandhi, A., Doroudi, S., Harchol-Balter, M., Scheller-Wolf, A.: Exact analysis of the M/M/k/setup class of Markov chains via recursive renewal reward. In: Proceedings of ACM Sigmetrics 2013, pp. 153–166 (2013)
Gandhi, A., Gupta, V., Harchol-Balter, M., Kozuch, M.: Optimality analysis of energy-performance trade-off for server farm management. Perform. Eval. 67, 1155–1171 (2010)
Gandhi, A., Harchol-Balter, M., Adan, I.: Server farms with setup costs. Perform. Eval. 67, 1123–1138 (2010)
Gandhi, A., Harchol-Balter, M., Raghunathan, R., Kozuch, M.: AutoScale: Dynamic, robust capacity management for multi-tier data centers. ACM Trans. Comput. Syst. 30, 1–26 (2012)
Gebrehiwot, M., Aalto, S., Lassila, P.: Optimal sleep-state control of energy-aware M/G/1 queues. In: Proceedings of Value Tools 2014, pp. 82–89 (2014)
Gebrehiwot, M., Aalto, S., Lassila, P.: Energy-performance trade-off for processor sharing queues with setup delay. Oper. Res. Lett. 44, 101–106 (2016)
Gebrehiwot, M.E., Aalto, S., Lassila, P.: Energy-aware server with SRPT scheduling: analysis and optimization. In: Agha, G., Van Houdt, B. (eds.) QEST 2016. LNCS, vol. 9826, pp. 107–122. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-43425-4_7
Harchol-Balter, M.: Performance Modeling and Design of Computer Systems: Queueing Theory in Action. Cambridge University Press, New York (2013)
Hyytiä, E., Penttinen, A., Aalto, S.: Size- and state-aware dispatching problem with queue-specific job sizes. Eur. J. Oper. Res. 217, 357–370 (2012)
Hyytiä, E.: Lookahead actions in dispatching to parallel queues. Perform. Eval. 70, 859–872 (2013)
Hyytiä, E., Righter, R., Aalto, S.: Task assignment in a heterogeneous server farm with switching delays and general energy-aware cost structure. Perform. Eval. 75–76, 17–35 (2014)
Hyytiä, E., Righter, R., Aalto, S.: Energy-aware job assignment in server farms with setup delays under LCFS and PS. In: Proceedings of ITC 26 (2014)
Maccio, V., Down, D.: On optimal policies for energy-aware servers. In: Proceedings of IEEE MASCOTS 2013, pp. 31–39 (2013)
Maccio, V., Down, D.: On optimal control for energy-aware queueing systems. In: Proceedings of ITC 27, pp. 98–106 (2015)
Maccio, V., Down, D.: Exact analysis of energy-aware multiserver queueing systems with setup times. In: Proceedings of IEEE MASCOTS 2016, pp. 11–20 (2016)
Mitrani, I.: Service center trade-offs between customer impatience and power consumption. Perform. Eval. 68, 1222–1231 (2011)
Mitrani, I.: Managing performance and power consumption in a server farm. Annals Oper. Res. 202, 121–134 (2013)
Mukherjee, D., Dhara, S., Borst, S., Leeuwaarden, J.: Optimal service elasticity in large-scale distributed systems. In: Proceedings of ACM Sigmetrics 2017 (2017)
Penttinen, A., Hyytiä, E., Aalto, S.: Energy-aware dispatching in parallel queues with on-off energy consumption. In: Proceedings of IEEE IPCCC 2011 (2011)
Phung-Duc, T.: Multiserver queues with finite capacity and setup time. In: Gribaudo, M., Manini, D., Remke, A. (eds.) ASMTA 2015. LNCS, vol. 9081, pp. 173–187. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-18579-8_13
Phung-Duc, T.: Exact solutions for M/M/c/Setup queues. Telecommun. Syst. 64, 309–324 (2017)
Puterman, M.: Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, New York (1994)
Slegers, J., Thomas, N., Mitrani, I.: Dynamic server allocation for power and performance. In: Kounev, S., Gorton, I., Sachs, K. (eds.) SIPEW 2008. LNCS, vol. 5119, pp. 247–261. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-69814-2_16
Welch, P.: On a generalized M/G/1 queuing process in which the first customer of each busy period receives exceptional service. Oper. Res. 12, 736–752 (1964)
Whittle, P.: Optimal Control: Basics and beyond. Wiley, Chichester (1996)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG
About this paper
Cite this paper
Hyytiä, E., Down, D., Lassila, P., Aalto, S. (2018). Dynamic Control of Running Servers. In: German, R., Hielscher, KS., Krieger, U. (eds) Measurement, Modelling and Evaluation of Computing Systems. MMB 2018. Lecture Notes in Computer Science(), vol 10740. Springer, Cham. https://doi.org/10.1007/978-3-319-74947-1_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-74947-1_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-74946-4
Online ISBN: 978-3-319-74947-1
eBook Packages: Computer ScienceComputer Science (R0)