-
A Restless Bandit Model for Energy-Efficient Job Assignments in Server Farms
Authors:
Jing Fu,
Xinyu Wang,
Zengfu Wang,
Moshe Zukerman
Abstract:
We aim to maximize the energy efficiency, gauged as average energy cost per job, in a large-scale server farm with various storage or/and computing components modeled as parallel abstracted servers. Each server operates in multiple power modes characterized by potentially different service and energy consumption rates. The heterogeneity of servers and multiple power modes complicate the maximizati…
▽ More
We aim to maximize the energy efficiency, gauged as average energy cost per job, in a large-scale server farm with various storage or/and computing components modeled as parallel abstracted servers. Each server operates in multiple power modes characterized by potentially different service and energy consumption rates. The heterogeneity of servers and multiple power modes complicate the maximization problem, where optimal solutions are generally intractable. Relying on the Whittle relaxation technique, we resort to a near-optimal, scalable job-assignment policy. Under a mild condition related to the service and energy consumption rates of the servers, we prove that our proposed policy approaches optimality as the size of the entire system tends to infinity; that is, it is asymptotically optimal. For the non-asymptotic regime, we show the effectiveness of the proposed policy through numerical simulations, where the policy outperforms all the tested baselines, and we numerically demonstrate its robustness against heavy-tailed job-size distributions.
△ Less
Submitted 20 October, 2023; v1 submitted 12 December, 2021;
originally announced December 2021.
-
Temperature-Aware Virtual Data Center Embedding to Avoid Hot Spots in Data Centers
Authors:
Chao Guo,
Kai Xu,
Gangxiang Shen,
Moshe Zukerman
Abstract:
Virtual Data Center (VDC) embedding has drawn significant attention recently because of growing need for efficient and flexible means of Data Center (DC) resource allocation. Existing studies on VDC embedding mainly focus on improving DCs' resource utilization. However, an important problem that has not been considered in VDC embedding solutions is the creation of hot spots by excessive heat dissi…
▽ More
Virtual Data Center (VDC) embedding has drawn significant attention recently because of growing need for efficient and flexible means of Data Center (DC) resource allocation. Existing studies on VDC embedding mainly focus on improving DCs' resource utilization. However, an important problem that has not been considered in VDC embedding solutions is the creation of hot spots by excessive heat dissipation and hot air generation from racks in DCs, which have significant adverse effect on energy consumption of the cooling system and IT equipment lifespan. To address this issue, we propose a temperature-aware VDC embedding scheme to avoid hot spots by minimizing the maximum temperature of hot air emitted from each rack. Meanwhile, we also aim to reduce the total power consumption of IT equipment in this scheme. A Mixed Integer Linear Programming (MILP) model and a heuristic algorithm are developed to implement the proposed VDC embedding scheme. Numerical results show that the proposed temperature-aware embedding scheme can significantly outperforms a load-balanced embedding scheme in terms of maximum rack temperature, total power consumption of IT equipment, and VDC rejection ratio.
△ Less
Submitted 26 December, 2019;
originally announced December 2019.
-
Machine Learning-Assisted Least Loaded Routing to Improve Performance of Circuit-Switched Networks
Authors:
Gangxiang Shen,
Longfei Li,
Ya Zhang,
Wei Chen,
Sanjay K. Bose,
Moshe Zukerman
Abstract:
The Least Loaded (LL) routing algorithm has been in recent decades the routing method of choice in circuit switched networks and therefore it provides a benchmark against which new methods can be compared. This paper improves the performance of the LL algorithm by additionally incorporating a machine learning approach, using a conceptually simple supervised naïve Bayes (NB) classifier. Based on a…
▽ More
The Least Loaded (LL) routing algorithm has been in recent decades the routing method of choice in circuit switched networks and therefore it provides a benchmark against which new methods can be compared. This paper improves the performance of the LL algorithm by additionally incorporating a machine learning approach, using a conceptually simple supervised naïve Bayes (NB) classifier. Based on a sequence of historical network snapshots, this predicts the potential future circuit blocking probability between each node pair. These snapshots are taken for each service request arriving to the network and record the number of busy capacity units on each link at that instant. The candidate route for serving a current service request is based on both the link loads and the potential future blocking probability of the entire network in case this route is indeed used. The performance of this proposed approach is studied via simulations and compared with both the conventional LL algorithm and the Shortest Path (SP) based approach. Results indicate that the proposed supervised naïve Bayes classifier-assisted LL routing algorithm significantly reduces blocking probability of service connection requests and outperforms both the conventional LL and SP routing algorithms. To enable the learning process based on a large number of network snapshots, we also develop a parallel computing framework to implement parallel learning and performance evaluation. Also, a network control system supporting naïve Bayes classifier-assisted LL routing algorithm is addressed.
△ Less
Submitted 3 April, 2018;
originally announced April 2018.
-
Introduction to Queueing Theory and Stochastic Teletraffic Models
Authors:
Moshe Zukerman
Abstract:
The aim of this textbook is to provide students with basic knowledge of stochastic models that may apply to telecommunications research areas, such as traffic modelling, resource provisioning and traffic management. These study areas are often collectively called teletraffic. This book assumes prior knowledge of a programming language, mathematics, probability and stochastic processes normally tau…
▽ More
The aim of this textbook is to provide students with basic knowledge of stochastic models that may apply to telecommunications research areas, such as traffic modelling, resource provisioning and traffic management. These study areas are often collectively called teletraffic. This book assumes prior knowledge of a programming language, mathematics, probability and stochastic processes normally taught in an electrical engineering course. For students who have some but not sufficiently strong background in probability and stochastic processes, we provide, in the first few chapters, background on the relevant concepts in these areas.
△ Less
Submitted 12 June, 2023; v1 submitted 10 July, 2013;
originally announced July 2013.
-
A New TCP/AQM System Analysis
Authors:
Qin Xu,
Fan Li,
Jinsheng Sun,
Moshe Zukerman
Abstract:
The MGT fluid model has been used extensively to guide designs of AQM schemes aiming to alleviate adverse effects of Internet congestion. In this paper, we provide a new analysis of a TCP/AQM system that aims to improve the accuracy of the MGT fluid model especially in heavy traffic conditions. The analysis is based on the consideration of two extreme congestion scenarios that leads to the derivat…
▽ More
The MGT fluid model has been used extensively to guide designs of AQM schemes aiming to alleviate adverse effects of Internet congestion. In this paper, we provide a new analysis of a TCP/AQM system that aims to improve the accuracy of the MGT fluid model especially in heavy traffic conditions. The analysis is based on the consideration of two extreme congestion scenarios that leads to the derivation of upper and lower bounds for the queue length and marking probability dynamics and showing that they approach each other in steady state. Both discrete and continuous time models are provided. Simulation results demonstrate that the new model achieves a significantly higher level of accuracy than a simplified version of the MGT fluid model.
△ Less
Submitted 4 July, 2013;
originally announced July 2013.
