TimeTrader: Exploiting Latency Tail to Save Datacenter Energy for On-line Data-Intensive Applications Article Swipe

MAKE IMPACT

Balajee Vamanan , Hamza Bin Sohail , Jahangir Hasan , T. N. Vijaykumar · YOU? · · 2015 · Open Access · · DOI: https://doi.org/10.48550/arxiv.1503.05338

Datacenters running on-line, data-intensive applications (OLDIs) consume significant amounts of energy. However, reducing their energy is challenging due to their tight response time requirements. A key aspect of OLDIs is that each user query goes to all or many of the nodes in the cluster, so that the overall time budget is dictated by the tail of the replies' latency distribution; replies see latency variations both in the network and compute. Previous work proposes to achieve load-proportional energy by slowing down the computation at lower datacenter loads based directly on response times (i.e., at lower loads, the proposal exploits the average slack in the time budget provisioned for the peak load). In contrast, we propose TimeTrader to reduce energy by exploiting the latency slack in the sub- critical replies which arrive before the deadline (e.g., 80% of replies are 3-4x faster than the tail). This slack is present at all loads and subsumes the previous work's load-related slack. While the previous work shifts the leaves' response time distribution to consume the slack at lower loads, TimeTrader reshapes the distribution at all loads by slowing down individual sub-critical nodes without increasing missed deadlines. TimeTrader exploits slack in both the network and compute budgets. Further, TimeTrader leverages Earliest Deadline First scheduling to largely decouple critical requests from the queuing delays of sub- critical requests which can then be slowed down without hurting critical requests. A combination of real-system measurements and at-scale simulations shows that without adding to missed deadlines, TimeTrader saves 15-19% and 41-49% energy at 90% and 30% loading, respectively, in a datacenter with 512 nodes, whereas previous work saves 0% and 31-37%.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/1503.05338

PDF

https://arxiv.org/pdf/1503.05338

OA Status

green

References

30

Related Works

10

OpenAlex ID

https://openalex.org/W1920038121

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W1920038121

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.1503.05338

Digital Object Identifier

Title

TimeTrader: Exploiting Latency Tail to Save Datacenter Energy for On-line Data-Intensive Applications

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2015

Year of publication

Publication date

2015-03-18

Full publication date if available

Authors

Balajee Vamanan, Hamza Bin Sohail, Jahangir Hasan, T. N. Vijaykumar

List of authors in order

Landing page

https://arxiv.org/abs/1503.05338

Publisher landing page

PDF URL

https://arxiv.org/pdf/1503.05338

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/1503.05338

Direct OA link when available

Concepts

Latency (audio), Computer science, Exploit, Scheduling (production processes), Provisioning, Efficient energy use, Response time, Queueing theory, Distributed computing, Load balancing (electrical power), Real-time computing, Computer network, Operating system, Telecommunications, Engineering, Geometry, Mathematics, Grid, Computer security, Electrical engineering, Operations management

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

References (count)

30

Number of works referenced by this work

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload