Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach Article Swipe

MAKE IMPACT

Qianqian Liu , Haixia Zhang , Xin Zhang , Dongfeng Yuan · YOU? · · 2023 · Open Access · · DOI: https://doi.org/10.48550/arxiv.2307.09691

Meeting the strict Quality of Service (QoS) requirements of terminals has imposed a signiffcant challenge on Multiaccess Edge Computing (MEC) systems, due to the limited multidimensional resources. To address this challenge, we propose a collaborative MEC framework that facilitates resource sharing between the edge servers, and with the aim to maximize the long-term QoS and reduce the cache switching cost through joint optimization of service caching, collaborative offfoading, and computation and communication resource allocation. The dual timescale feature and temporal recurrence relationship between service caching and other resource allocation make solving the problem even more challenging. To solve it, we propose a deep reinforcement learning (DRL)-based dual timescale scheme, called DGL-DDPG, which is composed of a short-term genetic algorithm (GA) and a long short-term memory network-based deep deterministic policy gradient (LSTM-DDPG). In doing so, we reformulate the optimization problem as a Markov decision process (MDP) where the small-timescale resource allocation decisions generated by an improved GA are taken as the states and input into a centralized LSTM-DDPG agent to generate the service caching decision for the large-timescale. Simulation results demonstrate that our proposed algorithm outperforms the baseline algorithms in terms of the average QoS and cache switching cost.

Type

preprint

Language

en

Landing Page

http://arxiv.org/abs/2307.09691

PDF

https://arxiv.org/pdf/2307.09691

OA Status

green

Related Works

10

OpenAlex ID

https://openalex.org/W4384918877

Raw OpenAlex JSON

OpenAlex ID

https://openalex.org/W4384918877

Canonical identifier for this work in OpenAlex

DOI

https://doi.org/10.48550/arxiv.2307.09691

Digital Object Identifier

Title

Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach

Work title

Type

preprint

OpenAlex work type

Language

en

Primary language

Publication year

2023

Year of publication

Publication date

2023-07-19

Full publication date if available

Authors

Qianqian Liu, Haixia Zhang, Xin Zhang, Dongfeng Yuan

List of authors in order

Landing page

https://arxiv.org/abs/2307.09691

Publisher landing page

PDF URL

https://arxiv.org/pdf/2307.09691

Direct link to full text PDF

Open access

Yes

Whether a free full text is available

OA status

green

Open access status per OpenAlex

OA URL

https://arxiv.org/pdf/2307.09691

Direct OA link when available

Concepts

Computer science, Resource allocation, Cache, Quality of service, Markov decision process, Reinforcement learning, Distributed computing, Enhanced Data Rates for GSM Evolution, Server, Resource management (computing), Service (business), Computer network, Markov process, Artificial intelligence, Mathematics, Statistics, Economics, Economy

Top concepts (fields/topics) attached by OpenAlex

Cited by

0

Total citation count in OpenAlex

Related works (count)

10

Other works algorithmically related by OpenAlex

Full payload