期刊
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE
卷 139, 期 -, 页码 29-37出版社
ELSEVIER
DOI: 10.1016/j.future.2022.09.007
关键词
Age of Information (AoI); Computation offloading; Deep Reinforcement Learning (DRL); Industrial Internet of Things (IIoT)
This paper focuses on the metric of Age of Information (AoI) and energy control problem in the Industrial Internet of Things (IIoT). By analyzing real-life IoT dataset and constructing Markovian queueing models, an intelligent Energy Control and Computation Offloading (ECCO) algorithm is proposed, which adapts to large-scale dynamic IIoT environments using Deep Reinforcement Learning (DRL) techniques. Extensive simulation experiments demonstrate the superiority of the ECCO algorithm over existing DRL and non-DRL algorithms.
In Industrial Internet of Things (IIoT), a large volume of data is collected periodically by IoT devices, and timely data routing and processing are important requirements. Age of Information (AoI), which is a metric to evaluate the freshness of status information in data processing, has become one of the most important objectives in IIoT. In this paper, considering limited communication, computation and energy resources on IoT devices, we jointly study the optimal AoI-aware energy control and computation offloading problem within a dynamic IIoT scenario with multiple IoT devices and multiple edge servers. Based on extensive analysis of real-life IoT dataset, Markovian queueing models are constructed to capture the dynamics of IoT devices and edge servers, and their corresponding analyses are provided. With the quantitative analytical results, we formulate a dynamic Markov decision problem with the objective of minimizing the long-term energy consumption while satisfying AoI constraints for real-time data processing. To solve the problem, we apply Deep Reinforcement Learning (DRL) techniques for adapting to large-scale dynamic IIoT environments, and design an intelligent Energy Control and Computation Offloading (ECCO) algorithm. Extensive simulation experiments are conducted based on real-world dataset, and the comparison results illustrate the superiority of our ECCO algorithm over both existing DRL and non-DRL algorithms.(c) 2022 Elsevier B.V. All rights reserved.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据