期刊
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS
卷 40, 期 1, 页码 276-289出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSAC.2021.3126073
关键词
Reinforcement learning; Heuristic algorithms; Satellites; Proposals; Bandwidth; Channel allocation; Topology; Space-air-ground integrated networks (SAGIN); satellite communication; UAV; traffic offloading; reinforcement learning (RL); double Q-learning
The paper proposes a reinforcement learning based traffic offloading method for SAGIN, considering the high mobility of nodes and frequent changing network traffic and link state. The algorithm allows nodes to decide offloading strategy based on local and neighboring historical information, achieving better performance compared to conventional offloading methods.
Space-Air-Ground Integrated Networks (SAGIN) is considered as the key structure of the next generation network. The space satellites and air nodes are the potential candidates to assist and offload the terrain transmissions. However, due to the high mobility of space and air nodes as well as the high dynamic of network traffic, the conventional traffic offloading strategy is not applicable for the high dynamic SAGIN. In this paper, we propose a reinforcement learning based traffic offloading for SAGIN by considering the high mobility of nodes as well as frequent changing network traffic and link state. In the proposal, a double Q-learning algorithm with improved delay-sensitive replay memory algorithm (DSRPM) is proposed to train the node to decide offloading strategy based on the local and neighboring historical information. Furthermore, a joint information collection with hello package and offline training mechanism is proposed to assist the proposed offloading algorithm. The simulation shows that the proposal outperforms conventional offloading algorithms in terms of signaling overhead, dynamic adaptivity, packet drop rate and transmission delay.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据