期刊
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS
卷 19, 期 3, 页码 1577-1592出版社
IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TWC.2019.2955129
关键词
Streaming media; Quality of experience; Transcoding; Adaptation models; Bit rate; Markov processes; Cloud computing; Software defined mobile networks; mobile edge cloud; adaptive video streaming; Lyapunov technique; deep reinforcement learning
资金
- National Natural Science Foundation of China [61571073]
- Science and Technology Research Program of Chongqing Municipal Education Commission [KJZD-M201800601]
Both mobile edge cloud (MEC) and software-defined networking (SDN) are technologies for next generation mobile networks. In this paper, we propose to simultaneously optimize energy consumption and quality of experience (QoE) metrics in video streaming over software-defined mobile networks (SDMN) combined with MEC. Specifically, we propose a novel mechanism to jointly consider buffer dynamics, video quality adaption, edge caching, video transcoding and transmission. First, we assume that the time-varying channel is a discrete-time Markov chain (DTMC). Then, based on this assumption, we formulate two optimization problems which can be depicted as a constrained Markov decision process (CMDP) and a Markov decision process (MDP). Then, we transform the CMDP problem into regular MDP by deploying Lyapunov technique. We utilize asynchronous advantage actor-critic (A3C) algorithm, one of the model-free deep reinforcement learning (DRL) methods, to solve the corresponding MDP issues. Simulation results are presented to show that the proposed scheme can achieve the goal of energy saving and QoE enhancement with the corresponding constraints satisfied.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据