Multiple Access in Cell-Free Networks: Outage Performance, Dynamic Clustering, and Deep Reinforcement Learning-Based Design

In future cell-free (or cell-less) wireless networks, a large number of devices in a geographical area will be served simultaneously in non-orthogonal multiple access scenarios by a large number of distributed access points (APs), which coordinate with a centralized processing pool. For such a centralized cell-free network with static predefined beamforming design, we first derive a closed-form expression of uplink outage probability for a user/device. To reduce the complexity of joint processing of received signals in presence of a large number of devices and APs, we propose a novel dynamic cell-free network architecture. In this architecture, the distributed APs are clustered (i.e. partitioned) among a set of subgroups with each subgroup acting as a virtual AP in a distributed antenna system (DAS). The conventional static cell-free network is a special case of this dynamic cell-free network when the cluster size is one. For this dynamic cell-free network, we propose a successive interference cancellation (SIC)-enabled signal detection method and an inter-user-interference (IUI)-aware receive diversity combining scheme. We then formulate the general problem of clustering the APs and designing the beamforming vectors with an objective such as maximizing the sum rate or maximizing the minimum rate. To this end, we propose a hybrid deep reinforcement learning (DRL) model, namely, a deep deterministic policy gradient (DDPG)-deep double Q-network (DDQN) model to solve the optimization problem for online implementation with low complexity. The DRL model for sum-rate optimization significantly outperforms that for maximizing the minimum rate in terms of average per-user rate performance. Also, in our system setting, the proposed DDPG-DDQN scheme is found to achieve around 78% of the rate achievable through an exhaustive search-based design.

Automated summary

In future cell-free wireless networks, a dynamic architecture and a heuristic interference cancellation signal detection method are proposed to serve a large number of devices simultaneously through distributed access points. The system aims to maximize the sum rate or the minimum rate, and a deep reinforcement learning model is introduced to solve the optimization problem efficiently. The proposed DRL model outperforms in terms of average per-user rate performance and achieves around 78% of the rate achievable through exhaustive search-based design in the system setting.