4.7 Article

Energy Efficient Federated Learning Over Wireless Communication Networks

Journal

IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS
Volume 20, Issue 3, Pages 1935-1949

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TWC.2020.3037554

Keywords

Wireless communication; Computational modeling; Training; Minimization; Wireless sensor networks; Resource management; Data models; Federated learning; resource allocation; energy efficiency

Funding

  1. Engineering and Physical Sciences Research Council (EPSRC) through the Scalable Full Duplex Dense Wireless Networks (SENSE) [EP/P003486/1]
  2. U.S. National Science Foundation [CNS-1814477]
  3. EPSRC [EP/P022723/1] Funding Source: UKRI

Ask authors/readers for more resources

This paper investigates the problem of energy-efficient transmission and computation resource allocation for federated learning over wireless communication networks. An iterative algorithm is proposed to minimize energy consumption and numerical results show a reduction of up to 59.5% compared to conventional methods.
In this paper, the problem of energy efficient transmission and computation resource allocation for federated learning (FL) over wireless communication networks is investigated. In the considered model, each user exploits limited local computational resources to train a local FL model with its collected data and, then, sends the trained FL model to a base station (BS) which aggregates the local FL model and broadcasts it back to all of the users. Since FL involves an exchange of a learning model between users and the BS, both computation and communication latencies are determined by the learning accuracy level. Meanwhile, due to the limited energy budget of the wireless users, both local computation energy and transmission energy must be considered during the FL process. This joint learning and communication problem is formulated as an optimization problem whose goal is to minimize the total energy consumption of the system under a latency constraint. To solve this problem, an iterative algorithm is proposed where, at every step, closed-form solutions for time allocation, bandwidth allocation, power control, computation frequency, and learning accuracy are derived. Since the iterative algorithm requires an initial feasible solution, we construct the completion time minimization problem and a bisection-based algorithm is proposed to obtain the optimal solution, which is a feasible solution to the original energy minimization problem. Numerical results show that the proposed algorithms can reduce up to 59.5% energy consumption compared to the conventional FL method.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Review Engineering, Environmental

Promising energy-storage applications by flotation of graphite ores: A review

Ye Chen, Shilong Li, Shiru Lin, Mingzhe Chen, Cheng Tang, Xinghui Liu

Summary: Graphite-based materials have gained significant attention and rapid development in the ore industry due to their structure and excellent conductivity. However, there is still a lack of a complete industrial chain from raw materials to commercial products. To accelerate the industrialization process, optimizing the beneficiation process is crucial for improving the valuable minerals by addressing the differences in their physical and chemical properties. This review focuses on the standard beneficiation methods and presents a comprehensive flotation process for high-quality graphite flake, and also discusses the energy storage applications of graphite-based materials.

CHEMICAL ENGINEERING JOURNAL (2023)

Article Engineering, Electrical & Electronic

Energy Efficient Semantic Communication Over Wireless Networks With Rate Splitting

Zhaohui Yang, Mingzhe Chen, Zhaoyang Zhang, Chongwen Huang

Summary: In this paper, the problem of wireless resource allocation and semantic information extraction for energy efficient semantic communications over wireless networks with rate splitting is investigated. A base station (BS) first extracts semantic information from its large-scale data, and then transmits the small-sized semantic information to each user which recovers the original data based on its local common knowledge. The joint computation and communication problem is formulated as an optimization problem aiming to minimize the total communication and computation energy consumption of the network under computation, latency, and transmit power constraints. An alternating algorithm is proposed to solve this problem, and numerical results demonstrate the effectiveness of the proposed algorithm.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2023)

Article Computer Science, Information Systems

Recurrent-Neural-Network-Based Anti-Jamming Framework for Defense Against Multiple Jamming Policies

Ali Pourranjbar, Georges Kaddoum, Walid Saad

Summary: Conventional anti-jamming methods are ineffective against a single jammer following multiple different jamming policies or multiple jammers with distinct policies. This article proposes an anti-jamming method that can adapt to the current jamming attack and estimates future occupied channels in the multiple jammers scenario. The proposed methods outperform the baseline method and achieve high success rates and ergodic rates.

IEEE INTERNET OF THINGS JOURNAL (2023)

Review Computer Science, Information Systems

Pushing AI to wireless network edge: an overview on integrated sensing, communication, and computation towards 6G

Guangxu Zhu, Zhonghao Lyu, Xiang Jiao, Peixi Liu, Mingzhe Chen, Jie Xu, Shuguang Cui, Ping Zhang

Summary: Pushing artificial intelligence (AI) from central cloud to network edge has gained consensus in both industry and academia for realizing the vision of artificial intelligence of things (AIoT) in the sixth-generation (6G) era. This has spurred the emergence of edge intelligence, which focuses on extracting human-like intelligence from the vast amount of data at the wireless network edge. This study provides an overview of seamlessly integrated sensing, communication, and computation (ISCC) for edge intelligence, discussing its concept, design challenges, enabling techniques, state-of-the-art advancements, and future prospects.

SCIENCE CHINA-INFORMATION SCIENCES (2023)

Article Computer Science, Information Systems

Seamless and Energy-Efficient Maritime Coverage in Coordinated 6G Space-Air-Sea Non-Terrestrial Networks

Sheikh Salman Hassan, Do Hyeon Kim, Yan Kyaw Tun, Nguyen H. H. Tran, Walid Saad, Choong Seon Hong

Summary: This study investigates the design of an energy-efficient resource allocation system for non-terrestrial networks (NTNs) that integrates space and aerial networks with terrestrial systems. The goal is to maximize system energy efficiency by optimizing user equipment association, power control, and unmanned aerial vehicle deployment. The study proposes a mixed-integer nonlinear programming problem and develops an algorithm to decompose and solve each problem distributedly. Simulation results demonstrate that the algorithm achieves better energy efficiency and spectral efficiency than baselines.

IEEE INTERNET OF THINGS JOURNAL (2023)

Editorial Material Engineering, Multidisciplinary

Guest Editorial The Nexus Between Edge Computing and AI for 6G Networks

Zhi Zhou, Dusit Niyato, Zehui Xiong, Xiaowen Gong, Walid Saad, Xiaoming Fu

Summary: The papers in this special issue discuss the interaction between edge computing and artificial intelligence (AI) in 6G mobile communication networks. They focus on the potential of 6G networks to create an Internet of Intelligence by connecting people, things, and intelligence to solve human challenges and improve our world. Edge computing, which pushes computing tasks and services from the network core to the edge, is recognized as an essential component for empowering 6G networks with AI capabilities.

IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING (2023)

Article Telecommunications

Deep Reinforcement Learning for Channel Estimation in RIS-Aided Wireless Networks

Kitae Kim, Yan Kyaw Tun, Md. Shirajum Munir, Walid Saad, Choong Seon Hong

Summary: Accurate channel estimation and allocation are crucial for delivering RIS-aided wireless network services. A new learning-based method is proposed for channel estimation in RIS systems, which uses a limited number of pilot signals trained in a masked autoencoder (MAE) to achieve high accuracy. Furthermore, a deep reinforcement learning (DRL) agent learns pilot allocation policies through MAE, resulting in higher channel estimation performance with fewer pilots than conventional methods.

IEEE COMMUNICATIONS LETTERS (2023)

Article Engineering, Electrical & Electronic

Adaptive Information Bottleneck Guided Joint Source and Channel Coding for Image Transmission

Lunan Sun, Yang Yang, Mingzhe Chen, Caili Guo, Walid Saad, H. Vincent Poor

Summary: This paper proposes an adaptive information bottleneck guided joint source and channel coding (AIB-JSCC) method for image transmission, aiming to reduce the transmission rate while improving the image reconstruction quality. By dynamically adjusting the hyperparameter of the loss function, a balance between compression and reconstruction quality is achieved. Experimental results demonstrate that AIB-JSCC can significantly reduce the amount of transmitted data and improve the reconstruction quality and downstream task accuracy.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2023)

Article Engineering, Electrical & Electronic

Ruin Theory for User Association and Energy Optimization in Multi-Access Edge Computing

Do Hyeon Kim, Aunas Manzoor, Madyan Alsenwi, Yan Kyaw Tun, Walid Saad, Choong Seon Hong

Summary: This paper proposes a novel framework for analyzing data offloading in a multi-access edge computing system, which includes an algorithm with two key phases. The first phase utilizes ruin theory to handle user association, taking into account their transmission reliability and resource utilization efficiency. The second phase employs an optimization-based algorithm to optimize the data offloading process and minimize users' energy consumption.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2023)

Article Engineering, Electrical & Electronic

Distributed Learning Over Networks With Graph-Attention-Based Personalization

Zhuojun Tian, Zhaoyang Zhang, Zhaohui Yang, Richeng Jin, Huaiyu Dai

Summary: In conventional distributed learning over a network, the unified learning model becomes inefficient for each agent due to the underlying non-i.i.d. data distribution among agents. To address this problem, we propose a graph-attention-based personalized training algorithm (GATTA) for distributed deep learning.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2023)

Article Telecommunications

Fair Computation Efficiency for OFDMA-Based Multiaccess Edge Computing Systems

Yihan Cang, Ming Chen, Jingwen Zhao, Tantao Gong, Jiahui Zhao, Zhaohui Yang

Summary: This paper investigates the joint optimization of task offloading and resource allocation for OFDMA-based multi-access edge computing systems. An iterative algorithm is proposed to solve the non-convex mixed-integer problem, and simulation results show the superiority of the proposed algorithm in terms of minimum computation efficiency.

IEEE COMMUNICATIONS LETTERS (2023)

Article Chemistry, Multidisciplinary

Taming the transition between ZIF-L-(Zn, Co) and ZIF-(8,67) using a multi-inlet vortex mixer (MIVM)

Mohammad Fahda, Manal Ammar, Walid Saad, Mohamad Hmadeh, Mazen Al-Ghoul

Summary: In this study, the high-quality synthesis of ZIF-(8, 67) crystals and their mixed metal derivatives was achieved in an aqueous medium with reduced organic ligand consumption and controlled particle size. The rapid and precise control over the transition from ZIF-L to ZIF-(8, 67) was demonstrated using flow rates and molar ratios of the initial ZIF precursors. The synthesis of smaller ZIF-8 nanoparticles and the controlled doping of ZIF-8 with cobalt were also achieved.

CRYSTENGCOMM (2023)

Article Computer Science, Information Systems

Joint AP Selection and Task Offloading Based on Deep Reinforcement Learning for Urban-Micro Cell-Free UAV Network

Chunyu Pan, Jincheng Wang, Xinwei Yue, Linyan Guo, Zhaohui Yang

Summary: This paper proposes an urban-micro CF-UAV (UMCF-UAV) network architecture and a dynamic resource allocation algorithm to reduce system delay in UAV-assisted cellular networks. Simulation results show that the proposed algorithm has fast convergence behavior and achieves decreased system delay compared to other baseline resource allocation schemes, with a maximum improvement of 53%.

ELECTRONICS (2023)

Article Computer Science, Information Systems

Learning From Images: Proactive Caching With Parallel Convolutional Neural Networks

Yantong Wang, Ye Hu, Zhaohui Yang, Walid Saad, Kai-Kit Wong, Vasilis Friderikos

Summary: This paper proposes a novel framework for proactive caching that combines model-based optimization with data-driven techniques. It transforms an optimization problem into a grayscale image and uses Convolutional Neural Networks (CNNs) to predict content caching locations. Two algorithms are provided to address competition and accelerate search.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2023)

Article Computer Science, Artificial Intelligence

Self-Organizing Democratized Learning: Toward Large-Scale Distributed Learning Systems

Minh N. H. Nguyen, Shashi Raj Pandey, Tri Nguyen Dang, Eui-Nam Huh, Nguyen H. Tran, Walid Saad, Choong Seon Hong

Summary: This article introduces a distributed learning approach based on the philosophy of democratized learning (Dem-AI), which includes a self-organizing hierarchical structuring mechanism and solutions for hierarchical generalized learning problems. Experimental results show that the proposed algorithm outperforms conventional federated learning algorithms in the generalization performance of learning models in agents.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

No Data Available