4.7 Article

Latency Optimization for Blockchain-Empowered Federated Learning in Multi-Server Edge Computing

Journal

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS
Volume 40, Issue 12, Pages 3373-3390

Publisher

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSAC.2022.3213344

Keywords

Federated learning; blockchain; edge computing; actor-critic learning; network optimization

Funding

  1. ONR [N00014-22-1-2305, N00014-21-1-2472]
  2. NSF [CNS-2146171]

Ask authors/readers for more resources

In this paper, the authors investigate the issue of latency optimization in blockchain-based federated learning in multi-server edge computing. They propose an offloading strategy to assist ML model training for resource-constrained mobile devices and develop a decentralized ML model aggregation solution based on blockchain communications. The authors also formulate the problem as an optimization task and propose a deep reinforcement learning scheme to solve it. Numerical evaluation shows that their proposed scheme outperforms baselines in terms of model training efficiency, convergence rate, system latency, and robustness against attacks.
In this paper, we study a new latency optimization problem for blockchain-based federated learning (BFL) in multi-server edge computing. In this system model, distributed mobile devices (MDs) communicate with a set of edge servers (ESs) to handle both machine learning (ML) model training and block mining simultaneously. To assist the ML model training for resource-constrained MDs, we develop an offloading strategy that enables MDs to transmit their data to one of the associated ESs. We then propose a new decentralized ML model aggregation solution at the edge layer based on a consensus mechanism to build a global ML model via peer-to-peer (P2P)-based blockchain communications. Blockchain builds trust among MDs and ESs to facilitate reliable ML model sharing and cooperative consensus formation, and enables rapid elimination of manipulated models caused by poisoning attacks. We formulate latency-aware BFL as an optimization aiming to minimize the system latency via joint consideration of the data offloading decisions, MDs' transmit power, channel bandwidth allocation for MDs' data offloading, MDs' computational allocation, and hash power allocation. Given the mixed action space of discrete offloading and continuous allocation variables, we propose a novel deep reinforcement learning scheme with a parameterized advantage actor critic algorithm. We theoretically characterize the convergence properties of BFL in terms of the aggregation delay, mini-batch size, and number of P2P communication rounds. Our numerical evaluation demonstrates the superiority of our proposed scheme over baselines in terms of model training efficiency, convergence rate, system latency, and robustness against model poisoning attacks.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Engineering, Electrical & Electronic

Rate Splitting for Future Wireless Networks

Bruno Clerckx, Yijie Mao, Eduard A. Jorswieck, Jinhong Yuan, David J. Love, Elza Erkip, Dusit Niyato

Summary: This Special Issue focuses on the theory, design, optimization, and applications of RS and RSMA in various network configurations. It begins with a tutorial paper written by a guest editor, which illustrates the basic principles and applications of RS and RSMA, followed by 17 technical papers.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2023)

Article Engineering, Electrical & Electronic

A Primer on Rate-Splitting Multiple Access: Tutorial, Myths, and Frequently Asked Questions

Bruno Clerckx, Yijie Mao, Eduard A. Jorswieck, Jinhong Yuan, David J. Love, Elza Erkip, Dusit Niyato

Summary: Rate-Splitting Multiple Access (RSMA) is evaluated for its importance in next generation communication systems as a powerful multiple access and interference management strategy. It offers numerous benefits and applications, addressing fundamental problems such as interference management and providing enhanced efficiency, universality, flexibility, robustness, and reliability. In 6G, RSMA can be applied to a wide range of scenarios and applications.

IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS (2023)

Article Engineering, Electrical & Electronic

Compressed Training for Dual-Wideband Time-Varying Sub-Terahertz Massive MIMO

Tzu-Hsuan Chou, Nicolo Michelusi, David J. Love, James V. Krogmeier

Summary: 6G operators may use mmWave and sub-THz bands to meet wireless access demand, but sub-THz communication faces new challenges due to wider bandwidths and harsher propagation conditions. This paper proposes a compressed training framework for estimating time-varying sub-THz MIMO-OFDM channels.

IEEE TRANSACTIONS ON COMMUNICATIONS (2023)

Article Computer Science, Information Systems

Cooperative Task Offloading and Block Mining in Blockchain-Based Edge Computing With Multi-Agent Deep Reinforcement Learning

Dinh C. Nguyen, Ming Ding, Pubudu N. Pathirana, Aruna Seneviratne, Jun Li, H. Vincent Poor

Summary: This article proposes a novel cooperative task offloading and block mining scheme for blockchain-based MEC system, aiming to maximize system utility by jointly optimizing offloading decision, channel selection, transmit power allocation, and computational resource allocation. Simulation results demonstrate significant improvement of system utility compared to baseline approaches.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2023)

Article Engineering, Electrical & Electronic

RFID: Towards Low Latency and Reliable DAG Task Scheduling Over Dynamic Vehicular Clouds

Zhang Liu, Minghui Liwang, Seyyedali Hosseinalipour, Huaiyu Dai, Zhibin Gao, Lianfen Huang

Summary: This paper investigates the challenges of scheduling tasks with a directed acyclic graph structure on dynamic vehicular cloud platforms and proposes a solution to minimize task completion time and ensure high success rate.

IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY (2023)

Article Computer Science, Information Systems

Graph-Represented Computation-Intensive Task Scheduling Over Air-Ground Integrated Vehicular Networks

Minghui Liwang, Zhibin Gao, Seyyedali Hosseinalipour, Yuhan Su, Xianbin Wang, Huaiyu Dai

Summary: This article investigates the application of vehicular cloud-assisted task scheduling in an air-ground integrated vehicular network. By modeling tasks carried by unmanned aerial vehicles and resources of vehicular clouds as graph structures, the authors consider the scenario where resource-limited UAVs offload computation-intensive tasks to resource-abundant vehicles for processing. They formulate an optimization problem to jointly optimize the mapping between task components and vehicles, transmission powers of UAVs, and address the trade-off between completion time of tasks, energy consumption of UAVs, and data exchange cost among vehicles. The authors propose a decoupling approach for task scheduling by segregating template searching from transmission power allocation, which is shown to outperform baseline methods in extensive simulations.

IEEE TRANSACTIONS ON SERVICES COMPUTING (2023)

Article Computer Science, Information Systems

UAV-Assisted Online Machine Learning Over Multi-Tiered Networks: A Hierarchical Nested Personalized Federated Learning Approach

Su Wang, Seyyedali Hosseinalipour, Maria Gorlatova, Christopher G. Brinton, Mung Chiang

Summary: In this study, we train machine learning models on geo-distributed, resource-constrained clusters of devices through unmanned aerial vehicle (UAV) swarms. We address the challenges posed by varying data heterogeneity and computational resource inadequacy among device clusters by introducing stratified UAV swarms, hierarchical nested personalized federated learning (HN-PFL), cooperative UAV resource pooling, and model/concept drift. Our methodology considers both micro and macro system design, with a focus on network-aware HN-PFL and swarm trajectory and learning duration design tackled via deep reinforcement learning. Simulations demonstrate the effectiveness of our approach in terms of ML performance, resource savings, and swarm trajectory efficiency.

IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT (2023)

Article Computer Science, Hardware & Architecture

Parallel Successive Learning for Dynamic Distributed Model Training Over Heterogeneous Wireless Networks

Seyyedali Hosseinalipour, Su Wang, Nicolo Michelusi, Vaneet Aggarwal, Christopher G. Brinton, David J. Love, Mung Chiang

Summary: In this paper, we propose parallel successive learning (PSL) to expand the architecture of federated learning in terms of network, heterogeneity, and proximity. PSL considers decentralized cooperation among devices, heterogeneous learning and data environments, and devices with different capabilities. We also analyze the concepts of cold vs. warmed up models and propose a network-aware dynamic model tracking method to optimize the tradeoff between model learning and resource efficiency. Our numerical results reveal new insights on the interdependencies between idle times, model/concept drift, and D2D cooperation configuration.

IEEE-ACM TRANSACTIONS ON NETWORKING (2023)

Article Computer Science, Hardware & Architecture

Decomposition Theory Meets Reliability Analysis: Processing of Computation-Intensive Dependent Tasks Over Vehicular Clouds With Dynamic Resources

Payam Abdisarabshali, Minghui Liwang, Amir Rajabzadeh, Mahmood Ahmadi, Seyyedali Hosseinalipour

Summary: Vehicular cloud is a promising technology for processing computation-intensive applications on smart vehicles. This work addresses the challenges of insufficient computing resources and dynamic resource availability caused by vehicle mobility in implementing vehicular clouds. A general reliability metric and a redundancy-based processing framework are introduced to improve the reliability of CI-App processing. A mathematical framework called event stochastic algebra is developed to analyze the reliability of the proposed methodology. Simulation results demonstrate the accuracy and efficiency of the proposed methodology in CI-App processing.

IEEE-ACM TRANSACTIONS ON NETWORKING (2023)

Article Computer Science, Hardware & Architecture

Multi-Edge Server-Assisted Dynamic Federated Learning With an Optimized Floating Aggregation Point

Bhargav Ganguly, Seyyedali Hosseinalipour, Kwang Taik Kim, Christopher G. Brinton, Vaneet Aggarwal, David J. Love, Mung Chiang

Summary: We propose a cooperative edge-assisted dynamic federated learning (CE-FL) approach. CE-FL introduces a distributed machine learning (ML) architecture, where data collection is carried out at the end devices, while the model training is conducted cooperatively at the end devices and the edge servers, enabled via data offloading from the end devices to the edge servers through base stations. CE-FL also introduces a floating aggregation point, where the local models generated at the devices and the servers are aggregated at an edge server, which varies from one model training round to another to cope with the network evolution in terms of data distribution and users' mobility.

IEEE-ACM TRANSACTIONS ON NETWORKING (2023)

Article Computer Science, Theory & Methods

Federated Learning for Smart Healthcare: A Survey

Dinh C Nguyen, Quoc-Viet Pham, Pubudu N. Pathirana, Ming Ding, Aruna Seneviratne, Zihuai Lin, Octavia Dobre, Won-Joo Hwang

Summary: Recent advances in communication technologies and the Internet-of-Medical-Things (IOMT) have enabled the use of artificial intelligence (AI) in smart healthcare. Federated Learning (FL), as a distributed collaborative AI paradigm, is particularly attractive for smart healthcare due to its ability to train AI models without sharing raw data. This survey provides a comprehensive overview of the recent advances in FL, its motivations, requirements, and applications in key healthcare domains.

ACM COMPUTING SURVEYS (2023)

Article Computer Science, Information Systems

Technological Evolution in the Instrumentation of Ataxia Severity Measurement

Thang Ngo, Pubudu N. N. Pathirana, Malcolm K. K. Horne, Louise A. A. Corben, Ian H. H. Harding, David J. J. Szmulewicz

Summary: Cerebellar ataxia is a movement disorder caused by injury or disease to the cerebellum. Diagnosis and assessment of ataxia are challenging due to the reliance on clinical experience and subjectivity. Recent advancements in neuroimaging, sensor-based approaches, and machine learning techniques have shown promise in addressing these challenges. This paper provides an overview of the clinical challenges and outlines possible machine learning approaches, while discussing limitations and potential for future research.

IEEE ACCESS (2023)

Article Engineering, Electrical & Electronic

Nonparametric Decentralized Detection and Sparse Sensor Selection via Multi-Sensor Online Kernel Scalar Quantization

Jing Guo, Raghu G. Raj, David J. Love, Christopher G. Brinton

Summary: This paper focuses on the signal classification problem in wireless sensor networks. It proposes a multi-sensor online kernel scalar quantization learning strategy to maximize classification performance and improve network resource efficiency through sparse sensor selection using a marginalized weighted kernel approach.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2022)

No Data Available