4.7 Article

Dynamic Anomalography: Tracking Network Anomalies Via Sparsity and Low Rank

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/JSTSP.2012.2233193

关键词

Traffic volume anomalies; online optimization; sparsity; network cartography; low rank

资金

  1. MURI [AFOSR FA9550-10-1-0567]

向作者/读者索取更多资源

In the backbone of large-scale networks, origin-to-destination (OD) traffic flows experience abrupt unusual changes known as traffic volume anomalies, which can result in congestion and limit the extent to which end-user quality of service requirements are met. As a means of maintaining seamless end-user experience in dynamic environments, as well as for ensuring network security, this paper deals with a crucial network monitoring task termed dynamic anomalography. Given link traffic measurements (noisy superpositions of unobserved OD flows) periodically acquired by backbone routers, the goal is to construct an estimated map of anomalies in real time, and thus summarize the network 'health state' along both the flow and time dimensions. Leveraging the low intrinsic-dimensionality of OD flows and the sparse nature of anomalies, a novel online estimator is proposed based on an exponentially-weighted least-squares criterion regularized with the sparsity-promoting l(1)-norm of the anomalies, and the nuclear norm of the nominal traffic matrix. After recasting the non-separable nuclear norm into a form amenable to online optimization, a real-time algorithm for dynamic anomalography is developed and its convergence established under simplifying technical assumptions. For operational conditions where computational complexity reductions are at a premium, a lightweight stochastic gradient algorithm based on Nesterov's acceleration technique is developed as well. Comprehensive numerical tests with both synthetic and real network data corroborate the effectiveness of the proposed online algorithms and their tracking capabilities, and demonstrate that they outperform state-of-the-art approaches developed to diagnose traffic anomalies.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Engineering, Electrical & Electronic

Online Change Point Detection for Weighted and Directed Random Dot Product Graphs

Bernardo Marenco, Paola Bermolen, Marcelo Fiori, Federico Larroca, Gonzalo Mateos

Summary: In this paper, we address the problem of online monitoring and detection of changes in the underlying data distribution using a graph representation learning method based on the RDPG model. We propose an efficient online change-point detection algorithm that quantifies the discrepancy between the streaming graph observations and the nominal RDPG. We provide insights on the algorithm's detection resolution and delay and offer an open-source implementation for weighted and directed graphs.

IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS (2022)

Article Computer Science, Artificial Intelligence

Lazily Aggregated Quantized Gradient Innovation for Communication-Efficient Federated Learning

Jun Sun, Tianyi Chen, Georgios B. Giannakis, Qinmin Yang, Zaiyue Yang

Summary: This paper proposes an adaptive communication method for the federated learning problem, which saves communication costs by quantizing gradients and skipping less informative communications. Extensive experiments validate the effectiveness of this method.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Computer Science, Artificial Intelligence

Efficient and Stable Graph Scattering Transforms via Pruning

Vassilis N. Ioannidis, Siheng Chen, Georgios B. Giannakis

Summary: This study introduces an efficient pruned GST approach to address the complexity limitation of traditional GSTs. The pruned GSTs retain informative scattering features while bypassing exponential complexity, and achieve comparable performance to state-of-the-art GCNs.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2022)

Article Engineering, Electrical & Electronic

Towards accelerate d gree dy sampling and reconstruction of bandlimited graph signals

Abolfazl Hashemi, Rasoul Shafipour, Haris Vikalo, Gonzalo Mateos

Summary: This paper studies the problem of sampling and reconstructing spectrally sparse graph signals. It proposes efficient methods for different scenarios and analyzes the reconstruction error.

SIGNAL PROCESSING (2022)

Article Engineering, Electrical & Electronic

Learning to Solve the AC-OPF Using Sensitivity-Informed Deep Neural Networks

Manish K. Singh, Vassilis Kekatos, Georgios B. Giannakis

Summary: Recent works propose the use of deep neural networks to predict optimal power flow solutions in power systems applications. This paper introduces a sensitivity-informed DNN and demonstrates its effectiveness and constraint satisfaction capabilities in optimization problems.

IEEE TRANSACTIONS ON POWER SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

Unsupervised Ensemble Classification With Sequential and Networked Data

Panagiotis A. Traganitis, Georgios B. Giannakis

Summary: This study explores the method of unsupervised ensemble classification and introduces novel algorithms for handling data dependencies in both sequential and networked data. Evaluation on synthetic and real datasets shows that knowledge of data dependencies in the meta-learner has a positive impact on unsupervised ensemble classification task.

IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING (2022)

Article Automation & Control Systems

Time-Domain Generalization of Kron Reduction

Manish K. Singh, Sairaj Dhople, Florian Doerfler, Georgios B. Giannakis

Summary: This letter proposes a Kron reduction method that eliminates nodes with zero current injections from electrical networks and applies it to the generalized setting of RL networks. Empirical tests on a Delta network are conducted to validate the analytical results.

IEEE CONTROL SYSTEMS LETTERS (2022)

Proceedings Paper Acoustics

Learning while Respecting Privacy and Robustness to Adversarial Distributed Datasets

Alireza Sadeghi, Georgios B. Giannakis

Summary: The use of federated learning framework allows for the distributed training of models on massive datasets without the need to upload data to a central server. However, maintaining performance and robustness in the face of varying data distributions across workers is a challenge. This study proposes a distributionally robust optimization framework and develops a primal-dual algorithm to ensure the trained model's robustness against adversarial attacks and distributional uncertainties.

2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) (2022)

Proceedings Paper Acoustics

Learning to Identify Sources of Network Diffusion

Chang Ye, Gonzalo Mateos

Summary: In this study, a deep learning solution is proposed for localizing sources of network diffusion. By leveraging graph signal processing and the ADMM method, a diffusion filter and source locations can be estimated. The trained neural network model, SLoG-Net, is interpretable, parameter efficient, and offers controllable complexity, achieving comparable performance and significant speedups compared to traditional methods.

2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) (2022)

Proceedings Paper Acoustics

Learning Similarity-Preserving Representations of Brain Structure-Function Coupling

Yang Li, Gonzalo Mateos

Summary: Advances in graph signal processing contribute to the integration of brain structure and function in network neuroscience. This study proposes a supervised graph representation learning framework to model the relationship between brain structural connectivity and functional connectivity. The proposed framework effectively learns embeddings that preserve the similarity between brain networks, and demonstrates superior discriminative power in subject classification and visualization tasks.

2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) (2022)

Proceedings Paper Acoustics

Algorithmic Advances for the Adjacency Spectral Embedding

Marcelo Fiori, Bernardo Marenco, Federico Larroca, Paola Bermolen, Gonzalo Mateos

Summary: The paper introduces the Random Dot Product Graph (RDPG) as a generative graph model for relational data and discusses the embedding problem of estimating latent positions from observed graphs. By utilizing recent advances in non-convex optimization, the paper proposes a first-order gradient descent method to solve the problem more effectively and demonstrates the effectiveness of the graph representation learning framework.

2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022) (2022)

Proceedings Paper Automation & Control Systems

Unifying Energy-management Problems for Inverter-based Power Networks

Manish K. Singh, D. Venkatramanan, Sairaj Dhople, Benjamin Kroposki, Georgios B. Giannakis

Summary: This paper outlines the energy-management problems for inverter-based power networks from the perspective of optimal control and (non)linear optimization. It categorizes the problems based on timescales and organizes them methodologically according to complexity. The paper establishes dynamic models, uncovers common assumptions, and postulates open challenges in this field.

IFAC PAPERSONLINE (2022)

Article Engineering, Electrical & Electronic

Learning to Model the Relationship Between Brain Structural and Functional Connectomes

Yang Li, Gonzalo Mateos, Zhengwu Zhang

Summary: Recent neuroimaging advances and algorithmic innovations enable the integration of brain structure and function, leading to the discovery of brain's organizing principles. This study develops a supervised graph representation learning framework to model the relationship between brain structural connectivity and functional connectivity, improving the accuracy of classifying alcohol consumption behavior.

IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS (2022)

Article Computer Science, Theory & Methods

Networks of international football: communities, evolution and globalization of the game

Yang Li, Gonzalo Mateos

Summary: This paper studies the macroscopic evolution of the football society from a complex network perspective. By analyzing football game records and constructing a football network, the dynamic features and community structures of the network are revealed. Furthermore, spatio-temporal analysis unveils the temporal states representing distinct development stages in football history.

APPLIED NETWORK SCIENCE (2022)

Article Engineering, Electrical & Electronic

Ensemble Gaussian Processes for Online Learning Over Graphs With Adaptivity and Scalability

Konstantinos D. Polyzos, Qin Lu, Georgios B. Giannakis

Summary: Semi-supervised learning (SSL) over graphs has gained popularity in network science applications. This work introduces a Bayesian SSL approach using Gaussian processes (GPs) to provide uncertainty quantification. An incremental learning mode is considered, and an ensemble of GP experts is utilized for prediction and weight updating. The random feature-based kernel approximation method is employed to ensure scalability and privacy preservation.

IEEE TRANSACTIONS ON SIGNAL PROCESSING (2022)

暂无数据