4.7 Article

Video anomaly detection and localization using motion-field shape description and homogeneity testing

期刊

PATTERN RECOGNITION
卷 105, 期 -, 页码 -

出版社

ELSEVIER SCI LTD
DOI: 10.1016/j.patcog.2020.107394

关键词

Abnormal activity; Anomaly detection; Anomaly localization; Shape description; K-NN similarity-based outlier detection

资金

  1. NSFC [61801417]
  2. Natural Science Research of Jiangsu Higher Education Institutions of China [18KJE3520051]
  3. Shanghai Science and Technology Commission [17511104203]
  4. National Key RD Program [2018YFE0116700]
  5. Shandong Provincial Natural Science Foundation [ZR2019MF049]

向作者/读者索取更多资源

Detection and localization of abnormal behaviors in surveillance videos of crowded scenes is challenging, where high-density people and various objects performing highly unpredictable motions lead to severe occlusions, making object segmentation and tracking extremely difficult. We associate the optical flows between multiple frames to capture short-term trajectories and introduce the histogram-based shape descriptor to describe such short-term trajectories, which reflects faithfully the motion trend and details in local patches. Furthermore, we propose a method to detect anomalies over time and space by judging whether the similarities between the testing sample and the retrieved K-NN samples follow the pattern distribution of homogeneous intra-class similarities, which is unsupervised one-class learning requiring no clustering nor prior assumption. Such a scheme can adapt to the whole scene, since the probability is used to judge and the calculation of probability is not affected by motion distortions arising from perspective distortion, which gains advantage over the existing solutions. We conduct experiments on real-world surveillance videos, and the results demonstrate that the proposed method can reliably detect and locate the abnormal events in video sequences, outperforming the state-of-the-art approaches. (C) 2020 Elsevier Ltd. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Customer Volume Prediction Using Fusion of Shared-private Dynamic Weighting over Multiple Modalities

Wenshan Wang, Su Yang, Weishan Zhang

Summary: In this article, we explore three dynamic weighting ensemble learning models to fuse spatio-temporal features and visual features for customer volume prediction in urban commercial districts. We introduce the shared-private dynamic weighting model with graph neural networks to capture geographic dependencies between districts. The effectiveness of the proposed models is demonstrated through experiments on real datasets, and a visualization method is used for knowledge discovery.

ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY (2023)

Article Computer Science, Information Systems

A Novel Deep Learning Model for Medical Report Generation by Inter-Intra Information Calibration

Junsan Zhang, Xiuxuan Shen, Shaohua Wan, Sotirios K. Goudos, Jie Wu, Ming Cheng, Weishan Zhang

Summary: Automatic generation of medical reports can assist doctors and reduce their workload. However, previous methods of injecting auxiliary information had limitations, which are addressed by the proposed Information Calibrated Transformer (ICT) that extracts features from datasets as auxiliary information and combines them with the main model through an Information Calibration Attention Module (ICA), resulting in improved quality of generated medical reports.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2023)

Article Computer Science, Information Systems

HCOME: Research on Hybrid Computation Offloading Strategy for MEC Based on DDPG

Shaohua Cao, Shu Chen, Hui Chen, Hanqing Zhang, Zijun Zhan, Weishan Zhang

Summary: With the growth of the Internet of Things, mobile edge computing is proposed as a solution to reduce service latency and congestion in mobile core networks. This paper presents a hybrid computation offloading framework based on Deep Deterministic Policy Gradient (DDPG) in IoT. The framework consists of edge servers and user devices, and uses Software Defined Network technologies to acquire the environment state and generate offloading strategies. Experimental results show that the proposed algorithm outperforms the comparison algorithm and improves system latency and stability of network and computational load.

ELECTRONICS (2023)

Article Computer Science, Cybernetics

Public Opinion Evolution in Cyberspace: A Case Analysis of Pelosi's Visit to Taiwan

Tao Chen, Baoyu Zhang, Xiao Wang, Weishan Zhang, Chitin Hon, Wang Di, Long Chen, Qiang Li, Fei-Yue Wang

Summary: The dynamics of public opinion on social media affect people's perceptions of international affairs and lead to the restructuring of social states in international conflicts. This article analyzes the evolution of topics on social media during Pelosi's visit. Such analysis helps related departments effectively sense and respond to the situation, and provides technical support for policy making. A new method and ALGC algorithm are proposed to reduce the computational complexity of large graphs and analyze the evolution pattern of topics. The experimental results show that the proposed method achieves high clustering accuracy with lower computational cost. The dataset used in this article is also released for public analysis.

IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS (2023)

Article Computer Science, Hardware & Architecture

Software Architecture for Responsible Artificial Intelligence Systems: Practice in the Digitization of Industrial Drawings

Zhicheng Bao, Weishan Zhang, Xingjie Zeng, Hongwei Zhao, Cihao Dong, Yuming Nie, Yuru Liu, Yuange Liu, Junzhong Wu

Summary: In this article, a comprehensive approach to a responsible AI-based software architecture for the digitalization of industry drawings is proposed, which also serves as a software engineering reference for responsible AI in other industry domains.

COMPUTER (2023)

Article Computer Science, Hardware & Architecture

Reinforcement learning based tasks offloading in vehicular edge computing networks

Shaohua Cao, Di Liu, Congcong Dai, Chengqi Wang, Yansheng Yang, Weishan Zhang, Danyang Zheng

Summary: With the development of autonomous and intelligent techniques, vehicles are equipped with computation and communication modules to handle on-vehicle computing requests. However, due to limited computation capacities, these requests are offloaded to special devices like roadside units or intelligent vehicles. Two challenges arise in vehicular edge computing networks: accurately determining peak or low hours and effectively offloading requests. This paper investigates computational requests offloading in different vehicular networking scenarios and proposes algorithms based on fuzzy inference and reinforcement learning to address these challenges. Experimental results show significant improvement in resource utilization compared to the benchmark.

COMPUTER NETWORKS (2023)

Article Computer Science, Information Systems

Homophily Learning-Based Federated Intelligence: A Case Study on Industrial IoT Equipment Failure Prediction

Xingjie Zeng, Zepei Yu, Weishan Zhang, Xiao Wang, Qinghua Lu, Tao Wang, Mu Gu, Yonglin Tian, Fei-Yue Wang

Summary: This article introduces a homophily learning-based federated intelligence (HLFI) approach, which uses hierarchical federated learning strategy and dynamic elimination learning strategy to address the issues in deep neural networks in federated learning. The experiments show that the proposed approach can improve equipment failure prediction F1-score up to 9.32% and has good generalization capabilities to improve model performance in other federated learning methods.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Automation & Control Systems

R(2)Fed: Resilient Reinforcement Federated Learning for Industrial Applications

Weishan Zhang, Fa Yu, Xiao Wang, Xingjie Zeng, Hongwei Zhao, Yonglin Tian, Fei-Yue Wang, Longfei Li, Zengxiang Li

Summary: Resilient Reinforcement Federated Learning (R(2)Fed) is a method that applies reinforcement learning to federated learning and uses reinforcement learning for weighted fusion of client models, instead of average fusion, to tackle the impact of device heterogeneity and non-identically and independently distributed data (Non-IID) in actual federated learning. Experiments demonstrate that the R(2)Fed method outperforms traditional federated learning in Non-IID and heterogeneity scenarios, increasing the average accuracy by 4.7%. The experiments also show that R(2)Fed is resilient to federation attacks.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2023)

Article Computer Science, Information Systems

Accurate and Efficient Federated-Learning-Based Edge Intelligence for Effective Video Analysis

Liang Xu, Haoyun Sun, Hongwei Zhao, Weishan Zhang, Huansheng Ning, Hongqing Guan

Summary: This article proposes an accurate and efficient federated learning-based edge intelligence for effective video analysis method called EIEVA-AEFL. It includes a FMRN network to reduce object misdetection and an efficient federated learning strategy to reduce communication cost. Experimental results on datasets show that EIEVA-AEFL improves model accuracy and reduces training time.

IEEE INTERNET OF THINGS JOURNAL (2023)

Article Computer Science, Cybernetics

Knowledge Graph-Based Reinforcement Federated Learning for Chinese Question and Answering

Liang Xu, Tao Chen, Zhaoxiang Hou, Weishan Zhang, Chitin Hon, Xiao Wang, Di Wang, Long Chen, Wenyin Zhu, Yunlong Tian, Huansheng Ning, Fei-Yue Wang

Summary: This article proposes a knowledge graph-based reinforcement federated learning (KGRFL)-based Q & A approach to address the challenges of error accumulation and data privacy in existing semantic parsing methods. By designing a multitask semantic parsing model and a reinforcement learning-based model fusion strategy, multi-institution joint modeling and data privacy protection are achieved. The experiments show that the proposed method outperforms using a single institution and is resilient to security attacks.

IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS (2023)

Article Telecommunications

A broad learning-based comprehensive defence against SSDP reflection attacks in IoTs

Xin Liu, Liang Zheng, Sumi Helal, Weishan Zhang, Chunfu Jia, Jiehan Zhou

Summary: This paper proposes a comprehensive defense approach against SSDP reflection attacks, combining broad learning and a set of defense strategies. It does not require detecting attacks or identifying the roles of IoT devices, and can accurately detect suspicious traffic, automatically deploy defense strategies, and significantly reduce DDoS packets.

DIGITAL COMMUNICATIONS AND NETWORKS (2023)

Article Telecommunications

Semi-asynchronous personalized federated learning for short-term photovoltaic power forecasting

Weishan Zhang, Xiao Chen, Ke He, Leiming Chen, Liang Xu, Xiao Wang, Su Yang

Summary: This paper introduces an efficient semi-asynchronous federated learning framework for short-term solar power forecasting, and evaluates the performance using a CNN-LSTM model. The research demonstrates that federated models can achieve higher forecasting performance while protecting data privacy.

DIGITAL COMMUNICATIONS AND NETWORKS (2023)

Article Engineering, Electrical & Electronic

The Adaptive Personalized Federated Meta-Learning for Anomaly Detection of Industrial Equipment

Yuange Liu, Zhicheng Bao, Yuqian Wang, Xingjie Zeng, Liang Xu, Weishan Zhang, Hongwei Zhao, Zepei Yu

Summary: This paper proposes an adaptive personalized federated meta-learning framework to address the challenges in industrial equipment anomaly detection, with excellent ability to adjust hyperparameters and applicability to different environments.

IEEE JOURNAL OF RADIO FREQUENCY IDENTIFICATION (2022)

Article Computer Science, Information Systems

Cloud-Based Framework for Spatio-Temporal Trajectory Data Segmentation and Query

Huaqiang Kang, Yan Liu, Weishan Zhang

Summary: This article introduces a distributed trajectory segmentation framework, which includes a greedy-split segmentation method and a distributed spatial R-tree index of trajectory segments. The framework can identify moving groups of trajectories by defining metrics to measure trajectory similarity and chance of collision. The evaluation results show that the system performs well in terms of data partition, parallelism, and data size.

IEEE TRANSACTIONS ON CLOUD COMPUTING (2022)

Article Computer Science, Information Systems

Timestamp Scheme to Mitigate Replay Attacks in Secure ZigBee Networks

Fadi Farha, Huansheng Ning, Shunkun Yang, Jiabo Xu, Weishan Zhang, Kim-Kwang Raymond Choo

Summary: ZigBee is a communication protocol used in IoT applications, but its security is compromised in typical low-cost and low-power deployment scenarios. This paper presents a timestamp-based scheme to mitigate replay attacks, which is power-efficient and applicable to different ZigBee topologies and end devices.

IEEE TRANSACTIONS ON MOBILE COMPUTING (2022)

Article Computer Science, Artificial Intelligence

Exploiting sublimated deep features for image retrieval

Guang-Hai Liu, Zuo-Yong Li, Jing-Yu Yang, David Zhang

Summary: This article introduces a novel image retrieval method that improves retrieval performance by using sublimated deep features. The method incorporates orientation-selective features and color perceptual features, effectively mimicking these mechanisms to provide a more discriminating representation.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Region-adaptive and context-complementary cross modulation for RGB-T semantic segmentation

Fengguang Peng, Zihan Ding, Ziming Chen, Gang Wang, Tianrui Hui, Si Liu, Hang Shi

Summary: RGB-Thermal (RGB-T) semantic segmentation is an emerging task that aims to improve the robustness of segmentation methods under extreme imaging conditions by using thermal infrared modality. The challenges of foreground-background distinguishment and complementary information mining are addressed by proposing a cross modulation process with two collaborative components. Experimental results show that the proposed method achieves state-of-the-art performances on current RGB-T segmentation benchmarks.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

F-SCP: An automatic prompt generation method for specific classes based on visual language pre-training models

Baihong Han, Xiaoyan Jiang, Zhijun Fang, Hamido Fujita, Yongbin Gao

Summary: This paper proposes a novel automatic prompt generation method called F-SCP, which focuses on generating accurate prompts for low-accuracy classes and similar classes. Experimental results show that our approach outperforms state-of-the-art methods on six multi-domain datasets.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Residual Deformable Convolution for better image de-weathering

Huikai Liu, Ao Zhang, Wenqian Zhu, Bin Fu, Bingjian Ding, Shengwu Xiong

Summary: Adverse weather conditions present challenges for computer vision tasks, and image de-weathering is an important component of image restoration. This paper proposes a multi-patch skip-forward structure and a Residual Deformable Convolutional module to improve feature extraction and pixel-wise reconstruction.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

A linear transportation LP distance for pattern recognition

Oliver M. Crook, Mihai Cucuringu, Tim Hurst, Carola-Bibiane Schonlieb, Matthew Thorpe, Konstantinos C. Zygalakis

Summary: The transportation LP distance (TLP) is a generalization of the Wasserstein WP distance that can be applied directly to color or multi-channelled images, as well as multivariate time-series. TLP interprets signals as functions, while WP interprets signals as measures. Although both distances are powerful tools in modeling data with spatial or temporal perturbations, their computational cost can be prohibitively high for moderate pattern recognition tasks. The linear Wasserstein distance offers a method for projecting signals into a Euclidean space, and in this study, we propose linear versions of the TLP distance (LTLP) that show significant improvement over the linear WP distance in signal processing tasks while being several orders of magnitude faster to compute than the TLP distance.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Learning a target-dependent classifier for cross-domain semantic segmentation: Fine-tuning versus meta-learning

Haitao Tian, Shiru Qu, Pierre Payeur

Summary: This paper proposes a method of target-dependent classifier, which optimizes the joint hypothesis of domain adaptation into a target-dependent hypothesis that better fits with the target domain clusters through an unsupervised fine-tuning strategy and the concept of meta-learning. Experimental results demonstrate that this method outperforms existing techniques in synthetic-to-real adaptation and cross-city adaptation benchmarks.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

KGSR: A kernel guided network for real-world blind super-resolution

Qingsen Yan, Axi Niu, Chaoqun Wang, Wei Dong, Marcin Wozniak, Yanning Zhang

Summary: Deep learning-based methods have achieved remarkable results in the field of super-resolution. However, the limitation of paired training image sets has led researchers to explore self-supervised learning. However, the assumption of inaccurate downscaling kernel functions often leads to degraded results. To address this issue, this paper introduces KGSR, a kernel-guided network that trains both upscaling and downscaling networks to generate high-quality high-resolution images even without knowing the actual downscaling process.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Gait feature learning via spatio-temporal two-branch networks

Yifan Chen, Xuelong Li

Summary: Gait recognition is a popular technology for identification due to its ability to capture gait features over long distances without cooperation. However, current methods face challenges as they use a single network to extract both temporal and spatial features. To solve this problem, we propose a two-branch network that focuses on spatial and temporal feature extraction separately. By combining these features, we can effectively learn the spatio-temporal information of gait sequences.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

PAMI: Partition Input and Aggregate Outputs for Model Interpretation

Wei Shi, Wentao Zhang, Wei-shi Zheng, Ruixuan Wang

Summary: This article proposes a simple yet effective visualization framework called PAMI, which does not require detailed model structure and parameters to obtain visualization results. It can be applied to various prediction tasks with different model backbones and input formats.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Disturbance rejection with compensation on features

Xiaobo Hu, Jianbo Su, Jun Zhang

Summary: This paper reviews the latest technologies in pattern recognition, highlighting their instabilities and failures in practical applications. From a control perspective, the significance of disturbance rejection in pattern recognition is discussed, and the existing problems are summarized. Finally, potential solutions related to the application of compensation on features are discussed to emphasize future research directions.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

ECLAD: Extracting Concepts with Local Aggregated Descriptors

Andres Felipe Posada-Moreno, Nikita Surya, Sebastian Trimpe

Summary: Convolutional neural networks are widely used in critical systems, and explainable artificial intelligence has proposed methods for generating high-level explanations. However, these methods lack the ability to determine the location of concepts. To address this, we propose a novel method for automatic concept extraction and localization based on pixel-wise aggregations, and validate it using synthetic datasets.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

Dynamic Graph Contrastive Learning via Maximize Temporal Consistency

Peng Bao, Jianian Li, Rong Yan, Zhongyi Liu

Summary: In this paper, a novel Dynamic Graph Contrastive Learning framework, DyGCL, is proposed to capture the temporal consistency in dynamic graphs and achieve good performance in node representation learning.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

ConvGeN: A convex space learning approach for deep-generative oversampling and imbalanced classification of small tabular datasets

Kristian Schultz, Saptarshi Bej, Waldemar Hahn, Markus Wolfien, Prashant Srivastava, Olaf Wolkenhauer

Summary: Research indicates that deep generative models perform poorly compared to linear interpolation-based methods for synthetic data generation on small, imbalanced tabular datasets. To address this, a new approach called ConvGeN, combining convex space learning with deep generative models, has been proposed. ConvGeN improves imbalanced classification on small datasets while remaining competitive with existing linear interpolation methods.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

H-CapsNet: A capsule network for hierarchical image classification

Khondaker Tasrif Noor, Antonio Robles-Kelly

Summary: In this paper, the authors propose H-CapsNet, a capsule network designed for hierarchical image classification. The network effectively captures hierarchical relationships using dedicated capsules for each class hierarchy. A modified hinge loss is utilized to enforce consistency among the involved hierarchies. Additionally, a strategy for dynamically adjusting training parameters is presented to achieve better balance between the class hierarchies. Experimental results demonstrate that H-CapsNet outperforms competing hierarchical classification networks.

PATTERN RECOGNITION (2024)

Article Computer Science, Artificial Intelligence

CS-net: Conv-simpleformer network for agricultural image segmentation

Lei Liu, Guorun Li, Yuefeng Du, Xiaoyu Li, Xiuheng Wu, Zhi Qiao, Tianyi Wang

Summary: This study proposes a new agricultural image segmentation model called CS-Net, which uses Simple-Attention Block and Simpleformer to improve accuracy and inference speed, and addresses the issue of performance collapse of Transformers in agricultural image processing.

PATTERN RECOGNITION (2024)