4.5 Article

Detecting violent and abnormal crowd activity using temporal analysis of grey level co-occurrence matrix (GLCM)-based texture measures

Journal

MACHINE VISION AND APPLICATIONS
Volume 28, Issue 3-4, Pages 361-371

Publisher

SPRINGER
DOI: 10.1007/s00138-017-0830-x

Keywords

Violence; Crowd; CCTV; Texture; GLCM

Funding

  1. Economic and Social Research Council [ES/L015471/1] Funding Source: researchfish
  2. Engineering and Physical Sciences Research Council [1511967] Funding Source: researchfish
  3. Medical Research Council [G0701758] Funding Source: researchfish
  4. National Institute for Health Research [10/3010/21] Funding Source: researchfish
  5. ESRC [ES/L015471/1] Funding Source: UKRI
  6. MRC [G0701758] Funding Source: UKRI

Ask authors/readers for more resources

The severity of sustained injury resulting from assault-related violence can be minimised by reducing detection time. However, it has been shown that human operators perform poorly at detecting events found in video footage when presented with simultaneous feeds. We utilise computer vision techniques to develop an automated method of abnormal crowd detection that can aid a human operator in the detection of violent behaviour. We observed that behaviour in city centre environments often occurs in crowded areas, resulting in individual actions being occluded by other crowd members. We propose a real-time descriptor that models crowd dynamics by encoding changes in crowd texture using temporal summaries of grey level co-occurrence matrix features. We introduce a measure of inter-frame uniformity and demonstrate that the appearance of violent behaviour changes in a less uniform manner when compared to other types of crowd behaviour. Our proposed method is computationally cheap and offers real-time description. Evaluating our method using a privately held CCTV dataset and the publicly available Violent Flows, UCF Web Abnormality and UMN Abnormal Crowd datasets, we report a receiver operating characteristic score of 0.9782, 0.9403, 0.8218 and 0.9956, respectively.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.5
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Information Systems

WSCNet: Weakly Supervised Coupled Networks for Visual Sentiment Classification and Detection

Dongyu She, Jufeng Yang, Ming-Ming Cheng, Yu-Kun Lai, Paul L. Rosin, Liang Wang

IEEE TRANSACTIONS ON MULTIMEDIA (2020)

Article Computer Science, Software Engineering

Mesh Saliency via Weakly Supervised Classification-for-Saliency CNN

Ran Song, Yonghuai Liu, Paul L. Rosin

Summary: A novel network trained in a weakly supervised manner, called CfS-CNN, has been developed to solve the difficulty of collecting vertex-level annotation for mesh saliency detection. This network outperforms existing state-of-the-art methods in mesh saliency detection and can be directly applied to scene saliency. Experimental results demonstrate the significant improvement of this approach.

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS (2021)

Article Computer Science, Software Engineering

SHREC'21: Quantifying shape complexity

Mazlum Ferhat Arslan, Alexandros Haridis, Paul L. Rosin, Sibel Tari, Charlotte Brassey, James D. Gardiner, Asli Genctav, Murat Genctav

Summary: This paper presents the results of the SHREC'21 track on quantifying shape complexity. The goal is to evaluate the performance of shape complexity measures and investigate their relationships. The methods are evaluated by computing correlation coefficients between the produced orders and the ground truth. This study provides an improved means for evaluating shape complexity.

COMPUTERS & GRAPHICS-UK (2022)

Article Chemistry, Multidisciplinary

Research on Performance Evaluation and Optimization Theory for Thermal Microscope Imaging Systems

Bozhi Zhang, Meijing Gao, Paul L. Rosin, Xianfang Sun, Qiuyue Chang, Qichong Yan, Yucheng Shang

Summary: This paper studied the performance evaluation and optimization theory of thermal microscope imaging systems, analyzed the differences between thermal microscope imaging and telephoto thermal imaging, derived the signal-to-noise ratio expression, and researched the performance evaluation model. Simulation and experiments on different detectors were carried out, providing reference for the performance evaluation and optimization of thermal microscope imaging systems.

APPLIED SCIENCES-BASEL (2021)

Editorial Material Computer Science, Software Engineering

Foreword to the special issue on 3D object retrieval 2021 workshop (3DOR2021)

Silvia Biasotti, Roberto M. Dyke, Yu-Kun Lai, Paul L. Rosin, Remco Veltkamp

COMPUTERS & GRAPHICS-UK (2022)

Article Computer Science, Artificial Intelligence

Quality Metric Guided Portrait Line Drawing Generation From Unpaired Training Data

Ran Yi, Yong-Jin Liu, Yu-Kun Lai, Paul L. Rosin

Summary: This paper introduces a unique and expressive style of art called face portrait line drawing. To automatically transform face photos into portrait drawings, the authors propose a novel method using unpaired training data and the ability to generate drawings in multiple styles and unseen styles. Through the introduction of a new quality metric and quality loss, the authors address the problem of missing important facial features in existing methods due to information imbalance. Experimental results demonstrate that their method outperforms state-of-the-art methods in portrait drawing generation.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Line Drawings for Face Portraits From Photos Using Global and Local Structure Based GANs

Ran Yi, Mengfei Xia, Yong-Jin Liu, Yu-Kun Lai, Paul L. Rosin

Summary: This paper proposes a composite GAN for transforming face photos to artistic portrait drawings, addressing challenges such as highly abstract styles and different drawing techniques. By introducing novel loss terms and a classification-and-synthesis approach, the method captures the highly abstract art form and improves the line quality. Extensive experiments show that the proposed method outperforms state-of-the-art methods both qualitatively and quantitatively.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2021)

Article Computer Science, Software Engineering

Learning on 3D Meshes With Laplacian Encoding and Pooling

Yi-Ling Qiao, Lin Gao, Jie Yang, Paul L. Rosin, Yu-Kun Lai, Xilin Chen

Summary: This article introduces a deep learning approach to process 3D meshes, which utilizes Laplacian spectral analysis to encode mesh connectivity and employs mesh feature aggregation blocks to gather local and global information. The method outperforms state-of-the-art algorithms in shape segmentation and classification tasks on ShapeNet and COSEG datasets.

IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS (2022)

Article Computer Science, Artificial Intelligence

Cross-validation of a semantic segmentation network for natural history collection specimens

Abraham Nieva de la Hidalga, Paul L. Rosin, Xianfang Sun, Laurence Livermore, James Durrant, James Turner, Mathias Dillen, Alicia Musson, Sarah Phillips, Quentin Groom, Alex Hardisty

Summary: This paper presents a cross-validation approach to evaluate the applicability, adaptability, and portability of a semantic segmentation network in different types of natural history collections and institutions. The proposed method is tested on entomological microscope slides and herbarium sheets, and contributions include a software and ground truth sets for cross-validation.

MACHINE VISION AND APPLICATIONS (2022)

Article Computer Science, Artificial Intelligence

LiTMNet: A deep CNN for efficient HDR image reconstruction from a single LDR image

Guotao Wu, Ran Song, Mingxin Zhang, Xiaolei Li, Paul L. Rosin

Summary: This paper presents a lightweight CNN, called LiTM-Net, which generates high-quality HDR images by recovering information in saturated regions. Compared to existing methods, LiTM-Net achieves faster performance on mobile devices without sacrificing reconstruction quality.

PATTERN RECOGNITION (2022)

Article Environmental Sciences

AMM-FuseNet: Attention-Based Multi-Modal Image Fusion Network for Land Cover Mapping

Wanli Ma, Oktay Karaku, Paul L. Rosin

Summary: Land cover mapping is a widely used technique in remote sensing computational imaging that provides spatial information on various classes of physical properties on the Earth's surface. It plays a crucial role in developing solutions to environmental problems and faces challenges in integrating complementary information from multi-modal remote sensing imagery.

REMOTE SENSING (2022)

Article Computer Science, Information Systems

3D Face Reconstruction and Gaze Tracking in the HMD for Virtual Interaction

Shu-Yu Chen, Yu-Kun Lai, Shihong Xia, Paul L. Rosin, Lin Gao

Summary: With the rapid development of VR technology, the need for bidirectional communication in immersive VR has arisen. This paper introduces a real-time system that can capture and reconstruct 3D faces wearing HMDs, and recover eye gaze effectively. It also proposes a novel method to map eye gaze directions to the 3D virtual world, offering a new interactive mode in VR. The effectiveness of the system is demonstrated through comparison with state-of-the-art techniques and live capture.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Computer Science, Artificial Intelligence

3D Visual Saliency: An Independent Perceptual Measure or a Derivative of 2D Image Saliency?

Ran Song, Wei Zhang, Yitian Zhao, Yonghuai Liu, Paul L. Rosin

Summary: This paper proposes a framework that combines a Generative Adversarial Network and a Conditional Random Field to learn the visual saliency of 3D objects and scenes. The experimental results demonstrate that this method outperforms the existing approaches in predicting human fixations and addresses the research question about 3D visual saliency.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Review Computer Science, Information Systems

A review of image and video colorization: From analogies to deep learning

Shu-Yu Chen, Jia-Qi Zhang, You-You Zhao, Paul L. Rosin, Yu-Kun Lai, Lin Gao

Summary: Image colorization is an important topic in computer graphics, aimed at adding color to monochromatic images. This survey presents the research history and popular algorithms in this field, highlighting recent developments in the combination of colorization with NLP and industrial applications. Various color control techniques, such as reference images and color-scribbles, are designed to improve color manipulation. The taxonomy of colorization methods based on input type (grayscale, sketch-based, and hybrid) is provided, with pros and cons discussed for each algorithm. The impact of deep learning, especially Generative Adversarial Networks (GANs), on this field is also discussed.

VISUAL INFORMATICS (2022)

Article Computer Science, Information Systems

Attention-Modulated Triplet Network for Face Sketch Recognition

Liang Fan, Xianfang Sun, Paul L. Rosin

Summary: In this paper, a novel triplet network with a spatial pyramid pooling layer and an attention model in the image space is proposed for face sketch recognition, achieving better performance on composite face photo-sketch datasets. The proposed solution reduces cross-modality differences between photo and sketch images, improving recognition accuracy by searching similar regions of the images. Particularly, the accuracy is higher than 81% for Set B in the UoM-SGFS dataset.

IEEE ACCESS (2021)

No Data Available