4.7 Article

Intelligent surveillance of indoor environments based on computer vision and 3D point cloud fusion

Journal

EXPERT SYSTEMS WITH APPLICATIONS
Volume 42, Issue 21, Pages 8156-8171

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.eswa.2015.06.026

Keywords

Intelligent Surveillance System; Sensor fusion; Computer vision; 3D point cloud; Intruder detection

Funding

  1. Spanish Government through the CICYT projects [TRA2013-48314-C3-1-R, TRA2011-29454-C03-02]

Ask authors/readers for more resources

A real-time detection algorithm for intelligent surveillance is presented. The system, based on 3D change detection with respect to a complex scene model, allows intruder monitoring and detection of added and missing objects, under different illumination conditions. The proposed system has two independent stages. First, a mapping application provides an accurate 3D wide model of the scene, using a view registration approach. This registration is based on computer vision and 3D point cloud. Fusion of visual features with 3D descriptors is used in order to identify corresponding points in two consecutive views. The matching of these two views is first estimated by a pre-alignment stage, based on the tilt movement of the sensor, later they are accurately aligned by an Iterative Closest Point variant (Levenberg-Marquardt ICP), which performance has been improved by a previous filter based on geometrical assumptions. The second stage provides accurate intruder and object detection by means of a 3D change detection approach, based on Octree volumetric representation, followed by a clusters analysis. The whole scene is continuously scanned, and every captured is compared with the corresponding part of the wide model thanks to the previous analysis of the sensor movement parameters. With this purpose a tilt-axis calibration method has been developed. Tests performed show the reliable performance of the system under real conditions and the improvements provided by each stage independently. Moreover, the main goal of this application has been enhanced, for reliable intruder detection by the tilting of the sensors using its built-in motor to increase the size of the monitored area. (C) 2015 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Hierarchical generator of tracking global hypotheses

Maria Jose Gomez-Silva, Arturo de la Escalera, Jose Maria Armingol

Summary: This article proposes a hierarchical method for generating tracking global hypotheses to address the difficulties of multi-object tracking in complex scenarios. By dividing the data association process into different levels and properly combining various affinity metrics, the method can generate a global hypothesis that describes the assignment of identities and handle new individuals entering the scene.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Article Engineering, Civil

Automatic Extrinsic Calibration Method for LiDAR and Camera Sensor Setups

Jorge Beltran, Carlos Guindel, Arturo de la Escalera, Fernando Garcia

Summary: Most sensor setups for onboard autonomous perception consist of LiDARs and vision systems, and an accurate calibration between the sensors is required. We propose a method to calibrate the extrinsic parameters of any pair of sensors, which can handle devices with different resolutions and poses, and outperforms existing methods.

IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS (2022)

Article Computer Science, Artificial Intelligence

A Kalman Variational Autoencoder Model Assisted by Odometric Clustering for Video Frame Prediction and Anomaly Detection

Giulia Slavic, Abrham Shiferaw Alemaw, Lucio Marcenaro, David Martin Gomez, Carlo Regazzoni

Summary: This paper proposes a method for video-frame prediction and anomaly detection in autonomous vehicles using a Dynamic Bayesian Network framework and Deep Learning methods. The method leverages multi-modal information from different sensors and learns an appropriate latent space. The evaluation shows that this method can effectively detect abnormal behaviors in a closed environment.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2023)

Article Computer Science, Artificial Intelligence

An improved deep learning architecture for multi-object tracking systems

Jesus Urdiales, David Martin, Jose Maria Armingol

Summary: This paper presents a tracking system based on the Kalman filter that uses a deep learning approach to the association problem. The proposed architecture consists of three neural networks for feature extraction, similarity calculation, and information extraction. The model follows the tracking-by-detection paradigm and has been trained to handle missed observations and reduce identity switches.

INTEGRATED COMPUTER-AIDED ENGINEERING (2023)

Review Computer Science, Artificial Intelligence

Semantic segmentation based on Deep learning for the detection of Cyanobacterial Harmful Algal Blooms (CyanoHABs) using synthetic images

Fredy Barrientos-Espillco, Esther Gasco, Clara I. Lopez-Gonzalez, Maria J. Gomez-Silva, Gonzalo Pajares

Summary: Cyanobacterial Harmful Algal Blooms (CyanoHABs) in lakes and reservoirs have increased due to environmental factors, making early detection crucial. Autonomous Surface Vehicles (ASVs) equipped with machine vision systems can be a useful alternative. This study proposes an image Semantic Segmentation approach based on Deep Learning with Convolutional Neural Networks (CNNs) to detect CyanoHABs from an ASV perspective.

APPLIED SOFT COMPUTING (2023)

Article Energy & Fuels

Proximal Policy Optimization for Energy Management of Electric Vehicles and PV Storage Units

Monica Alonso, Hortensia Amaris, David Martin, Arturo de la Escalera

Summary: Connected autonomous electric vehicles (CAEVs) play a crucial role in the decarbonization of the transport sector and are integral to home energy management systems (HEMSs) alongside PV units and battery energy storage systems. However, uncertainties associated with CAEVs pose challenges to HEMSs, such as uncertain arrival and departure times, unknown battery states of charge, and variable PV production. A proposed HEMS based on proximal policy optimization (PPO) addresses these challenges through deep reinforcement learning. Simulation results demonstrate that the PPO algorithm outperforms conventional methods, achieving a significant daily energy cost reduction.

ENERGIES (2023)

Article Chemistry, Analytical

Reinforcement Learning Algorithms for Autonomous Mission Accomplishment by Unmanned Aerial Vehicles: A Comparative View with DQN, SARSA and A2C

Gonzalo Aguilar Jimenez, Arturo de la Escalera Hueso, Maria J. Gomez-Silva

Summary: This article compares the performances of three reinforcement learning algorithms in UAV navigation and finds that DQN achieves the best target completion, while SARSA and A2C algorithms perform poorly. However, further analysis shows that fine-tuning A2C can surpass the performance of DQN under certain conditions.

SENSORS (2023)

Article Chemistry, Analytical

Battery-SOC Estimation for Hybrid-Power UAVs Using Fast-OCV Curve with Unscented Kalman Filters

Zhuoyao He, David Martin Gomez, Arturo de la Escalera Hueso, Pablo Flores Pena, Xingcai Lu, Jose Maria Armingol Moreno

Summary: Unmanned aerial vehicles (UAVs) face limitations in flight endurance due to the limited energy density of their batteries. This paper proposes a novel method, fast open circuit voltage (OCV), for obtaining battery OCVs, which offers advantages in simplicity, duration, and cost over traditional methods. Additionally, a batch mode is proposed for data sampling and battery-parameter identification, which effectively reduces noise compared to the single mode approach.

SENSORS (2023)

Article Computer Science, Artificial Intelligence

Neural Architectures for Feature Embedding in Person Re-Identification: A Comparative View

Javier Dominguez-Martin, Maria J. Gomez-Silva, Arturo De La Escalera

Summary: This article explores the challenge of solving Person Re-Identification (Re-Id) through Deep Convolutional Neural Networks, particularly in the case of limited training data. Different neural architectures, trained using a Triplet Model, are evaluated on two challenging Single-Shot Re-Id datasets, PRID2011 and CUHK. The results suggest that Inception-ResNet and DenseNet are potentially useful models for Re-Id tasks.

ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY (2023)

Article Radiology, Nuclear Medicine & Medical Imaging

Artificial Intelligence Techniques for Automatic Detection of Peri-implant Marginal Bone Remodeling in Intraoral Radiographs

Maria Vera, Maria Jose Gomez-Silva, Vicente Vera, Clara I. Lopez-Gonzalez, Ignacio Aliaga, Esther Gasco, Vicente Vera-Gonzalez, Maria Pedrera-Canal, Eva Besada-Portas, Gonzalo Pajares

Summary: An automatic image processing approach based on deep learning and image understanding techniques has been developed to assist dentists in determining bone loss around dental implants. The approach uses a deep learning object detector to roughly identify implants and crowns, and an image understanding process to optimize lines and detect significant points on screw edges. The performance evaluation shows satisfactory results in detecting bone loss.

JOURNAL OF DIGITAL IMAGING (2023)

Proceedings Paper Robotics

Deep Learning for Robust Vehicle Identification

Alvaro Ramajo Ballester, Jacobo Gonzalez Cepeda, Jose Maria Armingol Moreno

Summary: The high precision of deep neural networks in visual perception tasks has the potential to extract important information from the environment, benefiting projects like autonomous vehicles and smart cities. This study aims to explore the latest methods and develop a system that efficiently solves two tasks: vehicle visual characterization and re-identification, and license plate segmentation and character recognition. A custom dataset is created to test and validate the system, bridging the gap between lab and real-world environments.

ROBOT2022: FIFTH IBERIAN ROBOTICS CONFERENCE: ADVANCES IN ROBOTICS, VOL 1 (2023)

Review Computer Science, Artificial Intelligence

A comprehensive review of slope stability analysis based on artificial intelligence methods

Wei Gao, Shuangshuang Ge

Summary: This study provides a comprehensive review of slope stability research based on artificial intelligence methods, focusing on slope stability computation and evaluation. The review covers studies using quasi-physical intelligence methods, simulated evolutionary methods, swarm intelligence methods, hybrid intelligence methods, artificial neural network methods, vector machine methods, and other intelligence methods. The merits, demerits, and state-of-the-art research advancement of these studies are analyzed, and possible research directions for slope stability investigation based on artificial intelligence methods are suggested.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Machine learning approaches for lateral strength estimation in squat shear walls: A comparative study and practical implications

Khuong Le Nguyen, Hoa Thi Trinh, Saeed Banihashemi, Thong M. Pham

Summary: This study investigated the influence of input parameters on the shear strength of RC squat walls and found that ensemble learning models, particularly XGBoost, can effectively predict the shear strength. The axial load had a greater influence than reinforcement ratio, and longitudinal reinforcement had a more significant impact compared to horizontal and vertical reinforcement. The performance of XGBoost model outperforms traditional design models and reducing input features still yields reliable predictions.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

DHESN: A deep hierarchical echo state network approach for algal bloom prediction

Bo Hu, Huiyan Zhang, Xiaoyi Wang, Li Wang, Jiping Xu, Qian Sun, Zhiyao Zhao, Lei Zhang

Summary: A deep hierarchical echo state network (DHESN) is proposed to address the limitations of shallow coupled structures. By using transfer entropy, candidate variables with strong causal relationships are selected and a hierarchical reservoir structure is established to improve prediction accuracy. Simulation results demonstrate that DHESN performs well in predicting algal bloom.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Learning high-dependence Bayesian network classifier with robust topology

Limin Wang, Lingling Li, Qilong Li, Kuo Li

Summary: This paper discusses the urgency of learning complex multivariate probability distributions due to the increase in data variability and quantity. It introduces a highly scalable classifier called TAN, which utilizes maximum weighted spanning tree (MWST) for graphical modeling. The paper theoretically proves the feasibility of extending one-dependence MWST to model high-dependence relationships and proposes a heuristic search strategy to improve the fitness of the extended topology to data. Experimental results demonstrate that this algorithm achieves a good bias-variance tradeoff and competitive classification performance compared to other high-dependence or ensemble learning algorithms.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Make a song curative: A spatio-temporal therapeutic music transfer model for anxiety reduction

Zhejing Hu, Gong Chen, Yan Liu, Xiao Ma, Nianhong Guan, Xiaoying Wang

Summary: Anxiety is a prevalent issue and music therapy has been found effective in reducing anxiety. To meet the diverse needs of individuals, a novel model called the spatio-temporal therapeutic music transfer model (StTMTM) is proposed.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

A modified reverse-based analysis logic mining model with Weighted Random 2 Satisfiability logic in Discrete Hopfield Neural Network and multi-objective training of Modified Niched Genetic Algorithm

Nur Ezlin Zamri, Mohd. Asyraf Mansor, Mohd Shareduwan Mohd Kasihmuddin, Siti Syatirah Sidik, Alyaa Alway, Nurul Atiqah Romli, Yueling Guo, Siti Zulaikha Mohd Jamaludin

Summary: In this study, a hybrid logic mining model was proposed by combining the logic mining approach with the Modified Niche Genetic Algorithm. This model improves the generalizability and storage capacity of the retrieved induced logic. Various modifications were made to address other issues. Experimental results demonstrate that the proposed model outperforms baseline methods in terms of accuracy, precision, specificity, and correlation coefficient.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

On taking advantage of opportunistic meta-knowledge to reduce configuration spaces for automated machine learning

David Jacob Kedziora, Tien-Dung Nguyen, Katarzyna Musial, Bogdan Gabrys

Summary: The paper addresses the problem of efficiently optimizing machine learning solutions by reducing the configuration space of ML pipelines and leveraging historical performance. The experiments conducted show that opportunistic/systematic meta-knowledge can improve ML outcomes, and configuration-space culling is optimal when balanced. The utility and impact of meta-knowledge depend on various factors and are crucial for generating informative meta-knowledge bases.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Optimal location for an EVPL and capacitors in grid for voltage profile and power loss: FHO-SNN approach

G. Sophia Jasmine, Rajasekaran Stanislaus, N. Manoj Kumar, Thangamuthu Logeswaran

Summary: In the context of a rapidly expanding electric vehicle market, this research investigates the ideal locations for EV charging stations and capacitors in power grids to enhance voltage stability and reduce power losses. A hybrid approach combining the Fire Hawk Optimizer and Spiking Neural Network is proposed, which shows promising results in improving system performance. The optimization approach has the potential to enhance the stability and efficiency of electric grids.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

NLP-based approach for automated safety requirements information retrieval from project documents

Zhijiang Wu, Guofeng Ma

Summary: This study proposes a natural language processing-based framework for requirement retrieval and document association, which can help to mine and retrieve documents related to project managers' requirements. The framework analyzes the ontology relevance and emotional preference of requirements. The results show that the framework performs well in terms of iterations and threshold, and there is a significant matching between the retrieved documents and the requirements, which has significant managerial implications for construction safety management.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Dog nose-print recognition based on the shape and spatial features of scales

Yung-Kuan Chan, Chuen-Horng Lin, Yuan-Rong Ben, Ching-Lin Wang, Shu-Chun Yang, Meng-Hsiun Tsai, Shyr-Shen Yu

Summary: This study proposes a novel method for dog identification using nose-print recognition, which can be applied to controlling stray dogs, locating lost pets, and pet insurance verification. The method achieves high recognition accuracy through two-stage segmentation and feature extraction using a genetic algorithm.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Fostering supply chain resilience for omni-channel retailers: A two-phase approach for supplier selection and demand allocation under disruption risks

Shaohua Song, Elena Tappia, Guang Song, Xianliang Shi, T. C. E. Cheng

Summary: This study aims to optimize supplier selection and demand allocation decisions for omni-channel retailers in order to achieve supply chain resilience. It proposes a two-phase approach that takes into account various factors such as supplier evaluation and demand allocation.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Accelerating Benders decomposition approach for shared parking spaces allocation considering parking unpunctuality and no-shows

Jinyan Hu, Yanping Jiang

Summary: This paper examines the allocation problem of shared parking spaces considering parking unpunctuality and no-shows. It proposes an effective approach using sample average approximation (SAA) combined with an accelerating Benders decomposition (ABD) algorithm to solve the problem. The numerical experiments demonstrate the significance of supply-demand balance for the operation and user satisfaction of the shared parking system.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Review Computer Science, Artificial Intelligence

Financial fraud detection using graph neural networks: A systematic review

Soroor Motie, Bijan Raahemi

Summary: Financial fraud is a persistent problem in the finance industry, but Graph Neural Networks (GNNs) have emerged as a powerful tool for detecting fraudulent activities. This systematic review provides a comprehensive overview of the current state-of-the-art technologies in using GNNs for financial fraud detection, identifies gaps and limitations in existing research, and suggests potential directions for future research.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Review Computer Science, Artificial Intelligence

Occluded person re-identification with deep learning: A survey and perspectives

Enhao Ning, Changshuo Wang, Huang Zhang, Xin Ning, Prayag Tiwari

Summary: This review provides a detailed overview of occluded person re-identification methods and conducts a systematic analysis and comparison of existing deep learning-based approaches. It offers important theoretical and practical references for future research in the field.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

A hierarchical attention detector for bearing surface defect detection

Jiajun Ma, Songyu Hu, Jianzhong Fu, Gui Chen

Summary: The article presents a novel visual hierarchical attention detector for multi-scale defect location and classification, utilizing texture, semantic, and instance features of defects through a hierarchical attention mechanism, achieving multi-scale defect detection in bearing images with complex backgrounds.

EXPERT SYSTEMS WITH APPLICATIONS (2024)