4.7 Article

Layered architecture for real time sign recognition: Hand gesture and movement

Journal

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE
Volume 23, Issue 7, Pages 1216-1228

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.engappai.2010.06.001

Keywords

Machine learning; Sign recognition; Movement recognition; Signal processing; Human machine interface

Ask authors/readers for more resources

Sign and gesture recognition offers a natural way for human-computer interaction. This paper presents a real time sign recognition architecture including both gesture and movement recognition. Among the different technologies available for sign recognition data gloves and accelerometers were chosen for the purposes of this research. Due to the real time nature of the problem, the proposed approach works in two different tiers, the segmentation tier and the classification tier. In the first stage the glove and accelerometer signals are processed for segmentation purposes, separating the different signs performed by the system user. In the second stage the values received from the segmentation tier are classified. In an effort to emphasize the real use of the architecture, this approach deals specially with problems like sensor noise and simplification of the training phase. (C) 2010 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

Problems selection under dynamic selection of the best base classifier in one versus one: PSEUDOVO

Izaro Goienetxea, Inigo Mendialdua, Igor Rodriguez, Basilio Sierra

Summary: Binarization techniques decompose multi-class problems into easier binary sub-problems, with One versus One (OVO) being a popular technique. An extension called PSEUDOVO has been developed to improve the performance of DYNOVO. Empirical studies show promising results for the PSEUDOVO extension.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2021)

Article Chemistry, Analytical

3D Convolutional Neural Networks Initialized from Pretrained 2D Convolutional Neural Networks for Classification of Industrial Parts

Ibon Merino, Jon Azpiazu, Anthony Remazeilles, Basilio Sierra

Summary: In this study, transferring pretrained weights from 2D networks to their corresponding 3D versions improved the performance of 3D deep learning methods. EfficientNetB0 achieved the highest accuracy in industrial object recognition using extrusion, which is comparable to state-of-the art methods.

SENSORS (2021)

Article Chemistry, Analytical

Measurement Time Reduction by Means of Mathematical Modeling of Enzyme Mediated RedOx Reaction in Food Samples Biosensors

Arantzazu Florez, Elena Murga, Itziar Ortiz de Zarate, Arrate Jaureguibeitia, Arkaitz Artetxe, Basilio Sierra

Summary: The use of biosensors in the food industry is increasingly necessary for real-time measurement of different analytes in food. By modeling the kinetic reaction and adjusting an exponential decay model to the biosensor response, a novel mathematical approach is proposed to estimate the measurement output in advance, reducing the required measurement time by about 40% while maintaining low error rates to meet industry accuracy standards.

SENSORS (2021)

Article Computer Science, Information Systems

A Real Application of an Autonomous Industrial Mobile Manipulator within Industrial Context

Jose Luis Outon, Ibon Merino, Ivan Villaverde, Aitor Ibarguren, Hector Herrero, Paul Daelman, Basilio Sierra

Summary: The SHERLOCK project aims to integrate an autonomous industrial mobile manipulator (AIMM) to perform cooperative tasks between a robot and a human. By combining autonomous navigation and 3D perception technology, AIMM achieved pose estimation and manipulation of industrial objects in a real environment with a success rate of 83.33%.

ELECTRONICS (2021)

Article Automation & Control Systems

Adaptive Dendritic Cell-Deep Learning Approach for Industrial Prognosis Under Changing Conditions

Alberto Diez-Olivan, Patxi Ortego, Javier Del Ser, Itziar Landa-Torres, Diego Galar, David Camacho, Basilio Sierra

Summary: Industrial prognosis involves predicting failures of industrial assets based on data collected by IoT sensors, but concept drift can impact the data over time. To address this, contextual and operational changes must be detected and managed to trigger rapid model adaptation mechanisms. The proposed adaptive learning approach using a dendritic cell algorithm and neural network model demonstrated superior performance compared to other drift detectors and classification models in experimental results on a real-world industrial problem.

IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS (2021)

Article Chemistry, Analytical

Path Driven Dual Arm Mobile Co-Manipulation Architecture for Large Part Manipulation in Industrial Environments

Aitor Ibarguren, Paul Daelman

Summary: This paper introduces a path-driven mobile co-manipulation architecture and algorithm for handling collaborative part transportation, allowing the creation of collaborative lanes for conveying large components.

SENSORS (2021)

Article Automation & Control Systems

Efficient large-scale face clustering using an online Mixture of Gaussians

David Montero, Naiara Aginako, Basilio Sierra, Marcos Nieto

Summary: The demand for real-time face clustering algorithms has increased in recent years, especially for security and surveillance purposes. However, current methods are not suitable for real-time applications and online methods are less accurate. To address these limitations, researchers propose an online gaussian mixture-based clustering method (OGMC) that reduces dependency on data order and size and can handle complex data distributions.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2022)

Review Chemistry, Analytical

RANSAC for Robotic Applications: A Survey

Jose Maria Martinez-Otzeta, Itsaso Rodriguez-Moreno, Inigo Mendialdua, Basilio Sierra

Summary: Random Sample Consensus (RANSAC) is a robust estimation method for models contaminated by outliers. It starts with sample selection, evaluates the adequacy of the estimation, and repeats the process until a stopping criterion is met. RANSAC is widely used in robotics, particularly for finding geometric shapes in point clouds or estimating camera view transformations.

SENSORS (2023)

Article Computer Science, Artificial Intelligence

CatSight, a direct path to proper multi-variate time series change detection: perceiving a concept drift through common spatial pattern

Arantzazu Florez, Itsaso Rodriguez-Moreno, Arkaitz Artetxe, Igor Garcia Olaizola, Basilio Sierra

Summary: Detecting changes in data streams is a crucial problem in Industry 4.0. Traditional machine learning algorithms are often static and lack the ability to generalize to new concepts, resulting in a deterioration of predictive performance when there is a change in data distribution. Drift detecting methods offer a solution to identify concept drift in data. This paper introduces CatSight, a new approach for detecting sudden or abrupt drift in industrial processes, which combines Common Spatial Patterns with traditional machine learning algorithms and demonstrates its effectiveness through evaluation on a real use case.

INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS (2023)

Article Engineering, Electrical & Electronic

Semi-Automatic Validation and Verification Framework for CV&AI-Enhanced Railway Signaling and Landmark Detector

Mikel Labayen, Xabier Mendialdua, Naiara Aginako, Basilio Sierra

Summary: The automation of railway operations is growing, but there are no accepted certification rules for computer vision and AI-enhanced perception technologies. To meet the needs for trusted AI solutions, a semi-automatic system based on virtual scenarios is being developed to evaluate performance under different visibility conditions.

IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT (2023)

Article Computer Science, Information Systems

On the Evaluation, Management and Improvement of Data Quality in Streaming Time Series

Meritxell Gomez-Omella, Basilio Sierra, Susana Ferreiro

Summary: The Internet of Things (IoT) technologies play a crucial role in Industry 4.0, digitizing industries and services for enhanced productivity. This research proposes metrics to measure Data Quality (DQ) in streaming time series and implements techniques and tools for monitoring and improving information quality.

IEEE ACCESS (2022)

Article Computer Science, Information Systems

A Hybrid Machine-Learning Ensemble for Anomaly Detection in Real-Time Industry 4.0 Systems

David Velasquez, Enrique Perez, Xabier Oregui, Arkaitz Artetxe, Jorge Manteca, Jordi Escayola Mansilla, Mauricio Toro, Mikel Maiza, Basilio Sierra

Summary: This research proposes a hybrid machine learning model for real-time fault and anomaly detection in industrial systems. The results show that the model performs well in improving anomaly detection.

IEEE ACCESS (2022)

Article Computer Science, Information Systems

A New Approach for Video Action Recognition: CSP-Based Filtering for Video to Image Transformation

Itsaso Rodriguez-Moreno, Jose Maria Martinez-Otzeta, Izaro Goienetxea, Igor Rodriguez, Basilio Sierra

Summary: This paper introduces an approach using CSP algorithm to classify videos based on skeleton joints signals, and ultimately achieve action recognition through image classification techniques. The results of the tests indicate promising outcomes on two data sets.

IEEE ACCESS (2021)

Article Computer Science, Information Systems

A Generic ROS-Based Control Architecture for Pest Inspection and Treatment in Greenhouses Using a Mobile Manipulator

Jon Martin, Ander Ansuategi, Inaki Maurtua, Aitor Gutierrez, David Obregon, Oskar Casquero, Marga Marcos

Summary: In order to meet the increasing demands of a rising population, greenhouses must produce more in a more efficient and sustainable way. Innovative mobile robotic solutions with flexible navigation and manipulation strategies can help monitor fields in real-time, performing early pest detection and selective treatment tasks autonomously. The Robotframework architecture is a generic ROS-based framework that simplifies the development of new robotic applications by easily integrating different modules and skills, demonstrating its benefits in enhancing pest detection and pesticide spraying in greenhouses.

IEEE ACCESS (2021)

Article Computer Science, Theory & Methods

A survey on generative adversarial networks for imbalance problems in computer vision tasks

Vignesh Sampath, Inaki Maurtua, Juan Jose Aguilar Martin, Aitor Gutierrez

Summary: This article discusses the importance of image and data acquisition, preprocessing, and pattern recognition in computer vision application development. Particularly, the occurrence of imbalance issues in complex real-world problems is inevitable. Research shows that techniques based on GANs are able to address these imbalances effectively and boost the performance of computer vision algorithms.

JOURNAL OF BIG DATA (2021)

Article Automation & Control Systems

Walk as you feel: Privacy preserving emotion recognition from gait patterns

Carmen Bisogni, Lucia Cimmino, Michele Nappi, Toni Pannese, Chiara Pero

Summary: This paper presents a gait-based emotion recognition method that does not rely on facial cues, achieving competitive performance on small and unbalanced datasets. The proposed approach utilizes advanced deep learning architecture and achieves high recognition and accuracy rates.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Satellite constellation method for ground targeting optimized with K-means clustering and genetic algorithm

Soung Sub Lee

Summary: This study proposed a satellite constellation method that utilizes machine learning and customized repeating ground track orbits to optimize satellite revisit performance for each target.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A method of user recruitment and adaptation degree improvement via community collaboration in sparse mobile crowdsensing systems

Jian Wang, Xiuying Zhan, Yuping Yan, Guosheng Zhao

Summary: This paper proposes a method of user recruitment and adaptation degree improvement via community collaboration to solve the task allocation problem in sparse mobile crowdsensing. By matching social relationships and perception task characteristics, the entire perceptual map can be accurately inferred.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Robotic assembly control reconfiguration based on transfer reinforcement learning for objects with different geometric features

Yuhang Gai, Bing Wang, Jiwen Zhang, Dan Wu, Ken Chen

Summary: This paper investigates how to reconfigure existing compliance controllers for new assembly objects with different geometric features. By using the proposed Equivalent Theory of Compliance Law (ETCL) and Weighted Dimensional Policy Distillation (WDPD) method, the learning cost can be reduced and better control performance can be achieved.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Progress and prospects of future urban health status prediction

Zhihao Xu, Zhiqiang Lv, Benjia Chu, Zhaoyu Sheng, Jianbo Li

Summary: Predicting future urban health status is crucial for identifying urban diseases and planning cities. By applying an improved meta-analysis approach and considering the complexity of cities as systems, this study selects eight urban factors and explores suitable prediction methods for these factors.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A localized decomposition evolutionary algorithm for imbalanced multi-objective optimization

Yulong Ye, Qiuzhen Lin, Ka-Chun Wong, Jianqiang Li, Zhong Ming, Carlos A. Coello Coello

Summary: This paper proposes a localized decomposition evolutionary algorithm (LDEA) to tackle imbalanced multi-objective optimization problems (MOPs). LDEA assigns a local region for each subproblem using a localized decomposition method and restricts the solution update within the region to maintain diversity. It also speeds up convergence by evolving only the best-associated solution in each subproblem while balancing the population's diversity.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

LDD-Net: Lightweight printed circuit board defect detection network fusing multi-scale features

Longxin Zhang, Jingsheng Chen, Jianguo Chen, Zhicheng Wen, Xusheng Zhou

Summary: This study proposes a lightweight PCB image defect detection network (LDD-Net) that achieves high accuracy by designing a novel lightweight feature extraction network, multi-scale aggregation network, and lightweight decoupling head. Experimental results show that LDD-Net outperforms state-of-the-art models in terms of accuracy, computation, and detection speed, making it suitable for edge systems or resource-constrained embedded devices.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Adaptive stable backstepping controller based on support vector regression for nonlinear systems

Kemal Ucak, Gulay Oke Gunel

Summary: This paper introduces a novel adaptive stable backstepping controller based on support vector regression for nonlinear dynamical systems. The controller utilizes SVR to identify the dynamics of the nonlinear system and integrates stable BSC behavior. The experimental results demonstrate successful control performance for both nonlinear systems.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A non-dominated sorting genetic algorithm III using competition crossover and opposition-based learning for the optimal dispatch of the combined cooling, heating, and power system with photovoltaic thermal collector

Dexuan Zou, Mengdi Li, Haibin Ouyang

Summary: In this study, a photovoltaic thermal collector is integrated into a combined cooling, heating, and power system to reduce primary energy consumption, operation cost, and carbon dioxide emission. By applying a novel genetic algorithm and constraint handling approach, it is found that the CCHP scenarios with PV/T are more efficient and achieve the lowest energy consumption.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Identification and optimization of material constitutive equations using genetic algorithms

Abhinav Pandey, Litton Bhandari, Vidit Gaur

Summary: This research proposes a novel model-agnostic framework based on genetic algorithms to identify and optimize the set of coefficients of the constitutive equations of engineering materials. The framework demonstrates solution convergence, scalability, and high explainability for a wide range of engineering materials. The experimental validation shows that the proposed framework outperforms commercially available software in terms of optimization efficiency.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A generalized visibility graph algorithm for analyzing biological time series having rotation in polar plane

Zahra Ramezanpoor, Adel Ghazikhani, Ghasem Sadeghi Bajestani

Summary: Time series analysis is a method used to analyze phenomena with temporal measurements. Visibility graphs are a technique for representing and analyzing time series, particularly when dealing with rotations in the polar plane. This research proposes a visibility graph algorithm that efficiently handles biological time series with rotation in the polar plane. Experimental results demonstrate the effectiveness of the proposed algorithm in both synthetic and real world time series.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Mutual dimensionless improved bearing fault diagnosis based on Bp-increment broad learning system in computer vision

ChunLi Li, Qintai Hu, Shuping Zhao, Jigang Wu, Jianbin Xiong

Summary: Efficient and accurate diagnosis of rotating machinery in the petrochemical industry is crucial. However, the nonlinear and non-stationary vibration signals generated in harsh environments pose challenges in distinguishing fault signals from normal ones. This paper proposes a BP-Incremental Broad Learning System (BP-INBLS) model to address these challenges. The effectiveness of the proposed method in fault diagnosis is demonstrated through validation and comparative analysis with a published method.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

Influence of cost/loss functions on classification rate: A comparative study across diverse classifiers and domains

Fatemeh Chahkoutahi, Mehdi Khashei

Summary: The classification rate is the most important factor in selecting an appropriate classification approach. In this paper, the influence of different cost/loss functions on the classification rate of different classifiers is compared, and empirical results show that cost/loss functions significantly affect the classification rate.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Article Automation & Control Systems

A partition-based problem transformation algorithm for classifying imbalanced multi-label data

Jicong Duan, Xibei Yang, Shang Gao, Hualong Yu

Summary: The study proposes a novel partition-based imbalanced multi-label learning algorithm, MLHC, which divides the original label space into disconnected subspaces using hierarchical clustering. It successfully tackles the class imbalance problem in multi-label data and outperforms other class imbalance multi-label learning algorithms.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)

Review Automation & Control Systems

A review of retinal vessel segmentation for fundus image analysis

Qing Qin, Yuanyuan Chen

Summary: This paper offers a comprehensive review of retinal vessel automatic segmentation research, including both traditional methods and deep learning methods. In particular, supervised learning methods are summarized and analyzed based on CNN, GAN, and UNet. The advantages and disadvantages of existing segmentation methods are also outlined.

ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE (2024)