4.7 Article

Sensitive deep convolutional neural network for face recognition at large standoffs with small dataset

期刊

EXPERT SYSTEMS WITH APPLICATIONS
卷 87, 期 -, 页码 304-315

出版社

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.eswa.2017.06.025

关键词

Convolutional neural network; Gradient descent; Input-output mapping sensitivity error back; propagation; Face recognition at long distances with; small dataset; Sensitivity in cost function; Deep neural structures

资金

  1. ICT R&D program of MSIP/IITP [R7124-16-0004]
  2. National Research Foundation of Korea (NRF) - Korea government (MSIP) [NRF-2016M3C1B6929647]
  3. Institute for Information & Communication Technology Planning & Evaluation (IITP), Republic of Korea [R7124-16-0004] Funding Source: Korea Institute of Science & Technology Information (KISTI), National Science & Technology Information Service (NTIS)

向作者/读者索取更多资源

In this paper, we propose a sensitive convolutional neural network which incorporates sensitivity term in the cost function of Convolutional Neural Network (CNN) to emphasize on the slight variations and high frequency components in highly blurred input image samples. The proposed cost function in CNN has a sensitivity part in which the conventional error is divided by the derivative of the activation function, and subsequently the total error is minimized by the gradient descent method during the learning process. Due to the proposed sensitivity term, the data samples at the decision boundaries appear more on the middle band or the high gradient part of the activation function. This highlights the slight changes in the highly blurred input images enabling better feature extraction resulting in better generalization and improved classification performance in the highly blurred images. To study the effect of the proposed sensitivity term, experiments were performed for the face recognition task on small dataset of facial images at different long standoffs in both night-time and day-time modalities. (c) 2017 Elsevier Ltd. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Mathematics

Optimization-Based Energy Disaggregation: A Constrained Multi-Objective Approach

Jeewon Park, Oladayo S. Ajani, Rammohan Mallipeddi

Summary: Recently, optimization-based energy disaggregation algorithms have gained significance as they require less data for training compared to pattern-based algorithms. However, the performance of these algorithms depends on the problem formulation, including objective functions and constraints. In this study, the energy disaggregation problem is formulated as a constrained multi-objective problem and solved using a constrained multi-objective evolutionary algorithm. The proposed formulation is compared to three high-performing formulations in the literature, and the results show improvements in both appliance-level and overall energy disaggregation.

MATHEMATICS (2023)

Article Computer Science, Artificial Intelligence

Adaptive mating selection based on weighted indicator for Multi/Many-objective evolutionary algorithm

Saykat Dutta, M. Sri Srinivasa Raju, Rammohan Mallipeddi, Kedar Nath Das

Summary: This paper proposes a decomposition-based multi-objective optimization algorithm that effectively solves problems with discontinuous or degenerated Pareto fronts. It also introduces an adaptive mating selection strategy to further improve the algorithm's performance.

APPLIED SOFT COMPUTING (2023)

Article Computer Science, Artificial Intelligence

Spherical Search based constrained optimization algorithm for power flow analysis of islanded microgrids

Abhishek Kumar, Bablesh Kumar Jha, Swagatam Das, Rammohan Mallipeddi

Summary: Conventional power flow algorithms are ineffective in droop-regulated islanded microgrids due to inaccurate assumptions about constant slack bus voltage and system operating frequency. This study proposes a novel constrained optimization formulation to solve the power flow problem in islanded microgrids, considering non-linear and linear constraints for power balance and various modes of Distributed Generation units. The proposed optimization algorithm, called SS-NR (Spherical Search with Newton-Raphson based repair), outperforms state-of-the-art algorithms in convergence and accuracy, as demonstrated through experimental comparisons and validation with other power flow tools.

APPLIED SOFT COMPUTING (2023)

Article Computer Science, Artificial Intelligence

Adversarial Lagrangian integrated contrastive embedding for limited size datasets

Amin Jalali, Minho Lee

Summary: This study proposes an adversarial Lagrangian integrated contrastive embedding (ALICE) method for small-sized datasets. The method demonstrates improved accuracy and training convergence through pre-trained adversarial transfer. It also investigates an adversarial integrated contrastive model with various augmentation techniques and incorporates multi-objective augmented Lagrangian multipliers to encourage low-rank and sparsity.

NEURAL NETWORKS (2023)

Article Plant Sciences

A genetic programming-based optimal sensor placement for greenhouse monitoring and control

Oladayo S. Ajani, Esther Aboyeji, Rammohan Mallipeddi, Daniel Dooyum Uyeh, Yushin Ha, Tusan Park

Summary: Optimal sensor location methods are crucial for achieving a sensor profile that meets pre-defined performance criteria and minimal cost. This study presents a genetic programming-based optimal sensor placement approach for greenhouse monitoring and control, starting with a reference micro-climate condition obtained by aggregating measurements from 56 sensors. The results demonstrate high correlations and low error values, indicating the effectiveness of the proposed model.

FRONTIERS IN PLANT SCIENCE (2023)

Article Computer Science, Artificial Intelligence

CMA-ES with exponential based multiplicative covariance matrix adaptation for global optimization

Bishal Karmakar, Abhishek Kumar, Rammohan Mallipeddi, Dong-Gyu Lee

Summary: CMA-ES is an effective evolutionary algorithm for solving complex optimization problems, but it suffers from the computational burden of unstable matrix decomposition. This paper proposes an improved evolution path by using first-order exponential approximation to replace the costly covariance matrix decomposition, and incorporating the Heaviside function for mutation matrix update to control mutation step size. The proposed xSCMA-ES framework outperforms existing CMA-ES algorithms on various benchmark tests and a hybrid active power filter design problem in minimizing harmonic distortions.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Article Engineering, Electrical & Electronic

Predicting the Refrigerant Amounts Across Air Conditioners With a Domain Adaptive Lightweight Transformer

Kyoungho Hwang, Junwon Lee, Amin Jalali, Minho Lee

Summary: Air conditioner consumers expect their products to work well without any problem. Consumers encounter problems if the amount of refrigerant in the air conditioner is insufficient. Therefore, we propose a novel deep learning approach that predicts the amount of refrigerant in advance. Our approach differs from others, as it is not limited to specific types of air conditioners and is applicable to all types.

IEEE TRANSACTIONS ON CONSUMER ELECTRONICS (2023)

Article Computer Science, Artificial Intelligence

Spherical search with epsilon constraint and gradient-based repair framework for constrained optimization

Zhuji Yang, Abhishek Kumar, Rammohan Mallipeddi, Dong-Gyu Lee

Summary: This paper presents the Spherical Search (SS) algorithm based on hyper spherical search methodology, and extends its application to constrained optimization problems. The results show that this algorithm has good exploration capability for solving constrained problems and performs better than other algorithms on multiple test problems.

SWARM AND EVOLUTIONARY COMPUTATION (2023)

Review Green & Sustainable Science & Technology

Enhancing resilience in agricultural production systems with AI-based technologies

Member Joy Usigbe, Senorpe Asem-Hiablie, Daniel Dooyum Uyeh, Olayinka Iyiola, Tusan Park, Rammohan Mallipeddi

Summary: Agricultural production systems play a crucial role in providing the world's food, fuel, and fiber supplies. Modern technologies powered by artificial intelligence (AI) can help address challenges such as climate change and resource depletion. This comprehensive review explores the potential of AI-based technologies in enhancing resilience, sustainability, and climate-smart agriculture in agricultural production systems.

ENVIRONMENT DEVELOPMENT AND SUSTAINABILITY (2023)

Article Mathematics

Greenhouse Micro-Climate Prediction Based on Fixed Sensor Placements: A Machine Learning Approach

Oladayo S. Ajani, Member Joy Usigbe, Esther Aboyeji, Daniel Dooyum Uyeh, Yushin Ha, Tusan Park, Rammohan Mallipeddi

Summary: This paper proposes a method to predict micro-climates by using fixed location sensors, avoiding the cost and inconvenience of moving sensors, and achieves a high level of correlation.

MATHEMATICS (2023)

Article Computer Science, Artificial Intelligence

Encoder-decoder cycle for visual question answering based on perception-action cycle

Safaa Abdullahi Moallim Mohamud, Amin Jalali, Minho Lee

Summary: In this study, a novel encoder-decoder cycle (EDC) framework is proposed for tackling challenging problems such as visual question answering (VQA) and visual relationship detection (VRD). EDC is inspired by the perception-action cycle in human learning process and considers the understanding of visual features as perception and answering questions as an action. The framework mimics the mechanism of introspection by comprehending and refining visual features and performs cyclic decoding of visual and language features to generate answer features. Evaluation on multiple datasets demonstrates the superiority of the proposed framework over state-of-the-art models.

PATTERN RECOGNITION (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Intelligent Optimization Algorithms for Disruptive Anti-covering Location Problem

Edukondalu Chappidi, Alok Singh, Rammohan Mallipeddi

Summary: Given a set of potential sites, the DACLP aims to find the minimum number of facilities that can be located on these sites while maintaining a minimum distance requirement between them. This problem is closely related to the ACLP, which seeks to maximize the number of facilities with the same distance requirement. The DACLP is an NP-hard problem and has significant implications in various real-world applications. In this paper, two intelligent optimization approaches, GA and DDE, are proposed as the first heuristics to solve the DACLP, and their effectiveness is demonstrated through extensive testing.

DISTRIBUTED COMPUTING AND INTELLIGENT TECHNOLOGY, ICDCIT 2023 (2023)

Article Thermodynamics

A Cogeneration-Coupled energy storage system utilizing hydrogen and methane-fueled CAES and ORC with ambient temperature consideration enhanced by artificial neural Network, and Multi-Objective optimization

Ehsanolah Assareh, Seyed Sajad Mousavi Asl, Neha Agarwal, Mehrdad Ahmadinejad, Amin Jalali, Moonyong Lee

Summary: This paper presents a thermodynamics modeling, economic assessment, and optimization of a multigenerational module that utilizes compressed-air energy storing and polymer electrolyte membrane electrolysis with methane and hydrogen fuels, with a case study focused on Munich, Germany. The researchers selected the optimal scenario and evaluated the performance and cost of the module using multi-objective optimization.

THERMAL SCIENCE AND ENGINEERING PROGRESS (2023)

Article Computer Science, Information Systems

Two-Phase Evolutionary Convolutional Neural Network Architecture Search for Medical Image Classification

Arjun Ghosh, Nanda Dulal Jana, Swagatam Das, Rammohan Mallipeddi

Summary: This study proposes a two-phase evolutionary framework, TPEvo-CNN, for automatically designing CNN models for medical image classification. The framework utilizes differential evolution to determine the number of layers of the CNN architecture and genetic algorithm to fine-tune the hyperparameters. Experimental results demonstrate the superiority of the proposed framework in medical image classification tasks compared to existing CNN models.

IEEE ACCESS (2023)

Article Computer Science, Information Systems

Multi-level alignment for few-shot temporal action localization

Kanchan Keisham, Amin Jalali, Jonghong Kim, Minho Lee

Summary: This study proposes a new few-shot learning method for temporal action localization in long videos. The method utilizes a multi-level encoder cosine-similarity alignment module to capture the alignment of visual information, and incorporates cosine similarity in Transformer encoder layers to emphasize refined features. By adopting an episodic-based training scheme, it learns the alignment of similar video snippets and adapts to novel classes at test time.

INFORMATION SCIENCES (2023)

Review Computer Science, Artificial Intelligence

A comprehensive review of slope stability analysis based on artificial intelligence methods

Wei Gao, Shuangshuang Ge

Summary: This study provides a comprehensive review of slope stability research based on artificial intelligence methods, focusing on slope stability computation and evaluation. The review covers studies using quasi-physical intelligence methods, simulated evolutionary methods, swarm intelligence methods, hybrid intelligence methods, artificial neural network methods, vector machine methods, and other intelligence methods. The merits, demerits, and state-of-the-art research advancement of these studies are analyzed, and possible research directions for slope stability investigation based on artificial intelligence methods are suggested.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Machine learning approaches for lateral strength estimation in squat shear walls: A comparative study and practical implications

Khuong Le Nguyen, Hoa Thi Trinh, Saeed Banihashemi, Thong M. Pham

Summary: This study investigated the influence of input parameters on the shear strength of RC squat walls and found that ensemble learning models, particularly XGBoost, can effectively predict the shear strength. The axial load had a greater influence than reinforcement ratio, and longitudinal reinforcement had a more significant impact compared to horizontal and vertical reinforcement. The performance of XGBoost model outperforms traditional design models and reducing input features still yields reliable predictions.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

DHESN: A deep hierarchical echo state network approach for algal bloom prediction

Bo Hu, Huiyan Zhang, Xiaoyi Wang, Li Wang, Jiping Xu, Qian Sun, Zhiyao Zhao, Lei Zhang

Summary: A deep hierarchical echo state network (DHESN) is proposed to address the limitations of shallow coupled structures. By using transfer entropy, candidate variables with strong causal relationships are selected and a hierarchical reservoir structure is established to improve prediction accuracy. Simulation results demonstrate that DHESN performs well in predicting algal bloom.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Learning high-dependence Bayesian network classifier with robust topology

Limin Wang, Lingling Li, Qilong Li, Kuo Li

Summary: This paper discusses the urgency of learning complex multivariate probability distributions due to the increase in data variability and quantity. It introduces a highly scalable classifier called TAN, which utilizes maximum weighted spanning tree (MWST) for graphical modeling. The paper theoretically proves the feasibility of extending one-dependence MWST to model high-dependence relationships and proposes a heuristic search strategy to improve the fitness of the extended topology to data. Experimental results demonstrate that this algorithm achieves a good bias-variance tradeoff and competitive classification performance compared to other high-dependence or ensemble learning algorithms.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Make a song curative: A spatio-temporal therapeutic music transfer model for anxiety reduction

Zhejing Hu, Gong Chen, Yan Liu, Xiao Ma, Nianhong Guan, Xiaoying Wang

Summary: Anxiety is a prevalent issue and music therapy has been found effective in reducing anxiety. To meet the diverse needs of individuals, a novel model called the spatio-temporal therapeutic music transfer model (StTMTM) is proposed.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

A modified reverse-based analysis logic mining model with Weighted Random 2 Satisfiability logic in Discrete Hopfield Neural Network and multi-objective training of Modified Niched Genetic Algorithm

Nur Ezlin Zamri, Mohd. Asyraf Mansor, Mohd Shareduwan Mohd Kasihmuddin, Siti Syatirah Sidik, Alyaa Alway, Nurul Atiqah Romli, Yueling Guo, Siti Zulaikha Mohd Jamaludin

Summary: In this study, a hybrid logic mining model was proposed by combining the logic mining approach with the Modified Niche Genetic Algorithm. This model improves the generalizability and storage capacity of the retrieved induced logic. Various modifications were made to address other issues. Experimental results demonstrate that the proposed model outperforms baseline methods in terms of accuracy, precision, specificity, and correlation coefficient.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

On taking advantage of opportunistic meta-knowledge to reduce configuration spaces for automated machine learning

David Jacob Kedziora, Tien-Dung Nguyen, Katarzyna Musial, Bogdan Gabrys

Summary: The paper addresses the problem of efficiently optimizing machine learning solutions by reducing the configuration space of ML pipelines and leveraging historical performance. The experiments conducted show that opportunistic/systematic meta-knowledge can improve ML outcomes, and configuration-space culling is optimal when balanced. The utility and impact of meta-knowledge depend on various factors and are crucial for generating informative meta-knowledge bases.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Optimal location for an EVPL and capacitors in grid for voltage profile and power loss: FHO-SNN approach

G. Sophia Jasmine, Rajasekaran Stanislaus, N. Manoj Kumar, Thangamuthu Logeswaran

Summary: In the context of a rapidly expanding electric vehicle market, this research investigates the ideal locations for EV charging stations and capacitors in power grids to enhance voltage stability and reduce power losses. A hybrid approach combining the Fire Hawk Optimizer and Spiking Neural Network is proposed, which shows promising results in improving system performance. The optimization approach has the potential to enhance the stability and efficiency of electric grids.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

NLP-based approach for automated safety requirements information retrieval from project documents

Zhijiang Wu, Guofeng Ma

Summary: This study proposes a natural language processing-based framework for requirement retrieval and document association, which can help to mine and retrieve documents related to project managers' requirements. The framework analyzes the ontology relevance and emotional preference of requirements. The results show that the framework performs well in terms of iterations and threshold, and there is a significant matching between the retrieved documents and the requirements, which has significant managerial implications for construction safety management.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Dog nose-print recognition based on the shape and spatial features of scales

Yung-Kuan Chan, Chuen-Horng Lin, Yuan-Rong Ben, Ching-Lin Wang, Shu-Chun Yang, Meng-Hsiun Tsai, Shyr-Shen Yu

Summary: This study proposes a novel method for dog identification using nose-print recognition, which can be applied to controlling stray dogs, locating lost pets, and pet insurance verification. The method achieves high recognition accuracy through two-stage segmentation and feature extraction using a genetic algorithm.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Fostering supply chain resilience for omni-channel retailers: A two-phase approach for supplier selection and demand allocation under disruption risks

Shaohua Song, Elena Tappia, Guang Song, Xianliang Shi, T. C. E. Cheng

Summary: This study aims to optimize supplier selection and demand allocation decisions for omni-channel retailers in order to achieve supply chain resilience. It proposes a two-phase approach that takes into account various factors such as supplier evaluation and demand allocation.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

Accelerating Benders decomposition approach for shared parking spaces allocation considering parking unpunctuality and no-shows

Jinyan Hu, Yanping Jiang

Summary: This paper examines the allocation problem of shared parking spaces considering parking unpunctuality and no-shows. It proposes an effective approach using sample average approximation (SAA) combined with an accelerating Benders decomposition (ABD) algorithm to solve the problem. The numerical experiments demonstrate the significance of supply-demand balance for the operation and user satisfaction of the shared parking system.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Review Computer Science, Artificial Intelligence

Financial fraud detection using graph neural networks: A systematic review

Soroor Motie, Bijan Raahemi

Summary: Financial fraud is a persistent problem in the finance industry, but Graph Neural Networks (GNNs) have emerged as a powerful tool for detecting fraudulent activities. This systematic review provides a comprehensive overview of the current state-of-the-art technologies in using GNNs for financial fraud detection, identifies gaps and limitations in existing research, and suggests potential directions for future research.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Review Computer Science, Artificial Intelligence

Occluded person re-identification with deep learning: A survey and perspectives

Enhao Ning, Changshuo Wang, Huang Zhang, Xin Ning, Prayag Tiwari

Summary: This review provides a detailed overview of occluded person re-identification methods and conducts a systematic analysis and comparison of existing deep learning-based approaches. It offers important theoretical and practical references for future research in the field.

EXPERT SYSTEMS WITH APPLICATIONS (2024)

Article Computer Science, Artificial Intelligence

A hierarchical attention detector for bearing surface defect detection

Jiajun Ma, Songyu Hu, Jianzhong Fu, Gui Chen

Summary: The article presents a novel visual hierarchical attention detector for multi-scale defect location and classification, utilizing texture, semantic, and instance features of defects through a hierarchical attention mechanism, achieving multi-scale defect detection in bearing images with complex backgrounds.

EXPERT SYSTEMS WITH APPLICATIONS (2024)