4.6 Article

Textual sentiment analysis via three different attention convolutional neural networks and cross-modality consistent regression

Journal

NEUROCOMPUTING
Volume 275, Issue -, Pages 1407-1415

Publisher

ELSEVIER
DOI: 10.1016/j.neucom.2017.09.080

Keywords

Textual sentiment analysis; Word embedding; Lexicon embedding; Attention mechanism; Cross-modality consistent regression

Funding

  1. Natural Science Foundation of China [61702066]
  2. Scientific and Technological Research Program of Chongqing Municipal Education Commission [KJ1704080]
  3. Chongqing Research Program of Basic Research and Frontier Technology [cstc2017jcyjAX0256]

Ask authors/readers for more resources

Word embeddings and CNN (convolutional neural networks) architecture are crucial ingredients of sentiment analysis. However, sentiment and lexicon embeddings are rarely used and CNN is incompetent to capture global features of sentence. To this end, semantic embeddings, sentiment embeddings and lexicon embeddings are applied for texts encoding, and three different attentions including attention vector, LSTM (long short term memory) attention and attentive pooling are integrated with CNN model in this paper. Additionally, a word and its context are explored to disambiguate the meaning of the word for rich input representation. To improve the performance of three different attention CNN models, CCR (cross-modality consistent regression) and transfer learning are presented. It is worth noticing that CCR and transfer learning are used in textual sentiment analysis for the first time. Finally, some experiments on two different datasets demonstrate that the proposed attention CNN models achieve the best or the next-best results against the existing state-of-the-art models. (c) 2017 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Mathematics, Interdisciplinary Applications

Exploring Coevolution of Emotional Contagion and Behavior for Microblog Sentiment Analysis: A Deep Learning Architecture

Qi Zhang, Zufan Zhang, Maobin Yang, Lianxiang Zhu

Summary: This paper explores the coevolution of emotional contagion and behavior for microblog sentiment analysis using a deep learning architecture (MSA-UITC). The tie strength between microblogs is used to quantify the relationship between emotional contagion and behavior, leading to the development of a CNN-BiLSTM-Attention network for sentiment analysis. Experimental results show that MSA-UITC outperforms existing state-of-the-art methods on real Twitter datasets.

COMPLEXITY (2021)

Article Computer Science, Information Systems

Social Interaction and Information Diffusion in Social Internet of Things: Dynamics, Cloud-Edge, Traceability

Yinxue Yi, Zufan Zhang, Laurence T. Yang, Xianjun Deng, Lingzhi Yi, Xiaokang Wang

Summary: The Social Internet of Things integrates social networks and the Internet of Things, facilitating interactions between things, people, and between people and things, resulting in a wealth of information that holds hidden value for social administration and people's lives. Characterizing the interplay between behavior spreading and information diffusion is crucial in predicting and managing information in SIoT. A cloud-edge-aided information diffusion model and a blockchain-based cloud-edge SIoT architecture are proposed for efficient interactions and enhanced security of information diffusion.

IEEE INTERNET OF THINGS JOURNAL (2021)

Article Computer Science, Information Systems

LMFNet: Human Activity Recognition Using Attentive 3-D Residual Network and Multistage Fusion Strategy

Zufan Zhang, Yucheng Yang, Zongming Lv, Chenquan Gan, Qingyi Zhu

Summary: The LMFNet framework, incorporating a deep attentive 3D residual network and a multistage fusion strategy, addresses the limitations of current 3D convolutional networks in human activity recognition, achieving higher recognition accuracy and training efficiency compared to existing methods.

IEEE INTERNET OF THINGS JOURNAL (2021)

Editorial Material Mathematics, Interdisciplinary Applications

Dynamical Modeling, Analysis, and Control of Information Diffusion over Social Networks

Chenquan Gan, Qingyi Zhu, Wei Wang, Jianxin Li

DISCRETE DYNAMICS IN NATURE AND SOCIETY (2021)

Article Computer Science, Artificial Intelligence

Facial expression recognition using densely connected convolutional neural network and hierarchical spatial attention

Chenquan Gan, Junhao Xiao, Zhangyi Wang, Zufan Zhang, Qingyi Zhu

Summary: This paper proposes a novel method for facial expression recognition by eliminating redundant information from emotional-unrelated regions, leading to more accurate recognition. The method utilizes a densely connected convolutional neural network with hierarchical spatial attention, and its superior performance is verified through experiments.

IMAGE AND VISION COMPUTING (2022)

Article Computer Science, Artificial Intelligence

Edge-aided control dynamics for information diffusion in social Internet of Things

Yinxue Yi, Zufan Zhang, Laurence T. Yang, Xiaokang Wang, Chenquan Gan

Summary: This article proposes a control strategy for information diffusion in social Internet of Things (SIoT) based on edge computing and graph neural networks. The strategy can effectively dominate information diffusion within the target scope.

NEUROCOMPUTING (2022)

Article Computer Science, Information Systems

Dynamical Behavior of Hybrid Propagation of Computer Viruses

Qingyi Zhu, Pingfan Xiang, Xuhang Luo, Chenquan Gan

Summary: This article proposes a hybrid model to study the propagation of computer viruses on the Internet. Through mathematical analysis and numerical simulations, the equilibria and their stabilities are investigated, and the impact of parameters on system stability is analyzed.

SECURITY AND COMMUNICATION NETWORKS (2022)

Article Computer Science, Information Systems

Separable 3D residual attention network for human action recognition

Zufan Zhang, Yue Peng, Chenquan Gan, Andrea Francesco Abate, Lianxiang Zhu

Summary: This paper proposes a lightweight three-dimensional residual attention network (Sep-3D RAN) for human action recognition in video-based human computer interaction. Sep-3D RAN utilizes separable three-dimensional residual attention blocks and a dual attention mechanism to extract more discriminative features and improve model guidance capability. A multi-stage training strategy effectively reduces over-fitting.

MULTIMEDIA TOOLS AND APPLICATIONS (2023)

Article Computer Science, Artificial Intelligence

DHF-Net: A hierarchical feature interactive fusion network for dialogue emotion recognition

Chenquan Gan, Yucheng Yang, Qingyi Zhu, Deepak Kumar Jain, Vitomir Struc

Summary: This paper proposes a hierarchical feature interactive fusion network (DHF-Net) for identifying specific emotions during a dialogue. The network balances contextual information and fine-grained information, and extracts more detailed information. Experimental results demonstrate an improvement in performance.

EXPERT SYSTEMS WITH APPLICATIONS (2022)

Article Mathematics, Applied

Search-driven virus spreading on Social Internet of Things: A dynamical perspective

Chenquan Gan, Yi Qian, Anqi Liu, Qingyi Zhu

Summary: This paper studies the dynamics of computer virus spread in the Social Internet of Things (SIoT) and proposes a dynamic model that combines the impact of search engines and hierarchical individual-awareness. The theoretical results are fully verified through experiments on real datasets.

COMMUNICATIONS IN NONLINEAR SCIENCE AND NUMERICAL SIMULATION (2022)

Review Mathematics

Advanced Persistent Threats and Their Defense Methods in Industrial Internet of Things: A Survey

Chenquan Gan, Jiabin Lin, Da-Wen Huang, Qingyi Zhu, Liang Tian

Summary: The industrial internet of things (IIoT) integrates traditional industry with modern information technology to improve production efficiency and quality. However, it also faces serious challenges from advanced persistent threats (APTs), a stealthy and persistent method of attack. This paper defines and develops APTs, examines the types of APT attacks in each layer of the IIoT reference architecture, and reviews existing defense techniques. It also models and analyzes APT activities in IIoT to identify their inherent characteristics and patterns, and proposes open research topics and directions for IIoT security.

MATHEMATICS (2023)

Article Computer Science, Information Systems

Multi-Label Speech Emotion Recognition via Inter-Class Difference Loss Under Response Residual Network

Xiaoke Li, Zufan Zhang, Chenquan Gan, Yong Xiang

Summary: This study proposes a novel loss function (inter-class difference loss) to address the high statistical error issue in supervised speech emotion recognition systems. An end-to-end network architecture, called response residual network (R-ResNet), is also proposed to improve the efficiency of the speech emotion recognition system. The experimental results demonstrate the advanced performance of the proposed methods.

IEEE TRANSACTIONS ON MULTIMEDIA (2023)

Article Mathematics

Hybrid Propagation and Control of Network Viruses on Scale-Free Networks

Qingyi Zhu, Pingfan Xiang, Kefei Cheng, Chenquan Gan, Lu-Xing Yang

Summary: This paper investigates the propagation of network viruses in complex networks, taking into account the combined influence of network topology and hybrid transmission. The study identifies the propagation threshold and explores the impact of vertical transmission on viral spread. It also addresses the problem of dynamically containing the spread with limited resources, utilizing optimal control theory. Simulation experiments verify the effectiveness of the proposed control strategy.

BULLETIN OF THE IRANIAN MATHEMATICAL SOCIETY (2023)

Article Computer Science, Artificial Intelligence

3D-KCPNet: Efficient 3DCNNs based on tensor mapping theory

Rui Lv, Dingheng Wang, Jiangbin Zheng, Zhao-Xu Yang

Summary: In this paper, the authors investigate tensor decomposition for neural network compression. They analyze the convergence and precision of tensor mapping theory, validate the rationality of tensor mapping and its superiority over traditional tensor approximation based on the Lottery Ticket Hypothesis. They propose an efficient method called 3D-KCPNet to compress 3D convolutional neural networks using the Kronecker canonical polyadic (KCP) tensor decomposition. Experimental results show that 3D-KCPNet achieves higher accuracy compared to the original baseline model and the corresponding tensor approximation model.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Personalized robotic control via constrained multi-objective reinforcement learning

Xiangkun He, Zhongxu Hu, Haohan Yang, Chen Lv

Summary: In this paper, a novel constrained multi-objective reinforcement learning algorithm is proposed for personalized end-to-end robotic control with continuous actions. The approach trains a single model using constraint design and a comprehensive index to achieve optimal policies based on user-specified preferences.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Overlapping community detection using expansion with contraction

Zhijian Zhuo, Bilian Chen, Shenbao Yu, Langcai Cao

Summary: In this paper, a novel method called Expansion with Contraction Method for Overlapping Community Detection (ECOCD) is proposed, which utilizes non-negative matrix factorization to obtain disjoint communities and applies expansion and contraction processes to adjust the degree of overlap. ECOCD is applicable to various networks with different properties and achieves high-quality overlapping community detection.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

High-compressed deepfake video detection with contrastive spatiotemporal distillation

Yizhe Zhu, Chunhui Zhang, Jialin Gao, Xin Sun, Zihan Rui, Xi Zhou

Summary: In this work, the authors propose a Contrastive Spatio-Temporal Distilling (CSTD) approach to improve the detection of high-compressed deepfake videos. The approach leverages spatial-frequency cues and temporal-contrastive alignment to fully exploit spatiotemporal inconsistency information.

NEUROCOMPUTING (2024)

Review Computer Science, Artificial Intelligence

A review of coverless steganography

Laijin Meng, Xinghao Jiang, Tanfeng Sun

Summary: This paper provides a review of coverless steganographic algorithms, including the development process, known contributions, and general issues in image and video algorithms. It also discusses the security of coverless steganography from theoretical analysis to actual investigation for the first time.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Confidence-based interactable neural-symbolic visual question answering

Yajie Bao, Tianwei Xing, Xun Chen

Summary: Visual question answering requires processing multi-modal information and effective reasoning. Neural-symbolic learning is a promising method, but current approaches lack uncertainty handling and can only provide a single answer. To address this, we propose a confidence based neural-symbolic approach that evaluates NN inferences and conducts reasoning based on confidence.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

A framework-based transformer and knowledge distillation for interior style classification

Anh H. Vo, Bao T. Nguyen

Summary: Interior style classification is an interesting problem with potential applications in both commercial and academic domains. This project proposes a method named ISC-DeIT, which combines data-efficient image transformer architectures and knowledge distillation, to address the interior style classification problem. Experimental results demonstrate a significant improvement in predictive accuracy compared to other state-of-the-art methods.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Improving robustness for vision transformer with a simple dynamic scanning augmentation

Shashank Kotyan, Danilo Vasconcellos Vargas

Summary: This article introduces a novel augmentation technique called Dynamic Scanning Augmentation to improve the accuracy and robustness of Vision Transformer (ViT). The technique leverages dynamic input sequences to adaptively focus on different patches, resulting in significant changes in ViT's attention mechanism. Experimental results demonstrate that Dynamic Scanning Augmentation outperforms ViT in terms of both robustness to adversarial attacks and accuracy against natural images.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Introducing shape priors in Siamese networks for image classification

Hiba Alqasir, Damien Muselet, Christophe Ducottet

Summary: The article proposes a solution to improve the learning process of a classification network by providing shape priors, reducing the need for annotated data. The solution is tested on cross-domain digit classification tasks and a video surveillance application.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Neural dynamics solver for time-dependent infinity-norm optimization based on ACP framework with robot application

Dexiu Ma, Mei Liu, Mingsheng Shang

Summary: This paper proposes a method using neural dynamics solvers to solve infinity-norm optimization problems. Two improved solvers are constructed and their effectiveness and superiority are demonstrated through theoretical analysis and simulation experiments.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

cpp-AIF: A multi-core C plus plus implementation of Active Inference for Partially Observable Markov Decision Processes

Francesco Gregoretti, Giovanni Pezzulo, Domenico Maisto

Summary: Active Inference is a computational framework that uses probabilistic inference and variational free energy minimization to describe perception, planning, and action. cpp-AIF is a header-only C++ library that provides a powerful tool for implementing Active Inference for Partially Observable Markov Decision Processes through multi-core computing. It is cross-platform and improves performance, memory management, and usability compared to existing software.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Predicting stock market trends with self-supervised learning

Zelin Ying, Dawei Cheng, Cen Chen, Xiang Li, Peng Zhu, Yifeng Luo, Yuqi Liang

Summary: This paper proposes a novel stock market trends prediction framework called SMART, which includes a self-supervised stock technical data sequence embedding model S3E. By training with multiple self-supervised auxiliary tasks, the model encodes stock technical data sequences into embeddings and uses the learned sequence embeddings for predicting stock market trends. Extensive experiments on China A-Shares market and NASDAQ market prove the high effectiveness of our model in stock market trends prediction, and its effectiveness is further validated in real-world applications in a leading financial service provider in China.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

DHGAT: Hyperbolic representation learning on dynamic graphs via attention networks

Hao Li, Hao Jiang, Dongsheng Ye, Qiang Wang, Liang Du, Yuanyuan Zeng, Liu Yuan, Yingxue Wang, C. Chen

Summary: DHGAT1, a dynamic hyperbolic graph attention network, utilizes hyperbolic metric properties to embed dynamic graphs. It employs a spatiotemporal self-attention mechanism and weighted node representations, resulting in excellent performance in link prediction tasks.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Progressive network based on detail scaling and texture extraction: A more general framework for image deraining

Jiehui Huang, Zhenchao Tang, Xuedong He, Jun Zhou, Defeng Zhou, Calvin Yu-Chian Chen

Summary: This study proposes a progressive learning multi-scale feature blending model for image deraining tasks. The model utilizes detail dilation and texture extraction to improve the restoration of rainy images. Experimental results show that the model achieves near state-of-the-art performance in rain removal tasks and exhibits better rain removal realism.

NEUROCOMPUTING (2024)

Article Computer Science, Artificial Intelligence

Stabilization and synchronization control for discrete-time complex networks via the auxiliary role of edges subsystem

Lizhi Liu, Zilin Gao, Yinhe Wang, Yongfu Li

Summary: This paper proposes a novel discrete-time interconnected model for depicting complex dynamical networks. The model consists of nodes and edges subsystems, which consider the dynamic characteristic of both nodes and edges. By designing control strategies and coupling modes, the stabilization and synchronization of the network are achieved. Simulation results demonstrate the effectiveness of the proposed methods.

NEUROCOMPUTING (2024)