Article
Computer Science, Artificial Intelligence
Rui Li, Chao Ren, Yiqing Ge, Qiqi Zhao, Yikun Yang, Yuhan Shi, Xiaowei Zhang, Bin Hu
Summary: This study proposed a novel emotion recognition model called MTLFuseNet, which uses deep latent feature fusion of EEG signals and multi-task learning. Through unsupervised learning by a variational autoencoder (VAE), MTLFuseNet learned spatio-temporal latent features of EEG, and through supervised learning by a graph convolutional network (GCN) and gated recurrent unit (GRU) network, it learned spatio-spectral features. The fused latent features were able to provide more complementary and discriminative spatio-temporal-spectral fusion features for EEG signal representation, resulting in excellent recognition performance.
KNOWLEDGE-BASED SYSTEMS
(2023)
Article
Biology
Qian Wang, Mou Wang, Yan Yang, Xiaolei Zhang
Summary: This paper presents a multi-modal emotion database (MED4) containing various signals recorded from participants when influenced by video stimuli. The performance of baseline algorithms and emotion recognition methods are evaluated, and fusion strategies are designed to improve accuracy and robustness. EEG signals outperform speech signals in emotion recognition, and fusion methods further enhance recognition performance in noisy environments.
COMPUTERS IN BIOLOGY AND MEDICINE
(2022)
Article
Physics, Multidisciplinary
Xin Zuo, Chi Zhang, Timo Hamalainen, Hanbing Gao, Yu Fu, Fengyu Cong
Summary: This study proposes a cross-subject emotion recognition framework based on EEG, using fused entropy features and a BiLSTM network. The research found that multi-scale entropy (MSE) is more effective than other single-entropy features in recognizing emotions. The performance of BiLSTM is further improved with the use of fused entropy features compared to single-type features.
Article
Computer Science, Artificial Intelligence
Tao Zhang, Zhenhua Tan, Xiaoer Wu
Summary: This paper proposes a novel methodology HAAN-ERC, which hierarchically models intra-speaker, inter-speaker, intra-modal, and intermodal influences in dialogue context to infer emotional states of speakers. An adaptive attention mechanism is also proposed for each speaker to omit redundant or valueless utterances from historical contexts for adaptive fusion. HAAN-ERC is evaluated on two popular multimodal ERC datasets and achieves new state-of-the-art results, demonstrating its effectiveness.
NEURAL COMPUTING & APPLICATIONS
(2023)
Article
Multidisciplinary Sciences
Badar Almarri, Sanguthevar Rajasekaran, Chun-Hsi Huang
Summary: This paper introduces a subject-independent emotion recognition framework that reduces subject-to-subject variability by adequate preprocessing, transforming, and feature extraction prior to analyzing emotion data. By utilizing unsupervised algorithms and support vector machine, the study outperforms other subject-independent studies in accurately classifying human affection based on EEG benchmarks.
Article
Chemistry, Analytical
Menghang Li, Min Qiu, Wanzeng Kong, Li Zhu, Yu Ding
Summary: This paper proposes a fusion graph convolutional network (FGCN) to extract various relations existing in Electroencephalogram (EEG) data for emotion recognition. By mining brain connection features and fusing different relation graphs, the accuracy of emotion recognition can be significantly improved.
Article
Chemistry, Analytical
Jing Zong, Xin Xiong, Jianhua Zhou, Ying Ji, Diao Zhou, Qi Zhang
Summary: In this study, a novel EEG emotion recognition algorithm called FCAN-XGBoost is proposed, which achieves accurate classification of four emotions by combining FCAN and XGBoost algorithms. The proposed method achieves emotion recognition accuracies of 95.26% and 94.05% on the DEAP and DREAMER datasets, respectively, while reducing computation time by at least 75.45% and memory occupation by 67.51%.
Article
Education & Educational Research
Zhenzhen Luo, Chaoyu Zheng, Jun Gong, Shaolong Chen, Yong Luo, Yugen Yi
Summary: Learning interest is an important factor that affects the learning effect. Currently, students' learning interest in a teaching environment is mainly evaluated through traditional questionnaires or case analysis, which is not conducive for teachers to promptly access students' interest in class and improve teaching behavior effectively. To intelligently analyze students' learning interest, a Three-Dimensional Learning Interest Model (3DLIM) is proposed based on educational psychology angle, which includes cognitive attention, learning emotion, and thinking activities. The model utilizes multimodal information recognition and fusion to comprehensively analyze students' interest in a teaching environment.
EDUCATION AND INFORMATION TECHNOLOGIES
(2023)
Article
Computer Science, Cybernetics
Muhammad Johan Alibasa, Rafael A. Calvo, Kalina Yacef
Summary: Understanding the relationship between technology and wellbeing is crucial for improving interaction designs and raising awareness. This study introduces the concept of digital context and explores its impact on mood prediction models, showing that it can significantly improve accuracy compared to previous models.
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION
(2023)
Article
Engineering, Biomedical
Wei Zheng, Bo Pan
Summary: In the field of brain-computer interface, automatic recognition of emotions based on EEG signals is significant. This study proposes an EEG emotion recognition model called STS-Transformer, which directly recognizes emotions from raw EEG signals without preprocessing and feature extraction. The model exhibits remarkable performance advantages in the experiments.
BIOMEDICAL SIGNAL PROCESSING AND CONTROL
(2024)
Review
Computer Science, Artificial Intelligence
Bei Pan, Kaoru Hirota, Zhiyang Jia, Yaping Dai
Summary: Affective computing is an important research field in modern human-computer interaction, focusing on the study and development of theories, methods, and systems for recognizing, explaining, processing, and simulating human emotions. Emotion recognition, as a branch of affective computing, aims to enable machines/computers to automatically analyze human emotions. This paper provides a comprehensive review of multimodal emotion recognition, discussing multimodal datasets, data preprocessing, unimodal feature extraction, and multimodal information fusion methods. The review also highlights challenges and future research directions in this field.
Article
Chemistry, Analytical
Tianjiao Kong, Jie Shao, Jiuyuan Hu, Xin Yang, Shiyiling Yang, Reza Malekian
Summary: In this study, complex network features were extracted from EEG signals for emotion recognition through the construction of two types of complex networks and fusion of feature matrices. The proposed method achieved high emotion recognition accuracies in valence and arousal dimensions, and further improved classification accuracies when combined with time-domain features.
Article
Computer Science, Hardware & Architecture
Mei Wang, Ziyang Huang, Yuancheng Li, Lihong Dong, Hongguang Pan
Summary: This paper proposes an emotion recognition method based on the fusion of EEG and facial expression information, utilizing convolutional networks and multi-scale feature extraction networks for training and decision output, and applying a weighted fusion method for emotion recognition, with high accuracy achieved.
COMPUTERS & ELECTRICAL ENGINEERING
(2021)
Article
Computer Science, Interdisciplinary Applications
Guixun Xu, Wenhui Guo, Yanjiang Wang
Summary: This paper introduces a hybrid GRU and CNN deep learning framework named GRU-Conv, which can effectively extract spatio-temporal features from EEG signals and achieve good performance in emotion recognition.
MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING
(2023)
Article
Computer Science, Hardware & Architecture
Ying Hu, Feng Wang
Summary: Face expression can be used for emotion recognition, but artificial hiding can lead to misjudgment. Single-mode recognition often results in low recognition rates. In order to address these issues, a fusion of spatio-temporal neural network and separable residual network is proposed for emotion recognition of EEG and face.
JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS
(2023)
Article
Telecommunications
Zahid Halim, Aqsa Khan, Muhammad Sulaiman, Sajid Anwar, Muhammad Nawaz
Summary: Commuting in big cities with heavy traffic is a common daily task, and finding the most suitable path to reduce travel time is crucial. In addition to travel time and distance, factors like environmental conditions and traffic flow impact the overall commute time and quality.
TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES
(2022)
Article
Computer Science, Information Systems
Ahmar Rashid, Muhammad Amir Zeb, Amad Rashid, Sajid Anwar, Fernando Joaquim, Zahid Halim
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS
(2020)
Article
Computer Science, Theory & Methods
Shahab Haider, Ghulam Abbas, Ziaul Haq Abbas, Saadi Boudjit, Zahid Halim
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE
(2020)
Article
Computer Science, Artificial Intelligence
Shanshan Tu, Sadaqat ur Rehman, Muhammad Waqas, Obaid ur Rehman, Zhongliang Yang, Basharat Ahmad, Zahid Halim, Wei Zhao
IET COMPUTER VISION
(2020)
Article
Computer Science, Artificial Intelligence
Uzma, Zahid Halim
APPLIED SOFT COMPUTING
(2020)
Article
Computer Science, Information Systems
Shanshan Tu, Muhammad Waqas, Yuan Meng, Sadaqat Ur Rehman, Iftekhar Ahmad, Anis Koubaa, Zahid Halim, Muhammad Hanif, Chin-Chen Chang, Chengjie Shi
COMPUTER COMMUNICATIONS
(2020)
Article
Computer Science, Artificial Intelligence
Uzma, Feras Al-Obeidat, Abdallah Tubaishat, Babar Shah, Zahid Halim
Summary: This study proposes a gene encoder feature selection technique for the classification of cancer samples. By aggregating multiple filtering methods and using a genetic algorithm, the optimal feature subset is selected and evaluated using various classifiers. Experimental results suggest better performance of the proposed method.
NEURAL COMPUTING & APPLICATIONS
(2022)
Article
Computer Science, Artificial Intelligence
Madiha Tahir, Abdallah Tubaishat, Feras Al-Obeidat, Babar Shah, Zahid Halim, Muhammad Waqas
Summary: The paper presents a novel metaheuristic optimizer named as Binary Chaotic Genetic Algorithm (BCGA) to improve the performance of Genetic Algorithm (GA). By applying chaotic maps and reproduction operations, BCGA is able to achieve better fitness values, particularly in the field of feature selection.
NEURAL COMPUTING & APPLICATIONS
(2022)
Article
Engineering, Electrical & Electronic
Shanshan Tu, Muhammad Waqas, Sadaqat Ur Rehman, Talha Mir, Ghulam Abbas, Ziaul Haq Abbas, Zahid Halim, Iftekhar Ahmad
Summary: This study proposes a reinforcement learning-based technique to prevent impersonation attacks in device-to-device communication, while also improving the secret key generation rate under physical layer security.
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY
(2021)
Article
Computer Science, Artificial Intelligence
Zahid Halim, Omer Ali, Muhammad Ghufran Khan
Summary: This research introduces a graph-based approach to represent transactional databases, storing all information relevant to mining FIs in one pass, along with an algorithm for extracting FIs from this structure. Experimental results demonstrate that the proposed approach outperforms other methods in terms of time efficiency.
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING
(2021)
Article
Biochemical Research Methods
Shahid Iqbal, Zahid Halim
Summary: The current era's advanced computational techniques assist in identifying proteins that interact within complex biological networks and with the cell's environment. Biological pathways, chains of molecular actions resulting in new molecular product creation or altered cellular state, are helpful in predicting real-world issues. Rebuilding these pathways is challenging due to undirected protein interactions and directed pathways, requiring orientation for protein interactions in specific source and target data. The proposed pseudo-guided multi-objective genetic algorithm (PGMOGA) improves pathway reconstruction in a weighted network of yeast species' protein interactions, outperforming four state-of-the-art approaches through edge orientation assignment.
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS
(2021)
Article
Computer Science, Information Systems
Sajid Anwar, Bilal Mehrban, Musawar Ali, Farhan Hussain, Zahid Halim
Summary: The study proposes a novel and generic framework for automating the segmentation and labeling processes of handwritten datasets, which is significantly faster than manual and semi-automatic methods. The dataset, consisting of 160,000 samples, was collected for an oriental language and classified using traditional and state-of-the-art machine learning algorithms.
MULTIMEDIA TOOLS AND APPLICATIONS
(2021)
Article
Computer Science, Artificial Intelligence
Zahid Halim, Mehwish Waqar, Madiha Tahir
KNOWLEDGE-BASED SYSTEMS
(2020)
Article
Computer Science, Information Systems
Muhammad Waqas, Shanshan Tu, Sadaqat Ur Rehman, Zahid Halim, Sajid Anwar, Ghulam Abbas, Ziaul Haq Abbas, Obaid Ur Rehman
CMC-COMPUTERS MATERIALS & CONTINUA
(2020)
Article
Computer Science, Artificial Intelligence
C. Lopez-Molina, S. Iglesias-Rey, B. De Baets
Summary: Quantitative image comparison is a critical topic in image processing literature, with diverse applications. Existing measures of comparison often overlook the context in which the comparison takes place. This paper presents a context-aware comparison method for binary images, tested on the BSDS500 benchmark.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Lorenz Linhardt, Klaus-Robert Mueller, Gregoire Montavon
Summary: This paper investigates the issue of mismatches between the decision strategy of the explainable model and the user's domain knowledge, and proposes a new method EGEM to mitigate hidden flaws in the model. Experimental results demonstrate that the approach can significantly reduce reliance on Clever Hans strategies and improve the accuracy of the model on new data.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Zhimin Shao, Weibei Dou, Yu Pan
Summary: This paper proposes a novel algorithm, Dual-level Deep Evidential Fusion (DDEF), to integrate multimodal information at both the BBA level and multimodal level, aiming to enhance accuracy, robustness, and reliability. The DDEF approach utilizes the Dirichlet framework and BBA methods for effective uncertainty estimation and employs the Dempster-Shafer Theory for dual-level fusion. The experimental results show that the proposed DDEF outperforms existing methods in synthetic digit classification and real-world medical prognosis after BCI treatment.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Abhishek K. Ghosh, Danilo S. Catelli, Samuel Wilson, Niamh C. Nowlan, Ravi Vaidyanathan
Summary: The inability of current FM monitoring methods to be used outside clinical environments has made it challenging to understand the nature and evolution of FM. This investigation introduces a novel wearable FM monitor with a heterogeneous sensor suite and a data fusion architecture to efficiently capture and separate FM from interfering artifacts. The performance of the device and architecture were validated through at-home use, demonstrating high accuracy in detecting and recognizing FM events. This research is a major milestone in the development of low-cost wearable FM monitors for pervasive monitoring of FM in unsupervised environments.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Jianlei Kong, Xiaomeng Fan, Min Zuo, Muhammet Deveci, Xuebo Jin, Kaiyang Zhong
Summary: In this study, we propose an intelligent traffic flow prediction framework based on the adaptive dual-graphic transformer with a cross-fusion strategy, aiming to uncover latent graphic feature representations that transcend temporal and spatial limitations. By establishing a traffic spatiotemporal prediction model using a cross-fusion attention mechanism, our proposed model achieves superior prediction performance on practical urban traffic flow datasets, particularly for long-term predictions.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Huilai Zhi, Jinhai Li
Summary: This article addresses the issue that conflict analysis based on single-valued information systems is no longer valid. It proposes a conflict analysis method based on component similarity, which uses three-way n-valued concept lattices to handle set-valued formal contexts and realizes fast conflict analysis from an information fusion viewpoint. Experimental results verify the effectiveness of this method in reducing time consumption.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Huchang Liao, Jiaxin Qi, Jiawei Zhang, Chonghui Zhang, Fan Liu, Weiping Ding
Summary: In this paper, a hospital selection approach based on a fuzzy multi-criterion decision-making method is proposed. This approach considers sentiment evaluation values of unstructured data from online reviews and structured data of public indexes simultaneously. The methodology involves collecting and processing online reviews, classifying topics and sentiments, quantifying sentiment analysis results using fuzzy numbers, and obtaining final preference scores of hospitals based on patients' preferences. A case study and robustness analysis are conducted to validate the effectiveness of the method.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Faramarz Farhangian, Rafael M. O. Cruz, George D. C. Cavalcanti
Summary: The proliferation of social networks has posed challenges in combating fake news, but automatic fake news detection using artificial intelligence has become more feasible. This paper revisits the definitions and perspectives of fake news and proposes an updated taxonomy, based on multiple criteria, for the field. The study finds that optimal feature extraction techniques vary depending on the dataset, and context-dependent models based on transformer models consistently exhibit superior performance.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Mariana A. Souza, Robert Sabourin, George D. C. Cavalcanti, Rafael M. O. Cruz
Summary: In this study, a dynamic selection technique is proposed to handle sparse and overlapped data. The technique leverages the relationships between instances and classifiers to learn a dynamic classifier combination rule. Experimental results show that the proposed method outperforms static selection and other dynamic selection techniques.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Bin Yu, Ruihui Xu, Mingjie Cai, Weiping Ding
Summary: This paper introduces a clustering method based on non-Euclidean metric and multi-granularity staged clustering to address the challenges posed by complex spatial structure data to traditional clustering methods. The method improves the similarity measure and employs an attenuation-diffusion pattern for local to global clustering, achieving good clustering results.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Jian Zhu, Pengbo Hu, Bingqian Li, Yi Zhou
Summary: The acquisition of multi-view hash representation for heterogeneous data is highly important for multimedia retrieval. Current approaches suffer from limited retrieval precision due to insufficient integration of multi-view features and failure to effectively utilize metric information from diverse samples. In this paper, we propose an innovative method called Fast Metric Multi-View Hashing (FMMVH), which demonstrates the superiority of gate-based fusion over traditional methods. We also introduce a novel deep metric loss function to leverage metric information from dissimilar samples. By optimizing and employing model compression techniques, our FMMVH method significantly outperforms existing state-of-the-art methods on benchmark datasets, with up to 7.47% improvement in mean Average Precision (mAP).
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Fayaz Ali Dharejo, Iyyakutti Iyappan Ganapathi, Muhammad Zawish, Basit Alawode, Moath Alathbah, Naoufel Werghi, Sajid Javed
Summary: The resource-limited nature of underwater vision equipment affects underwater robotics and ocean engineering tasks. Super-resolution methods, particularly using Vision Transformers (ViTs), have emerged to enhance low-resolution underwater images. However, ViTs face challenges in handling severe degradation in underwater imaging. In contrast, Multi-scale ViTs (MViTs) overcome these challenges by preserving long-range dependencies through evolving channel capacity. This study proposes a novel algorithm, SwinWave-SR, for efficient and accurate multi-scale super-resolution for underwater images.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Weiwei Jiang, Haoyu Han, Yang Zhang, Jianbin Mu
Summary: This study incorporates federated learning and split learning paradigms with satellite-terrestrial integrated networks and introduces a split-then-federated learning framework and federated split learning with long short-term memory to handle sequential data in STINs. The proposed solution is demonstrated to be effective through a case study of electricity theft detection based on a real-world dataset.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Najah Abuali, Mohammad Bilal Khan, Farman Ullah, Mohammad Hayajneh, Hikmat Ullah, Shahid Mumtaz
Summary: The demand for innovative solutions in biomedical systems for precise diagnosis and management of critical diseases is increasing. A promising technology, non-invasive and intelligent Internet of Medical Things (IoMT) system, emerges to assess patients with reduced health risks. This research introduces a comprehensive framework for early diagnosis of respiratory abnormalities through RF sensing and SDR technology. The results highlight the superior performance of deep learning frameworks in classifying respiratory anomalies.
INFORMATION FUSION
(2024)
Article
Computer Science, Artificial Intelligence
Shichen Huang, Weina Fu, Zhaoyue Zhang, Shuai Liu
Summary: In the era of adversarial machine learning (AML), developing robust and generalized algorithms has become a key research topic. This study proposes a global similarity matching module and a global-local cognition fusion training mechanism based on relationship adversarial sample generation to improve image-text matching algorithm. Experimental results show significant improvements in accuracy and robustness, performing well in facing security challenges and promoting the fusion of visual and linguistic modalities.
INFORMATION FUSION
(2024)