4.7 Article

An analysis of hierarchical text classification using word embeddings

Journal

INFORMATION SCIENCES
Volume 471, Issue -, Pages 216-232

Publisher

ELSEVIER SCIENCE INC
DOI: 10.1016/j.ins.2018.09.001

Keywords

Hierarchical text classification; Word embeddings; Gradient tree boosting; fastText; Support vector machines

Funding

  1. Brazilian National Council for the Improvement of Higher Education (CAPES) [PROSUC 88887.150315/2017-00]

Ask authors/readers for more resources

Efficient distributed numerical word representation models (word embeddings) combinec with modern machine learning algorithms have recently yielded considerable improvement on automatic document classification tasks. However, the effectiveness of such techniques has not been assessed for the hierarchical text classification (HTC) yet. This stud investigates the application of those models and algorithms on this specific problem b3 means of experimentation and analysis. We trained classification models with prominent machine learning algorithm implementations-fastText, XGBoost, SVM, and Keras' CNN-and noticeable word embeddings generation methods-GloVe, word2vec, and fastTextwith publicly available data and evaluated them with measures specifically appropriate fot the hierarchical context. FastText achieved an LcAF(1) of 0.893 on a single-labeled version o the RCV1 dataset. An analysis indicates that using word embeddings and its flavors is very promising approach for HTC. (C) 2018 Elsevier Inc. All rights reserved

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Interdisciplinary Applications

Affective states in computer-supported collaborative learning: Studying the past to drive the future

Rachel Carlos Duque Reis, Seiji Isotani, Carla Lopes Rodriguez, Kamila Takayama Lyra, Patricia Augustin Jaques, Ig Ibert Bittencourt

COMPUTERS & EDUCATION (2018)

Article Computer Science, Interdisciplinary Applications

Effects of adaptive training on metacognitive knowledge monitoring ability in computer-based learning

Tiago Roberto Kautzmann, Patricia A. Jaques

COMPUTERS & EDUCATION (2019)

Article Computer Science, Interdisciplinary Applications

The dynamics of Brazilian students' emotions in digital learning systems

Felipe de Morais, Patricia A. A. Jaques

Summary: Research on affect dynamics in digital learning systems focuses on how students' emotions evolve while using these systems. Recent studies suggest that affect dynamics can vary based on students' demographic and personal characteristics, such as nationality. However, there is a lack of understanding regarding affect dynamics in Latin American learners and the potential differences based on gender and emotion duration. This study introduces an affect dynamics model for Brazilian students using a Math DLS, highlighting the role of gender and emotion duration. Analyzing affect dynamics across cultures allows for better comprehension and application of these models, while also considering the influence of emotion duration and learners' gender.

INTERNATIONAL JOURNAL OF ARTIFICIAL INTELLIGENCE IN EDUCATION (2023)

Proceedings Paper Computer Science, Interdisciplinary Applications

A machine learning approach for the identification of learners' misconceptions in algebraic problem-solving

Joice Cazanoski Gomes, Patricia A. Jaques

Summary: Misconceptions play a significant role in the learning process. This paper proposes a solution that utilizes expression trees and the DBSCAN algorithm to identify misconceptions by clustering similar errors. This approach allows for effective and efficient misconception diagnosis.

2023 IEEE INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES, ICALT (2023)

Article Education & Educational Research

The impact of gamification on students' learning, engagement and behavior based on their personality traits

Rodrigo Smiderle, Sandro Jose Rigo, Leonardo B. Marques, Jorge Arthur Pecanha de Miranda Coelho, Patricia A. Jaques

SMART LEARNING ENVIRONMENTS (2020)

Proceedings Paper Computer Science, Artificial Intelligence

EmAP-ML: A Protocol of Emotions and Behaviors Annotation for Machine Learning Labels

Felipe de Morais, Tiago R. Kautzmann, Ig I. Bittencourt, Patricia A. Jaques

TRANSFORMING LEARNING WITH MEANINGFUL TECHNOLOGIES, EC-TEL 2019 (2019)

Proceedings Paper Computer Science, Information Systems

Studying the impact of gamification on learning and engagement of introverted and extroverted students

Rodrigo Smiderle, Leonardo Marques, Jorge Artur P. de M. Coelho, Sandro J. Rigo, Patricia A. Jaques

2019 IEEE 19TH INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT 2019) (2019)

Proceedings Paper Computer Science, Theory & Methods

Improving the Metacognitive Ability of Knowledge Monitoring in Computer Learning Systems

Tiago Roberto Kautzmann, Patricia Augustin Jaques

HIGHER EDUCATION FOR ALL: FROM CHALLENGES TO NOVEL TECHNOLOGY-ENHANCED SOLUTIONS (2018)

Article Computer Science, Artificial Intelligence

Deep Learning Applied on Refined Opinion Review Datasets

Ingo Jost, Joao Francisco Valiati

INTELIGENCIA ARTIFICIAL-IBEROAMERICAL JOURNAL OF ARTIFICIAL INTELLIGENCE (2018)

Proceedings Paper Computer Science, Artificial Intelligence

Analysis of Permanence Time in Emotional States: A Case Study Using Educational Software

Helena Reis, Danilo Alvares, Patricia Jaques, Seiji Isotani

INTELLIGENT TUTORING SYSTEMS, ITS 2018 (2018)

Article Computer Science, Artificial Intelligence

An Investigation to Identify Factors that Lead to Delay in Healthcare Reimbursement Process: A Brazilian case

Ricardo Gerhardt, Joao F. Valiati, Jose Vicente Canto dos Santos

BIG DATA RESEARCH (2018)

Proceedings Paper Computer Science, Information Systems

The use of handwriting input in Math Tutoring Systems: an use case with PAT2Math

Felipe de Morais, Ig I. Bittencourt, Seiji Isotani, Patricia A. Jaques

2017 IEEE 17TH INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT) (2017)

Article Computer Science, Information Systems

A consensus model considers managing manipulative and overconfident behaviours in large-scale group decision-making

Xia Liang, Jie Guo, Peide Liu

Summary: This paper investigates a novel consensus model based on social networks to manage manipulative and overconfident behaviors in large-scale group decision-making. By proposing a novel clustering model and improved methods, the consensus reaching is effectively facilitated. The feedback mechanism and management approach are employed to handle decision makers' behaviors. Simulation experiments and comparative analysis demonstrate the effectiveness of the model.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

CGN: Class gradient network for the construction of adversarial samples

Xiang Li, Haiwang Guo, Xinyang Deng, Wen Jiang

Summary: This paper proposes a method based on class gradient networks for generating high-quality adversarial samples. By introducing a high-level class gradient matrix and combining classification loss and perturbation loss, the method demonstrates superiority in the transferability of adversarial samples on targeted attacks.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Distinguishing latent interaction types from implicit feedbacks for recommendation

Lingyun Lu, Bang Wang, Zizhuo Zhang, Shenghao Liu

Summary: Many recommendation algorithms only rely on implicit feedbacks due to privacy concerns. However, the encoding of interaction types is often ignored. This paper proposes a relation-aware neural model that classifies implicit feedbacks by encoding edges, thereby enhancing recommendation performance.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Proximity-based density description with regularized reconstruction algorithm for anomaly detection

Jaehong Yu, Hyungrok Do

Summary: This study discusses unsupervised anomaly detection using one-class classification, which determines whether a new instance belongs to the target class by constructing a decision boundary. The proposed method uses a proximity-based density description and a regularized reconstruction algorithm to overcome the limitations of existing one-class classification methods. Experimental results demonstrate the superior performance of the proposed algorithm.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Non-iterative border-peeling clustering algorithm based on swap strategy

Hui Tu, Shifei Ding, Xiao Xu, Haiwei Hou, Chao Li, Ling Ding

Summary: Border-Peeling algorithm is a density-based clustering algorithm, but its complexity and issues on unbalanced datasets restrict its application. This paper proposes a non-iterative border-peeling clustering algorithm, which improves the clustering performance by distinguishing and associating core points and border points.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A two-stage denoising framework for zero-shot learning with noisy labels

Long Tang, Pan Zhao, Zhigeng Pan, Xingxing Duan, Panos M. Pardalos

Summary: In this work, a two-stage denoising framework (TSDF) is proposed for zero-shot learning (ZSL) to address the issue of noisy labels. The framework includes a tailored loss function to remove suspected noisy-label instances and a ramp-style loss function to reduce the negative impact of remaining noisy labels. In addition, a dynamic screening strategy (DSS) is developed to efficiently handle the nonconvexity of the ramp-style loss.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Selection of a viable blockchain service provider for data management within the internet of medical things: An MCDM approach to Indian healthcare

Raghunathan Krishankumar, Sundararajan Dhruva, Kattur S. Ravichandran, Samarjit Kar

Summary: Health 4.0 is gaining global attention for better healthcare through digital technologies. This study proposes a new decision-making framework for selecting viable blockchain service providers in the Internet of Medical Things (IoMT). The framework addresses the limitations in previous studies and demonstrates its applicability in the Indian healthcare sector. The results show the top ranking BSPs, the importance of various criteria, and the effectiveness of the developed model.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Q-learning with heterogeneous update strategy

Tao Tan, Hong Xie, Liang Feng

Summary: This paper proposes a heterogeneous update idea and designs HetUp Q-learning algorithm to enlarge the normalized gap by overestimating the Q-value corresponding to the optimal action and underestimating the Q-value corresponding to the other actions. To address the limitation, a softmax strategy is applied to estimate the optimal action, resulting in HetUpSoft Q-learning and HetUpSoft DQN. Extensive experimental results show significant improvements over SOTA baselines.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Dyformer: A dynamic transformer-based architecture for multivariate time series classification

Chao Yang, Xianzhi Wang, Lina Yao, Guodong Long, Guandong Xu

Summary: This paper proposes a dynamic transformer-based architecture called Dyformer for multivariate time series classification. Dyformer captures multi-scale features through hierarchical pooling and adaptive learning strategies, and improves model performance by introducing feature-map-wise attention mechanisms and a joint loss function.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

ESSENT: an arithmetic optimization algorithm with enhanced scatter search strategy for automated test case generation

Xiguang Li, Baolu Feng, Yunhe Sun, Ammar Hawbani, Saeed Hammod Alsamhi, Liang Zhao

Summary: This paper proposes an enhanced scatter search strategy, using opposition-based learning, to solve the problem of automated test case generation based on path coverage (ATCG-PC). The proposed ESSENT algorithm selects the path with the lowest path entropy among the uncovered paths as the target path and generates new test cases to cover the target path by modifying the dimensions of existing test cases. Experimental results show that the ESSENT algorithm outperforms other state-of-the-art algorithms, achieving maximum path coverage with fewer test cases.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

An attention based approach for automated account linkage in federated identity management

Shirin Dabbaghi Varnosfaderani, Piotr Kasprzak, Aytaj Badirova, Ralph Krimmel, Christof Pohl, Ramin Yahyapour

Summary: Linking digital accounts belonging to the same user is crucial for security, user satisfaction, and next-generation service development. However, research on account linkage is mainly focused on social networks, and there is a lack of studies in other domains. To address this, we propose SmartSSO, a framework that automates the account linkage process by analyzing user routines and behavior during login processes. Our experiments on a large dataset show that SmartSSO achieves over 98% accuracy in hit-precision.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A memetic algorithm with fuzzy-based population control for the joint order batching and picker routing problem

Renchao Wu, Jianjun He, Xin Li, Zuguo Chen

Summary: This paper proposes a memetic algorithm with fuzzy-based population control (MA-FPC) to solve the joint order batching and picker routing problem (JOBPRP). The algorithm incorporates batch exchange crossover and a two-level local improvement procedure. Experimental results show that MA-FPC outperforms existing algorithms in terms of solution quality.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

Refining one-class representation: A unified transformer for unsupervised time-series anomaly detection

Guoxiang Zhong, Fagui Liu, Jun Jiang, Bin Wang, C. L. Philip Chen

Summary: In this study, we propose the AMFormer framework to address the problem of mixed normal and anomaly samples in deep unsupervised time-series anomaly detection. By refining the one-class representation and introducing the masked operation mechanism and cost sensitive learning theory, our approach significantly improves anomaly detection performance.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A data-driven optimisation method for a class of problems with redundant variables and indefinite objective functions

Jin Zhou, Kang Zhou, Gexiang Zhang, Ferrante Neri, Wangyang Shen, Weiping Jin

Summary: In this paper, the authors focus on the issue of multi-objective optimisation problems with redundant variables and indefinite objective functions (MOPRVIF) in practical problem-solving. They propose a dual data-driven method for solving this problem, which consists of eliminating redundant variables, constructing objective functions, selecting evolution operators, and using a multi-objective evolutionary algorithm. The experiments conducted on two different problem domains demonstrate the effectiveness, practicality, and scalability of the proposed method.

INFORMATION SCIENCES (2024)

Article Computer Science, Information Systems

A Monte Carlo fuzzy logistic regression framework against imbalance and separation

Georgios Charizanos, Haydar Demirhan, Duygu Icen

Summary: This article proposes a new fuzzy logistic regression framework that addresses the problems of separation and imbalance while maintaining the interpretability of classical logistic regression. By fuzzifying binary variables and classifying subjects based on a fuzzy threshold, the framework demonstrates superior performance on imbalanced datasets.

INFORMATION SCIENCES (2024)