4.7 Article

A novel probabilistic feature selection method for text classification

Journal

KNOWLEDGE-BASED SYSTEMS
Volume 36, Issue -, Pages 226-235

Publisher

ELSEVIER
DOI: 10.1016/j.knosys.2012.06.005

Keywords

Feature selection; Filter; Pattern recognition; Text classification; Dimension reduction

Ask authors/readers for more resources

High dimensionality of the feature space is one of the most important concerns in text classification problems due to processing time and accuracy considerations. Selection of distinctive features is therefore essential for text classification. This study proposes a novel filter based probabilistic feature selection method, namely distinguishing feature selector (DFS), for text classification. The proposed method is compared with well-known filter approaches including chi square, information gain, Gini index and deviation from Poisson distribution. The comparison is carried out for different datasets, classification algorithms, and success measures. Experimental results explicitly indicate that DFS offers a competitive performance with respect to the abovementioned approaches in terms of classification accuracy, dimension reduction rate and processing time. (C) 2012 Elsevier B.V. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Computer Science, Artificial Intelligence

EDTriangles: a high-speed triangle detection algorithm with a false detection control

Selcan Kaplan Berkaya, Serkan Gunal, Cuneyt Akinlar

PATTERN ANALYSIS AND APPLICATIONS (2018)

Article Engineering, Biomedical

A survey on ECG analysis

Selcan Kaplan Berkaya, Alper Kursat Uysal, Efnan Sora Gunal, Semih Ergin, Serkan Gunal, M. Bilginer Gulmezoglu

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2018)

Article Computer Science, Information Systems

On constituent chunking for Turkish

Ozkan Aslan, Serkan Gunal, Bekir Taner Dincer

INFORMATION PROCESSING & MANAGEMENT (2018)

Article Computer Science, Information Systems

On classification of abstracts obtained from medical journals

Bekir Parlak, Alper Kursat Uysal

JOURNAL OF INFORMATION SCIENCE (2020)

Article Computer Science, Artificial Intelligence

Improved inverse gravity moment term weighting for text classification

Turgut Dogan, Alper Kursat Uysal

EXPERT SYSTEMS WITH APPLICATIONS (2019)

Article Biology

Classification models for SPECT myocardial perfusion imaging

Selcan Kaplan Berkaya, Ilknur Ak Sivrikoz, Serkan Gunal

COMPUTERS IN BIOLOGY AND MEDICINE (2020)

Article Computer Science, Information Systems

The effects of globalisation techniques on feature selection for text classification

Bekir Parlak, Alper Kursat Uysal

Summary: This study comprehensively investigated the effects of various globalisation techniques on local feature selection methods, finding that the AVG method was the most successful across different dataset characteristics. The DFSS method performed well on MCU and MCB datasets, while the CHI2 method was more accurate on BCU and BCB datasets. Additionally, the SVM classifier outperformed the DT classifier in most cases.

JOURNAL OF INFORMATION SCIENCE (2021)

Article Computer Science, Information Systems

A novel filter feature selection method for text classification: Extensive Feature Selector

Bekir Parlak, Alper Kursat Uysal

Summary: In the domain of text classification, applying feature selection methods is essential for improving classification accuracy. This study proposes a new feature selection method called Extensive Feature Selector (EFS), which utilizes corpus-based and class-based probabilities. The performance of EFS is compared with nine other methods on four benchmark datasets, and the results show that EFS outperforms the other methods in most cases.

JOURNAL OF INFORMATION SCIENCE (2023)

Article Ecology

Deep learning-based classification models for beehive monitoring

Selcan Kaplan Berkaya, Efnan Sora Gunal, Serkan Gunal

Summary: Deep learning-based image classification models are proposed for beehive monitoring, capable of recognizing different conditions and abnormalities with an accuracy of up to 99.07%, making them good candidates for smart beekeeping and beehive monitoring.

ECOLOGICAL INFORMATICS (2021)

Article Computer Science, Hardware & Architecture

A Model for Cross-Domain Opinion Target Extraction in Sentiment Analysis

Muhammet Yasin Pak, Serkan Gunal

Summary: This paper proposes a rule mining model based on sequential patterns for cross-domain opinion target extraction from product reviews in unknown domains. Experimental results show that the proposed model can extract opinion targets more accurately than previous studies.

COMPUTER SYSTEMS SCIENCE AND ENGINEERING (2022)

Article Computer Science, Software Engineering

A new metric for feature selection on short text datasets

Rasim Cekik, Alper Kursat Uysal

Summary: Short texts are very common, especially in social media networks. The task of short text classification is crucial for various applications. However, using the entire feature set for classification can lead to high dimensionality and negatively impact classifier performance. In this study, the XY method is proposed as an effective feature selection algorithm. It calculates the distance of features to the XY line and uses the lambda value to determine the discriminatory capability of terms. Evaluation results show that the XY method achieves better or competitive performance while significantly reducing feature sizes.

CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE (2022)

Article Chemistry, Multidisciplinary

A Purely Entity-Based Semantic Search Approach for Document Retrieval

Mohamed Lemine Sidi, Serkan Gunal

Summary: This paper proposes a Purely Entity-based Semantic Search Approach for Information Retrieval (PESS4IR) to improve document retrieval. The approach includes its own entity linking and inverted indexing methods, as well as an appropriate ranking method. The experiments show that the approach achieves good performance on queries with rich annotations.

APPLIED SCIENCES-BASEL (2023)

Article Computer Science, Artificial Intelligence

Segmentation of diatoms using edge detection and deep learning

Huseyin Gunduz, Cuneyd Nadir Solak, Serkan Gunal

Summary: In this study, a new and effective model for the automatic segmentation of diatoms based on image processing and deep learning algorithms is proposed. Through extensive experimental work, the performance of the proposed segmentation model is measured and verified to surpass previous works.

TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES (2022)

Article Education & Educational Research

AUTOMATIC CLASSIFICATION OF EFL LEARNERS' SELF-REPORTED TEXT DOCUMENTS ALONG AN AFFECTIVE CONTINUUM

Derya Uysal, Alper Kursat Uysal

Summary: This study aims to use machine learning methods to classify EFL learners along an affective continuum and provides a new dataset about their affective characteristics. The results show that machine learning methods can effectively classify students' affective characteristics and feature selection methods can be used to assess their feelings towards EFL learning.

ADVANCED EDUCATION (2022)

Article Multidisciplinary Sciences

On Term Frequency Factor in Supervised Term Weighting Schemes for Text Classification

Turgut Dogan, Alper Kursat Uysal

ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING (2019)

Article Computer Science, Artificial Intelligence

Confidence-based and sample-reweighted test-time adaptation

Hao Yang, Min Wang, Zhengfei Yu, Hang Zhang, Jinshen Jiang, Yun Zhou

Summary: In this paper, a novel method called CSTTA is proposed for test time adaptation (TTA), which utilizes confidence-based optimization and sample reweighting to better utilize sample information. Extensive experiments demonstrate the effectiveness of the proposed method.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

A novel method for generating a canonical basis for decision implications based on object-induced three-way operators

Jin Liu, Ju-Sheng Mi, Dong-Yun Niu

Summary: This article focuses on a novel method for generating a canonical basis for decision implications based on object-induced operators (OE operators). The logic of decision implication based on OE operators is described, and a method for obtaining the canonical basis for decision implications is given. The completeness, nonredundancy, and optimality of the canonical basis are proven. Additionally, a method for generating true premises based on OE operators is proposed.

KNOWLEDGE-BASED SYSTEMS (2024)

Review Computer Science, Artificial Intelligence

Efficient utilization of pre-trained models: A review of sentiment analysis via prompt learning

Kun Bu, Yuanchao Liu, Xiaolong Ju

Summary: This paper discusses the importance of sentiment analysis and pre-trained models in natural language processing, and explores the application of prompt learning. The research shows that prompt learning is more suitable for sentiment analysis tasks and can achieve good performance.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

M-EDEM: A MNN-based Empirical Decomposition Ensemble Method for improved time series forecasting

Xiangjun Cai, Dagang Li

Summary: This paper presents a new decomposition mechanism based on learned decomposition mapping. By using a neural network to learn the relationship between original time series and decomposed results, the repetitive computation overhead during rolling decomposition is relieved. Additionally, extended mapping and partial decomposition methods are proposed to alleviate boundary effects on prediction performance. Comparative studies demonstrate that the proposed method outperforms existing RDEMs in terms of operation speed and prediction accuracy.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Privacy-preserving trust management method based on blockchain for cross-domain industrial IoT

Xu Wu, Yang Liu, Jie Tian, Yuanpeng Li

Summary: This paper proposes a blockchain-based privacy-preserving trust management architecture, which adopts federated learning to train task-specific trust models and utilizes differential privacy to protect device privacy. In addition, a game theory-based incentive mechanism and a parallel consensus protocol are proposed to improve the accuracy of trust computing and the efficiency of consensus.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MV-ReID: 3D Multi-view Transformation Network for Occluded Person Re-Identification

Zaiyang Yu, Prayag Tiwari, Luyang Hou, Lusi Li, Weijun Li, Limin Jiang, Xin Ning

Summary: This study introduces a 3D view-based approach that effectively handles occlusions and leverages the geometric information of 3D objects. The proposed method achieves state-of-the-art results on occluded ReID tasks and exhibits competitive performance on holistic ReID tasks.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

City-scale continual neural semantic mapping with three-layer sampling and panoptic representation

Yongliang Shi, Runyi Yang, Zirui Wu, Pengfei Li, Caiyun Liu, Hao Zhao, Guyue Zhou

Summary: Neural implicit representations have gained attention due to their expressive, continuous, and compact properties. However, there is still a lack of research on city-scale continual implicit dense mapping based on sparse LiDAR input. In this study, a city-scale continual neural mapping system with a panoptic representation is developed, incorporating environment-level and instance-level modeling. A tailored three-layer sampling strategy and category-specific prior are proposed to address the challenges of representing geometric information in city-scale space and achieving high fidelity mapping of instances under incomplete observation.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MDSSN: An end-to-end deep network on triangle mesh parameterization

Ruihan Hu, Zhi-Ri Tang, Rui Yang, Zhongjie Wang

Summary: Mesh data is crucial for 3D computer vision applications worldwide, but traditional deep learning frameworks have struggled with handling meshes. This paper proposes MDSSN, a simple mesh computation framework that models triangle meshes and represents their shape using face-based and edge-based Riemannian graphs. The framework incorporates end-to-end operators inspired by traditional deep learning frameworks, and includes dedicated modules for addressing challenges in mesh classification and segmentation tasks. Experimental results demonstrate that MDSSN outperforms other state-of-the-art approaches.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Semi-supervised learning with missing values imputation

Buliao Huang, Yunhui Zhu, Muhammad Usman, Huanhuan Chen

Summary: This paper proposes a novel semi-supervised conditional normalizing flow (SSCFlow) algorithm that combines unsupervised imputation and supervised classification. By estimating the conditional distribution of incomplete instances, SSCFlow facilitates imputation and classification simultaneously, addressing the issue of separated tasks ignoring data distribution and label information in traditional methods.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Emotion-and-knowledge grounded response generation in an open-domain dialogue setting

Deeksha Varshney, Asif Ekbal, Erik Cambria

Summary: This paper focuses on the neural-based interactive dialogue system that aims to engage and retain humans in long-lasting conversations. It proposes a new neural generative model that combines step-wise co-attention, self-attention-based transformer network, and an emotion classifier to control emotion and knowledge transfer during response generation. The results from quantitative, qualitative, and human evaluation show that the proposed models can generate natural and coherent sentences, capturing essential facts with significant improvement over emotional content.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

MvTS-library: An open library for deep multivariate time series forecasting

Junchen Ye, Weimiao Li, Zhixin Zhang, Tongyu Zhu, Leilei Sun, Bowen Du

Summary: Modeling multivariate time series has long been a topic of interest for scholars in various fields. This paper introduces MvTS, an open library based on Pytorch, which provides a unified framework for implementing and evaluating these models. Extensive experiments on public datasets demonstrate the effectiveness and universality of the models reproduced by MvTS.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

An adaptive hybrid mutated differential evolution feature selection method for low and high-dimensional medical datasets

Reham R. Mostafa, Ahmed M. Khedr, Zaher Al Aghbari, Imad Afyouni, Ibrahim Kamel, Naveed Ahmed

Summary: Feature selection is crucial in classification procedures, but it faces challenges in high-dimensional datasets. To overcome these challenges, this study proposes an Adaptive Hybrid-Mutated Differential Evolution method that incorporates the mechanics of the Spider Wasp Optimization algorithm and the concept of Enhanced Solution Quality. Experimental results demonstrate the effectiveness of the method in terms of accuracy and convergence speed, and it outperforms contemporary cutting-edge algorithms.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

TCM Model for improving track sequence classification in real scenarios with Multi-Feature Fusion and Transformer Block

Ti Xiang, Pin Lv, Liguo Sun, Yipu Yang, Jiuwu Hao

Summary: This paper introduces a Track Classification Model (TCM) based on marine radar, which can effectively recognize and classify shipping tracks. By using a feature extraction network with multi-feature fusion and a dataset production method to address missing labels, the classification accuracy is improved, resulting in successful engineering application in real scenarios.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Language model as an Annotator: Unsupervised context-aware quality phrase generation

Zhihao Zhang, Yuan Zuo, Chenghua Lin, Junjie Wu

Summary: This paper proposes a novel unsupervised context-aware quality phrase mining framework called LMPhrase, which is built upon large pre-trained language models. The framework mines quality phrases as silver labels using a parameter-free probing technique on the pre-trained language model BERT, and formalizes the phrase tagging task as a sequence generation problem by fine-tuning on the Sequence to-Sequence pre-trained language model BART. The results of extensive experiments show that LMPhrase consistently outperforms existing competitors in two different granularity phrase mining tasks.

KNOWLEDGE-BASED SYSTEMS (2024)

Article Computer Science, Artificial Intelligence

Stochastic Gradient Descent for matrix completion: Hybrid parallelization on shared- and distributed-memory systems

Kemal Buyukkaya, M. Ozan Karsavuran, Cevdet Aykanat

Summary: The study aims to investigate the hybrid parallelization of the Stochastic Gradient Descent (SGD) algorithm for solving the matrix completion problem on a high-performance computing platform. A hybrid parallel decentralized SGD framework with asynchronous inter-process communication and a novel flexible partitioning scheme is proposed to achieve scalability up to hundreds of processors. Experimental results on real-world benchmark datasets show that the proposed algorithm achieves 6x higher throughput on sparse datasets compared to the state-of-the-art, while achieving comparable throughput on relatively dense datasets.

KNOWLEDGE-BASED SYSTEMS (2024)