4.6 Article

Multifeature Analysis and Semantic Context Learning for Image Classification

Publisher

ASSOC COMPUTING MACHINERY
DOI: 10.1145/2457450.2457454

Keywords

Algorithms; Image classification; object detection; multifeature fusion; semantic context modeling

Funding

  1. European Commission [FP7-287704 CUBRIK]

Ask authors/readers for more resources

This article introduces an image classification approach in which the semantic context of images and multiple low-level visual features are jointly exploited. The context consists of a set of semantic terms defining the classes to be associated to unclassified images. Initially, a multiobjective optimization technique is used to define a multifeature fusion model for each semantic class. Then, a Bayesian learning procedure is applied to derive a context model representing relationships among semantic classes. Finally, this context model is used to infer object classes within images. Selected results from a comprehensive experimental evaluation are reported to show the effectiveness of the proposed approaches.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.6
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Radiology, Nuclear Medicine & Medical Imaging

A Cascade-SEME network for COVID-19 detection in chest c-ray images

Dailin Lv, Yaqi Wang, Shuai Wang, Qianni Zhang, Wuteng Qi, Yunxiang Li, Lingling Sun

Summary: The proposed Cascade-SEME framework effectively detects COVID-19 cases by evaluating chest x-ray images, improving model performance significantly in pneumonia infection type diagnosis and COVID-19 detection tasks. The application of SEME structure in the network enhances the performance of ResNet50 and DenseNet169, while Regional Learning corrects the impact of non-lesion features and directs the network's attention to relevant pathological regions in lung radiographs.

MEDICAL PHYSICS (2021)

Article Cardiac & Cardiovascular Systems

End-diastolic segmentation of intravascular ultrasound images enables more reproducible volumetric analysis of atheroma burden

Emrah Erdogan, Xingru Huang, Jackie Cooper, Ajay Jain, Anantharaman Ramasamy, Retesh Bajaj, Ryo Torii, James Moon, Andrew Deaner, Christos Costa, Hector M. Garcia-Garcia, Vincenzo Tufaro, Patrick W. Serruys, Francesca Pugliese, Anthony Mathur, Jouke Dijkstra, Andreas Baumbach, Qianni Zhang, Christos V. Bourantas

Summary: This study compared the reproducibility of IVUS volumetric analysis at fixed frame intervals and at end diastolic (ED) frames, showing that ED analysis was more reproducible and stable, providing more accurate results for longitudinal studies assessing novel pharmacotherapies.

CATHETERIZATION AND CARDIOVASCULAR INTERVENTIONS (2022)

Article Cardiac & Cardiovascular Systems

Advanced deep learning methodology for accurate, real-time segmentation of high-resolution intravascular ultrasound images

Retesh Bajaj, Xingru Huang, Yakup Kilic, Anantharaman Ramasamy, Ajay Jain, Mick Ozkor, Vincenzo Tufaro, Hannah Safi, Emrah Erdogan, Patrick W. Serruys, James Moon, Francesca Pugliese, Anthony Mathur, Ryo Torii, Andreas Baumbach, Jouke Dijkstra, Qianni Zhang, Christos Bourantas

Summary: This study aimed to develop and validate a deep learning methodology for automated and accurate segmentation of IVUS image sequences in real-time. The results demonstrated that the developed DL methodology showed minimal differences compared to expert analysts, indicating its accuracy and reliability for segmenting IVUS images.

INTERNATIONAL JOURNAL OF CARDIOLOGY (2021)

Article Computer Science, Artificial Intelligence

SRPN: similarity-based region proposal networks for nuclei and cells detection in histology images

Yibao Sun, Xingru Huang, Huiyu Zhou, Qianni Zhang

Summary: The proposed similarity based region proposal networks (SRPN) for nuclei and cells detection in histology images utilize an embedding layer for similarity learning to enhance classification performance. Experimental results demonstrate that networks applying similarity learning outperform conventional methods on both tasks of multi-organ nuclei detection and signet ring cells detection.

MEDICAL IMAGE ANALYSIS (2021)

Article Computer Science, Artificial Intelligence

Cost-Sensitive Boosting Pruning Trees for Depression Detection on Twitter

Lei Tong, Zhihua Liu, Zheheng Jiang, Feixiang Zhou, Long Chen, Jialin Lyu, Xiangrong Zhang, Qianni Zhang, Abdul Sadka, Yinhai Wang, Ling Li, Huiyu Zhou

Summary: Depression is a common mental health disorder, and many sufferers do not seek help due to shame or lack of awareness. This paper proposes a novel classifier, CBPT, which can accurately detect depression by mining online social behaviors. The results show that the framework has promising potential for identifying Twitter users with depression.

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING (2023)

Article Computer Science, Information Systems

AGMB-Transformer: Anatomy-Guided Multi-Branch Transformer Network for Automated Evaluation of Root Canal Therapy

Yunxiang Li, Guodong Zeng, Yifan Zhang, Jun Wang, Qun Jin, Lingling Sun, Qianni Zhang, Qisi Lian, Guiping Qian, Neng Xia, Ruizi Peng, Kai Tang, Shuai Wang, Yaqi Wang

Summary: The article introduces an automated evaluation method for root canal therapy results using computer vision and artificial intelligence, proposing a novel AGMB-Transformer network to improve diagnostic accuracy. Through collecting a large-scale dataset of root canal therapy X-ray images, the experimental results demonstrate the effectiveness and accuracy of the approach.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2022)

Article Automation & Control Systems

Multimodal Gait Recognition for Neurodegenerative Diseases

Aite Zhao, Jianbo Li, Junyu Dong, Lin Qi, Qianni Zhang, Ning Li, Xin Wang, Huiyu Zhou

Summary: This article proposes a novel hybrid model to learn gait differences between different neurodegenerative diseases, Parkinson's disease severity levels, and healthy individuals and patients through fusion and aggregation of data from multiple sensors. The model utilizes a spatial feature extractor and a new correlative memory neural network architecture to capture temporal information, along with a multiswitch discriminator to associate observations with individual state estimations. Compared to several state-of-the-art techniques, the framework shows more accurate classification results.

IEEE TRANSACTIONS ON CYBERNETICS (2022)

Article Biology

Class-Aware Attention Network for infectious keratitis diagnosis using corneal photographs

Jinhao Li, Shuai Wang, Shaodan Hu, Yiming Sun, Yaqi Wang, Peifang Xu, Juan Ye

Summary: This paper proposes a novel method, CAA-Net, for automatically diagnosing infectious keratitis using corneal photographs. The method combines class-awareness and attention strategies, and has been verified to be effective in diagnosing different types of infectious keratitis.

COMPUTERS IN BIOLOGY AND MEDICINE (2022)

Article Engineering, Biomedical

Disagreement attention: Let us agree to disagree on computed tomography segmentation

Edgar Giussepi Lopez Molina, Xingru Huang, Qianni Zhang

Summary: This research combines co-training and attention mechanisms to propose a new type of attention based on disagreement, which improves model generalization. It also introduces an innovative deep supervision approach that trains the model following the sequence of supervision branches. Extensive experiments on LiTS17 and CT-82 datasets verify the effectiveness of these approaches.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Computer Science, Artificial Intelligence

Stimulus-guided adaptive transformer network for retinal blood vessel segmentation in fundus images

Ji Lin, Xingru Huang, Huiyu Zhou, Yaqi Wang, Qianni Zhang

Summary: Automated retinal blood vessel segmentation in fundus images is a challenging task due to the variety in scale and appearance of blood vessels, as well as the similarity in visual features between lesions and retinal vascular. In this study, a Stimulus-Guided Adaptive Transformer Network (SGAT-Net) is proposed to accurately segment retinal blood vessels by extracting compound features, enriching contextual embedding representation, and adjusting the receptive field based on the task. Experimental results on multiple datasets demonstrate the competitive performance and advantage of the proposed method in avoiding errors in areas with similar visual features. The source code is publicly available at https://github.com/Gins-07/SGAT.

MEDICAL IMAGE ANALYSIS (2023)

Article Computer Science, Interdisciplinary Applications

CANet: Context Aware Network for Brain Glioma Segmentation

Zhihua Liu, Lei Tong, Long Chen, Feixiang Zhou, Zheheng Jiang, Qianni Zhang, Yinhai Wang, Caifeng Shan, Ling Li, Huiyu Zhou

Summary: The study introduces a novel method called CANet for brain glioma segmentation, which outperforms other methods and is better at incorporating contextual information of tumor cells and their surrounding environment.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2021)

Article Computer Science, Information Systems

Building High-Fidelity Human Body Models From User-Generated Data

Zongyi Xu, Wei Chang, Yindi Zhu, Le Dong, Huiyu Zhou, Qianni Zhang

Summary: Two approaches are proposed to estimate high-fidelity human body models, one based on 3D scanner point clouds and the other based on 2D images from smartphones. Extensive experiments demonstrate that both approaches can robustly build believable and animatable human body models.

IEEE TRANSACTIONS ON MULTIMEDIA (2021)

Proceedings Paper Computer Science, Artificial Intelligence

BEM-RCNN Segmentation Based on the Inadequately Labeled Moving Mesenchymal Stem Cells

Jingxiong Li, Yaqi Wang, Qianni Zhang

IMAGE ANALYSIS AND RECOGNITION (ICIAR 2019), PT II (2019)

Article Computer Science, Information Systems

CNN and KPCA-Based Automated Feature Extraction for Real Time Driving Pattern Recognition

Liang Xie, Jili Tao, Qianni Zhang, Huiyu Zhou

IEEE ACCESS (2019)

Proceedings Paper Engineering, Biomedical

US-NET FOR ROBUST AND EFFICIENT NUCLEI INSTANCE SEGMENTATION

Zhaoyang Xu, Faranak Sohhani, Carlos Fernandez Moro, Qianni Hang

2019 IEEE 16TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2019) (2019)

No Data Available