4.7 Article

Fully convolutional attention network for biomedical image segmentation

期刊

ARTIFICIAL INTELLIGENCE IN MEDICINE
卷 107, 期 -, 页码 -

出版社

ELSEVIER
DOI: 10.1016/j.artmed.2020.101899

关键词

Biomedical image; Segmentation; Dilated fully convolutional network; Attention modules; Long-range and short-range distance

资金

  1. Xinjiang Uygur Autonomous Region Natural Science Fund Project [2016D01C050]
  2. Xinjiang Autonomous Region Science and Technology Talent Training Project [QN2016YX0051]

向作者/读者索取更多资源

In this paper, we embed two types of attention modules in the dilated fully convolutional network (FCN) to solve biomedical image segmentation tasks efficiently and accurately. Different from previous work on image seg-mentation through multiscale feature fusion, we propose the fully convolutional attention network (FCANet) to aggregate contextual information at long-range and short-range distances. Specifically, we add two types of attention modules, the spatial attention module and the channel attention module, to the Res2Net network, which has a dilated strategy. The features of each location are aggregated through the spatial attention module, so that similar features promote each other in space size. At the same time, the channel attention module treats each channel of the feature map as a feature detector and emphasizes the channel dependency between any two channel maps. Finally, we weight the sum of the output features of the two types of attention modules to retain the feature information of the long-range and short-range distances, to further improve the representation of the features and make the biomedical image segmentation more accurate. In particular, we verify that the proposed attention module can seamlessly connect to any end-to-end network with minimal overhead. We perform comprehensive experiments on three public biomedical image segmentation datasets, i.e., the Chest X-ray col-lection, the Kaggle 2018 data science bowl and the Herlev dataset. The experimental results show that FCANet can improve the segmentation effect of biomedical images. The source code models are available at https:// github.com/luhongchun/FCANet

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Information Systems

Medical image segmentation based on dual-channel integrated cross-layer residual algorithm

Hongfeng You, Long Yu, Shengwei Tian, Xiang Ma, Yan Xing

Summary: In this paper, a new deep learning algorithm (TIC-Net) is proposed for medical image segmentation. By utilizing multiple structures and feature fusion, the algorithm fully mines the semantic information between features and achieves the best results.

MULTIMEDIA TOOLS AND APPLICATIONS (2023)

Article Computer Science, Artificial Intelligence

BGAT: Aspect-based sentiment analysis based on bidirectional GRU and graph attention network

Xinyu Zhang, Long Yu, Shengwei Tian

Summary: In today's social media and lifestyle applications, expressing sentiments through comments or instant barrage is common. Aspect-based sentiment analysis has become a widely-used technology, using public datasets as benchmarks. Current models stack multi-RNNs layers or combine neural networks with pre-trained models. Considering the importance of dependencies between aspect words and sentiment words, a novel model (BGAT) blending BiGRU and RGAT is investigated to learn dependencies information. Extensive experiments on five datasets demonstrate the great capability of the model.

JOURNAL OF INTELLIGENT & FUZZY SYSTEMS (2023)

Article Computer Science, Artificial Intelligence

Attention-based multi-modal fusion sarcasm detection

Jing Liu, Shengwei Tian, Long Yu, Jun Long, Tiejun Zhou, Bo Wang

Summary: This paper proposes a multi-modal fusion sarcasm detection model based on the attention mechanism, introducing Vision Transformer (ViT) to extract image features and designing a Double-Layer Bi-Directional Gated Recurrent Unit (D-BiGRU) to extract text features. The features of the two modalities are fused into one feature vector and predicted after attention enhancement. The model presented in this paper achieved significant experimental results on the baseline datasets, with F1-score and accuracy higher by 0.71% and 0.38% respectively compared to the best baseline model.

JOURNAL OF INTELLIGENT & FUZZY SYSTEMS (2023)

Article Health Care Sciences & Services

FSOU-Net: Feature supplement and optimization U-Net for 2D medical image segmentation

Yongtao Wang, Shengwei Tian, Long Yu, Weidong Wu, Dezhi Zhang, Junwen Wang, Junlong Cheng

Summary: To improve the feature expression ability and segmentation performance of U-Net, we proposed a feature supplement and optimization U-Net (FSOU-Net). The proposed method utilizes shallow feature supplement module and deep feature optimization module to enhance the representation ability of features. Experimental results demonstrate the superiority of the proposed model in medical image segmentation.

TECHNOLOGY AND HEALTH CARE (2023)

Correction Computer Science, Information Systems

Medical image segmentation based on dual-channel integrated cross-layer residual algorithm (Sept, 10.1007/s11042-021-11326-9, 2022)

Hongfeng You, Long Yu, Shengwei Tian, Xiang Ma, Yan Xing

MULTIMEDIA TOOLS AND APPLICATIONS (2023)

Article Engineering, Biomedical

Skin disease migration segmentation network based on multi-scale channel attention

Bin Yu, Long Yu, Shengwei Tian, Weidong Wu, Zhang Dezhi, Xiaojing Kang

Summary: This research proposes a new multi-scale channel attention module (MS-CA), which is applied to an image segmentation model for accurate diagnosis and treatment planning of skin lesions. Experimental results show that the MS-CA model achieves better segmentation results compared to existing methods.

COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION (2023)

Article Engineering, Biomedical

Semi-supervised medical image classification with adaptive threshold pseudo-labeling and unreliable sample contrastive loss

Zhen Peng, Shengwei Tian, Long Yu, Dezhi Zhang, Weidong Wu, Shaofeng Zhou

Summary: Semi-supervised learning is significant in medical imaging tasks, but pseudo-labeling-based methods face two problems in medical image datasets: bias towards the majority class and loss of useful information. To address these issues, we propose FullMatch, an SSL framework that utilizes all unlabeled data. Our method includes adaptive threshold pseudo-labeling (ATPL) that generates pseudo-labels based on the model's learning status and does not discard unlabeled data below the thresholds. We also introduce unreliable sample contrastive loss (USCL) to leverage useful information from low-confidence unlabeled data. Experimental results demonstrate the superiority of our method over state-of-the-art SSL methods.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Computer Science, Interdisciplinary Applications

ReFixMatch-LS: reusing pseudo-labels for semi-supervised skin lesion classification

Shaofeng Zhou, Shenwei Tian, Long Yu, Weidong Wu, Dezhi Zhang, Zhen Peng, Zhicheng Zhou

Summary: In this article, we propose a semi-supervised learning method called ReFixMatch-LS, which combines consistency regularization and pseudo-labeling. We apply this method to medical image classification and reduce the impact of noisy labels through label smoothing and consistency regularization. By recording high-confidence pseudo-labels generated during training, we effectively increase the number of pseudo-labels and improve the model performance.

MEDICAL & BIOLOGICAL ENGINEERING & COMPUTING (2023)

Article Computer Science, Artificial Intelligence

TEDT: Transformer-Based Encoding-Decoding Translation Network for Multimodal Sentiment Analysis

Fan Wang, Shengwei Tian, Long Yu, Jing Liu, Junwen Wang, Kun Li, Yongtao Wang

Summary: In this study, a multimodal encoding-decoding translation network with a Transformer was proposed to address the impact of individual modal data on sentiment analysis results. The model achieved improved accuracy by using a joint encoding-decoding method, a modality reinforcement cross-attention module, and a dynamic filtering mechanism.

COGNITIVE COMPUTATION (2023)

Article Biochemical Research Methods

ISLMI:Predicting lncRNA-miRNA Interactions Based on Information Injection and Second-Order Graph Convolution Network

Jinmiao Song, Shengwei Tian, Long Yu, Qimeng Yang, Yuanxu Wang, Qiguo Dai, Xiaodong Duan

Summary: Studies have shown that IncRNA-miRNA interactions have important effects on gene expression and biological activities. In this research, a new prediction model called ISLMI was proposed, which used information injection and a second order graph convolution network (SOGCN) to enhance the performance of predicting lncRNA-miRNA interactions. The model achieved reliable performance in 5-fold cross-validation and significantly improved the prediction accuracy.

IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS (2023)

Article Computer Science, Artificial Intelligence

A stereo spatial decoupling network for medical image classification

Hongfeng You, Long Yu, Shengwei Tian, Weiwei Cai

Summary: We propose a stereo spatial discoupling network (TSDNets) to leverage the multi-dimensional spatial details of medical images, solve the difficulty of establishing effective spatial associations, and extract similar low-level features, resulting in redundancy of information.

COMPLEX & INTELLIGENT SYSTEMS (2023)

Article Engineering, Biomedical

FixMatch-LS: Semi-supervised skin lesion classification with label smoothing

Shaofeng Zhou, Shenwei Tian, Long Yu, Weidong Wu, Dezhi Zhang, Zhen Peng, Zhicheng Zhou, Junwen Wang

Summary: Recent research in semi-supervised learning focuses on consistency regularization using data augmentation, while the more general method of pseudolabelling is limited by noisy training. Medical datasets have a long-tail distribution, and combining these limitations, we propose FixMatch-LS and its variant FixMatch-LS-v2 for medical image classification. We introduce label smoothing to adjust the pseudolabel threshold and reduce the influence of noisy pseudolabels, and emphasize the importance of consistency for pseudolabelling to improve pseudolabel quality. The framework is validated on skin lesion diagnoses from the ISIC 2018 and ISIC 2019 challenges, achieving AUCs of 91.63%, 93.70%, 94.46%, and 95.44% on different proportions of labelled data from ISIC 2018.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Computer Science, Artificial Intelligence

A few-shot disease diagnosis decision making model based on meta-learning for general practice

Qianghua Liu, Yu Tian, Tianshu Zhou, Kewei Lyu, Ran Xin, Yong Shang, Ying Liu, Jingjing Ren, Jingsong Li

Summary: This study proposes a few-shot disease diagnosis decision making model based on a model-agnostic meta-learning algorithm (FSDD-MAML). It significantly improves the diagnostic process in primary health care and helps general practitioners diagnose few-shot diseases more accurately.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2024)

Article Computer Science, Artificial Intelligence

Predicting stroke outcome: A case for multimodal deep learning methods with tabular and CT Perfusion data

Balazs Borsos, Corinne G. Allaart, Aart van Halteren

Summary: The study demonstrates the feasibility of predicting functional outcomes for ischemic stroke patients and the usability of multimodal deep learning architectures for this purpose.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2024)

Article Computer Science, Artificial Intelligence

Depression detection for twitter users using sentiment analysis in English and Arabic tweets

Abdelmoniem Helmy, Radwa Nassar, Nagy Ramdan

Summary: This study utilizes machine learning models to detect depression symptoms in Arabic and English texts, and provides manually and automatically annotated tweet corpora. The study also develops an application that can detect tweets with depression symptoms and predict depression trends.

ARTIFICIAL INTELLIGENCE IN MEDICINE (2024)