4.7 Article

Relation-Aware Shared Representation Learning for Cancer Prognosis Analysis With Auxiliary Clinical Variables and Incomplete Multi-Modality Data

期刊

IEEE TRANSACTIONS ON MEDICAL IMAGING
卷 41, 期 1, 页码 186-198

出版社

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
DOI: 10.1109/TMI.2021.3108802

关键词

Cancer; Prognostics and health management; Data models; Training; Genomics; Clinical diagnosis; Bioinformatics; Prognosis analysis; shared representations; auxiliary clinical variables; incomplete multi-modality data

资金

  1. National Natural Science Foundation of China [61971213, 61671230]
  2. Basic and Applied Basic Research Foundation of Guangdong Province [2019A1515010417]
  3. Guangdong Provincial Key Laboratory of Medical Image Processing [2020B1212060039]

向作者/读者索取更多资源

This study proposes a relation-aware shared representation learning method for prognostic analysis of cancers, which makes full use of clinical information and incomplete multi-modality data. The proposed method learns multi-modal shared space tailored for prognostic model through a dual mapping. Experimental results demonstrate the superior performance of the proposed method.
The integrative analysis of complementary phenotype information contained in multi-modality data (e.g., histopathological images and genomic data) has advanced the prognostic evaluation of cancers. However, multi-modality based prognosis analysis confronts two challenges: (1) how to explore underlying relations inherent in different modalities data for learning compact and discriminative multi-modality representations; (2) how to take full consideration of incomplete multi-modality data for constructing accurate and robust prognostic model, since a host of complete multi-modality data are not always available. Additionally, many existing multi-modality based prognostic methods commonly ignore relevant clinical variables (e.g., grade and stage), which, however, may provide supplemental information to promote the performance of model. In this paper, we propose a relation-aware shared representation learning method for prognosis analysis of cancers, which makes full use of clinical information and incomplete multi-modality data. The proposed method learns multi-modal shared space tailored for prognostic model via a dual mapping. Within the shared space, it equips with relational regularizers to explore the potential relations (i.e., feature-label and feature-feature relations) among multi-modality data for inducing discriminatory representations and simultaneously obtaining extra sparsity for alleviating overfitting. Moreover, it regresses and incorporates multiple auxiliary clinical attributes with dynamic coefficients to meliorate performance. Furthermore, in training stage, a partial mapping strategy is employed to extend and train a more reliable model with incomplete multi-modality data. We have evaluated our method on three public datasets derived from The Cancer Genome Atlas (TCGA) project, and the experimental results demonstrate the superior performance of the proposed method.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Interdisciplinary Applications

A Joint Framework for Denoising and Estimating Diffusion Kurtosis Tensors Using Multiple Prior Information

Li Guo, Jian Lyu, Zhe Zhang, Jinping Shi, Qianjin Feng, Yanqiu Feng, Mingyong Gao, Xinyuan Zhang

Summary: Diffusion kurtosis imaging (DKI) has shown its value in various applications, but accurate estimation of DKI tensors is often compromised by noise. This study proposes a joint denoising and estimating framework that integrates multiple sources of prior information to improve the estimation of DKI tensors. The results demonstrate that the proposed method outperforms other methods in simulations and in-vivo dMRI datasets with spatially stationary and nonstationary noise distributions. The study also confirms the effectiveness of integrating multiple sources of priors into the joint framework and the importance of local and nonlocal spatial smoothing constraints.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2022)

Article Computer Science, Interdisciplinary Applications

SMU-Net: Saliency-Guided Morphology-Aware U-Net for Breast Lesion Segmentation in Ultrasound Image

Zhenyuan Ning, Shengzhou Zhong, Qianjin Feng, Wufan Chen, Yu Zhang

Summary: In this paper, a saliency-guided morphology-aware U-Net (SMU-Net) is proposed for lesion segmentation in breast ultrasound images. This method utilizes saliency maps to guide the network for learning foreground and background representations, and incorporates a middle stream for fusing features and enhancing morphological information. Experimental results demonstrate superior performance and robustness compared to state-of-the-art approaches.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2022)

Article Computer Science, Artificial Intelligence

Automatic 3-D segmentation and volumetric light fluence correction for photoacoustic tomography based on optimal 3-D graph search

Zhichao Liang, Shuangyang Zhang, Jian Wu, Xipan Li, Zhijian Zhuang, Qianjin Feng, Wufan Chen, Li Qi

Summary: Preclinical imaging with photoacoustic tomography (PAT) has gained attention for its ability to provide molecular contrast with deep imaging depth. Automatic extraction and segmentation of animals in PAT images is crucial for improving image analysis efficiency and enabling advanced image post-processing. By proposing a volumetric auto-segmentation method based on the 3-D optimal graph search (3-D GS) algorithm, the study ensures surface continuity and enhances the accuracy and smoothness of segmented animal surfaces. Testing the method in vivo nude mice imaging experiments showed successful retention of continuous global surface structure and smooth local subcutaneous tumor boundaries in different development stages, leading to enhanced structural visibility and uniform image intensity in LF corrected PAT images.

MEDICAL IMAGE ANALYSIS (2022)

Article Computer Science, Artificial Intelligence

DGMSNet: Spine segmentation for MR image by a detection-guided mixed-supervised segmentation network

Shumao Pang, Chunlan Pang, Zhihai Su, Liyan Lin, Lei Zhao, Yangfan Chen, Yujia Zhou, Hai Lu, Qianjin Feng

Summary: The paper introduces a novel mixed-supervised segmentation network to reduce inter-class similarity in spine segmentation. By generating dynamic parameters for semantic feature map and utilizing a mixed-supervised loss, the network achieves state-of-the-art performance in automated spine segmentation.

MEDICAL IMAGE ANALYSIS (2022)

Article Engineering, Biomedical

Neural architecture search for real-time quality assessment of wearable multi-lead ECG on mobile devices

Huixin Tan, Jiewei Lai, Yunbi Liu, Yuzhang Song, Jinliang Wang, Mingyang Chen, Yong Yan, Liming Zhong, Qianjin Feng, Wei Yang

Summary: In this study, a robust and lightweight quality assessment model for wearable ECG data is developed using neural architecture search algorithm. The model achieved excellent performance on large-scale datasets with high AUC and F1 scores. The proposed method is effective in real-time assessment of the quality of all leads of wearable ECG data on mobile devices.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2022)

Article Orthopedics

Automatic segmentation model of intercondylar fossa based on deep learning: a novel and effective assessment method for the notch volume

Mifang Li, Hanhua Bai, Feiyuan Zhang, Yujia Zhou, Qiuyu Lin, Quan Zhou, Qianjin Feng, Lingyan Zhang

Summary: This study aimed to develop an MRI segmentation model of intercondylar fossa using deep learning to automatically measure notch volume and explore its correlation with ACL injury.

BMC MUSCULOSKELETAL DISORDERS (2022)

Article Computer Science, Interdisciplinary Applications

EVA: Fully automatic hemodynamics assessment system for the bulbar conjunctival microvascular network

Zhaoqiang Yun, Qing Xu, Gengyuan Wang, Shuang Jin, Guoye Lin, Qianjin Feng, Jin Yuan

Summary: In this study, an EVA system based on deep learning was developed to quantitatively assess hemodynamics in conjunctival microvascular images. The system maintained vessel segmentation continuity and automatically measured blood velocity, providing an automatic and reliable solution.

COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE (2022)

Article Neurosciences

Deep learning derived automated ASPECTS on non-contrast CT scans of acute ischemic stroke patients

Zehong Cao, Jiaona Xu, Bin Song, Lizhou Chen, Tianyang Sun, Yichu He, Ying Wei, Guozhong Niu, Yu Zhang, Qianjin Feng, Zhongxiang Ding, Feng Shi, Dinggang Shen

Summary: In this study, an automated ASPECTS scoring method utilizing neural networks was proposed. The method achieved remarkable performance in a large dataset and an independent testing dataset, and showed a high correlation between ASPECTS scores and patient prognosis.

HUMAN BRAIN MAPPING (2022)

Article Orthopedics

Three-dimensional reconstruction of Kambin's triangle based on automated magnetic resonance image segmentation

Zhihai Su, Zheng Liu, Min Wang, Shaolin Li, Liyan Lin, Zhen Yuan, Shumao Pang, Qianjin Feng, Tao Chen, Hai Lu

Summary: This study developed a new method for 3D reconstruction of Kambin's triangle using automated MRI segmentation. The method showed good performance in segmenting lumbar spinal structures and evaluating anatomical performance.

JOURNAL OF ORTHOPAEDIC RESEARCH (2022)

Article Computer Science, Artificial Intelligence

DDTNet: A dense dual-task network for tumor-infiltrating lymphocyte detection and segmentation in histopathological images of breast cancer

Xiaoxuan Zhang, Xiongfeng Zhu, Kai Tang, Yinghua Zhao, Zixiao Lu, Qianjin Feng

Summary: In this paper, a novel dense dual-task network (DDTNet) is proposed to achieve automatic detection and segmentation of tumor-infiltrating lymphocytes (TILs) in histopathological images. DDTNet utilizes a feature pyramid network for extracting multi-scale morphological characteristics of TILs, a detection module for locating TIL centers, and a segmentation module for delineating TIL boundaries. Experimental results show that DDTNet outperforms other methods in detection and segmentation metrics.

MEDICAL IMAGE ANALYSIS (2022)

Article Computer Science, Artificial Intelligence

Structure-constraine d combination-base d nonlinear association analysis between incomplete multimodal imaging and genetic data for biomarker detection of neurodegenerative diseases

Xiumei Chen, Tao Wang, Haoran Lai, Xiaoling Zhang, Qianjin Feng, Meiyan Huang

Summary: In this study, a novel method was proposed to analyze and detect the associations between multimodal imaging and genetic data for biomarker detection of neurodegenerative diseases. The method utilized structure constraints and nonlinear association analysis, achieving high accuracy of biomarker detection and validating previously identified disease-related biomarkers. This suggests that the method may provide insights into the pathological mechanism of neurodegenerative diseases and early prediction.

MEDICAL IMAGE ANALYSIS (2022)

Article Radiology, Nuclear Medicine & Medical Imaging

Improving sensitivity and connectivity of retinal vessel segmentation via error discrimination network

Guoye Lin, Hanhua Bai, Jie Zhao, Zhaoqiang Yun, Yangfan Chen, Shumao Pang, Qianjin Feng

Summary: The proposed method provides an accurate and robust solution for difficult vessel segmentation by introducing an error discrimination network to assist the segmentation network and training with different types of vessel samples and error masks, improving sensitivity to small vessels and the connectivity of segmentation results.

MEDICAL PHYSICS (2022)

Article Neurosciences

Continuous Blood Pressure Estimation Based on Multi-Scale Feature Extraction by the Neural Network With Multi-Task Learning

Hengbing Jiang, Lili Zou, Dequn Huang, Qianjin Feng

Summary: This article proposes and evaluates a novel method for continuous blood pressure estimation based on multi-scale feature extraction by a neural network with multi-task learning. The developed method achieves high accuracy and meets standard requirements without the need for calibration. It has the potential to enable continuous blood pressure monitoring by mobile health devices.

FRONTIERS IN NEUROSCIENCE (2022)

Article Computer Science, Artificial Intelligence

Multi-Constraint Latent Representation Learning for Prognosis Analysis Using Multi-Modal Data

Zhenyuan Ning, Zehui Lin, Qing Xiao, Denghui Du, Qianjin Feng, Wufan Chen, Yu Zhang

Summary: In this article, a novel Cox-driven multi-constraint latent representation learning framework is proposed for prognosis analysis with multi-modal data. The framework efficiently fuses and selects complementary information from high-dimensional multi-modal data by learning a multi-modal latent space via a bi-mapping approach with ranking and regression constraints. The proposed method outperforms state-of-the-art Cox-based models according to extensive experiments on three datasets acquired from The Cancer Genome Atlas (TCGA).

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

暂无数据