4.6 Article

Patient-specific reconstruction of volumetric computed tomography images from a single projection view via deep learning

期刊

NATURE BIOMEDICAL ENGINEERING
卷 3, 期 11, 页码 880-888

出版社

NATURE PORTFOLIO
DOI: 10.1038/s41551-019-0466-4

关键词

-

资金

  1. National Institutes of Health [R01CA176553, R01EB016777]

向作者/读者索取更多资源

Tomographic imaging using penetrating waves generates cross-sectional views of the internal anatomy of a living subject. For artefact-free volumetric imaging, projection views from a large number of angular positions are required. Here we show that a deep-learning model trained to map projection radiographs of a patient to the corresponding 3D anatomy can subsequently generate volumetric tomographic X-ray images of the patient from a single projection view. We demonstrate the feasibility of the approach with upper-abdomen, lung, and head-and-neck computed tomography scans from three patients. Volumetric reconstruction via deep learning could be useful in image-guided interventional procedures such as radiation therapy and needle biopsy, and might help simplify the hardware of tomographic imaging systems.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.6
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Interdisciplinary Applications

Label-Efficient Self-Supervised Federated Learning for Tackling Data Heterogeneity in Medical Imaging

Rui Yan, Liangqiong Qu, Qingyue Wei, Shih-Cheng Huang, Liyue Shen, Daniel L. Rubin, Lei Xing, Yuyin Zhou

Summary: In this paper, a robust and label-efficient self-supervised federated learning (FL) framework for medical image analysis is proposed. The method introduces a novel Transformer-based self-supervised pre-training paradigm, which enhances the robustness of models against heterogeneous data and improves knowledge transfer to downstream models. Extensive experiments on simulated and real-world medical imaging non-IID federated datasets demonstrate the effectiveness of the proposed method.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Radiology, Nuclear Medicine & Medical Imaging

Modeling linear accelerator (Linac) beam data by implicit neural representation learning for commissioning and quality assurance applications

Lianli Liu, Liyue Shen, Yong Yang, Emil Schueler, Wei Zhao, Gordon Wetzstein, Lei Xing

Summary: In this study, a NeRP beam data modeling technique was developed to predict beam characteristics from sparse measurements and detect data collection errors. The model showed promising results in predicting beam data and verifying its accuracy, which can simplify the commissioning and QA process without compromising the quality of medical physics service.

MEDICAL PHYSICS (2023)

Article Radiology, Nuclear Medicine & Medical Imaging

Sub-second photon dose prediction via transformer neural networks

Oscar Pastor-Serrano, Peng Dong, Charles Huang, Xing Lei, Zoltan Perko

Summary: This study presents a deep learning algorithm that accurately predicts broad photon beam dose distributions in a few milliseconds by combining transformer and convolutional layers. The proposed algorithm maps patient geometries and beam information to corresponding dose distributions, achieving high accuracy and speed.

MEDICAL PHYSICS (2023)

Article Computer Science, Artificial Intelligence

Image classification using graph neural network and multiscale wavelet superpixels

Varun Vasudevan, Maxime Bassenne, Md Tauhidul Islam, Lei Xing

Summary: Previous studies on image classification using graph neural networks (GNNs) have mainly focused on graphs generated from a regular grid of pixels or similar-sized superpixels. However, this study investigates image classification using graphs generated from an image-specific number of multiscale superpixels. The proposed WaveMesh algorithm calculates the number and sizes of superpixels in an image based on its content, resulting in structurally different superpixel graphs compared to similar-sized superpixels. Experimental results show that the SplineCNN network learns from multiscale WaveMesh superpixels on-par with similar-sized superpixels, while poor cluster assignment negatively affects the network's performance.

PATTERN RECOGNITION LETTERS (2023)

Article Engineering, Biomedical

Improving anisotropy resolution of computed tomography and annotation using 3D super-resolution network

Rongjun Ge, Fanqi Shi, Yang Chen, Shujun Tang, Hailong Zhang, Xiaojian Lou, Wei Zhao, Gouenou Coatrieux, Dazhi Gao, Shuo Li, Xiaoli Mai

Summary: In this study, an Average Super-Resolution Generative Adversarial Network (ASRGAN) is proposed to recover inter-slice information from CT images with different quality. Experimental results show that ASRGAN outperforms other methods in reconstruction, with a 2.42 db improvement in PSNR. Additionally, based on its reconstruction results, it further improves 3D segmentation of abdominal tumors and the pancreas.

BIOMEDICAL SIGNAL PROCESSING AND CONTROL (2023)

Article Computer Science, Interdisciplinary Applications

Less Is More: Surgical Phase Recognition From Timestamp Supervision

Xinpeng Ding, Xinjian Yan, Zixun Wang, Wei Zhao, Jian Zhuang, Xiaowei Xu, Xiaomeng Li

Summary: This paper introduces a timestamp supervision method for surgical phase recognition, which reduces the manual annotation cost. The proposed UATD method generates reliable pseudo labels for training and achieves competitive results in surgical phase recognition.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Multidisciplinary Sciences

Cartography of Genomic Interactions Enables Deep Analysis of Single-Cell Expression Data

Md Tauhidul Islam, Lei Xing

Summary: The authors develop a cartography strategy based on gene-gene interactions to transform high-dimensional gene expression data into a spatially configured genomap, enabling accurate deep pattern discovery. This approach presents significant challenges and opportunities in the field of single cell genomics for biomedical research. The unique cartography method captures gene interactions in the spatial configuration of genomaps, allowing for the extraction of deep genomic interaction features and the discovery of discriminative patterns in the data.

NATURE COMMUNICATIONS (2023)

Article Engineering, Biomedical

Tumor detection under cystoscopy with transformer-augmented deep learning algorithm

Xiao Jia, Eugene Shkolyar, Mark A. Laurie, Okyaz Eminaga, Joseph C. Liao, Lei Xing

Summary: This study developed a deep learning algorithm for accurate detection of bladder tumors in white-light cystoscopy. The algorithm, CystoNet-T, uses a transformer-augmented pyramidal CNN architecture to improve tumor detection performance. The algorithm achieved high F1 and AP scores on a test set of patient data.

PHYSICS IN MEDICINE AND BIOLOGY (2023)

Article Multidisciplinary Sciences

Biology-guided deep learning predicts prognosis and cancer immunotherapy response

Yuming Jiang, Zhicheng Zhang, Wei Wang, Weicai Huang, Chuanli Chen, Sujuan Xi, M. Usman Ahmad, Yulan Ren, Shengtian Sang, Jingjing Xie, Jen-Yeu Wang, Wenjun Xiong, Tuanjie Li, Zhen Han, Qingyu Yuan, Yikai Xu, Lei Xing, George A. Poultsides, Guoxin Li, Ruijiang Li

Summary: Significant progress has been made in using deep learning for cancer detection and diagnosis, but predicting treatment response and outcomes remains challenging. This study presents a biology-guided deep learning approach that simultaneously predicts tumor microenvironment status and treatment outcomes from medical images. The model was validated for gastric cancer prognosis and response to adjuvant chemotherapy, and it complements clinically approved biomarkers, providing information for patient selection.

NATURE COMMUNICATIONS (2023)

Proceedings Paper Optics

Flat lesion detection of white light cystoscopy with deep learning

Xiao Jia, Eugene Shkolyar, Okyaz Eminaga, Mark A. Laurie, Zixia Zhou, Timothy Lee, Md Tauhidul Islam, Max Q. -H. Meng, Joseph C. Liao, Lei Xing

Summary: In this study, a deep-learning algorithm called CystoNet-F was developed to enhance the detection of flat lesions in white-light cystoscopy. By incorporating domain translation, transfer learning, and region of interest detection, the algorithm improves the ability to detect lesions in standard white-light cystoscopy.

ADVANCED PHOTONICS IN UROLOGY 2023 (2023)

Proceedings Paper Optics

Sequential Modeling for Cystoscopic Image Classification

Mark Laurie, Okyaz Eminaga, Eugene Shkolyar, Xiao Jia, Timothy Lee, Jin Long, Md Tauhidul Islam, Hubert Lau, Lei Xing, Joseph C. Liao

Summary: In this study, four advanced sequential models (SlowFast, Multiscale Vision Transformers, X3D, and CNN-LSTM) were used to train and classify bladder tumors. The best performing model was X3D with a sequence length of 8, achieving 100% sensitivity, 94.7% sensitivity, and 80.0% specificity. Sequential modeling has the potential to accurately classify a wide variety of bladder tumors in a real-time setting.

ADVANCED PHOTONICS IN UROLOGY 2023 (2023)

Proceedings Paper Computer Science, Artificial Intelligence

PINER: Prior-informed Implicit Neural Representation Learning for Test-time Adaptation in Sparse-view CT Reconstruction

Bowen Song, Liyue Shen, Lei Xing

Summary: Recently, deep learning has been used to address medical image reconstruction problems in CT scans with limited views. However, these models have difficulty generalizing to new domains and the privacy concerns limit access to training data. To overcome these challenges, a source-free black-box test-time adaptation method called PINER is introduced. By leveraging implicit neural representation learning, the method can adapt to unknown noise levels and outperforms state-of-the-art algorithms.

2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV) (2023)

Article Computer Science, Artificial Intelligence

Small-Object Sensitive Segmentation Using Across Feature Map Attention

Shengtian Sang, Yuyin Zhou, Md Tauhidul Islam, Lei Xing

Summary: This article introduces a novel attention-based method called AFMA, which addresses the issue of information loss in small object segmentation. By utilizing different feature levels of the original image, AFMA quantifies the inner relationship between large and small objects of the same category, compensating for the loss of high-level feature information and improving segmentation accuracy. Extensive experiments demonstrate the substantial and consistent improvement of small object segmentation achieved by our method.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Multibranch CNN With MLP-Mixer-Based Feature Exploration for High-Performance Disease Diagnosis

Zixia Zhou, Md Tauhidul Islam, Lei Xing

Summary: Deep learning-based diagnosis is essential in modern healthcare. An optimal design of deep neural networks (DNNs) is crucial for high-performance diagnosis. Existing supervised DNNs based on convolutional layers tend to have limited feature exploration ability, which compromises the network performance.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

Article Radiology, Nuclear Medicine & Medical Imaging

Volumetric MRI with sparse sampling for MR-guided 3D motion tracking via sparse prior-augmented implicit neural representation learning

Lianli Liu, Liyue Shen, Adam Johansson, James M. Balter, Yue Cao, Lucas Vitzthum, Lei Xing

Summary: A method for volumetric MRI reconstruction using a NeRP model has been proposed, training the model with only one inhale and one exhale 3D MRI to learn prior information of patient breathing motion for sparse image reconstruction. The method has the potential to support 3D motion tracking during MR-guided radiotherapy and promises a major simplification of the workflow.

MEDICAL PHYSICS (2023)

暂无数据