4.7 Article

BIRNet: Brain image registration using dual-supervised fully convolutional networks

期刊

MEDICAL IMAGE ANALYSIS
卷 54, 期 -, 页码 193-206

出版社

ELSEVIER
DOI: 10.1016/j.media.2019.03.006

关键词

Image registration; Convolutional neural networks; Brain MR image; Hierarchical registration

资金

  1. NIH [EB006733, EB008374, MH100217, MH108914, AG041721, AG049371, AG042599, AG053867, EB022880, MH110274]

向作者/读者索取更多资源

In this paper, we propose a deep learning approach for image registration by predicting deformation from image appearance. Since obtaining ground-truth deformation fields for training can be challenging, we design a fully convolutional network that is subject to dual-guidance: (1) Ground-truth guidance using deformation fields obtained by an existing registration method; and (2) Image dissimilarity guidance using the difference between the images after registration. The latter guidance helps avoid overly relying on the supervision from the training deformation fields, which could be inaccurate. For effective training, we further improve the deep convolutional network with gap filling, hierarchical loss, and multi-source strategies. Experiments on a variety of datasets show promising registration accuracy and efficiency compared with state-of-the-art methods. (C) 2019 Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Computer Science, Artificial Intelligence

Denoising of MR and CT images using cascaded multi-supervision convolutional neural networks with progressive training

Hong Song, Lei Chen, Yutao Cui, Qiang Li, Qi Wang, Jingfan Fan, Jian Yang, Le Zhang

Summary: In this paper, the authors propose a cascaded multi-supervision convolutional neural network (CMSNet) to remove low-dose perfusion noise in CT images and Rician noise in MR images. The network consists of a multi-supervision network (MSNet) and a refinement network, which are used for noise prediction and denoising operations. Experimental results demonstrate the promising performance of the proposed model under different noise levels.

NEUROCOMPUTING (2022)

Article Engineering, Biomedical

Fusion Siamese network with drift correction for target tracking in ultrasound sequences

Chan Wu, Tianyu Fu, Yifan Wang, Yucong Lin, Yan Wang, Danni Ai, Jingfan Fan, Hong Song, Jian Yang

Summary: This article proposes a fusion Siamese network with drift correction for target tracking in ultrasound sequences. By generating response maps using cross-correlation between convolution layers at different resolutions and combining a correction strategy, the method effectively corrects target drift. Experimental results demonstrate its high tracking accuracy on ultrasound image data.

PHYSICS IN MEDICINE AND BIOLOGY (2022)

Article Biochemical Research Methods

Feature matching for texture-less endoscopy images via superpixel vector field consistency

Shiyuan Liu, Jingfan Fan, Danni Ai, Hong Song, Tianyu Fu, Yongtian Wang, Jian Yang

Summary: Feature matching is crucial in obtaining the surface morphology of soft tissues in intraoperative endoscopy images. We proposed an adaptive gradient-preserving method to enhance the visual features of texture-less images. Experimental results demonstrate the effectiveness of our method in feature point extraction and surface reconstruction.

BIOMEDICAL OPTICS EXPRESS (2022)

Editorial Material Biophysics

Special issue on machine learning and deep learning in magnetic resonance

Hui Zhang, Daniel C. Alexander, Dinggang Shen, Pew-Thian Yap

NMR IN BIOMEDICINE (2022)

Article Engineering, Biomedical

Endoscopy image enhancement method by generalized imaging defect models based adversarial training

Wenjie Li, Jingfan Fan, Yating Li, Pengcheng Hao, Yucong Lin, Tianyu Fu, Danni Ai, Hong Song, Jian Yang

Summary: This study presents a physics model driven semi-supervised learning framework for high-quality pixel-wise endoscopic image enhancement in order to address common issues in endoscopic surgery, such as smoke, uneven lighting, and color deviation. The proposed network integrates specific physical imaging defect models with the CycleGAN framework and achieves superior performance compared to state-of-the-art methods. Transfer learning is also applied to overcome data scarcity in endoscope enhancement tasks, resulting in improved network performance.

PHYSICS IN MEDICINE AND BIOLOGY (2022)

Article Computer Science, Interdisciplinary Applications

Dual Adversarial Attention Mechanism for Unsupervised Domain Adaptive Medical Image Segmentation

Xu Chen, Tianshu Kuang, Hannah Deng, Steve H. Fung, Jaime Gateno, James J. Xia, Pew-Thian Yap

Summary: This paper introduces a dual-attention domain-adaptative segmentation network for cross-modality medical image segmentation, which shows superior performance in challenging tasks.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2022)

Article Biochemical Research Methods

Multifaceted atlases of the human brain in its infancy

Sahar Ahmad, Ye Wu, Zhengwang Wu, Kim-Han Thung, Siyuan Liu, Weili Lin, Gang Li, Li Wang, Pew-Thian Yap

Summary: Brain atlases serve as spatial references for integrating, processing, and analyzing brain features from different individuals, sources, and scales. This study introduces a collection of joint surface-volume atlases that map the postnatal development of the human brain in a densely spatiotemporal manner from two weeks to two years old. These atlases provide normative patterns and capture key traits of early brain development, enabling the identification of deviations from normal developmental trajectories. By facilitating the mapping of diverse features of the infant brain to a common reference frame, these atlases enhance our understanding of early structural and functional development by enabling precise quantification of cortical and subcortical changes.

NATURE METHODS (2023)

Article Computer Science, Interdisciplinary Applications

High-Resolution 3D Magnetic Resonance Fingerprinting With a Graph Convolutional Network

Feng Cheng, Yilin Liu, Yong Chen, Pew-Thian Yap

Summary: Magnetic Resonance Fingerprinting (MRF) is a new quantitative imaging framework for simultaneous measurement of multiple tissue properties. A graph convolution network (GCN) is developed to replace GRAPPA for accurate tissue quantification in MRF. The GCN achieves up to 6-fold acceleration and enables the acquisition of whole-brain 3D MRF data with 1mm isotropic resolution in 3 minutes, or submillimeter 3D MRF data (0.8mm) in 5 minutes, greatly improving the feasibility of MRF in clinical settings.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Computer Science, Artificial Intelligence

Deep learning prediction of diffusion MRI data with microstructure-sensitive loss functions

Geng Chen, Yoonmi Hong, Khoi Minh Huynh, Pew-Thian Yap

Summary: This study proposes two novel loss functions, microstructural loss and spherical variance loss, to explicitly consider the quality of both the predicted DMRI data and derived diffusion scalars. Applying these loss functions to multi-shell data prediction and angular resolution enhancement, evaluation results show that both microstructural loss and spherical variance loss improve the quality of derived diffusion scalars.

MEDICAL IMAGE ANALYSIS (2023)

Article Computer Science, Information Systems

Attention-Guided Autoencoder for Automated Progression Prediction of Subjective Cognitive Decline With Structural MRI

Hao Guan, Ling Yue, Pew-Thian Yap, Shifu Xiao, Andrea Bozoki, Mingxia Liu

Summary: Subjective cognitive decline (SCD) is an early stage of Alzheimer's disease (AD) that occurs before mild cognitive impairment (MCI). It can progress to MCI and eventually to AD. Therefore, early identification of progressive SCD using neuroimaging techniques like structural MRI is crucial for early intervention of AD. This study proposes an interpretable autoencoder model with domain transfer learning (IADT) to predict the progression of SCD. The model leverages MRIs from both the target domain (SCD) and auxiliary domains (AD and NC), and uses an attention mechanism to automatically locate disease-related brain regions, achieving good interpretability. The IADT model is easy to train and test, requires only 5 to 10 seconds on CPUs, and is suitable for medical tasks with small datasets. Extensive experiments on publicly available and private datasets have demonstrated the effectiveness of the proposed method.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2023)

Article Computer Science, Artificial Intelligence

Improved polar complex exponential transform for robust local image description

Zhanlong Yang, Linzhi Yang, Geng Chen, Pew-Thian Yap

Summary: In this paper, a novel local image descriptor called IPCET is proposed, which is based on the phase and amplitude information of PCET. The IPCET descriptor is robust to both photometric and geometric transformations, and outperforms cutting-edge moment-based descriptors according to extensive experiments.

PATTERN RECOGNITION (2023)

Article Computer Science, Artificial Intelligence

Longitudinal prediction of postnatal brain magnetic resonance images via a metamorphic generative adversarial network

Yunzhi Huang, Sahar Ahmad, Luyi Han, Shuai Wang, Zhengwang Wu, Weili Lin, Gang Li, Li Wang, Pew-Thian Yap

Summary: This paper proposes a deep learning framework to predict missing scans in longitudinal infant studies. The model, called MGAN, uses image translation and quality-guided learning strategies to accurately predict tissue contrasts and anatomical details. Experimental results show that MGAN outperforms existing GANs in this task.

PATTERN RECOGNITION (2023)

Article Multidisciplinary Sciences

A paired dataset of T1-and T2-weighted MRI at 3 Tesla and 7 Tesla

Xiaoyang Chen, Liangqiong Qu, Yifang Xie, Sahar Ahmad, Pew-Thian Yap

Summary: Brain MRI provides critical soft tissue contrasts for disease diagnosis and neuroscience research. Ultra-high field strength 7T MRI allows for higher resolution and better tissue contrast and SNR, but its high costs limit its adoption. To obtain higher-quality images without 7T MRI, algorithms for synthesizing 7T images from 3T images are being developed. A dataset of paired 3T and 7T MR images of 10 healthy subjects is made available to facilitate the development and evaluation of 3T-to-7T MR image synthesis models.

SCIENTIFIC DATA (2023)

Article Computer Science, Artificial Intelligence

Portal Vein and Hepatic Vein Segmentation in Multi-Phase MR Images Using Flow-Guided Change Detection

Qing Guo, Hong Song, Jingfan Fan, Danni Ai, Yuanjin Gao, Xiaoling Yu, Jian Yang

Summary: In this paper, a unified framework is proposed for automatically and robustly segmenting 3D hepatic vein (HV) and portal vein (PV) from multi-phase MRI images. The framework considers the change and appearance caused by vascular flow events and improves the segmentation performance through clustering and decision-making methods. The evaluation results demonstrate that the proposed framework outperforms existing methods.

IEEE TRANSACTIONS ON IMAGE PROCESSING (2022)

Article Engineering, Biomedical

Augmented reality navigation with real-time tracking for facial repair surgery

Long Shao, Tianyu Fu, Zhao Zheng, Zehua Zhao, Lele Ding, Jingfan Fan, Hong Song, Tao Zhang, Jian Yang

Summary: This paper proposes a method to track the position of the patient directly using video data from a single camera, which achieves noninvasive, real time, and high positioning accuracy in facial repair surgeries.

INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY (2022)

Article Computer Science, Artificial Intelligence

Simultaneous alignment and surface regression using hybrid 2D-3D networks for 3D coherent layer segmentation of retinal OCT images with full and annotations

Hong Liu, Dong Wei, Donghuan Lu, Xiaoying Tang, Liansheng Wang, Yefeng Zheng

Summary: This study proposes a framework based on hybrid 2D-3D convolutional neural networks for obtaining continuous 3D retinal layer surfaces from OCT volumes. The framework works well with both full and sparse annotations and utilizes alignment displacement vectors and layer segmentation to align the B-scans and segment the layers. Experimental results show that the framework outperforms state-of-the-art 2D deep learning methods in terms of layer segmentation accuracy and cross-B-scan 3D continuity.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

WarpDrive: Improving spatial normalization using manual refinements

Simon Oxenford, Ana Sofia Rios, Barbara Hollunder, Clemens Neudorfer, Alexandre Boutet, Gavin J. B. Elias, Jurgen Germann, Aaron Loh, Wissam Deeb, Bryan Salvato, Leonardo Almeida, Kelly D. Foote, Robert Amaral, Paul B. Rosenberg, David F. Tang-Wai, David A. Wolk, Anna D. Burke, Marwan N. Sabbagh, Stephen Salloway, M. Mallar Chakravarty, Gwenn S. Smith, Constantine G. Lyketsos, Michael S. Okun, William S., Zoltan Mari, Francisco A. Ponce, Andres Lozano, Wolf-Julian Neumann, Bassam Al-Fatly, Andreas Horn

Summary: Spatial normalization is a method to map subject brain images to an average template brain, allowing comparison of brain imaging results. We introduce a novel tool called WarpDrive, which enables manual refinements of image alignment after automated registration. The tool improves accuracy of data representation and aids in understanding patient outcomes.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Interpretable and intervenable ultrasonography-based machine learning models for pediatric appendicitis

Ricards Marcinkevics, Patricia Reis Wolfertstetter, Ugne Klimiene, Kieran Chin-Cheong, Alyssia Paschke, Julia Zerres, Markus Denzinger, David Niederberger, Sven Wellmann, Ece Ozkan, Christian Knorr, Julia E. Vogt

Summary: This study presents interpretable machine learning models for predicting the diagnosis, management, and severity of suspected appendicitis using ultrasound images. The proposed models utilize concept bottleneck models (CBM) that facilitate interpretation and intervention by clinicians, without compromising performance or requiring time-consuming image annotation.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Residual Aligner-based Network (RAN) : Motion-separable structure for coarse-to-fine discontinuous deformable registration

Jian-Qing Zheng, Ziyang Wang, Baoru Huang, Ngee Han Lim, Bartlomiej W. Papiez

Summary: This article introduces a new method for medical image registration, which utilizes a separable motion backbone and a residual aligner module to better handle the discontinuous motion of multiple neighboring objects. The proposed method achieves excellent registration results on abdominal CT scans and lung CT scans.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

A knowledge-interpretable multi-task learning framework for automated thyroid nodule diagnosis in ultrasound videos

Xiangqiong Wu, Guanghua Tan, Hongxia Luo, Zhilun Chen, Bin Pu, Shengli Li, Kenli Li

Summary: This study develops a user-friendly framework for the automated diagnosis of thyroid nodules in ultrasound videos, simulating the diagnostic workflow of radiologists. By interpreting image characteristics and modeling temporal contextual information, the efficiency and generalizability of the diagnosis can be improved.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

DeepSSM: A blueprint for image-to-shape deep learning models

Riddhish Bhalodia, Shireen Elhabian, Jadie Adams, Wenzheng Tao, Ladislav Kavan, Ross Whitaker

Summary: This paper introduces DeepSSM, a deep learning-based framework for image-to-shape modeling. By learning the functional mapping from images to low-dimensional shape descriptors, DeepSSM can directly infer statistical representation of anatomy from 3D images. Compared to traditional methods, DeepSSM eliminates the need for heavy manual preprocessing and segmentation, and significantly improves computational time.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Florentin Liebmann, Marco von Atzigen, Dominik Stutz, Julian Wolf, Lukas Zingg, Daniel Suter, Nicola A. Cavalcanti, Laura Leoty, Hooman Esfandiari, Jess G. Snedeker, Martin R. Oswald, Marc Pollefeys, Mazda Farshad, Philipp Furnstahl

Summary: This study presents a marker-less approach for automatic registration and real-time navigation of lumbar spinal fusion surgery using a deep neural network, avoiding radiation exposure and surgical errors. The method was validated on an ex-vivo surgery and a public dataset.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Cycle consistent twin energy-based models for image-to-image translation

Piyush Tiwary, Kinjawl Bhattacharyya, A. P. Prathosh

Summary: Domain shift refers to the change of distributional characteristics between training and testing datasets, leading to performance drop. For medical image tasks, domain shift can be caused by changes in imaging modalities, devices, and staining mechanisms. Existing approaches based on generative models suffer from training difficulties and lack of diversity. In this paper, the authors propose the use of energy-based models (EBMs) for unpaired image-to-image translation in medical images. The proposed method, called Cycle Consistent Twin EBMs (CCT-EBM), employs a pair of EBMs in the latent space of an Auto-Encoder to ensure translation symmetry and coupling between domains.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

ReFs: A hybrid pre-training paradigm for 3D medical image segmentation

Yutong Xie, Jianpeng Zhang, Lingqiao Liu, Hu Wang, Yiwen Ye, Johan Verjans, Yong Xia

Summary: This paper proposes a hybrid pre-training paradigm that combines self-supervised learning and supervised learning to improve the representation quality for medical image segmentation tasks. It introduces a reference task in self-supervised learning and optimizes the model using a gradient matching method. The experimental results demonstrate the effectiveness of this approach on multiple medical image segmentation benchmarks.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Cell classification with worse-case boosting for intelligent cervical cancer screening

Youyi Song, Jing Zou, Kup-Sze Choi, Baiying Lei, Jing Qin

Summary: Cell classification is crucial for intelligent cervical cancer screening, but the variation in cells' appearance and shape poses challenges. A new learning algorithm, worse-case boosting, is proposed to improve classification accuracy for under-represented data. Experimental results demonstrate the effectiveness of this algorithm in two publicly available datasets, achieving a 4% improvement in accuracy.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Self-supervised multi-modal training from uncurated images and reports enables monitoring AI in radiology

Sangjoon Park, Eun Sun Lee, Kyung Sook Shin, Jeong Eun Lee, Jong Chul Ye

Summary: The increasing demand for AI systems to monitor human errors and abnormalities in healthcare presents challenges. This study presents a model called Medical X-VL, which is tailored for the medical domain and outperformed current state-of-the-art models in two medical image datasets. The model enables various zero-shot tasks for monitoring AI in the medical domain.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Signal domain adaptation network for limited-view optoacoustic tomography

Anna Klimovskaia Susmelj, Berkan Lafci, Firat Ozdemir, Neda Davoudi, Xose Luis Dean-Ben, Fernando Perez-Cruz, Daniel Razansky

Summary: Optoacoustic imaging is a technique that uses optical excitation and ultrasound detection for biological tissue imaging. The quality of the images depends on the extent of tomographic coverage provided by the ultrasound detector arrays. However, full coverage is not always possible due to experimental constraints. The proposed signal domain adaptation network aims to reduce limited-view artifacts in the images.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

SynCLay: Interactive synthesis of histology images from bespoke cellular layouts

Srijay Deshpande, Muhammad Dawood, Fayyaz Minhas, Nasir Rajpoot

Summary: In this work, a novel framework called SynCLay is proposed for automated synthesis of histology images based on user-defined cellular layouts. The framework can generate realistic and high-quality histology images with different cellular arrangements, which is helpful for studying the role of cells in the tumor microenvironment. The framework integrates a nuclear segmentation and classification model to refine nuclear structures and generate nuclear masks. Evaluation using quantitative metrics and feedback from pathologists shows that the synthetic images generated by SynCLay have high realism scores and can accurately differentiate between benign and malignant tumors.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

CenTime: Event-conditional modelling of censoring in survival analysis

Ahmed H. Shahin, An Zhao, Alexander C. Whitehead, Daniel C. Alexander, Joseph Jacob, David Barber

Summary: Survival analysis is a valuable tool in healthcare for predicting the time to specific events. This paper introduces CenTime, a novel approach that directly estimates the time to event. The method performs well with censored data and can be easily integrated with deep learning models. Compared to standard methods, CenTime offers superior performance in predicting event time while maintaining comparable ranking performance.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Do we really need dice? The hidden region-size biases of segmentation losses

Bingyuan Liu, Jose Dolz, Adrian Galdran, Riadh Kobbi, Ismail Ben Ayed

Summary: Most segmentation losses, such as CE and Dice, are variants of the Cross-Entropy or Dice losses. This work provides a theoretical analysis that shows a deeper connection between CE and Dice than previously thought. From a constrained-optimization perspective, both CE and Dice decompose into similar ground-truth matching terms and region-size penalty terms. The analysis uncovers hidden region-size biases: Dice has an intrinsic bias towards extremely imbalanced solutions, while CE implicitly encourages the ground-truth region proportions. Based on this analysis, a principled and simple solution is proposed to explicitly control the region-size bias.

MEDICAL IMAGE ANALYSIS (2024)