4.7 Article Proceedings Paper

Temporal sparse free-form deformations

期刊

MEDICAL IMAGE ANALYSIS
卷 17, 期 7, 页码 779-789

出版社

ELSEVIER
DOI: 10.1016/j.media.2013.04.010

关键词

Free-form deformation; Sparse; Registration; Cardiac; Temporal

资金

  1. EPSRC [EP/H046410/1] Funding Source: UKRI
  2. Engineering and Physical Sciences Research Council [EP/H02025X/1, EP/H046410/1, EP/H019847/1] Funding Source: researchfish

向作者/读者索取更多资源

FFD represent a widely used model for the non-rigid registration of medical images. The balance between robustness to noise and accuracy in modelling localised motion is typically controlled by the control point grid spacing and the amount of regularisation. More recently, TFFD have been proposed which extend the FFD approach in order to recover smooth motion from temporal image sequences. In this paper, we revisit the classic FFD approach and propose a sparse representation using the principles of compressed sensing. The sparse representation can model both global and local motion accurately and robustly. We view the registration as a deformation reconstruction problem. The deformation is reconstructed from a pair of images (or image sequences) with a sparsity constraint applied to the parametric space. Specifically, we introduce sparsity into the deformation via L-1 regularisation, and apply a bending energy regularisation between neighbouring control points within each level to encourage a grouped sparse solution. We further extend the sparsity constraint to the temporal domain and propose a TSFFD which can capture fine local details such as motion discontinuities in both space and time without sacrificing robustness. We demonstrate the capabilities of the proposed framework to accurately estimate deformations in dynamic 2D and 3D image sequences. Compared to the classic FFD and TFFD approach, a significant increase in registration accuracy can be observed in natural images as well as in cardiac images. Crown Copyright (C) 2013 Published by Elsevier B.V. All rights reserved.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Cardiac & Cardiovascular Systems

Geometry and flow in ascending aortic aneurysms are influenced by left ventricular outflow tract orientation: Detecting increased wall shear stress on the outer curve of proximal aortic aneurysms

M. Yousuf Salmasi, Selene Pirola, Suchaya Mahuttanatan, Serena M. Fisichella, Sampad Sengupta, Omar A. Jarral, Aung Oo, Declan O'Regan, Xiao Yun Xu, Thanos Athanasiou

Summary: This study investigates the relationship between the angle of the left ventricular outflow tract and ascending thoracic aortic aneurysm disease. The findings suggest that a greater angle is associated with larger diameters in the sinus and ascending aorta. Computational fluid dynamics simulations also show that a larger angle is associated with higher wall shear stress values in the outer curve of the aorta. These results support the hypothesis of flow-mediated disease progression and propose the left ventricular outflow tract angle as a predictor of disease severity.

JOURNAL OF THORACIC AND CARDIOVASCULAR SURGERY (2023)

Article Computer Science, Artificial Intelligence

AtrialJSQnet: A New framework for joint segmentation and quantification of left atrium and scars incorporating spatial and shape information

Lei Li, Veronika A. Zimmer, Julia A. Schnabel, Xiahai Zhuang

Summary: This study introduces a new framework named AtrialJSQnet that can conduct left atrial segmentation, scar projection onto the left atrial surface, and scar quantification simultaneously, achieving competitive performance on public datasets. Additionally, by incorporating a shape attention mechanism and spatial encoding loss, the method demonstrates significant effects in reducing noisy patches and improving task performance.

MEDICAL IMAGE ANALYSIS (2022)

Article Engineering, Electrical & Electronic

Physics-Driven Deep Learning for Computational Magnetic Resonance Imaging: Combining physics and machine learning for improved medical imaging

Kerstin Hammernik, Thomas Kustner, Burhaneddin Yaman, Zhengnan Huang, Daniel Rueckert, Florian Knoll, Mehmet Akcakaya

Summary: Physics-driven deep learning methods have revolutionized computational MRI reconstruction by improving the performance of reconstruction. This article provides an overview of recent developments in incorporating physics information into learning-based MRI reconstruction. It discusses both linear and non-linear forward models for computational MRI, classical approaches for solving these inverse problems, as well as physics-driven deep learning approaches such as physics-driven loss functions, plug-and-play methods, generative models, and unrolled networks. Challenges specific to MRI with linear and non-linear forward models are highlighted, and common issues and open challenges are also discussed.

IEEE SIGNAL PROCESSING MAGAZINE (2023)

Article Computer Science, Interdisciplinary Applications

CortexODE: Learning Cortical Surface Reconstruction by Neural ODEs

Qiang Ma, Liu Li, Emma C. Robinson, Bernhard Kainz, Daniel Rueckert, Amir Alansary

Summary: CortexODE is a deep learning framework that uses neural ordinary differential equations (ODEs) to reconstruct cortical surfaces. By modeling the trajectories of points on the surface as ODEs and parameterizing the derivatives with a learnable deformation network, CortexODE is able to prevent self-intersections. Integrated with an automatic learning-based pipeline, CortexODE can efficiently reconstruct cortical surfaces in less than 5 seconds.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Computer Science, Artificial Intelligence

Generative myocardial motion tracking via latent space exploration with biomechanics-informed prior

Chen Qin, Shuo Wang, Chen Chen, Wenjia Bai, Daniel Rueckert

Summary: This paper proposes a novel method for myocardial motion tracking by using a generative model based on variational autoencoder to learn biomechanically plausible deformations and embed them into a neural network-parameterized transformation model. Experimental results show that the proposed method outperforms other approaches in terms of motion tracking accuracy, volume preservation, and generalizability.

MEDICAL IMAGE ANALYSIS (2023)

Article Computer Science, Interdisciplinary Applications

Causality-Inspired Single-Source Domain Generalization for Medical Image Segmentation

Cheng Ouyang, Chen Chen, Surui Li, Zeju Li, Chen Qin, Wenjia Bai, Daniel Rueckert

Summary: In this work, the authors investigate the problem of training a deep network that is robust to unseen domains using only data from one source domain. They propose a causality-inspired data augmentation approach to expose the model to synthesized domain-shifted training examples. The approach is validated on three cross-domain segmentation scenarios and shows consistent performance improvements compared to competitive methods.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Computer Science, Artificial Intelligence

Differentially Private Graph Neural Networks for Whole-Graph Classification

Tamara T. Mueller, Johannes C. Paetzold, Chinmay Prabhakar, Dmitrii Usynin, Daniel Rueckert, Georgios Kaissis

Summary: Graph Neural Networks (GNNs) have become the state-of-the-art for many machine learning applications, but differentially private training of GNNs has remained under-explored. In this work, we propose a framework for differentially private graph-level classification using DP-SGD, which is applicable to multi-graph datasets.

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE (2023)

Article Computer Science, Artificial Intelligence

Fast fetal head compounding from multi-view 3D ultrasound

Robert Wright, Alberto Gomez, Veronika A. Zimmer, Nicolas Toussaint, Bishesh Khanal, Jacqueline Matthew, Emily Skelton, Bernhard Kainz, Daniel Rueckert, Joseph V. Hajnal, Julia A. Schnabel

Summary: This paper introduces a novel method to fuse partially imaged fetal head anatomy from multiple views into a single coherent 3D volume. The method aligns and fuses ultrasound images to improve image detail and minimize artifacts, achieving state-of-the-art performance in terms of image quality and robustness.

MEDICAL IMAGE ANALYSIS (2023)

Article Cardiac & Cardiovascular Systems

Identification of an increased lifetime risk of major adverse cardiovascular events in UK Biobank participants with scoliosis

Valentina Quintero Santofimio, Adam Clement, Declan P. O'Regan, James S. Ware, Kathryn A. McGurk

Summary: Study finds that spinal curvature in patients with scoliosis affects cardiac function and increases the risk of cardiovascular events, such as heart failure and atrial fibrillation. These findings have important clinical implications for the management of scoliosis patients.

OPEN HEART (2023)

Article Multidisciplinary Sciences

Environmental and genetic predictors of human cardiovascular ageing

Mit Shah, Marco de A. H. Inacio, Chang Lu, Pierre-Raphael Schiratti, Sean L. L. Zheng, Adam Clement, Antonio de Marvao, Wenjia Bai, Andrew P. King, James S. Ware, Martin R. Wilkins, Johanna Mielke, Eren Elci, Ivan Kryukov, Kathryn A. McGurk, Christian Bender, Daniel F. Freitag, Declan P. O'Regan

Summary: Cardiovascular ageing is a progressive process that leads to changes in structure and decline in function. Machine learning can predict biological age and identify key genetic risk factors.

NATURE COMMUNICATIONS (2023)

Article Computer Science, Interdisciplinary Applications

Concurrent Ischemic Lesion Age Estimation and Segmentation of CT Brain Using a Transformer-Based Network

Adam Marcus, Paul Bentley, Daniel Rueckert

Summary: The proposed study introduces a novel end-to-end multi-task transformer-based model for concurrent segmentation and age estimation of cerebral ischemic lesions. The method captures long-range dependencies using gated positional self-attention and CT-specific data augmentation, and can be effectively trained with low-data regimes in medical imaging. Experimental results demonstrate promising performance in lesion age classification, outperforming existing task-specific algorithms.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Computer Science, Artificial Intelligence

Unrolled and rapid motion-compensated reconstruction for cardiac CINE MRI

Jiazhen Pan, Manal Hamdi, Wenqi Huang, Kerstin Hammernik, Thomas Kuestner, Daniel Rueckert

Summary: This article introduces a learning-based and unrolled MCMR framework that can achieve accurate and rapid CMR reconstruction, delivering artifacts-free motion estimation and high-quality reconstruction even at imaging acceleration rates up to 20x.

MEDICAL IMAGE ANALYSIS (2024)

Proceedings Paper Cardiac & Cardiovascular Systems

Review of Data Types and Model Dimensionality for Cardiac DTI SMS-Related Artefact Removal

Michael Tanzer, Sea Hee Yook, Pedro Ferreira, Guang Yang, Daniel Rueckert, Sonia Nielles-Vallespin

Summary: This study compares the effects of different input types, dimensionalities, and input types on the performance of a deep learning-based model in accelerating cardiac DTI. The results show that simpler 2D real-valued models outperform 3D or complex models, and the best performance is achieved by a real-valued model trained using both magnitude and phase components.

STATISTICAL ATLASES AND COMPUTATIONAL MODELS OF THE HEART: REGULAR AND CMRXMOTION CHALLENGE PAPERS, STACOM 2022 (2022)

Article Computer Science, Artificial Intelligence

Simultaneous alignment and surface regression using hybrid 2D-3D networks for 3D coherent layer segmentation of retinal OCT images with full and annotations

Hong Liu, Dong Wei, Donghuan Lu, Xiaoying Tang, Liansheng Wang, Yefeng Zheng

Summary: This study proposes a framework based on hybrid 2D-3D convolutional neural networks for obtaining continuous 3D retinal layer surfaces from OCT volumes. The framework works well with both full and sparse annotations and utilizes alignment displacement vectors and layer segmentation to align the B-scans and segment the layers. Experimental results show that the framework outperforms state-of-the-art 2D deep learning methods in terms of layer segmentation accuracy and cross-B-scan 3D continuity.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

WarpDrive: Improving spatial normalization using manual refinements

Simon Oxenford, Ana Sofia Rios, Barbara Hollunder, Clemens Neudorfer, Alexandre Boutet, Gavin J. B. Elias, Jurgen Germann, Aaron Loh, Wissam Deeb, Bryan Salvato, Leonardo Almeida, Kelly D. Foote, Robert Amaral, Paul B. Rosenberg, David F. Tang-Wai, David A. Wolk, Anna D. Burke, Marwan N. Sabbagh, Stephen Salloway, M. Mallar Chakravarty, Gwenn S. Smith, Constantine G. Lyketsos, Michael S. Okun, William S., Zoltan Mari, Francisco A. Ponce, Andres Lozano, Wolf-Julian Neumann, Bassam Al-Fatly, Andreas Horn

Summary: Spatial normalization is a method to map subject brain images to an average template brain, allowing comparison of brain imaging results. We introduce a novel tool called WarpDrive, which enables manual refinements of image alignment after automated registration. The tool improves accuracy of data representation and aids in understanding patient outcomes.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Interpretable and intervenable ultrasonography-based machine learning models for pediatric appendicitis

Ricards Marcinkevics, Patricia Reis Wolfertstetter, Ugne Klimiene, Kieran Chin-Cheong, Alyssia Paschke, Julia Zerres, Markus Denzinger, David Niederberger, Sven Wellmann, Ece Ozkan, Christian Knorr, Julia E. Vogt

Summary: This study presents interpretable machine learning models for predicting the diagnosis, management, and severity of suspected appendicitis using ultrasound images. The proposed models utilize concept bottleneck models (CBM) that facilitate interpretation and intervention by clinicians, without compromising performance or requiring time-consuming image annotation.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Residual Aligner-based Network (RAN) : Motion-separable structure for coarse-to-fine discontinuous deformable registration

Jian-Qing Zheng, Ziyang Wang, Baoru Huang, Ngee Han Lim, Bartlomiej W. Papiez

Summary: This article introduces a new method for medical image registration, which utilizes a separable motion backbone and a residual aligner module to better handle the discontinuous motion of multiple neighboring objects. The proposed method achieves excellent registration results on abdominal CT scans and lung CT scans.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

A knowledge-interpretable multi-task learning framework for automated thyroid nodule diagnosis in ultrasound videos

Xiangqiong Wu, Guanghua Tan, Hongxia Luo, Zhilun Chen, Bin Pu, Shengli Li, Kenli Li

Summary: This study develops a user-friendly framework for the automated diagnosis of thyroid nodules in ultrasound videos, simulating the diagnostic workflow of radiologists. By interpreting image characteristics and modeling temporal contextual information, the efficiency and generalizability of the diagnosis can be improved.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

DeepSSM: A blueprint for image-to-shape deep learning models

Riddhish Bhalodia, Shireen Elhabian, Jadie Adams, Wenzheng Tao, Ladislav Kavan, Ross Whitaker

Summary: This paper introduces DeepSSM, a deep learning-based framework for image-to-shape modeling. By learning the functional mapping from images to low-dimensional shape descriptors, DeepSSM can directly infer statistical representation of anatomy from 3D images. Compared to traditional methods, DeepSSM eliminates the need for heavy manual preprocessing and segmentation, and significantly improves computational time.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Automatic registration with continuous pose updates for marker-less surgical navigation in spine surgery

Florentin Liebmann, Marco von Atzigen, Dominik Stutz, Julian Wolf, Lukas Zingg, Daniel Suter, Nicola A. Cavalcanti, Laura Leoty, Hooman Esfandiari, Jess G. Snedeker, Martin R. Oswald, Marc Pollefeys, Mazda Farshad, Philipp Furnstahl

Summary: This study presents a marker-less approach for automatic registration and real-time navigation of lumbar spinal fusion surgery using a deep neural network, avoiding radiation exposure and surgical errors. The method was validated on an ex-vivo surgery and a public dataset.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Cycle consistent twin energy-based models for image-to-image translation

Piyush Tiwary, Kinjawl Bhattacharyya, A. P. Prathosh

Summary: Domain shift refers to the change of distributional characteristics between training and testing datasets, leading to performance drop. For medical image tasks, domain shift can be caused by changes in imaging modalities, devices, and staining mechanisms. Existing approaches based on generative models suffer from training difficulties and lack of diversity. In this paper, the authors propose the use of energy-based models (EBMs) for unpaired image-to-image translation in medical images. The proposed method, called Cycle Consistent Twin EBMs (CCT-EBM), employs a pair of EBMs in the latent space of an Auto-Encoder to ensure translation symmetry and coupling between domains.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

ReFs: A hybrid pre-training paradigm for 3D medical image segmentation

Yutong Xie, Jianpeng Zhang, Lingqiao Liu, Hu Wang, Yiwen Ye, Johan Verjans, Yong Xia

Summary: This paper proposes a hybrid pre-training paradigm that combines self-supervised learning and supervised learning to improve the representation quality for medical image segmentation tasks. It introduces a reference task in self-supervised learning and optimizes the model using a gradient matching method. The experimental results demonstrate the effectiveness of this approach on multiple medical image segmentation benchmarks.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Cell classification with worse-case boosting for intelligent cervical cancer screening

Youyi Song, Jing Zou, Kup-Sze Choi, Baiying Lei, Jing Qin

Summary: Cell classification is crucial for intelligent cervical cancer screening, but the variation in cells' appearance and shape poses challenges. A new learning algorithm, worse-case boosting, is proposed to improve classification accuracy for under-represented data. Experimental results demonstrate the effectiveness of this algorithm in two publicly available datasets, achieving a 4% improvement in accuracy.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Self-supervised multi-modal training from uncurated images and reports enables monitoring AI in radiology

Sangjoon Park, Eun Sun Lee, Kyung Sook Shin, Jeong Eun Lee, Jong Chul Ye

Summary: The increasing demand for AI systems to monitor human errors and abnormalities in healthcare presents challenges. This study presents a model called Medical X-VL, which is tailored for the medical domain and outperformed current state-of-the-art models in two medical image datasets. The model enables various zero-shot tasks for monitoring AI in the medical domain.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Signal domain adaptation network for limited-view optoacoustic tomography

Anna Klimovskaia Susmelj, Berkan Lafci, Firat Ozdemir, Neda Davoudi, Xose Luis Dean-Ben, Fernando Perez-Cruz, Daniel Razansky

Summary: Optoacoustic imaging is a technique that uses optical excitation and ultrasound detection for biological tissue imaging. The quality of the images depends on the extent of tomographic coverage provided by the ultrasound detector arrays. However, full coverage is not always possible due to experimental constraints. The proposed signal domain adaptation network aims to reduce limited-view artifacts in the images.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

SynCLay: Interactive synthesis of histology images from bespoke cellular layouts

Srijay Deshpande, Muhammad Dawood, Fayyaz Minhas, Nasir Rajpoot

Summary: In this work, a novel framework called SynCLay is proposed for automated synthesis of histology images based on user-defined cellular layouts. The framework can generate realistic and high-quality histology images with different cellular arrangements, which is helpful for studying the role of cells in the tumor microenvironment. The framework integrates a nuclear segmentation and classification model to refine nuclear structures and generate nuclear masks. Evaluation using quantitative metrics and feedback from pathologists shows that the synthetic images generated by SynCLay have high realism scores and can accurately differentiate between benign and malignant tumors.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

CenTime: Event-conditional modelling of censoring in survival analysis

Ahmed H. Shahin, An Zhao, Alexander C. Whitehead, Daniel C. Alexander, Joseph Jacob, David Barber

Summary: Survival analysis is a valuable tool in healthcare for predicting the time to specific events. This paper introduces CenTime, a novel approach that directly estimates the time to event. The method performs well with censored data and can be easily integrated with deep learning models. Compared to standard methods, CenTime offers superior performance in predicting event time while maintaining comparable ranking performance.

MEDICAL IMAGE ANALYSIS (2024)

Article Computer Science, Artificial Intelligence

Do we really need dice? The hidden region-size biases of segmentation losses

Bingyuan Liu, Jose Dolz, Adrian Galdran, Riadh Kobbi, Ismail Ben Ayed

Summary: Most segmentation losses, such as CE and Dice, are variants of the Cross-Entropy or Dice losses. This work provides a theoretical analysis that shows a deeper connection between CE and Dice than previously thought. From a constrained-optimization perspective, both CE and Dice decompose into similar ground-truth matching terms and region-size penalty terms. The analysis uncovers hidden region-size biases: Dice has an intrinsic bias towards extremely imbalanced solutions, while CE implicitly encourages the ground-truth region proportions. Based on this analysis, a principled and simple solution is proposed to explicitly control the region-size bias.

MEDICAL IMAGE ANALYSIS (2024)