4.7 Article

Learning deformable registration of medical images with anatomical constraints

Journal

NEURAL NETWORKS
Volume 124, Issue -, Pages 269-279

Publisher

PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.neunet.2020.01.023

Keywords

Medical image registration; Convolutional neural networks; X-ray image analysis

Funding

  1. AXA Research Fund grant (France)
  2. UNL [CAID-PIC-50220140100084LI, 2016-082]
  3. ANPCyT [PICT 2014-2627, 2018-03907, 2018-3384]

Ask authors/readers for more resources

Deformable image registration is a fundamental problem in the field of medical image analysis. During the last years, we have witnessed the advent of deep learning-based image registration methods which achieve state-of-the-art performance, and drastically reduce the required computational time. However, little work has been done regarding how can we encourage our models to produce not only accurate, but also anatomically plausible results, which is still an open question in the field. In this work, we argue that incorporating anatomical priors in the form of global constraints into the learning process of these models, will further improve their performance and boost the realism of the warped images after registration. We learn global non-linear representations of image anatomy using segmentation masks, and employ them to constraint the registration process. The proposed AC-RegNet architecture is evaluated in the context of chest X-ray image registration using three different datasets, where the high anatomical variability makes the task extremely challenging. Our experiments show that the proposed anatomically constrained registration model produces more realistic and accurate results than state-of-the-art methods, demonstrating the potential of this approach. (C) 2020 Elsevier Ltd. All rights reserved.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Review Biochemical Research Methods

Genome-wide discovery of pre-miRNAs: comparison of recent approaches based on machine learning

Leandro A. Bugnon, Cristian Yones, Diego H. Milone, Georgina Stegmayer

Summary: Six recent methods for predicting miRNAs in the genome were reviewed and compared on different genome-wide datasets. It was found that all methods performed similarly for smaller genomes and imbalances, but deep learning approaches using raw sequence information achieved the best scores for larger datasets like the human genome.

BRIEFINGS IN BIOINFORMATICS (2021)

Article Biology

Deepred-Mt: Deep representation learning for predicting C-to-U RNA editing in plant mitochondria

Alejandro A. Edera, Ian Small, Diego H. Milone, M. Virginia Sanchez-Puerta

Summary: A new method using deep convolutional neural network to predict plant mitochondrial C-to-U RNA editing events was introduced, which showed a significant improvement in predictive performance compared to traditional methods, indicating the potential importance for studying RNA regulation.

COMPUTERS IN BIOLOGY AND MEDICINE (2021)

Article Biochemical Research Methods

miRe2e: a full end-to-end deep model based on transformers for prediction of pre-miRNAs

Jonathan Raad, Leandro A. Bugnon, Diego H. Milone, Georgina Stegmayer

Summary: In this study, the first full end-to-end deep learning model for pre-miRNA prediction, miRe2e, was developed. The model is based on Transformers and can accept raw genome-wide data as input without any preprocessing or feature engineering. Experimental results showed that the model achieved 10 times better performance compared to state-of-the-art algorithms when tested using the human genome.

BIOINFORMATICS (2022)

Article Biochemical Research Methods

Anc2vec: embedding gene ontology terms by preserving ancestors relationships

Alejandro A. Edera, Diego H. Milone, Georgina Stegmayer

Summary: A novel protocol anc2vec based on neural networks is proposed for constructing vector representations of GO terms, preserving ontological features and showing better performance on diverse tasks.

BRIEFINGS IN BIOINFORMATICS (2022)

Article Engineering, Biomedical

Transfer Learning Based on Optimal Transport for Motor Imagery Brain-Computer Interfaces

Victoria Peterson, Nicolas Nieto, Dominik Wyser, Olivier Lambercy, Roger Gassert, Diego H. Milone, Ruben D. Spies

Summary: This paper addresses the cross-sessions variability in electroencephalography-based brain-computer interfaces (BCIs) and proposes a backward method to avoid the need for classifier retraining and reduce calibration time. The results show that the proposed approach can effectively mitigate the variability between sessions while maintaining classification performance.

IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING (2022)

Article Neurosciences

Bridging physiological and perceptual views of autism by means of sampling-based Bayesian inference

Rodrigo Echeveste, Enzo Ferrante, Diego H. Milone, Ines Samengo

Summary: This study combines two different views of autism, altered probabilistic computations and inhibitory dysfunction, using a trained recurrent neural network model that performs sampling-based inference in a visual setting. The model also captures various experimental observations on neural variability and oscillations in individuals with autism. By linking neural connectivity, dynamics, and function, this work contributes to understanding the physiological underpinnings of perceptual traits in autism spectrum disorder.

NETWORK NEUROSCIENCE (2022)

Article Biochemical Research Methods

Hierarchical deep learning for predicting GO annotations by integrating protein knowledge

Gabriela A. Merino, Rabie Saidi, Diego H. Milone, Georgina Stegmayer, Maria J. Martin

Summary: This paper proposes a novel deep learning model called DeeProtGO for predicting GO term annotations by integrating protein knowledge. The experiments show that the prediction quality improves when more protein knowledge is integrated. DeeProtGO is benchmarked against state-of-the-art methods on public datasets and demonstrates effective improvement in the prediction of GO annotations.

BIOINFORMATICS (2022)

Review Biochemical Research Methods

Secondary structure prediction of long noncoding RNA: review and experimental comparison of existing approaches

L. A. Bugnon, A. A. Edera, S. Prochetto, M. Gerard, J. Raad, E. Fenoy, M. Rubiolo, U. Chorostecki, T. Gabaldon, F. Ariel, L. E. Di Persia, D. H. Milone, G. Stegmayer

Summary: This study compares the performance of classical methods and recently proposed approaches for predicting RNA secondary structure, and introduces a new metric based on chemical probing data to assess their predictive performance. The results provide a comprehensive assessment and a benchmark resource for future approaches.

BRIEFINGS IN BIOINFORMATICS (2022)

Article Computer Science, Interdisciplinary Applications

Improving Anatomical Plausibility in Medical Image Segmentation via Hybrid Graph Neural Networks: Applications to Chest X-Ray Analysis

Nicolas Gaggion, Lucas Mansilla, Candelaria Mosquera, Diego H. Milone, Enzo Ferrante

Summary: This study proposes a novel neural architecture, called HybridGNet, which combines graph convolutional neural networks with standard convolutional neural networks for anatomical segmentation. It effectively addresses topological errors and anatomical inconsistencies in medical images. Experimental results demonstrate that HybridGNet outperforms other models in anatomical segmentation of chest x-ray images in various scenarios.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Agricultural Engineering

Using segment-based features of jaw movements to recognise foraging activities in grazing cattle

Jose O. Chelotti, Sebastian R. Vanrell, Luciano S. Martinez-Rau, Julio R. Galli, Santiago A. Utsumi, Alejandra M. Planisich, Suyai A. Almiron, Diego H. Milone, Leonardo L. Giovanini, H. . Leonardo Ruffner

Summary: Precision livestock farming optimizes livestock production through the use of sensor information and communication technologies. This study proposes an algorithm called JMFAR based on jaw movement sounds for detecting rumination and grazing bouts with high accuracy and low computational cost. The algorithm was tested in a free grazing environment and showed improved performance compared to a state-of-the-art algorithm for estimating grazing bouts.

BIOSYSTEMS ENGINEERING (2023)

Article Biochemical Research Methods

exp2GO: Improving Prediction of Functions in the Gene Ontology With Expression Data

Leandro Di Persia, Tiago Lopez, Agustin Arce, Diego H. Milone, Georgina Stegmayer

Summary: This work proposes a novel method for predicting gene function annotations based on the inference of GO similarities from expression similarities. The proposed method outperforms other methods on several public biological datasets and effectively improves the prediction of GO annotations. It is also capable of predicting relevant and accurate biological functions in a full genome case.

IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS (2023)

Editorial Material Computer Science, Artificial Intelligence

Transfer learning: The key to functionally annotate the protein universe

Leandro A. Bugnon, Emilio Fenoy, Alejandro A. Edera, Jonathan Raad, Georgina Stegmayer, Diego H. Milone

Summary: The automatic annotation of the protein universe remains a challenge. Currently, only 0.25% of the 229,149,489 entries in the UniProtKB database have been functionally annotated. Manual annotation processes utilize knowledge from the protein families database Pfam, but the growth of annotations has been slow. Deep learning models offer potential for learning evolutionary patterns, but the lack of large-scale data for many protein families poses a limitation. Transfer learning can overcome this limitation and result in significant improvements in protein family prediction accuracy.

PATTERNS (2023)

Proceedings Paper Computer Science, Artificial Intelligence

Domain Generalization via Gradient Surgery

Lucas Mansilla, Rodrigo Echeveste, Diego H. Milone, Enzo Ferrante

Summary: In real-life applications, machine learning models often face scenarios where there is a change in data distribution between training and test domains. We propose novel gradient agreement strategies based on gradient surgery to alleviate conflicting gradients and enhance the generalization capability of deep learning models in domain shift scenarios.

2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021) (2021)

Article Biology

ChronoRoot: High-throughput phenotyping by deep segmentation networks reveals novel temporal parameters of plant root system architecture

Nicolas Gaggion, Federico Ariel, Vladimir Daric, Eric Lambert, Simon Legendre, Thomas Roule, Alejandra Camoirano, Diego H. Milone, Martin Crespi, Thomas Blein, Enzo Ferrante

Summary: This study introduces the ChronoRoot system, combining 3D printing and deep learning techniques for high temporal resolution phenotyping of plant roots in agarized medium. A novel deep learning-based root extraction method was developed, incorporating temporal consistency into root system architecture reconstruction, allowing automatic extraction of phenotypic parameters and derivation of novel time-related parameters from spectral features of temporal signals. The combination of machine intelligence methods and a 3D-printed device expands the possibilities of root high-throughput phenotyping for genetic and natural variation studies.

GIGASCIENCE (2021)

Proceedings Paper Computer Science, Artificial Intelligence

Hybrid Graph Convolutional Neural Networks for Landmark-Based Anatomical Segmentation

Nicolas Gaggion, Lucas Mansilla, Diego H. Milone, Enzo Ferrante

Summary: The study introduces a novel neural architecture HybridGNet, which combines standard convolutions and graph convolutional neural networks for better decoding of anatomical structures and robustness to image occlusions, as well as construction of landmark-based segmentations from pixel level annotations.

MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT I (2021)

Article Computer Science, Artificial Intelligence

Reduced-complexity Convolutional Neural Network in the compressed domain

Hamdan Abdellatef, Lina J. Karam

Summary: This paper proposes performing the learning and inference processes in the compressed domain to reduce computational complexity and improve speed of neural networks. Experimental results show that modified ResNet-50 in the compressed domain is 70% faster than traditional spatial-based ResNet-50 while maintaining similar accuracy. Additionally, a preprocessing step with partial encoding is suggested to improve resilience to distortions caused by low-quality encoded images. Training a network with highly compressed data can achieve good classification accuracy with significantly reduced storage requirements.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Theoretical limits on the speed of learning inverse models explain the rate of adaptation in arm reaching tasks

Victor R. Barradas, Yasuharu Koike, Nicolas Schweighofer

Summary: Inverse models are essential for human motor learning as they map desired actions to motor commands. The shape of the error surface and the distribution of targets in a task play a crucial role in determining the speed of learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning a robust foundation model against clean-label data poisoning attacks at downstream tasks

Ting Zhou, Hanshu Yan, Jingfeng Zhang, Lei Liu, Bo Han

Summary: We propose a defense strategy that reduces the success rate of data poisoning attacks in downstream tasks by pre-training a robust foundation model.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

AdaSAM: Boosting sharpness-aware minimization with adaptive learning rate and momentum for neural networks

Hao Sun, Li Shen, Qihuang Zhong, Liang Ding, Shixiang Chen, Jingwei Sun, Jing Li, Guangzhong Sun, Dacheng Tao

Summary: In this paper, the convergence rate of AdaSAM in the stochastic non-convex setting is analyzed. Theoretical proof shows that AdaSAM has a linear speedup property and decouples the stochastic gradient steps with the adaptive learning rate and perturbed gradient. Experimental results demonstrate that AdaSAM outperforms other optimizers in terms of performance.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Grasping detection of dual manipulators based on Markov decision process with neural network

Juntong Yun, Du Jiang, Li Huang, Bo Tao, Shangchun Liao, Ying Liu, Xin Liu, Gongfa Li, Disi Chen, Baojia Chen

Summary: In this study, a dual manipulator grasping detection model based on the Markov decision process is proposed. By parameterizing the grasping detection model of dual manipulators using a cross entropy convolutional neural network and a full convolutional neural network, stable grasping of complex multiple objects is achieved. Robot grasping experiments were conducted to verify the feasibility and superiority of this method.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Asymmetric double networks mutual teaching for unsupervised person Re-identification

Miaohui Zhang, Kaifang Li, Jianxin Ma, Xile Wang

Summary: This paper proposes an unsupervised person re-identification (Re-ID) method that uses two asymmetric networks to generate pseudo-labels for each other by clustering and updates and optimizes the pseudo-labels through alternate training. It also designs similarity compensation and similarity suppression based on the camera ID of pedestrian images to optimize the similarity measure. Extensive experiments show that the proposed method achieves superior performance compared to state-of-the-art unsupervised person re-identification methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Low-variance Forward Gradients using Direct Feedback Alignment and momentum

Florian Bacho, Dominique Chu

Summary: This paper proposes a new approach called the Forward Direct Feedback Alignment algorithm for supervised learning in deep neural networks. By combining activity-perturbed forward gradients, direct feedback alignment, and momentum, this method achieves better performance and convergence speed compared to other local alternatives to backpropagation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Maximum margin and global criterion based-recursive feature selection

Xiaojian Ding, Yi Li, Shilin Chen

Summary: This research paper addresses the limitations of recursive feature elimination (RFE) and its variants in high-dimensional feature selection tasks. The proposed algorithms, which introduce a novel feature ranking criterion and an optimal feature subset evaluation algorithm, outperform current state-of-the-art methods.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Mental image reconstruction from human brain activity: Neural decoding of mental imagery via deep neural network-based Bayesian estimation

Naoko Koide-Majima, Shinji Nishimoto, Kei Majima

Summary: Visual images observed by humans can be reconstructed from brain activity, and the visualization of arbitrary natural images from mental imagery has been achieved through an improved method. This study provides a unique tool for directly investigating the subjective contents of the brain.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Hierarchical attention network with progressive feature fusion for facial expression recognition

Huanjie Tao, Qianyue Duan

Summary: In this paper, a hierarchical attention network with progressive feature fusion is proposed for facial expression recognition (FER), addressing the challenges posed by pose variation, occlusions, and illumination variation. The model achieves enhanced performance by aggregating diverse features and progressively enhancing discriminative features.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

SLAPP: Subgraph-level attention-based performance prediction for deep learning models

Zhenyi Wang, Pengfei Yang, Linwei Hu, Bowen Zhang, Chengmin Lin, Wenkai Lv, Quan Wang

Summary: In the face of the complex landscape of deep learning, we propose a novel subgraph-level performance prediction method called SLAPP, which combines graph and operator features through an innovative graph neural network called EAGAT, providing accurate performance predictions. In addition, we introduce a mixed loss design with dynamic weight adjustment to improve predictive accuracy.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

LDCNet: Lightweight dynamic convolution network for laparoscopic procedures image segmentation

Yiyang Yin, Shuangling Luo, Jun Zhou, Liang Kang, Calvin Yu-Chian Chen

Summary: Medical image segmentation is crucial for modern healthcare systems, especially in reducing surgical risks and planning treatments. Transanal total mesorectal excision (TaTME) has become an important method for treating colon and rectum cancers. Real-time instance segmentation during TaTME surgeries can assist surgeons in minimizing risks. However, the dynamic variations in TaTME images pose challenges for accurate instance segmentation.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

start-stop points CenterNet for wideband signals detection and time-frequency localization in spectrum sensing

Teng Cheng, Lei Sun, Junning Zhang, Jinling Wang, Zhanyang Wei

Summary: This study proposes a scheme that combines the start-stop point signal features for wideband multi-signal detection, called Fast Spectrum-Size Self-Training network (FSSNet). By utilizing start-stop points to build the signal model, this method successfully solves the difficulty of existing deep learning methods in detecting discontinuous signals and achieves satisfactory detection speed.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Learning deep representation and discriminative features for clustering of multi-layer networks

Wenming Wu, Xiaoke Ma, Quan Wang, Maoguo Gong, Quanxue Gao

Summary: The layer-specific modules in multi-layer networks are critical for understanding the structure and function of the system. However, existing methods fail to accurately characterize and balance the connectivity and specificity of these modules. To address this issue, a joint learning graph clustering algorithm (DRDF) is proposed, which learns the deep representation and discriminative features of the multi-layer network, and balances the connectivity and specificity of the layer-specific modules through joint learning.

NEURAL NETWORKS (2024)

Article Computer Science, Artificial Intelligence

Boundary uncertainty aware network for automated polyp segmentation

Guanghui Yue, Guibin Zhuo, Weiqing Yan, Tianwei Zhou, Chang Tang, Peng Yang, Tianfu Wang

Summary: This paper proposes a novel boundary uncertainty aware network (BUNet) for precise and robust colorectal polyp segmentation. BUNet utilizes a pyramid vision transformer encoder to learn multi-scale features and incorporates a boundary exploration module (BEM) and a boundary uncertainty aware module (BUM) to handle boundary areas. Experimental results demonstrate that BUNet outperforms other methods in terms of performance and generalization ability.

NEURAL NETWORKS (2024)