4.7 Article

Unbiased identification of novel subclinical imaging biomarkers using unsupervised deep learning

期刊

SCIENTIFIC REPORTS
卷 10, 期 1, 页码 -

出版社

NATURE PUBLISHING GROUP
DOI: 10.1038/s41598-020-69814-1

关键词

-

资金

  1. Austrian Federal Ministry for Digital and Economic Affairs
  2. National Foundation for Research, Technology and Development

向作者/读者索取更多资源

Artificial intelligence has recently made a disruptive impact in medical imaging by successfully automatizing expert-level diagnostic tasks. However, replicating human-made decisions may inherently be biased by the fallible and dogmatic nature of human experts, in addition to requiring prohibitive amounts of training data. In this paper, we introduce an unsupervised deep learning architecture particularly designed for OCT representations for unbiased, purely data-driven biomarker discovery. We developed artificial intelligence technology that provides biomarker candidates without any restricting input or domain knowledge beyond raw images. Analyzing 54,900 retinal optical coherence tomography (OCT) volume scans of 1094 patients with age-related macular degeneration, we generated a vocabulary of 20 local and global markers capturing characteristic retinal patterns. The resulting markers were validated by linking them with clinical outcomes (visual acuity, lesion activity and retinal morphology) using correlation and machine learning regression. The newly identified features correlated well with specific biomarkers traditionally used in clinical practice (r up to 0.73), and outperformed them in correlating with visual acuity (R2=0.46 compared to R2=0.29 for conventional markers), despite representing an enormous compression of OCT imaging data (67 million voxels to 20 features). In addition, our method also discovered hitherto unknown, clinically relevant biomarker candidates. The presented deep learning approach identified known as well as novel medical imaging biomarkers without any prior domain knowledge. Similar approaches may be worthwhile across other medical imaging fields.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.7
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Ophthalmology

Developing and validating a multivariable prediction model which predicts progression of intermediate to late age-related macular degeneration-the PINNACLE trial protocol

Janice Sutton, Martin J. Menten, Sophie Riedl, Hvroje Bogunovic, Oliver Leingang, Philipp Anders, Ahmed M. Hagag, Sebastian Waldstein, Amber Wilson, Angela J. Cree, Ghislaine Traber, Lars G. Fritsche, Hendrik Scholl, Daniel Rueckert, Ursula Schmidt-Erfurth, Sobha Sivaprasad, Toby Prevost, Andrew Lotery

Summary: This study aims to utilize machine learning and advanced statistical modeling to discover biomarkers for disease progression in intermediate age-related macular degeneration (AMD) and report the natural history of its progression through multimodal retinal imaging.
Correction Ophthalmology

Developing and validating a multivariable prediction model which predicts progression of intermediate to late age-related macular degeneration-the PINNACLE trial protocol (May, 10.1038/s41433-022-02097-0, 2022)

Janice Sutton, Martin J. Menten, Sophie Riedl, Hrvoje Bogunovic, Oliver Leingang, Philipp Anders, Ahmed M. Hagag, Sebastian Waldstein, Amber Wilson, Angela J. Cree, Ghislaine Traber, Lars G. Fritsche, Hendrik Scholl, Daniel Rueckert, Ursula Schmidt-Erfurth, Sobha Sivaprasad, Toby Prevost, Andrew Lotery

Article Ophthalmology

A systematic evaluation of human expert agreement on optical coherence tomography biomarkers using multiple devices

Martin Michl, Martina Neschi, Alexandra Kaider, Katja Hatz, Gabor Deak, Bianca S. S. Gerendas, Ursula Schmidt-Erfurth

Summary: The objective of this study was to assess agreement in evaluating OCT variables in leading macular diseases among OCT-certified graders. Even in optimized conditions, there is disease-dependent variability in biomarker evaluation, particularly for IRF in nAMD and DMO. Our findings highlight the variability in human expert OCT grading performance and the need for AI-based automated feature analyses.
Article Computer Science, Information Systems

Segmentation of Bruch's Membrane in Retinal OCT With AMD Using Anatomical Priors and Uncertainty Quantification

Botond Fazekas, Dmitrii Lachinov, Guilherme Aresta, Julia Mai, Ursula Schmidt-Erfurth, Hrvoje Bogunovic

Summary: Segmentation of Bruch's membrane (BM) on optical coherence tomography (OCT) is crucial for the diagnosis and follow-up of age-related macular degeneration (AMD), a leading cause of blindness. Existing automated methods lack anatomical coherence and confidence feedback, limiting their real-world applicability. To address this, we propose an end-to-end deep learning method that uses an Attention U-Net to output a probability density function and considers the natural curvature of the surface. Additionally, our method estimates uncertainty and interpolates A-scans with high uncertainty. Evaluation on internal and external datasets demonstrates superior performance and strong generalization ability.

IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS (2023)

Article Ophthalmology

Point-to-point associations of drusen and hyperreflective foci volumes with retinal sensitivity in non-exudative age-related macular degeneration

Gregor S. Reiter, Hrvoje Bogunovic, Ferdinand Schlanitz, Wolf-Dieter Vogl, Philipp Seeboeck, Dariga Ramazanova, Ursula Schmidt-Erfurth

Summary: This study evaluated the quantitative impact of drusen and hyperreflective foci (HRF) volumes on mesopic retinal sensitivity in age-related macular degeneration (AMD) patients. The results showed a negative correlation between the volume of drusen and HRF and retinal sensitivity. The study highlights the use of AI-based methods to assess the impact of cellular changes on the development of AMD.
Article Ophthalmology

Performance of retinal fluid monitoring in OCT imaging by automated deep learning versus human expert grading in neovascular AMD

Maximilian Pawloff, Bianca S. S. Gerendas, Gabor Deak, Hrvoje Bogunovic, Anastasiia Gruber, Ursula Schmidt-Erfurth

Summary: The purpose of this study was to evaluate the reliability of automated fluid detection in identifying retinal fluid activity in OCT scans of patients treated with anti-VEGF therapy for neovascular age-related macular degeneration. The results showed that the concordance between human expert grading and automated algorithm performance was high, indicating that deep learning-based segmentation of retinal fluid performs reliably on OCT images.
Article Computer Science, Interdisciplinary Applications

Ultra-Widefield OCT Angiography

M. Niederleithner, L. de Sisternes, H. Stino, A. Sedova, T. Schlegl, H. Bagherinia, A. Britten, P. Matten, U. Schmidt-Erfurth, A. Pollreisz, W. Drexler, R. A. Leitgeb, T. Schmoll

Summary: Optical Coherence Tomography Angiography (OCTA) has the potential to replace invasive fluorescein angiography (FA) in ophthalmology, but it still lacks the field of view compared to fluorescence fundus photography techniques. To address this issue, a custom developed high-speed swept-source OCT (SS-OCT) system is presented, which can capture ultra-wide fields of view up to 90 degrees with high resolution. Additionally, a three-dimensional deep learning based algorithm is developed for denoising volumetric OCTA data sets, enhancing the visual appearance of angiograms.

IEEE TRANSACTIONS ON MEDICAL IMAGING (2023)

Article Biochemical Research Methods

Automated inter-device 3D OCT image registration using deep learning and retinal layer segmentation

David Rivas-Villar, Alice R. Motschi, Michael Pircher, Christoph K. Hitzenberger, Markus Schranz, Philipp K. Roberts, Ursula Schmidt-Erfurth, Hrvoje Bogunovic

Summary: In this study, a novel automated pipeline for registering OCT images from different devices is proposed. The pipeline utilizes deep learning for multi-modal 2D en-face registration and retinal layer segmentation for Z-axis registration. The experimental results show high-quality registrations, with mean errors of approximately 46 μm for 2D registration and 9.59 μm for Z-axis registration. This registration method can be valuable for various clinical applications such as layer segmentation validation.

BIOMEDICAL OPTICS EXPRESS (2023)

Article Ophthalmology

Progression Dynamics of Early versus Later Stage Atrophic Lesions in Nonneovascular Age-Related Macular Degeneration Using Quantitative OCT Biomarker Segmentation

Leonard M. Coulibaly, Gregor S. Reiter, Philipp Fuchs, Dmitrii Lachinov, Oliver Leingang, Wolf-Dieter Vogl, Hrvoje Bogunovic, Ursula Schmidt-Erfurth

Summary: This study investigated the progression of geographic atrophy secondary to nonneovascular age-related macular degeneration using artificial intelligence-based precision tools. The findings revealed that early lesions have slower growth rates and there are differences in growth dynamics compared to atrophic lesions in advanced stages.

OPHTHALMOLOGY RETINA (2023)

Article Ophthalmology

Analysing early changes of photoreceptor layer thickness following surgery in eyes with epiretinal membranes

Marlene Hollaus, Michael Georgopoulos, Johannes Iby, Jonas Brugger, Oliver Leingang, Hrvoje Bogunovic, Ursula Schmidt-Erfurth, Stefan Sacu

Summary: This study aimed to analyze the short-term changes of mean photoreceptor thickness (PRT) on the ETDRS-grid after vitrectomy and membrane peeling in patients with epiretinal membrane (ERM). The results showed significant changes in PRT after surgery, but no correlation with BCVA was found.
Article Multidisciplinary Sciences

Few-shot out-of-distribution detection for automated screening in retinal OCT images using deep learning

Teresa Araujo, Guilherme Aresta, Ursula Schmidt-Erfurth, Hrvoje Bogunovic

Summary: This study performs a comparative analysis of uncertainty estimation methods for out-of-distribution (OOD) detection in automated screening and staging of age-related macular degeneration (AMD) using retinal OCT imaging. The combination of cosine distance in the feature space and a few-shot outlier exposure (OE) approach improves the near-OOD detection performance, providing robust and reliable diagnostic systems.

SCIENTIFIC REPORTS (2023)

Article Ophthalmology

Impact of Choroidal Melanoma Characteristics on Progression-Free Survival in Patients Undergoing Hypofractionated Stereotactic Photon Radiotherapy

Reinhard Told, Judith Kreminger, Ursula Schmidt-Erfurth, Roman Dunavoelgyi, Adrian Reumueller

Summary: This study investigated the relationship between choroidal melanoma characteristics and progression-free survival (PFS) in patients who underwent linear accelerator-based hypofractionated stereotactic photon radiotherapy. The results showed that thickness and largest basal diameter (LBD) were significantly associated with PFS. For monitoring treated choroidal melanoma, LBD assessments could be used instead of ultrasonography-based thickness measurements.

OPHTHALMOLOGY AND THERAPY (2023)

Letter Ophthalmology

Re: Vogl et al.: Predicting topographic disease progression and treatment response of pegcetacoplan in geographic atrophy quantified by deep learning (Ophthalmol Retina. 2023;7:4-13) REPLY

Ursula Schmidt-Erfurth, Wolf-Dieter Vogl, Sophie Riedl, Julia Mai, Gregor S. Reiter, Dmitrii Lachinov, Hrvoje Bogunovic

OPHTHALMOLOGY RETINA (2023)

暂无数据