4.7 Article

A Multitask Deep-Learning System to Classify Diabetic Macular Edema for Different Optical Coherence Tomography Devices: A Multicenter Analysis

Journal

DIABETES CARE
Volume 44, Issue 9, Pages 2078-2088

Publisher

AMER DIABETES ASSOC
DOI: 10.2337/dc20-3064

Keywords

-

Ask authors/readers for more resources

A deep learning system was developed for accurate classification of DME using OCT images, achieving high AUROC values. This system showed excellent performance in automated DME classification, demonstrating potential as an effective screening tool for patients with diabetes.
OBJECTIVE Diabetic macular edema (DME) is the primary cause of vision loss among individuals with diabetes mellitus (DM). We developed, validated, and tested a deep learning (DL) system for classifying DME using images from three common commercially available optical coherence tomography (OCT) devices. RESEARCH DESIGN AND METHODS We trained and validated two versions of a multitask convolution neural network (CNN) to classify DME (center-involved DME [CI-DME], non-CI-DME, or absence of DME) using three-dimensional (3D) volume scans and 2D B-scans, respectively. For both 3D and 2D CNNs, we used the residual network (ResNet) as the backbone. For the 3D CNN, we used a 3D version of ResNet-34 with the last fully connected layer removed as the feature extraction module. A total of 73,746 OCT images were used for training and primary validation. External testing was performed using 26,981 images across seven independent data sets from Singapore, Hong Kong, the U.S., China, and Australia. RESULTS In classifying the presence or absence of DME, the DL system achieved area under the receiver operating characteristic curves (AUROCs) of 0.937 (95% CI 0.920-0.954), 0.958 (0.930-0.977), and 0.965 (0.948-0.977) for the primary data set obtained from CIRRUS, SPECTRALIS, and Triton OCTs, respectively, in addition to AUROCs >0.906 for the external data sets. For further classification of the CI-DME and non-CI-DME subgroups, the AUROCs were 0.968 (0.940-0.995), 0.951 (0.898-0.982), and 0.975 (0.947-0.991) for the primary data set and >0.894 for the external data sets. CONCLUSIONS We demonstrated excellent performance with a DL system for the automated classification of DME, highlighting its potential as a promising second-line screening tool for patients with DM, which may potentially create a more effective triaging mechanism to eye clinics.

Authors

I am an author on this paper
Click your name to claim this paper and add it to your profile.

Reviews

Primary Rating

4.7
Not enough ratings

Secondary Ratings

Novelty
-
Significance
-
Scientific rigor
-
Rate this paper

Recommended

Article Ophthalmology

OCT-based biomarkers for predicting treatment response in eyes with centre-involved diabetic macular oedema treated with anti-VEGF injections: a real-life retina clinic-based study

Simon K. H. Szeto, Vivian W. K. Hui, Fang Yao Tang, Dawei Yang, Zi Han Sun, Shaheeda Mohamed, Carmen K. M. Chan, Timothy Y. Y. Lai, Carol Cheung

Summary: This study aims to investigate whether a combination of baseline and change in SD-OCT biomarkers can predict visual outcomes in patients with DMO treated with anti-VEGF injections. The results indicate that baseline DRIL, hyper-reflective foci in retina, and disruption of ELM/EZ and COST were associated with worse baseline and subsequent VA up to 24 months after treatment. Improvement in DRIL, ELM/EZ, and COST after treatment was associated with greater improvement in VA at 12 months.

BRITISH JOURNAL OF OPHTHALMOLOGY (2023)

Article Ophthalmology

Massive retinal infiltrates as the presenting sign of chronic myeloid leukemia: Clinical and imaging features of leukemic retinopathy

Simon K. H. Szeto, Shaheeda Mohamed, Chi Wai Tsang, Carmen K. M. Chan

Summary: This article describes the clinical and optical coherence tomography (OCT) features of two cases with bilateral diffuse retinal infiltrates as the only presenting feature of chronic myeloid leukemia (CML) on initial diagnosis and upon relapse. The findings highlight the important role of ophthalmologists in promptly diagnosing leukemia in patients with visual complaints, and the potential for systemic investigation and hematologist referrals to improve outcomes and preserve vision.

EUROPEAN JOURNAL OF OPHTHALMOLOGY (2023)

Article Ophthalmology

Clinically relevant factors associated with a binary outcome of diabetic macular ischaemia: an OCTA study

Da Wei Yang, Zi Qi Tang, Fang Yao Tang, Simon K. H. Szeto, Jason Chan, Fanny Yip, Cherie Y. K. Wong, An Ran Ran, Timothy Y. Y. Lai, Carol Y. Cheung

Summary: This study investigated the factors associated with diabetic macular ischaemia (DMI) as assessed by optical coherence tomography angiography (OCTA). The results showed that age, visual acuity, ganglion cell-inner plexiform layer thickness, diabetic retinopathy severity, haemoglobin A1c level, estimated glomerular filtration rate, and low-density lipoprotein cholesterol level were associated with SCP-DMI. In addition, the presence of diabetic macular oedema and shorter axial length were associated with DCP-DMI.

BRITISH JOURNAL OF OPHTHALMOLOGY (2023)

Article Computer Science, Artificial Intelligence

Deep semi-supervised multiple instance learning with self-correction for DME classification from OCT images

Xi Wang, Fangyao Tang, Hao Chen, Carol Y. Cheung, Pheng-Ann Heng

Summary: Supervised deep learning has achieved success in DME recognition from OCT volumetric images. However, the shortage of labeled data and the expensive annotation make accurate analysis difficult. To tackle this problem, the authors propose a deep semi-supervised multiple instance learning framework that leverages a small amount of labeled data and a large amount of unlabeled data.

MEDICAL IMAGE ANALYSIS (2023)

Article Ophthalmology

Case Report: Retinal vasculitis in two adolescents after COVID-19 vaccination

Shaheeda Mohamed, Carmen K. M. Chan, Chi Wai Tsang, Simon K. H. Szeto, Angie H. C. Fong, Jason C. K. Chan, Cherie Y. K. Wong

Summary: This study reports two cases of bilateral retinal vasculitis in adolescents following COVID-19 vaccination. It suggests a possible association between mRNA vaccinations and the development of autoimmune-related eye diseases. Clinicians should be aware of the potential risk of retinal vasculitis in adolescents after COVID-19 vaccination.

OCULAR IMMUNOLOGY AND INFLAMMATION (2023)

Review Medicine, General & Internal

Deep Learning in Optical Coherence Tomography Angiography: Current Progress, Challenges, and Future Directions

Dawei Yang, An Ran Ran, Truong X. X. Nguyen, Timothy P. H. Lin, Hao Chen, Timothy Y. Y. Lai, Clement C. C. Tham, Carol Y. Y. Cheung

Summary: Optical coherence tomography angiography (OCT-A) provides non-invasive visualization of retinal microvasculature, and deep learning (DL) has been applied in OCT-A image analysis to enhance its clinical values. However, the deployment of this combination in real-world clinics is still in the proof-of-concept stage due to limitations in training sample size, data preprocessing, external dataset testing, and results interpretation standardization. In this review, we introduce the applications of DL in OCT-A, summarize the challenges of clinical deployment, and discuss future research directions.

DIAGNOSTICS (2023)

Article Ophthalmology

Assessment of Parafoveal Diabetic Macular Ischemia on Optical Coherence Tomography Angiography Images to Predict Diabetic Retinal Disease Progression and Visual Acuity Deterioration

Dawei Yang, Ziqi Tang, Anran Ran, Truong X. X. Nguyen, Simon Szeto, Jason Chan, Cherie Y. K. Wong, Vivian Hui, Ken Tsang, Carmen K. M. Chan, Clement C. C. Tham, Sobha Sivaprasad, Timothy Y. Y. Lai, Carol Y. Y. Cheung

Summary: The presence of diabetic macular ischemia (DMI) on optical coherence tomography angiography (OCTA) images is important for predicting the progression of diabetic retinal disease and visual acuity deterioration. An automated binary DMI algorithm using OCTA images was found to have prognostic value for DR progression, diabetic macular edema development, and visual acuity deterioration.

JAMA OPHTHALMOLOGY (2023)

Review Ophthalmology

AI-integrated ocular imaging for predicting cardiovascular disease: advancements and future outlook

Yu Huang, Carol Y. Cheung, Dawei Li, Yih Chung Tham, Bin Sheng, Ching Yu Cheng, Ya Xing Wang, Tien Yin Wong

Summary: Cardiovascular disease (CVD) is a major cause of death globally, and the use of artificial intelligence (AI) in analyzing ocular images has the potential to enhance CVD risk prediction. This review provides an overview of AI-based ocular image analysis for predicting CVD and discusses the limitations in AI research and the challenges in clinical practice.
Article Health Care Sciences & Services

Remote Perimetry in a Virtual Reality Metaverse Environment for Out-of-Hospital Functional Eye Screening Compared Against the Gold Standard Humphrey Visual Fields Perimeter: Proof-of-Concept Pilot Study

Kang-An Wong, Bryan Chin Hou Ang, Dinesh Visva Gunasekeran, Rahat Husain, Joewee Boon, Krishna Vikneson, Zyna Pei Qi Tan, Gavin Siew Wei Tan, Tien Yin Wong, Rupesh Agrawal

Summary: This study investigates the performance of a novel remote perimetry application designed in a virtual reality metaverse environment to enable functional testing in community-based and primary care settings. The results show that the remote perimetry application has good concordance with the gold standard perimetry and could potentially be used for functional eye screening in out-of-hospital settings.

JOURNAL OF MEDICAL INTERNET RESEARCH (2023)

Article Computer Science, Information Systems

Pivotal trial of a deep-learning-based retinal biomarker (Reti-CVD) in the prediction of cardiovascular disease: data from CMERC-HI

Chan Joo Lee, Tyler Hyungtaek Rim, Hyun Goo Kang, Joseph Keunhong Yi, Geunyoung Lee, Marco Yu, Soo-Hyun Park, Jin-Taek Hwang, Yih-Chung Tham, Tien Yin Wong, Ching-Yu Cheng, Dong Wook Kim, Sung Soo Kim, Sungha Park

Summary: This study validated a personalized cardiovascular disease (CVD) risk scoring system, named Reti-CVD, based on retinal images. The risk groups defined by Reti-CVD were significantly associated with increased CVD risk and remained effective in a comprehensive model with other risk factors.

JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION (2023)

Article Oncology

Cancer immunotherapy response prediction from multi-modal clinical and image data using semi-supervised deep learning

Xi Wang, Yuming Jiang, Hao Chen, Taojun Zhang, Zhen Han, Chuanli Chen, Qingyu Yuan, Wenjun Xiong, Wei Wang, Guoxin Li, Pheng-Ann Heng, Ruijiang Li

Summary: This study presents a multi-modal deep learning radiomics approach to predict the immunotherapy response in gastric cancer patients using both clinical data and computed tomography images. The deep learning model achieved promising performance for predicting immunotherapy response and further improved the accuracy when combined with PD-L1 expression.

RADIOTHERAPY AND ONCOLOGY (2023)

Article Urology & Nephrology

A deep learning system for retinal vessel calibre improves cardiovascular risk prediction in Asians with chronic kidney disease

Cynthia Ciwei Lim, Crystal Chong, Gavin Tan, Chieh Suai Tan, Carol Y. Cheung, Tien Y. Wong, Ching Yu Cheng, Charumathi Sabanayagam

Summary: This study found that retinal vessel calibre measurements obtained by a deep learning system were significantly associated with incident cardiovascular disease (CVD) in chronic kidney disease (CKD) patients. The addition of kidney function and retinal vessel calibre parameters improved the prediction of CVD risk among CKD patients.

CLINICAL KIDNEY JOURNAL (2023)

Article Computer Science, Artificial Intelligence

Diffusion Source Inference for Large-Scale Complex Networks Based on Network Percolation

Yang Liu, Xiaoqi Wang, Xi Wang, Zhen Wang, Jurgen Kurths

Summary: This article studies the diffusion-source-inference (DSI) problem and proposes a percolation-based evolutionary framework (PrEF) to optimize the observer set and minimize the candidate set. The effectiveness of the proposed method is validated on both synthetic and empirical networks in varied circumstances and shows better performance compared to the state of the art. This research provides a framework for the analysis of the DSI problem in large-scale networks.

IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2023)

No Data Available