Search

Summary Background Geographic atrophy is a major vision-threatening manifestation of age-related macular degeneration, one of the leading causes of blindness globally. Geographic atrophy has no proven treatment or method for easy detection. Rapid, reliable, and objective detection and quantification of geographic atrophy from optical coherence tomography (OCT) retinal scans is necessary for disease monitoring, prognostic research, and to serve as clinical endpoints for therapy development. To this end, we aimed to develop and validate a fully automated method to detect and quantify geographic atrophy from OCT. Methods We did a deep-learning model development and external validation study on OCT retinal scans at Moorfields Eye Hospital Reading Centre and Clinical AI Hub (London, UK). A modified U-Net architecture was used to develop four distinct deep-learning models for segmentation of geographic atrophy and its constituent retinal features from OCT scans acquired with Heidelberg Spectralis. A manually segmented clinical dataset for model development comprised 5049 B-scans from 984 OCT volumes selected randomly from 399 eyes of 200 patients with geographic atrophy secondary to age-related macular degeneration, enrolled in a prospective, multicentre, phase 2 clinical trial for the treatment of geographic atrophy (FILLY study). Performance was externally validated on an independently recruited dataset from patients receiving routine care at Moorfields Eye Hospital (London, UK). The primary outcome was segmentation and classification agreement between deep-learning model geographic atrophy prediction and consensus of two independent expert graders on the external validation dataset. Findings The external validation cohort included 884 B-scans from 192 OCT volumes taken from 192 eyes of 110 patients as part of real-life clinical care at Moorfields Eye Hospital between Jan 1, 2016, and Dec, 31, 2019 (mean age 78·3 years [SD 11·1], 58 [53%] women). The resultant geographic atrophy deep-learning model produced predictions similar to consensus human specialist grading on the external validation dataset (median Dice similarity coefficient [DSC] 0·96 [IQR 0·10]; intraclass correlation coefficient [ICC] 0·93) and outperformed agreement between human graders (DSC 0·80 [0·28]; ICC 0·79). Similarly, the three independent feature-specific deep-learning models could accurately segment each of the three constituent features of geographic atrophy: retinal pigment epithelium loss (median DSC 0·95 [IQR 0·15]), overlying photoreceptor degeneration (0·96 [0·12]), and hypertransmission (0·97 [0·07]) in the external validation dataset versus consensus grading. Interpretation We present a fully developed and validated deep-learning composite model for segmentation of geographic atrophy and its subtypes that achieves performance at a similar level to manual specialist assessment. Fully automated analysis of retinal OCT from routine clinical practice could provide a promising horizon for diagnosis and prognosis in both research and real-life patient care, following further clinical validation Funding Apellis Pharmaceuticals.

PurposeTo externally validate a deep learning pipeline (AutoMorph) for automated analysis of retinal vascular morphology on fundus photographs. AutoMorph has been made publicly available (https://github.com/rmaphoh/AutoMorph), facilitating widespread research in ophthalmic and systemic diseases.MethodsAutoMorph consists of four functional modules: image pre-processing, image quality grading, anatomical segmentation (including binary vessel, artery/vein, and optic disc/cup segmentation), and vascular morphology feature measurement. Image quality grading and anatomical segmentation use the most recent deep learning techniques. We employ a model ensemble strategy to achieve robust results and analyse the prediction confidence to rectify false gradable cases in image quality grading. We externally validate each module’s performance on several independent publicly available datasets.ResultsThe EfficientNet-b4 architecture used in the image grading module achieves comparable performance to the state-of-the-art for EyePACS-Q, with an F1-score of 0.86. The confidence analysis reduces the number of images incorrectly assessed as gradable by 76%. Binary vessel segmentation achieves an F1-score of 0.73 on AV-WIDE and 0.78 on DR-HAGIS. Artery/vein scores 0.66 on IOSTAR-AV, and disc segmentation achieves 0.94 in IDRID. Vascular morphology features measured from AutoMorph segmentation map and expert annotation show good to excellent agreement.ConclusionsAutoMorph modules perform well even when external validation data shows domain differences from training data, e.g., with different imaging devices. This fully automated pipeline can thus allow detailed, efficient and comprehensive analysis of retinal vascular morphology on colour fundus photographs.Translational RelevanceBy making AutoMorph publicly available and open source, we hope to facilitate ophthalmic and systemic disease research, particularly in the emerging field of ‘oculomics’.

Background/aimsEvaluation of telemedicine care models has highlighted its potential for exacerbating healthcare inequalities. This study seeks to identify and characterise factors associated with non-attendance across face-to-face and telemedicine outpatient appointments.MethodsA retrospective cohort study at a tertiary-level ophthalmic institution in the UK, between 1 January 2019 and 31 October 2021. Logistic regression modelled non-attendance against sociodemographic, clinical and operational exposure variables for all new patient registrations across five delivery modes: asynchronous, synchronous telephone, synchronous audiovisual and face to face prior to the pandemic and face to face during the pandemic.ResultsA total of 85 924 patients (median age 55 years, 54.4% female) were newly registered. Non-attendance differed significantly by delivery mode: (9.0% face to face prepandemic, 10.5% face to face during the pandemic, 11.7% asynchronous and 7.8%, synchronous during pandemic). Male sex, greater levels of deprivation, a previously cancelled appointment and not self-reporting ethnicity were strongly associated with non-attendance across all delivery modes. Individuals identifying as black ethnicity had worse attendance in synchronous audiovisual clinics (adjusted OR 4.24, 95% CI 1.59 to 11.28) but not asynchronous. Those not self-reporting their ethnicity were from more deprived backgrounds, had worse broadband access and had significantly higher non-attendance across all modes (all pConclusionPersistent non-attendance among underserved populations attending telemedicine appointments highlights the challenge digital transformation faces for reducing healthcare inequalities. Implementation of new programmes should be accompanied by investigation into the differential health outcomes of vulnerable populations.

PurposeRetinal signatures of systemic disease (‘oculomics’) are increasingly being revealed through a combination of high-resolution ophthalmic imaging and sophisticated modelling strategies. Progress is currently limited not mainly by technical issues, but by the lack of large labelled datasets, a sine qua non for deep learning. Such data are derived from prospective epidemiological studies, in which retinal imaging is typically unimodal, cross-sectional, of modest number and relates to cohorts, which are not enriched with subpopulations of interest, such as those with systemic disease. We thus linked longitudinal multimodal retinal imaging from routinely collected National Health Service (NHS) data with systemic disease data from hospital admissions using a privacy-by-design third-party linkage approach.ParticipantsBetween 1 January 2008 and 1 April 2018, 353 157 participants aged 40 years or older, who attended Moorfields Eye Hospital NHS Foundation Trust, a tertiary ophthalmic institution incorporating a principal central site, four district hubs and five satellite clinics in and around London, UK serving a catchment population of approximately six million people.Findings to dateAmong the 353 157 individuals, 186 651 had a total of 1 337 711 Hospital Episode Statistics admitted patient care episodes. Systemic diagnoses recorded at these episodes include 12 022 patients with myocardial infarction, 11 735 with all-cause stroke and 13 363 with all-cause dementia. A total of 6 261 931 retinal images of seven different modalities and across three manufacturers were acquired from 1 54 830 patients. The majority of retinal images were retinal photographs (n=1 874 175) followed by optical coherence tomography (n=1 567 358).Future plansAlzEye combines the world’s largest single institution retinal imaging database with nationally collected systemic data to create an exceptional large-scale, enriched cohort that reflects the diversity of the population served. First analyses will address cardiovascular diseases and dementia, with a view to identifying hidden retinal signatures that may lead to earlier detection and risk management of these life-threatening conditions.

Objective: Predict visual function with machine-learning applied to automatically acquired quantitative imaging biomarkers in geographic atrophyDesign: Post-hoc analysis of data from a clinical trial and routine clinical care.Methods: Automated segmentation of OCT scans from 476 eyes (325 patients) with geographic atrophy. Machine learning modelling of resultant quantitative OCT (qOCT) biomarkers to predict cross-sectional visual acuity under both standard luminance (VA) and low luminance (LLVA) conditions.Main Outcome Measure: Correlation coefficient (R2) and mean absolute error (MAE) for cross-sectional VA and LLVA in Early Treatment Diabetic Retinopathy Study (ETDRS) letters.Results: Best-corrected VA under both standard luminance (R2 0.46 MAE 10.2 ETDRS letters) and low-luminance conditions (R2 0.25 MAE 12.1) could be predicted. The foveal region contributed the most (46.5%) toward model performance, with retinal pigment epithelium loss and outer retinal atrophy contributing the most (31.1%). For LLVA, however, features in the non-foveal regions were most important (74.5%), led by photoreceptor degeneration (38.9%).Conclusions: Our method of automatic qOCT segmentation demonstrates functional significance for vision in geographic atrophy, including LLVA. LLVA is itself predictive of geographic atrophy progression, implying that the predictive qOCT biomarkers provided by our model are also prognostic.

Key Points Question What are the enablers and barriers of patient engagement for app-based home vision monitoring at scale? Findings In this cohort and survey study including 417 adults, 258 patients were active users (61.9%) of whom 166 patients (64.3%) were compliant users. Engagement was positively associated with higher comfort with technology, White British ethnicity, visual acuity, neovascular age-related macular degeneration diagnosis, and the number of intravitreal injections and was negatively associated with increased age. Meaning These findings suggest effective smartphone app-based home vision monitoring should address the risk factors for low engagement and digital exclusion during clinical practice setting deployment., This cohort study examines the associations between patient characteristics and clinical measures with vision monitoring app uptake and engagement., Importance Telemedicine is accelerating the remote detection and monitoring of medical conditions, such as vision-threatening diseases. Meaningful deployment of smartphone apps for home vision monitoring should consider the barriers to patient uptake and engagement and address issues around digital exclusion in vulnerable patient populations. Objective To quantify the associations between patient characteristics and clinical measures with vision monitoring app uptake and engagement. Design, Setting, and Participants In this cohort and survey study, consecutive adult patients attending Moorfields Eye Hospital receiving intravitreal injections for retinal disease between May 2020 and February 2021 were included. Exposures Patients were offered the Home Vision Monitor (HVM) smartphone app to self-test their vision. A patient survey was conducted to capture their experience. App data, demographic characteristics, survey results, and clinical data from the electronic health record were analyzed via regression and machine learning. Main Outcomes and Measures Associations of patient uptake, compliance, and use rate measured in odds ratios (ORs). Results Of 417 included patients, 236 (56.6%) were female, and the mean (SD) age was 72.8 (12.8) years. A total of 258 patients (61.9%) were active users. Uptake was negatively associated with age (OR, 0.98; 95% CI, 0.97-0.998; P = .02) and positively associated with both visual acuity in the better-seeing eye (OR, 1.02; 95% CI, 1.00-1.03; P = .01) and baseline number of intravitreal injections (OR, 1.01; 95% CI, 1.00-1.02; P = .02). Of 258 active patients, 166 (64.3%) fulfilled the definition of compliance. Compliance was associated with patients diagnosed with neovascular age-related macular degeneration (OR, 1.94; 95% CI, 1.07-3.53; P = .002), White British ethnicity (OR, 1.69; 95% CI, 0.96-3.01; P = .02), and visual acuity in the better-seeing eye at baseline (OR, 1.02; 95% CI, 1.01-1.04; P = .04). Use rate was higher with increasing levels of comfort with use of modern technologies (β = 0.031; 95% CI, 0.007-0.055; P = .02). A total of 119 patients (98.4%) found the app either easy or very easy to use, while 96 (82.1%) experienced increased reassurance from using the app. Conclusions and Relevance This evaluation of home vision monitoring for patients with common vision-threatening disease within a clinical practice setting revealed demographic, clinical, and patient-related factors associated with patient uptake and engagement. These insights inform targeted interventions to address risks of digital exclusion with smartphone-based medical devices.

The developmental process of embryos follows a monotonic order. An embryo can progressively cleave from one cell to multiple cells and finally transform to morula and blastocyst. For time-lapse videos of embryos, most existing developmental stage classification methods conduct per-frame predictions using an image frame at each time step. However, classification using only images suffers from overlapping between cells and imbalance between stages. Temporal information can be valuable in addressing this problem by capturing movements between neighboring frames. In this work, we propose a two-stream model for developmental stage classification. Unlike previous methods, our two-stream model accepts both temporal and image information. We develop a linear-chain conditional random field (CRF) on top of neural network features extracted from the temporal and image streams to make use of both modalities. The linear-chain CRF formulation enables tractable training of global sequential models over multiple frames while also making it possible to inject monotonic development order constraints into the learning process explicitly. We demonstrate our algorithm on two time-lapse embryo video datasets: i) mouse and ii) human embryo datasets. Our method achieves 98.1% and 80.6% for mouse and human embryo stage classification, respectively. Our approach will enable more pro-found clinical and biological studies and suggests a new direction for developmental stage classification by utilizing temporal information.

PURPOSE OF REVIEW This article aims to discuss the current state of resources enabling the democratization of artificial intelligence (AI) in ophthalmology. RECENT FINDINGS Open datasets, efficient labeling techniques, code-free automated machine learning (AutoML) and cloud-based platforms for deployment are resources that enable clinicians with scarce resources to drive their own AI projects. SUMMARY Clinicians are the use-case experts who are best suited to drive AI projects tackling patient-relevant outcome measures. Taken together, open datasets, efficient labeling techniques, code-free AutoML and cloud platforms break the barriers for clinician-driven AI. As AI becomes increasingly democratized through such tools, clinicians and patients stand to benefit greatly.

Purpose Neovascular age-related macular degeneration (nAMD) is a major global cause of blindness. Whilst anti-vascular endothelial growth factor (anti-VEGF) treatment is effective, response varies considerably between individuals. Thus, patients face substantial uncertainty regarding their future ability to perform daily tasks. In this study, we evaluate the performance of an automated machine learning (AutoML) model which predicts visual acuity (VA) outcomes in patients receiving treatment for nAMD, in comparison to a manually coded model built using the same dataset. Furthermore, we evaluate model performance across ethnic groups and analyse how the models reach their predictions. Methods Binary classification models were trained to predict whether patients’ VA would be ‘Above’ or ‘Below’ a score of 70 one year after initiating treatment, measured using the Early Treatment Diabetic Retinopathy Study (ETDRS) chart. The AutoML model was built using the Google Cloud Platform, whilst the bespoke model was trained using an XGBoost framework. Models were compared and analysed using the What-if Tool (WIT), a novel model-agnostic interpretability tool. Results Our study included 1631 eyes from patients attending Moorfields Eye Hospital. The AutoML model (area under the curve [AUC], 0.849) achieved a highly similar performance to the XGBoost model (AUC, 0.847). Using the WIT, we found that the models over-predicted negative outcomes in Asian patients and performed worse in those with an ethnic category of Other. Baseline VA, age and ethnicity were the most important determinants of model predictions. Partial dependence plot analysis revealed a sigmoidal relationship between baseline VA and the probability of an outcome of ‘Above’. Conclusion We have described and validated an AutoML-WIT pipeline which enables clinicians with minimal coding skills to match the performance of a state-of-the-art algorithm and obtain explainable predictions.

A major challenge in clinical In-Vitro Fertilization (IVF) is selecting the highest quality embryo to transfer to the patient in the hopes of achieving a pregnancy. Time-lapse microscopy provides clinicians with a wealth of information for selecting embryos. However, the resulting movies of embryos are currently analyzed manually, which is time consuming and subjective. Here, we automate feature extraction of time-lapse microscopy of human embryos with a machine-learning pipeline of five convolutional neural networks (CNNs). Our pipeline consists of (1) semantic segmentation of the regions of the embryo, (2) regression predictions of fragment severity, (3) classification of the developmental stage, and object instance segmentation of (4) cells and (5) pronuclei. Our approach greatly speeds up the measurement of quantitative, biologically relevant features that may aid in embryo selection.