Accurate Identification of the Trabecular Meshwork under Gonioscopic View in Real Time Using Deep Learning.
Ken Y Lin, Gregor Urban, Michael C Yang, Lung-Chi Lee, Da-Wen Lu, Wallace L M Alward, Pierre Baldi
Summary
Our CNN model can identify the TM in gonioscopy videos in real time with remarkable accuracy, allowing it to be used in connection with a video camera intraoperatively.
Abstract
PURPOSE
Accurate identification of iridocorneal structures on gonioscopy is difficult to master, and errors can lead to grave surgical complications. This study aimed to develop and train convolutional neural networks (CNNs) to accurately identify the trabecular meshwork (TM) in gonioscopic videos in real time for eventual clinical integrations.
DESIGN
Cross-sectional study.
PARTICIPANTS
Adult patients with open angle were identified in academic glaucoma clinics in both Taipei, Taiwan, and Irvine, California.
METHODS
Neural Encoder-Decoder CNNs (U-nets) were trained to predict a curve marking the TM using an expert-annotated data set of 378 gonioscopy images. The model was trained and evaluated with stratified cross-validation grouped by patients to ensure uncorrelated training and testing sets, as well as on a separate test set and 3 intraoperative gonioscopic videos of ab interno trabeculotomy with Trabectome (totaling 90 seconds long, 30 frames per second). We also evaluated our model's performance by comparing its accuracy against ophthalmologists.
MAIN OUTCOME MEASURES
Successful development of real-time-capable CNNs that are accurate in predicting and marking the TM's position in video frames of gonioscopic views. Models were evaluated in comparison with human expert annotations of static images and video data.
RESULTS
The best CNN model produced test set predictions with a median deviation of 0.8% of the video frame's height (15.25 μm) from the human experts' annotations. This error is less than the average vertical height of the TM. The worst test frame prediction of this model had an average deviation of 4% of the frame height (76.28 μm), which is still considered a successful prediction. When challenged with unseen images, the CNN model scored greater than 2 standard deviations above the mean performance of the surveyed general ophthalmologists.
CONCLUSIONS
Our CNN model can identify the TM in gonioscopy videos in real time with remarkable accuracy, allowing it to be used in connection with a video camera intraoperatively. This model can have applications in surgical training, automated screenings, and intraoperative guidance. The dataset developed in this study is one of the first publicly available gonioscopy image banks (https://lin.hs.uci.edu/research), which may encourage future investigations in this topic.
Keywords
More by Ken Y Lin
View full profile →Fast and Accurate Ophthalmic Medication Bottle Identification Using Deep Learning on a Smartphone Device.
Anterior Chamber Washout During Ahmed Valve Glaucoma Surgery Reduces the Incidence of Hypertensive Phase.
Histological basis for the variability of visual field defects in early glaucoma.
Top Research in Glaucoma Surgery
Browse all →Treatment Outcomes in the Primary Tube Versus Trabeculectomy Study after 1 Year of Follow-up.
Efficacy, Safety, and Risk Factors for Failure of Standalone Ab Interno Gelatin Microstent Implantation versus Standalone Trabeculectomy.
Prospective, Randomized, Controlled Pivotal Trial of an Ab Interno Implanted Trabecular Micro-Bypass in Primary Open-Angle Glaucoma and Cataract: Two-Year Results.
In the Knowledge Library
Discussion
Comments and discussion will appear here in a future update.