Purpose: The rapid integration of machine learning in ophthalmology may exacerbate existing disparities in eye health among underserved populations. This study aimed to assess the representation and quality of reporting on equity-relevant sociodemographic characteristics in retinal studies utilizing artificial intelligence (AI).
Design: A systematic scoping review.
Methods: A comprehensive literature search was conducted using Ovid MEDLINE, Ovid Embase, and the Cochrane Central Register of Controlled Trials (CENTRAL) from January 1, 2018, to July 29, 2023. The reporting of equity-relevant sociodemographic characteristics of participants was assessed using the PROGRESS equity framework.
Main outcome measures: The proportion of AI-based retinal studies reporting sociodemographic characteristics (e.g., race, ethnicity, gender, socioeconomic status), geographic diversity of dataset sources, and quality of reporting of racial and ethnic data.
Results: A total of 360 studies met inclusion criteria, the majority of which were retrospective (79.2%), imaging-based (99.4%) studies utilizing fundus photos (51.9%) or optical coherence tomography (43.1%) data from online databases (55.6%) or clinical charts (42.2%). Geographic diversity of studies was minimal, with only a few of the studies using clinical chart data that was collected in countries within the African (0.3%), Eastern Mediterranean (5.0%), and South-East Asian Region (6.7%). Sociodemographic reporting was limited, with 30.8% of studies reporting gender or sex, and only 8.9% reporting race or ethnicity of participants. Only 11.1% of studies tested AI algorithm performance by gender or sex, and 1.7% by race or ethnicity. The quality of racial and ethnic data reporting was poor overall, with significant gaps in how data was collected, determined, and classified.
Conclusions: AI-related retinal studies have limited equity considerations, particularly with regards to underrepresentation of diverse sociodemographic groups and insufficient racial and ethnic data reporting. Enhanced diversity in study populations and improved data collection and reporting methodologies are needed to ensure AI algorithms are trained and perform comparably across heterogenous populations affected by retinal diseases.
Keywords: Artificial intelligence; ethnicity; health equity; machine learning; ophthalmology; racial groups; systematic reviews.
Copyright © 2025. Published by Elsevier Inc.