Parameterized Diffusion Optimization enabled Autoregressive Ordinal Regression for Diabetic Retinopathy Grading
Preprint
Abstract
As a long-term complication of diabetes, diabetic retinopathy (DR) progresses slowly, potentially taking years to threaten vision. An accurate and robust evaluation of its severity is vital to ensure prompt management and care. Ordinal regression leverages the underlying inherent order between categories to achieve superior performance beyond traditional classification. However, there exist challenges leading to lower DR classification performance: 1) The uneven distribution of DR severity levels, characterized by a long-tailed pattern, adds complexity to the grading process. 2)The ambiguity in defining category boundaries introduces additional challenges, making the classification process more complex and prone to inconsistencies. This work proposes a novel autoregressive ordinal regression method called AOR-DR to address the above challenges by leveraging the clinical knowledge of inherent ordinal information in DR grading dataset settings. Specifically, we decompose the DR grading task into a series of ordered steps by fusing the prediction of the previous steps with extracted image features as conditions for the current prediction step. Additionally, we exploit the diffusion process to facilitate conditional probability modeling, enabling the direct use of continuous global image features for autoregression without relearning contextual information from patch-level features. This ensures the effectiveness of the autoregressive process and leverages the capabilities of pre-trained large-scale foundation models. Extensive experiments were conducted on four large-scale publicly available color fundus datasets, demonstrating our model's effectiveness and superior performance over six recent state-of-the-art ordinal regression methods. The implementation code is available at https://github.com/Qinkaiyu/AOR-DR.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Autoregressive Sequence Modeling for 3D Medical Image RepresentationProceedings of the AAAI Conference on Artificial Intelligence, 2025
- A foundation model for generalizable disease detection from retinal imagesNature, 2023
- Deep neural networks for rank-consistent ordinal regression based on conditional probabilitiesPattern Analysis and Applications, 2023
- DeepDRiD: Diabetic Retinopathy—Grading and Image Quality Estimation ChallengePatterns, 2022
- Geometric Order Learning for Rank Estimation2022
- Rank consistent ordinal regression for neural networks with application to age estimationPattern Recognition Letters, 2020
- Diagnostic assessment of deep learning algorithms for diabetic retinopathy screeningInformation Sciences, 2019
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding2019
- Improved Automated Detection of Diabetic Retinopathy on a Publicly Available Dataset Through Integration of Deep LearningInvestigative Ophthalmology & Visual Science, 2016
- The Prevalence of Diabetic Retinopathy Among Adults in the United StatesArchives of Ophthalmology (1950), 2004