Distilling Knowledge to Efficient Transformer for Semi-Supervised Citrus Maturity Detection Using Consumer UAVs
- 29 January 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Consumer Electronics
- Vol. 72 (2) , 3186-3198
Abstract
Accurate detection of citrus fruit maturity is critical for optimizing harvest schedules and maximizing yield. Consumer-grade unmanned aerial vehicles (UAVs) have emerged as cost-effective alternatives to traditional methods for detecting maturity, which rely on labor-intensive manual inspections. This paper presents a two-step, semi-supervised approach leveraging knowledge distillation (KD) and transfer learning for citrus maturity detection in UAV images. Specifically, we combine teacher-filtered pseudo-labels with a consistency-guided feature distillation signal to exploit abundant unlabeled UAV frames while using only a small labeled seed set. Firstly, a consistency-guided KD transfers knowledge from a pretrained detection transformer with collaborative hybrid assignment training (Co-DETR) to a lightweight student network by exploiting a small labeled and a large unlabeled dataset. The student network (Cit-DETR) is based on the highly efficient detection transformer (RT-DETR) having a ResNet18 backbone with selective kernel blocks and the hybrid encoder module. Step 2 uses a small labeled augmented dataset with maturity labels to fine-tune the Cit-DETR model for maturity detection. Experimental results on a custom UAV-captured citrus dataset demonstrate the effectiveness of our method, achieving 86.2% average precision in citrus detection and 91.0% mean average precision in ripeness detection. The model has been further optimized for real-time inference on edge devices or UAVs, enabling precision agriculture applications.Keywords
Funding Information
- United Arab Emirates University (G00005398)
This publication has 52 references indexed in Scilit:
- A robust and efficient citrus counting approach for large-scale unstructured orchardsAgricultural Systems, 2024
- Identifying strawberry appearance quality based on unsupervised deep learningPrecision Agriculture, 2023
- The Vision-Based Target Recognition, Localization, and Control for Harvesting Robots: A ReviewInternational Journal of Precision Engineering and Manufacturing, 2023
- Understanding the potential applications of Artificial Intelligence in Agriculture SectorAdvanced Agrochem, 2023
- Leaf image based plant disease identification using transfer learning and feature fusionComputers and Electronics in Agriculture, 2022
- Citrus fruits maturity detection in natural environments based on convolutional neural networks and visual saliency mapPrecision Agriculture, 2022
- Knowledge Distillation: A SurveyInternational Journal of Computer Vision, 2021
- End-to-End Object Detection with Transformers2020
- Immature green citrus fruit detection using color and thermal imagesComputers and Electronics in Agriculture, 2018
- Microsoft COCO: Common Objects in Context2014