Enhancing RGB-D Mirror Segmentation With a Neighborhood-Matching and Demand-Modal Adaptive Network Using Knowledge Distillation
- 3 March 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 22 (15455955) , 12679-12692
Abstract
Recent breakthroughs in computer vision have led to remarkable progress in the areas of autonomous vehicles and robotics. However, ordinary objects such as mirrors pose unique challenges to computer vision systems owing to occlusion, reflection, and distortion. Moreover, existing deep learning models suffer from issues such as excessive parameters and high computational complexity, making it challenging to implement numerous studies offline. To address these issues, we propose an innovative solution: a neighborhood-matching and demand-modal adaptive network using knowledge distillation (KD), called NDANet-S*, specifically designed for red-green-blue depth mirror segmentation. NDANet-S* operates by iteratively matching detailed and semantic difference between neighborhood features during the encoding phase. It then complements information across different modalities through demand-modal adaptation, enhancing heteromodal cross-complementation during the KD stage. In the decoding phase, semantic enhancement features and iterative encoding features are deeply integrated, forming a strong foundation for multistage progressive knowledge transfer in the KD process. Furthermore, we introduce a multistage teacher-assisted KD scheme, guided by sample complexity, to work synergistically with the mirror segmentation model. This innovative scheme includes a sample complexity rater, heterogeneous cross-complementarity, and hierarchical progressive knowledge transfer. Experimental evaluations on publicly available datasets indicate that NDANet-S* significantly enhances segmentation accuracy while preserving a consistent number of parameters. Additionally, it achieves state-of-the-art performance in mirror segmentation. The source code for our model is publicly available and can be accessed at: https://github.com/2021nihao/NMDANet.Keywords
Funding Information
- Zhejiang Provincial Natural Science Foundation of China (ZCLZ25F0202)
- National Natural Science Foundation of China (62371422)
This publication has 71 references indexed in Scilit:
- Towards robotic on-orbit assembly of large space telescopes: Mission architectures, concepts, and analysesActa Astronautica, 2024
- EGA-Net: Edge feature enhancement and global information attention network for RGB-D salient object detectionInformation Sciences, 2023
- Multi-level knowledge distillation for low-resolution object detection and facial expression recognitionKnowledge-Based Systems, 2022
- Real-time semantic segmentation via sequential knowledge distillationNeurocomputing, 2021
- Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detection2020
- Differentiable Feature Aggregation Search for Knowledge Distillation2020
- Semantic Relation Preserving Knowledge Distillation for Image-to-Image Translation2020
- BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network2020
- Learning Deep Representations with Probabilistic Knowledge Transfer2018
- A Tutorial on the Cross-Entropy MethodAnnals of Operations Research, 2005