Ruoxi Deng
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Ruoxi Deng has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Jie Hu
Key Laboratory of Intelligent Informatics for Safety & Emergency of Zhejiang Province, Wenzhou University, Wenzhou, China
3 shared publications - Zhao-Min Chen
College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, China
3 shared publications - Bin Yu
School of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou, China
1 shared publication - Caixia Zhou
Shanghai Maritime University, Shanghai, China and Beijing Jiaotong University, Beijing, China
1 shared publication - Chaoqun Xia
College of Computer Science and Artificial Intelligence, Wenzhou University, Wenzhou 325035, China
1 shared publication - Guodao Zhang
School of Automation, Hangzhou Dianzi University, Hangzhou, 310018, China
1 shared publication
Latest Publications
- Open Access
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 4524-4532
Advancing Semantic Edge Detection through Cross-Modal Knowledge Learning
Semantic edge detection (SED) is pivotal for the precise demarcation of object boundaries, yet it faces ongoing challenges due to the prevalence of low-quality labels in current methods. In this paper, we present a novel solution to bolster SED through the encoding of both language and image data. Distinct from antecedent language-driven techniques, which predominantly utilize static elements such as dataset labels, our method taps into the dynamic language content that details the objects in each image and their interrelations. By encoding this varied input, we generate integrated features that utilize semantic insights to refine the high-level image features and the ultimate mask representations. This advancement improves the quality of these features and elevates SED performance. Experimental evaluation on benchmark datasets, including SBD and Cityscape, showcases the efficacy of our method, achieving leading ODS F-scores of 79.0 and 76.0, respectively. Our approach signifies a notable advancement in SED technology by seamlessly integrating multimodal textual information, embracing both static and dynamic aspects.
- 28 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 4524-4532
Open AccessAdvancing Semantic Edge Detection through Cross-Modal Knowledge Learning
Semantic edge detection (SED) is pivotal for the precise demarcation of object boundaries, yet it faces ongoing challenges due to the prevalence of low-quality labels in current methods. In this paper, we present a novel solution to bolster SED through the encoding of both language and image data. Distinct from antecedent language-driven techniques, which predominantly utilize static elements such as dataset labels, our method taps into the dynamic language content that details the objects in each image and their interrelations. By encoding this varied input, we generate integrated features that utilize semantic insights to refine the high-level image features and the ultimate mask representations. This advancement improves the quality of these features and elevates SED performance. Experimental evaluation on benchmark datasets, including SBD and Cityscape, showcases the efficacy of our method, achieving leading ODS F-scores of 79.0 and 76.0, respectively. Our approach signifies a notable advancement in SED technology by seamlessly integrating multimodal textual information, embracing both static and dynamic aspects.
- 25 October 2024
- Published by Springer Nature
- p. 218-234
Modeling Label Correlations with Latent Context for Multi-label Recognition
- 25 October 2024
- Published by Springer Nature
- p. 218-234
Modeling Label Correlations with Latent Context for Multi-label Recognition
- Open Access
- 23 August 2023
- Published by IOP Publishing in Machine Learning: Science and Technology
- Vol. 4 (3) , 035047
DIM: long-tailed object detection and instance segmentation via dynamic instance memory
Object detection and instance segmentation have been successful on benchmarks with relatively balanced category distribution (e.g. MSCOCO). However, state-of-the-art object detection and segmentation methods still struggle to generalize on long-tailed datasets (e.g. LVIS), where a few classes (head classes) dominate the instance samples, while most classes (tailed classes) have only a few samples. To address this challenge, we propose a plug-and-play module within the Mask R-CNN framework called dynamic instance memory (DIM). Specifically, we augment Mask R-CNN with an auxiliary branch for training. It maintains a dynamic memory bank storing an instance-level prototype representation for each category, and shares the classifier with the existing instance branch. With a simple metric loss, the representations in DIM can be dynamically updated by the instance proposals in the mini-batch during training. Our DIM introduces a bias toward tailed classes to the classifier learning along with a class frequency reversed sampler, which learns generalizable representations from the original data distribution, complementing the existing instance branch. Comprehensive experiments on LVIS demonstrate the effectiveness of DIM, as well as the significant advantages of DIM over the baseline Mask R-CNN.
- 23 August 2023
- Published by IOP Publishing in Machine Learning: Science and Technology
- Vol. 4 (3) , 035047
Open AccessDIM: long-tailed object detection and instance segmentation via dynamic instance memory
Object detection and instance segmentation have been successful on benchmarks with relatively balanced category distribution (e.g. MSCOCO). However, state-of-the-art object detection and segmentation methods still struggle to generalize on long-tailed datasets (e.g. LVIS), where a few classes (head classes) dominate the instance samples, while most classes (tailed classes) have only a few samples. To address this challenge, we propose a plug-and-play module within the Mask R-CNN framework called dynamic instance memory (DIM). Specifically, we augment Mask R-CNN with an auxiliary branch for training. It maintains a dynamic memory bank storing an instance-level prototype representation for each category, and shares the classifier with the existing instance branch. With a simple metric loss, the representations in DIM can be dynamically updated by the instance proposals in the mini-batch during training. Our DIM introduces a bias toward tailed classes to the classifier learning along with a class frequency reversed sampler, which learns generalizable representations from the original data distribution, complementing the existing instance branch. Comprehensive experiments on LVIS demonstrate the effectiveness of DIM, as well as the significant advantages of DIM over the baseline Mask R-CNN.