Multi-Label and Evolvable Dataset Preparation for Web-Based Object Detection
Open Access
- 30 October 2024
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 18 (9) , 1-21
Abstract
In this article, we focus on the emerging field of web-based object detection, which has gained considerable attention due to its ability to utilize large amounts of web data for training, thus eliminating the need for labor-intensive manual annotations. However, the noisy and ever-evolving nature of web data poses challenges in preparing high-quality datasets for web-based object detection. To address these challenges, we propose a fully automatic dataset preparation method in this article. Our proposed method incorporates a hierarchical clustering module that assigns multiple precise labels to each image. This module is based on our observation that web image data exhibits different distributions at varying granularities. Furthermore, an evolutionary relabeling module ensures the adaptability of both the prepared dataset and trained detection models to the ever-evolving web data. Extensive experiments demonstrate that our method outperforms other web-based methods, and achieves a comparable performance to those manually labeled benchmark datasets.Keywords
Funding Information
- National Key R & D Program of China (2022YFF0604503)
- NSFC (NSFC-62272224, 62272215, 61872176, 62341201, and 62302207)
- Leading edge Technology Program of Jiangsu Natural Science (BK20202001)
- Science Foundation for Youths of Jiangsu (BK20220772)
This publication has 26 references indexed in Scilit:
- Webly-supervised semantic segmentation via curriculum learningComputer Vision and Image Understanding, 2023
- Large Loss Matters in Weakly Supervised Multi-Label Classification2022
- End-to-End Object Detection with Transformers2020
- Towards Automatic Construction of Diverse, High-Quality Image DatasetsIEEE Transactions on Knowledge and Data Engineering, 2019
- Exploiting Web Images for Dataset Construction: A Domain Robust ApproachIEEE Transactions on Multimedia, 2017
- Webly Supervised Learning of Convolutional Networks2015
- Fast R-CNN2015
- Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation2014
- Microsoft COCO: Common Objects in Context2014
- ImageNet: A large-scale hierarchical image database2009