Few-Shot Object Detection for Classifying Reported Urban Problems
Authors:
- 23 November 2023
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 134-140
Abstract
These days, one of the government-citizen engagements is a digital report submitted by citizens. Urban problem detection is a process to classify images reported in an application to be followed up by the Government. The detection is crucial for maintaining livable and sustainable cities. However, annotating large-scale datasets for object detection models is labor-intensive. This paper proposes a few-shot object detection model for urban problem detection, overcoming data limitations. Our model demonstrates promising performance across 13 selected categories, including 10 base classes and 3 novel classes, using a dataset from the Jakarta Kini (JAKI) application. We evaluate the model on familiar (base classes) and unseen (novel classes) categories, showcasing its generalization capabilities. With increased instances (n-shot), our model achieves high average precision (AP) scores, with the highest performance observed at 30-shot. The validation evaluation yields AP scores of 54.5% for all classes, 65.3% for base classes, and 71.6% for novel classes. Similarly, the test evaluation results in AP scores of 42.5% for all classes, 51.4% for base classes, and 69.8% for novel classes. The performance differences between the validation and test datasets stem from unique features and category challenges. Our few-shot object detection model holds promise for real-world urban problem detection and can be extended to other urban-related tasks and datasets.Keywords
This publication has 12 references indexed in Scilit:
- Automatic Detection of Pedestrian Crosswalk with Faster R-CNN and YOLOv7Buildings, 2023
- Smart City Applications to Promote Citizen Participation in City Management and Governance: A Systematic ReviewInformatics, 2022
- Few-Shot Multi-Class Ship Detection in Remote Sensing Images Using Attention Feature Map and Multi-Relation DetectorRemote Sensing, 2022
- Tools, techniques, datasets and application areas for object detection in an image: a reviewMultimedia Tools and Applications, 2022
- A Comparative Analysis of Object Detection Metrics with a Companion Open-Source ToolkitElectronics, 2021
- Road Damage Detection and Classification with Detectron2 and Faster R-CNN2020
- Grand Challenges in Sustainable Cities and HealthFrontiers in Sustainable Cities, 2019
- Meta R-CNN: Towards General Solver for Instance-Level Low-Shot Learning2019
- Autonomous garbage detection for intelligent urban managementMATEC Web of Conferences, 2018
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016