Few-Shot Object Detection: Application to Medieval Musicological Studies
Open Access
- 19 January 2022
- journal article
- research article
- Published by MDPI AG in Journal of Imaging
- Vol. 8 (2) , 18
Abstract
Detecting objects with a small representation in images is a challenging task, especially when the style of the images is very different from recent photos, which is the case for cultural heritage datasets. This problem is commonly known as few-shot object detection and is still a new field of research. This article presents a simple and effective method for black box few-shot object detection that works with all the current state-of-the-art object detection models. We also present a new dataset called MMSD for medieval musicological studies that contains five classes and 693 samples, manually annotated by a group of musicology experts. Due to the significant diversity of styles and considerable disparities between the artistic representations of the objects, our dataset is more challenging than the current standards. We evaluate our method on YOLOv4 (m/s), (Mask/Faster) RCNN, and ViT/Swin-t. We present two methods of benchmarking these models based on the overall data size and the worst-case scenario for object detection. The experimental results show that our method always improves object detector results compared to traditional transfer learning, regardless of the underlying architecture.Keywords
This publication has 26 references indexed in Scilit:
- Hyperparameter Optimization2019
- Meta-Learning2019
- Triplet Loss Network for Unsupervised Domain AdaptationAlgorithms, 2019
- Bayesian-optimized Bidirectional LSTM Regression Model for Non-intrusive Load Monitoring2019
- Deep Transfer Learning for Art Classification Problems2019
- Google Vizier2017
- Application of pattern recognition in detection of buried archaeological sites based on analysing environmental variables, Khorramabad Plain, West IranJournal of Archaeological Science: Reports, 2016
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksIEEE Transactions on Pattern Analysis and Machine Intelligence, 2016
- Fast R-CNN2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015