ORBIT: A Real-World Few-Shot Dataset for Teachable Object Recognition
Authors:
- 1 October 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 10798-10808
Abstract
Object recognition has made great advances in the last decade, but predominately still relies on many high-quality training examples per object category. In contrast, learning new objects from only a few examples could enable many impactful applications from robotics to user personalization. Most few-shot learning research, however, has been driven by benchmark datasets that lack the high variation that these applications will face when deployed in the real-world. To close this gap, we present the ORBIT dataset and benchmark, grounded in the real-world application of teachable object recognizers for people who are blind/low-vision. The dataset contains 3,822 videos of 486 objects recorded by people who are blind/low-vision on their mobile phones. The benchmark reflects a realistic, highly challenging recognition problem, providing a rich playground to drive research in robustness to few-shot, high-variation conditions. We set the benchmark’s first state-of-the-art and show there is massive scope for further innovation, holding the potential to impact a broad range of real-world vision applications including tools for the blind/low-vision community. We release the dataset at https://doi.org/10.25383/city.14294597 and benchmark code at https://github.com/microsoft/ORBIT-Dataset.Keywords
Funding Information
- Microsoft
This publication has 20 references indexed in Scilit:
- Teachable machines for accessibilityACM SIGACCESS Accessibility and Computing, 2017
- The “Something Something” Video Database for Learning and Evaluating Visual Common Sense2017
- Mask R-CNN2017
- “Hands On” Visual Recognition for Visually Impaired UsersACM Transactions on Accessible Computing, 2017
- YOLO9000: Better, Faster, Stronger2017
- Learning Video Object Segmentation from Static Images2017
- Deep Residual Learning for Image Recognition2016
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Describing Textures in the Wild2014
- Automated Flower Classification over a Large Number of Classes2008