USC-DCT: A Collection of Diverse Classification Tasks
Open Access
Abstract
Machine learning is a crucial tool for both academic and real-world applications. Classification problems are often used as the preferred showcase in this space, which has led to a wide variety of datasets being collected and utilized for a myriad of applications. Unfortunately, there is very little standardization in how these datasets are collected, processed, and disseminated. As new learning paradigms like lifelong or meta-learning become more popular, the demand for merging tasks for at-scale evaluation of algorithms has also increased. This paper provides a methodology for processing and cleaning datasets that can be applied to existing or new classification tasks as well as implements these practices in a collection of diverse classification tasks called USC-DCT. Constructed using 107 classification tasks collected from the internet, this collection provides a transparent and standardized pipeline that can be useful for many different applications and frameworks. While there are currently 107 tasks, USC-DCT is designed to enable future growth. Additional discussion provides explanations of applications in machine learning paradigms such as transfer, lifelong, or meta-learning, how revisions to the collection will be handled, and further tips for curating and using classification tasks at this scale.Keywords
Funding Information
- Defense Advanced Research Projects Agency (HR00112190134, W911NF2020053)
- C-BRIC (HR00112190134, W911NF2020053)
- Army Research Office (HR00112190134, W911NF2020053)
This publication has 63 references indexed in Scilit:
- Scene-free multi-class weather classification on single imagesNeurocomputing, 2016
- Deep Learning Face Attributes in the Wild2015
- Evaluation of deep convolutional nets for document image classification and retrieval2015
- A data-driven approach to cleaning large face datasets2014
- 3D Object Representations for Fine-Grained Categorization2013
- A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defectsApplied Surface Science, 2013
- Man vs. computer: Benchmarking machine learning algorithms for traffic sign recognitionNeural Networks, 2012
- How do humans sketch objects?ACM Transactions on Graphics, 2012
- Object retrieval with large vocabularies and fast spatial matching2007
- What, where and who? Classifying events by scene and object recognition2007