Alloy
Authors:
Open Access
- 7 May 2016
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 3180-3191
Abstract
Crowdsourced clustering approaches present a promising way to harness deep semantic knowledge for clustering complex information. However, existing approaches have difficulties supporting the global context needed for workers to generate meaningful categories, and are costly because all items require human judgments. We introduce Alloy, a hybrid approach that combines the richness of human judgments with the power of machine algorithms. Alloy supports greater global context through a new "sample and search" crowd pattern which changes the crowd's task from classifying a fixed subset of items to actively sampling and querying the entire dataset. It also improves efficiency through a two phase process in which crowds provide examples to help a machine cluster the head of the distribution, then classify low-confidence examples in the tail. To accomplish this, Alloy introduces a modular "cast and gather" approach which leverages a machine learning backbone to stitch together different types of judgment tasks.Keywords
Funding Information
- NSF (IIS-1149797)
This publication has 25 references indexed in Scilit:
- Zensors2015
- Structured labeling for facilitating concept evolution in machine learning2014
- Interactive topic modelingMachine Learning, 2013
- LIBSVMACM Transactions on Intelligent Systems and Technology, 2011
- A note on Platt’s probabilistic outputs for support vector machinesMachine Learning, 2007
- Information foraging.Psychological Review, 1999
- Data clusteringACM Computing Surveys, 1999
- Indexing by latent semantic analysisJournal of the American Society for Information Science, 1990
- Context theory of classification learning.Psychological Review, 1978
- A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVALJournal of Documentation, 1972