Building large knowledge bases by mass collaboration
Authors:
Open Access
- 23 October 2003
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 129-137
Abstract
Acquiring knowledge has long been the major bottleneck preventing the rapid spread of AI systems. Manual approaches are slow and costly. Machine-learning approaches have limitations in the depth and breadth of knowledge they can acquire. The spread of the Internet has made possible a third solution: building knowledge bases by mass collaboration, with thousands of volunteers contributing simultaneously. While this approach promises large improvements in the speed and cost of knowledge base development, it can only succeed if the problem of ensuring the quality, relevance and consistency of the knowledge is addressed, if contributors are properly motivated, and if the underlying algorithms scale. In this paper we propose an architecture that meets all these desiderata. It uses first-order probabilistic reasoning techniques to combine potentially inconsistent knowledge sources of varying quality, and it uses machine-learning techniques to estimate the quality of knowledge. We evaluate the approach using a series of synthetic knowledge bases and a pilot study in the domain of printer troubleshooting.Keywords
This publication has 9 references indexed in Scilit:
- Trust Management for the Semantic Web2003
- The Semantic WebScientific American, 2001
- Answering queries from context-sensitive probabilistic knowledge basesTheoretical Computer Science, 1997
- GroupLens1994
- The Utility of Knowledge in Inductive LearningMachine Learning, 1992
- From knowledge bases to decision modelsThe Knowledge Engineering Review, 1992
- Combining Probability Distributions: A Critique and an Annotated BibliographyStatistical Science, 1986
- Maximum Likelihood from Incomplete Data Via the EM AlgorithmJournal of the Royal Statistical Society Series B: Statistical Methodology, 1977
- Judgment under Uncertainty: Heuristics and BiasesScience, 1974