Towards Confidence Interval Estimation in Truth Discovery
- 15 May 2018
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 31 (3) , 575-588
Abstract
The demand for automatic extraction of true information (i.e., truths) from conflicting multi-source data has soared recently. A variety of truth discovery methods have witnessed great successes via jointly estimating source reliability and truths. All existing truth discovery methods focus on providing a point estimator for each object's truth, but in many real-world applications, confidence interval estimation of truths is more desirable, since confidence interval contains richer information. To address this challenge, in this paper, we propose a novel truth discovery method (ETCIBoot) to construct confidence interval estimates as well as identify truths, where the bootstrapping techniques are nicely integrated into the truth discovery procedure. Due to the properties of bootstrapping, the estimators obtained by ETCIBoot are more accurate and robust compared with the state-of-the-art truth discovery approaches. The proposed framework is further adapted to deal with large-scale truth discovery task in distributed paradigm. Theoretically, we prove the asymptotical consistency of the confidence interval obtained by ETCIBoot. Experimentally, we demonstrate that ETCIBoot is not only effective in constructing confidence intervals but also able to obtain better truth estimates.Keywords
Funding Information
- US National Science Foundation (IIS 1319973, IIS 1553411, CNS 1566374, CNS 1742845, CNS 1652503)
This publication has 27 references indexed in Scilit:
- Modeling Truth Existence in Truth Discovery2015
- FaitCrowd2015
- A confidence-aware approach for truth discovery on long-tail dataProceedings of the VLDB Endowment, 2014
- Resolving conflicts in heterogeneous data by truth discovery and source reliability estimation2014
- Truth finding on the deep webProceedings of the VLDB Endowment, 2012
- ZenCrowd2012
- A Bayesian approach to discovering truth from conflicting sources for data integrationProceedings of the VLDB Endowment, 2012
- Integrating conflicting dataProceedings of the VLDB Endowment, 2009
- Bootstrap Procedures under some Non-I.I.D. ModelsThe Annals of Statistics, 1988
- Maximum Likelihood Estimation of Observer Error-Rates Using the EM AlgorithmJournal of the Royal Statistical Society Series C: Applied Statistics, 1979