Crowdsourcing Truth Inference via Reliability-Driven Multi-View Graph Embedding
Open Access
- 27 February 2023
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 17 (5) , 1-26
Abstract
Crowdsourcing truth inference aims to assign a correct answer to each task from candidate answers that are provided by crowdsourced workers. A common approach is to generate workers’ reliabilities to represent the quality of answers. Although crowdsourced triples can be converted into various crowdsourced relationships, the available related methods are not effective in capturing these relationships to alleviate the harm to inference that is caused by conflicting answers. In this research, we propose aReliability-drivenMulti-viewGraphEmbedding framework forTruthinference (TiReMGE), which explores multiple crowdsourced relationships by organically integrating worker reliabilities into a graph space that is constructed from crowdsourced triples. Specifically, to create an interactive environment, we propose a reliability-driven initialization criterion for initializing vectors of tasks and workers as interactive carriers of reliabilities. From the perspective of multiple crowdsourced relationships, a multi-view graph embedding framework is proposed for reliability information interaction on a task-worker graph, which encodes latent crowdsourced relationships into vectors of workers and tasks for reliability update and truth inference. A heritable reliability updating method based on the Lagrange multiplier method is proposed to obtain reliabilities that match the quality of workers for interaction by a novel constraint law. Our ultimate goal is to minimize the Euclidean distance between the encoded task vector and the answer that is provided by a worker with high reliability. Extensive experimental results on nine real-world datasets demonstrate that TiReMGE significantly outperforms the nine state-of-the-art baselines.Keywords
Funding Information
- National Key Research and Development Program of China (2018YFC1603601)
- Program for Innovative Research Team in University of the Ministry of Education (IRT_17R32)
- National Natural Science Foundation of China (62076085 and 62120106008)
This publication has 29 references indexed in Scilit:
- Truth inference in crowdsourcingProceedings of the VLDB Endowment, 2017
- A Survey on Truth DiscoveryACM SIGKDD Explorations Newsletter, 2016
- Multi-Class Ground Truth Inference in Crowdsourcing with ClusteringIEEE Transactions on Knowledge and Data Engineering, 2015
- Truth Discovery on Crowd Sensing of Correlated Entities2015
- A confidence-aware approach for truth discovery on long-tail dataProceedings of the VLDB Endowment, 2014
- Resolving conflicts in heterogeneous data by truth discovery and source reliability estimation2014
- Fusing data with correlations2014
- ZenCrowd2012
- Integrating conflicting dataProceedings of the VLDB Endowment, 2009
- Graphical Models, Exponential Families, and Variational InferenceFoundations and Trends in Machine Learning, 2008