Trustworthy human computation: a survey
Open Access
- 12 October 2024
- journal article
- research article
- Published by Springer Nature in Artificial Intelligence Review
- Vol. 57 (12) , 1-45
Abstract
Human computation is an approach to solving problems that prove difficult using AI only, and involves the cooperation of many humans. Because human computation requires close engagement with both “human populations as users” and “human populations as driving forces,” establishing mutual trust between AI and humans is an important issue to further the development of human computation. This survey lays the groundwork for the realization of trustworthy human computation. First, the trustworthiness of human computation as computing systems, that is, trust offered by humans to AI, is examined using the RAS (reliability, availability, and serviceability) analogy, which define measures of trustworthiness in conventional computer systems. Next, the social trustworthiness provided by human computation systems to users or participants is discussed from the perspective of AI ethics, including fairness, privacy, and transparency. Then, we consider human–AI collaboration based on two-way trust, in which humans and AI build mutual trust and accomplish difficult tasks through reciprocal collaboration. Finally, future challenges and research directions for realizing trustworthy human computation are discussed.Keywords
All Related Versions
Funding Information
- Japan Science and Technology Agency (CREST Program, Grant Number JPMJCR21D1, CREST Program, Grant Number JPMJCR21D1, CREST Program, Grant Number JPMJCR21D1, CREST Program, Grant Number JPMJCR21D1)
This publication has 150 references indexed in Scilit:
- Crowdsourcing Evaluation of Saliency-Based XAI Methods2021
- Crowdsourcing Truthfulness: The Impact of Judgment Scale and Assessor Bias2020
- The EU General Data Protection Regulation (GDPR)2017
- Crowdordering2014
- Handbook of Human Computation2013
- Human Computation2011
- Visual Recognition with Humans in the Loop2010
- The role of trust in information science and technologyAnnual Review of Information Science and Technology, 2003
- Reliability of Computer Systems and Networks2002
- The Supervised Learning No-Free-Lunch Theorems2002