Considering Human Aspects on Strategies for Designing and Managing Distributed Human Computation
Authors:
- Lesandro PoncianoLPLesandro Ponciano
- Francisco BrasileiroFBFrancisco Brasileiro
- Nazareno AndradeNANazareno Andrade
- Lívia SampaioLSLívia Sampaio
Preprint
Abstract
A human computation system can be viewed as a distributed system in which the processors are humans, called workers. Such systems harness the cognitive power of a group of workers connected to the Internet to execute relatively simple tasks, whose solutions, once grouped, solve a problem that systems equipped with only machines could not solve satisfactorily. Examples of such systems are Amazon Mechanical Turk and the Zooniverse platform. A human computation application comprises a group of tasks, each of them can be performed by one worker. Tasks might have dependencies among each other. In this study, we propose a theoretical framework to analyze such type of application from a distributed systems point of view. Our framework is established on three dimensions that represent different perspectives in which human computation applications can be approached: quality-of-service requirements, design and management strategies, and human aspects. By using this framework, we review human computation in the perspective of programmers seeking to improve the design of human computation applications and managers seeking to increase the effectiveness of human computation infrastructures in running such applications. In doing so, besides integrating and organizing what has been done in this direction, we also put into perspective the fact that the human aspects of the workers in such systems introduce new challenges in terms of, for example, task assignment, dependency management, and fault prevention and tolerance. We discuss how they are related to distributed systems and other areas of knowledge.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Crowdsourcing tasks to social networks in BPEL4PeopleWorld Wide Web, 2012
- Individual differences in cognition, affect, and performance: Behavioral, neuroimaging, and molecular genetic approachesNeuroImage, 2012
- Stimulating Skill Evolution in Market-Based CrowdsourcingLecture Notes in Computer Science, 2011
- A Taxonomy of Workflow Management Systems for Grid ComputingJournal of Grid Computing, 2005
- Cognitive performance inconsistency: Intraindividual change and variability.Psychology and Aging, 2005
- Quality of service for workflows and web service processesJournal of Web Semantics, 2004
- The Emerging Field of Emotion Regulation: An Integrative ReviewReview of General Psychology, 1998
- Cognitive Architecture and Instructional DesignEducational Psychology Review, 1998
- An overview of workflow management: From process modeling to workflow automation infrastructureDistributed and Parallel Databases, 1995
- Coping with human errors through system design: implications for ecological interface designInternational Journal of Man-Machine Studies, 1989