Human Beyond the Machine: Challenges and Opportunities of Microtask Crowdsourcing
- 14 July 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Intelligent Systems
- Vol. 30 (4) , 81-85
Abstract
In the 21st century, where automated systems and artificial intelligence are replacing arduous manual labor by supporting data-intensive tasks, many problems still require human intelligence. Over the last decade, by tapping into human intelligence through microtasks, crowdsourcing has found remarkable applications in a wide range of domains. In this article, the authors discuss the growth of crowdsourcing systems since the term was coined by columnist Jeff Howe in 2006. They shed light on the evolution of crowdsourced microtasks in recent times. Next, they discuss a main challenge that hinders the quality of crowdsourced results: the prevalence of malicious behavior. They reflect on crowdsourcing's advantages and disadvantages. Finally, they leave the reader with interesting avenues for future research.Keywords
This publication has 14 references indexed in Scilit:
- Understanding Malicious Behavior in Crowdsourcing Platforms2015
- Measuring Crowdsourcing Effort with Error-Time Curves2015
- Competitive Game Designs for Improving the Cost Effectiveness of Crowdsourcing2014
- Turkopticon2013
- The future of crowd work2013
- Increasing cheat robustness of crowdsourcing tasksInformation Retrieval Journal, 2012
- Worker types and personality traits in crowdsourcing relevance labels2011
- Human computation2011
- Volunteered Geographic Information and Crowdsourcing Disaster Relief: A Case Study of the Haitian EarthquakeWorld Medical & Health Policy, 2010
- Human Intelligence in the Process of Semantic Content CreationWorld Wide Web, 2009