A Card Game for Collecting Human-Perceived Similarity Data of Artwork Images
Open Access
- 13 January 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 10, 8103-8111
Abstract
In this paper, we propose a card game system named “Lottery” for collecting similarity data of artwork images. It is built based on the concept of game design called “Audience Participation Game With a Purpose (APGWAP),” which is to outsource computational steps in a given task to humans via a game that allows audiences to participate in a meaningful way. The game system is streamed on Twitch. In this game system, two Artificial Intelligence (AI) players match two cards that are most similar from a set of cards in their turn and discard them. The audiences can choose their roles between Assistant and Jury. Assistant helps the AI player of a given turn choose such a pair of cards, while Jury gives a score telling how similar a chosen pair is. In the experiments, different methods for providing rewards to audiences are investigated: equal reward, random reward, and performance-based reward. Experimental results show that the performance-based reward significantly promotes personal gratification and provides a better gaming experience on several other factors. In addition, it was found in our experiment that different groups of humans provided similar similarity scores for all the pairs of images, indicating that collecting promises reliable human data that are consistent through several trials is possible using our game system.Keywords
Funding Information
- Grant-in-Aid for Scientific Research (19K12291)
- Japan Society for the Promotion of Science, Japan
This publication has 23 references indexed in Scilit:
- Methods for the detection of carelessly invalid responses in survey dataJournal of Experimental Social Psychology, 2016
- Gamification in theory and action: A surveyInternational Journal of Human-Computer Studies, 2015
- The Use of Player-centered Positive Reinforcement to Schedule In-game Rewards Increases Enjoyment and Performance in a Serious GameInternational Journal of Serious Games, 2014
- Empirical Power Comparison Of Goodness of Fit Tests for Normality In The Presence of OutliersJournal of Physics: Conference Series, 2013
- Game-powered machine learningProceedings of the National Academy of Sciences, 2012
- Human ComputationSynthesis Lectures on Artificial Intelligence and Machine Learning, 2011
- The challenge of designing scientific discovery games2010
- Galaxy Zoo: morphologies derived from visual inspection of galaxies from the Sloan Digital Sky Survey★Monthly Notices of the Royal Astronomical Society, 2008
- Designing games with a purposeCommunications of the ACM, 2008
- FaceTracer: A Search Engine for Large Collections of Images with Faces2008