An analytical model for generalized ESP games

Bo Chun Wang, Chien Wei Lin, Kuan Ta Chen, Ling-Jyh Chen

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

The ESP game belongs to the genre called Games With A Purpose (GWAP), which leverage people's desire to be entertained and also outsource certain steps of the computational process to humans. The games have shown promise in solving a variety of problems, which computer computation has been unable to resolve completely thus far. In this study, we consider generalized ESP games with two objectives. First, we propose an analytical model for computing the utility of generalized ESP games, where the number of players, the consensus threshold, and the stopping condition are variable. We show that our model can accurately predict the stopping condition that will yield the optimal utility of a generalized ESP game under a specific game setting. A service provider can therefore utilize the model to ensure that the hosted generalized ESP games produce high-quality labels efficiently. Second, we propose a metric, called system gain, for evaluating the performance of ESP-like GWAP systems, and also use analysis to study the properties of generalized ESP games. We believe that GWAP systems should be designed and played with strategies. To this end, we implement an optimal puzzle selection strategy (OPSA) based on our analysis. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of generalized ESP games, as long as the number of puzzles in the system is sufficiently large.

Original languageEnglish
Pages (from-to)114-127
Number of pages14
JournalKnowledge-Based Systems
Volume34
DOIs
Publication statusPublished - 2012 Oct 1

Fingerprint

Analytical models
Metric system
Labels
Analytical model

Keywords

  • Analytical model
  • ESP game
  • Games With A Purpose
  • Human computation
  • Tagging

ASJC Scopus subject areas

  • Software
  • Management Information Systems
  • Information Systems and Management
  • Artificial Intelligence

Cite this

An analytical model for generalized ESP games. / Wang, Bo Chun; Lin, Chien Wei; Chen, Kuan Ta; Chen, Ling-Jyh.

In: Knowledge-Based Systems, Vol. 34, 01.10.2012, p. 114-127.

Research output: Contribution to journalArticle

Wang, Bo Chun ; Lin, Chien Wei ; Chen, Kuan Ta ; Chen, Ling-Jyh. / An analytical model for generalized ESP games. In: Knowledge-Based Systems. 2012 ; Vol. 34. pp. 114-127.
@article{0b50aad8ce204a49822f81d00689f6d7,
title = "An analytical model for generalized ESP games",
abstract = "The ESP game belongs to the genre called Games With A Purpose (GWAP), which leverage people's desire to be entertained and also outsource certain steps of the computational process to humans. The games have shown promise in solving a variety of problems, which computer computation has been unable to resolve completely thus far. In this study, we consider generalized ESP games with two objectives. First, we propose an analytical model for computing the utility of generalized ESP games, where the number of players, the consensus threshold, and the stopping condition are variable. We show that our model can accurately predict the stopping condition that will yield the optimal utility of a generalized ESP game under a specific game setting. A service provider can therefore utilize the model to ensure that the hosted generalized ESP games produce high-quality labels efficiently. Second, we propose a metric, called system gain, for evaluating the performance of ESP-like GWAP systems, and also use analysis to study the properties of generalized ESP games. We believe that GWAP systems should be designed and played with strategies. To this end, we implement an optimal puzzle selection strategy (OPSA) based on our analysis. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of generalized ESP games, as long as the number of puzzles in the system is sufficiently large.",
keywords = "Analytical model, ESP game, Games With A Purpose, Human computation, Tagging",
author = "Wang, {Bo Chun} and Lin, {Chien Wei} and Chen, {Kuan Ta} and Ling-Jyh Chen",
year = "2012",
month = "10",
day = "1",
doi = "10.1016/j.knosys.2011.08.009",
language = "English",
volume = "34",
pages = "114--127",
journal = "Knowledge-Based Systems",
issn = "0950-7051",
publisher = "Elsevier",

}

TY - JOUR

T1 - An analytical model for generalized ESP games

AU - Wang, Bo Chun

AU - Lin, Chien Wei

AU - Chen, Kuan Ta

AU - Chen, Ling-Jyh

PY - 2012/10/1

Y1 - 2012/10/1

N2 - The ESP game belongs to the genre called Games With A Purpose (GWAP), which leverage people's desire to be entertained and also outsource certain steps of the computational process to humans. The games have shown promise in solving a variety of problems, which computer computation has been unable to resolve completely thus far. In this study, we consider generalized ESP games with two objectives. First, we propose an analytical model for computing the utility of generalized ESP games, where the number of players, the consensus threshold, and the stopping condition are variable. We show that our model can accurately predict the stopping condition that will yield the optimal utility of a generalized ESP game under a specific game setting. A service provider can therefore utilize the model to ensure that the hosted generalized ESP games produce high-quality labels efficiently. Second, we propose a metric, called system gain, for evaluating the performance of ESP-like GWAP systems, and also use analysis to study the properties of generalized ESP games. We believe that GWAP systems should be designed and played with strategies. To this end, we implement an optimal puzzle selection strategy (OPSA) based on our analysis. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of generalized ESP games, as long as the number of puzzles in the system is sufficiently large.

AB - The ESP game belongs to the genre called Games With A Purpose (GWAP), which leverage people's desire to be entertained and also outsource certain steps of the computational process to humans. The games have shown promise in solving a variety of problems, which computer computation has been unable to resolve completely thus far. In this study, we consider generalized ESP games with two objectives. First, we propose an analytical model for computing the utility of generalized ESP games, where the number of players, the consensus threshold, and the stopping condition are variable. We show that our model can accurately predict the stopping condition that will yield the optimal utility of a generalized ESP game under a specific game setting. A service provider can therefore utilize the model to ensure that the hosted generalized ESP games produce high-quality labels efficiently. Second, we propose a metric, called system gain, for evaluating the performance of ESP-like GWAP systems, and also use analysis to study the properties of generalized ESP games. We believe that GWAP systems should be designed and played with strategies. To this end, we implement an optimal puzzle selection strategy (OPSA) based on our analysis. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of generalized ESP games, as long as the number of puzzles in the system is sufficiently large.

KW - Analytical model

KW - ESP game

KW - Games With A Purpose

KW - Human computation

KW - Tagging

UR - http://www.scopus.com/inward/record.url?scp=84865580624&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84865580624&partnerID=8YFLogxK

U2 - 10.1016/j.knosys.2011.08.009

DO - 10.1016/j.knosys.2011.08.009

M3 - Article

AN - SCOPUS:84865580624

VL - 34

SP - 114

EP - 127

JO - Knowledge-Based Systems

JF - Knowledge-Based Systems

SN - 0950-7051

ER -