An analytical study of Puzzle Selection strategies for the ESP game

Ling Jyh Chen, Bo Chun Wang, Kuan Ta Chen, Irwin King, Jimmy Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

"Human Computation" represents a new paradigm of applications that take advantage of people's desire to be entertained and produce useful metadata as a by-product. By creating games with a purpose, human computation has shown promise in solving a variety of problems that computer computation cannot currently resolve completely. Using the ESP game as an example, we propose a metric, called system gain, for evaluating the performance of human computation systems, and also use analysis to study the properties of the ESP game. We argue that human computation systems should be played with a strategy. To this end, we implement an Optimal Puzzle Selection Strategy (OPSA) based on our analysis to improve human computation. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of the ESP game, as long as the number of puzzles in the system is sufficiently large.

Original languageEnglish
Title of host publicationProceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008
Pages180-183
Number of pages4
DOIs
Publication statusPublished - 2008 Dec 1
Event2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008 - Sydney, NSW, Australia
Duration: 2008 Dec 92008 Dec 12

Publication series

NameProceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008

Other

Other2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008
CountryAustralia
CitySydney, NSW
Period08/12/908/12/12

Fingerprint

Metric system
Metadata
Byproducts

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this

Chen, L. J., Wang, B. C., Chen, K. T., King, I., & Lee, J. (2008). An analytical study of Puzzle Selection strategies for the ESP game. In Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008 (pp. 180-183). [4740444] (Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008). https://doi.org/10.1109/WIIAT.2008.31

An analytical study of Puzzle Selection strategies for the ESP game. / Chen, Ling Jyh; Wang, Bo Chun; Chen, Kuan Ta; King, Irwin; Lee, Jimmy.

Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008. 2008. p. 180-183 4740444 (Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Chen, LJ, Wang, BC, Chen, KT, King, I & Lee, J 2008, An analytical study of Puzzle Selection strategies for the ESP game. in Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008., 4740444, Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008, pp. 180-183, 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008, Sydney, NSW, Australia, 08/12/9. https://doi.org/10.1109/WIIAT.2008.31
Chen LJ, Wang BC, Chen KT, King I, Lee J. An analytical study of Puzzle Selection strategies for the ESP game. In Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008. 2008. p. 180-183. 4740444. (Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008). https://doi.org/10.1109/WIIAT.2008.31
Chen, Ling Jyh ; Wang, Bo Chun ; Chen, Kuan Ta ; King, Irwin ; Lee, Jimmy. / An analytical study of Puzzle Selection strategies for the ESP game. Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008. 2008. pp. 180-183 (Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008).
@inproceedings{a81b5c8da262484bb2a5dc937b7691d8,
title = "An analytical study of Puzzle Selection strategies for the ESP game",
abstract = "{"}Human Computation{"} represents a new paradigm of applications that take advantage of people's desire to be entertained and produce useful metadata as a by-product. By creating games with a purpose, human computation has shown promise in solving a variety of problems that computer computation cannot currently resolve completely. Using the ESP game as an example, we propose a metric, called system gain, for evaluating the performance of human computation systems, and also use analysis to study the properties of the ESP game. We argue that human computation systems should be played with a strategy. To this end, we implement an Optimal Puzzle Selection Strategy (OPSA) based on our analysis to improve human computation. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of the ESP game, as long as the number of puzzles in the system is sufficiently large.",
author = "Chen, {Ling Jyh} and Wang, {Bo Chun} and Chen, {Kuan Ta} and Irwin King and Jimmy Lee",
year = "2008",
month = "12",
day = "1",
doi = "10.1109/WIIAT.2008.31",
language = "English",
isbn = "9780769534961",
series = "Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008",
pages = "180--183",
booktitle = "Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008",

}

TY - GEN

T1 - An analytical study of Puzzle Selection strategies for the ESP game

AU - Chen, Ling Jyh

AU - Wang, Bo Chun

AU - Chen, Kuan Ta

AU - King, Irwin

AU - Lee, Jimmy

PY - 2008/12/1

Y1 - 2008/12/1

N2 - "Human Computation" represents a new paradigm of applications that take advantage of people's desire to be entertained and produce useful metadata as a by-product. By creating games with a purpose, human computation has shown promise in solving a variety of problems that computer computation cannot currently resolve completely. Using the ESP game as an example, we propose a metric, called system gain, for evaluating the performance of human computation systems, and also use analysis to study the properties of the ESP game. We argue that human computation systems should be played with a strategy. To this end, we implement an Optimal Puzzle Selection Strategy (OPSA) based on our analysis to improve human computation. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of the ESP game, as long as the number of puzzles in the system is sufficiently large.

AB - "Human Computation" represents a new paradigm of applications that take advantage of people's desire to be entertained and produce useful metadata as a by-product. By creating games with a purpose, human computation has shown promise in solving a variety of problems that computer computation cannot currently resolve completely. Using the ESP game as an example, we propose a metric, called system gain, for evaluating the performance of human computation systems, and also use analysis to study the properties of the ESP game. We argue that human computation systems should be played with a strategy. To this end, we implement an Optimal Puzzle Selection Strategy (OPSA) based on our analysis to improve human computation. Using a comprehensive set of simulations, we demonstrate that the proposed OPSA approach can effectively improve the system gain of the ESP game, as long as the number of puzzles in the system is sufficiently large.

UR - http://www.scopus.com/inward/record.url?scp=62949138685&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=62949138685&partnerID=8YFLogxK

U2 - 10.1109/WIIAT.2008.31

DO - 10.1109/WIIAT.2008.31

M3 - Conference contribution

AN - SCOPUS:62949138685

SN - 9780769534961

T3 - Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008

SP - 180

EP - 183

BT - Proceedings - 2008 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2008

ER -