The design and evaluation of task assignment algorithms for GWAP-based geospatial tagging systems

Ling Jyh Chen, Yu Song Syu, Hung Chia Chen, Wang Chien Lee

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Geospatial tagging (geotagging) is an emerging and very promising application that can help users find a wide variety of location-specific information, and thereby facilitate the development of advanced location-based services. Conventional geotagging systems share some limitations, such as the use of a two-phase operating model and the tendency to tag popular objects with simple contexts. To address these problems, a number of geotagging systems based on the concept of 'Games with a Purpose' (GWAP) have been developed recently. In this study, we use analysis to investigate these new systems. Based on our analysis results, we design three metrics to evaluate the system performance, and develop five task assignment algorithms for GWAP-based systems. Using a comprehensive set of simulations under both synthetic and realistic mobility scenarios, we find that the Least-Throughput-First Assignment algorithm (LTFA) is the most effective approach because it can achieve competitive system utility, while its computational complexity remains moderate. We also find that, to improve the system utility, it is better to assign as many tasks as possible in each round. However, because players may feel annoyed if too many tasks are assigned at the same time, it is recommended that multiple tasks be assigned one by one in each round in order to achieve higher system utility.

Original languageEnglish
Pages (from-to)395-414
Number of pages20
JournalMobile Networks and Applications
Volume17
Issue number3
DOIs
Publication statusPublished - 2012 Jun 1

Fingerprint

Location based services
Computational complexity
Throughput

Keywords

  • Games with a Purpose
  • Geospatial tagging
  • Human computation
  • Tagging

ASJC Scopus subject areas

  • Software
  • Information Systems
  • Hardware and Architecture
  • Computer Networks and Communications

Cite this

The design and evaluation of task assignment algorithms for GWAP-based geospatial tagging systems. / Chen, Ling Jyh; Syu, Yu Song; Chen, Hung Chia; Lee, Wang Chien.

In: Mobile Networks and Applications, Vol. 17, No. 3, 01.06.2012, p. 395-414.

Research output: Contribution to journalArticle

Chen, Ling Jyh ; Syu, Yu Song ; Chen, Hung Chia ; Lee, Wang Chien. / The design and evaluation of task assignment algorithms for GWAP-based geospatial tagging systems. In: Mobile Networks and Applications. 2012 ; Vol. 17, No. 3. pp. 395-414.
@article{eddb3ee530944518a538f60a8f5d6c9f,
title = "The design and evaluation of task assignment algorithms for GWAP-based geospatial tagging systems",
abstract = "Geospatial tagging (geotagging) is an emerging and very promising application that can help users find a wide variety of location-specific information, and thereby facilitate the development of advanced location-based services. Conventional geotagging systems share some limitations, such as the use of a two-phase operating model and the tendency to tag popular objects with simple contexts. To address these problems, a number of geotagging systems based on the concept of 'Games with a Purpose' (GWAP) have been developed recently. In this study, we use analysis to investigate these new systems. Based on our analysis results, we design three metrics to evaluate the system performance, and develop five task assignment algorithms for GWAP-based systems. Using a comprehensive set of simulations under both synthetic and realistic mobility scenarios, we find that the Least-Throughput-First Assignment algorithm (LTFA) is the most effective approach because it can achieve competitive system utility, while its computational complexity remains moderate. We also find that, to improve the system utility, it is better to assign as many tasks as possible in each round. However, because players may feel annoyed if too many tasks are assigned at the same time, it is recommended that multiple tasks be assigned one by one in each round in order to achieve higher system utility.",
keywords = "Games with a Purpose, Geospatial tagging, Human computation, Tagging",
author = "Chen, {Ling Jyh} and Syu, {Yu Song} and Chen, {Hung Chia} and Lee, {Wang Chien}",
year = "2012",
month = "6",
day = "1",
doi = "10.1007/s11036-011-0314-6",
language = "English",
volume = "17",
pages = "395--414",
journal = "Mobile Networks and Applications",
issn = "1383-469X",
publisher = "Springer Netherlands",
number = "3",

}

TY - JOUR

T1 - The design and evaluation of task assignment algorithms for GWAP-based geospatial tagging systems

AU - Chen, Ling Jyh

AU - Syu, Yu Song

AU - Chen, Hung Chia

AU - Lee, Wang Chien

PY - 2012/6/1

Y1 - 2012/6/1

N2 - Geospatial tagging (geotagging) is an emerging and very promising application that can help users find a wide variety of location-specific information, and thereby facilitate the development of advanced location-based services. Conventional geotagging systems share some limitations, such as the use of a two-phase operating model and the tendency to tag popular objects with simple contexts. To address these problems, a number of geotagging systems based on the concept of 'Games with a Purpose' (GWAP) have been developed recently. In this study, we use analysis to investigate these new systems. Based on our analysis results, we design three metrics to evaluate the system performance, and develop five task assignment algorithms for GWAP-based systems. Using a comprehensive set of simulations under both synthetic and realistic mobility scenarios, we find that the Least-Throughput-First Assignment algorithm (LTFA) is the most effective approach because it can achieve competitive system utility, while its computational complexity remains moderate. We also find that, to improve the system utility, it is better to assign as many tasks as possible in each round. However, because players may feel annoyed if too many tasks are assigned at the same time, it is recommended that multiple tasks be assigned one by one in each round in order to achieve higher system utility.

AB - Geospatial tagging (geotagging) is an emerging and very promising application that can help users find a wide variety of location-specific information, and thereby facilitate the development of advanced location-based services. Conventional geotagging systems share some limitations, such as the use of a two-phase operating model and the tendency to tag popular objects with simple contexts. To address these problems, a number of geotagging systems based on the concept of 'Games with a Purpose' (GWAP) have been developed recently. In this study, we use analysis to investigate these new systems. Based on our analysis results, we design three metrics to evaluate the system performance, and develop five task assignment algorithms for GWAP-based systems. Using a comprehensive set of simulations under both synthetic and realistic mobility scenarios, we find that the Least-Throughput-First Assignment algorithm (LTFA) is the most effective approach because it can achieve competitive system utility, while its computational complexity remains moderate. We also find that, to improve the system utility, it is better to assign as many tasks as possible in each round. However, because players may feel annoyed if too many tasks are assigned at the same time, it is recommended that multiple tasks be assigned one by one in each round in order to achieve higher system utility.

KW - Games with a Purpose

KW - Geospatial tagging

KW - Human computation

KW - Tagging

UR - http://www.scopus.com/inward/record.url?scp=84861906292&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84861906292&partnerID=8YFLogxK

U2 - 10.1007/s11036-011-0314-6

DO - 10.1007/s11036-011-0314-6

M3 - Article

AN - SCOPUS:84861906292

VL - 17

SP - 395

EP - 414

JO - Mobile Networks and Applications

JF - Mobile Networks and Applications

SN - 1383-469X

IS - 3

ER -