MapReduce skyline query processing with partitioning and distributed dominance tests

Jia Ling Koh, Chia Ching Chen, Chih Yu Chan, Arbee L.P. Chen*

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

15 引文 斯高帕斯(Scopus)

摘要

In this paper, in order to efficiently process skyline queries by the MapReduce framework, two algorithms are proposed to prevent the bottleneck of centrally finding the global skyline from the local skylines. The proposed algorithms aim to reduce the number of dominance tests, which check whether a data point is dominated by another data point, and perform the necessary dominance tests in parallel. The first algorithm uses a grid-based and an angle-based partitioning schemes to divide the data space into segments for finding the local skyline data points. Two sets of rules are designed respectively for the two partitioning methods to reduce the number of dominance tests among the local skyline data points to find the skyline data points. The second algorithm uses the skyline data points discovered from sample data points to filter out most non-skyline data points in the mappers. For the remaining data points, the dominance relationship between the grid-partitioning segments is used to further reduce the number of dominance tests performed in both the mapper and the reducer. The experiment results show that the proposed two algorithms have significant improvement on response time compared with the related works.

原文英語
頁(從 - 到)114-137
頁數24
期刊Information Sciences
375
DOIs
出版狀態已發佈 - 2017 一月 1

ASJC Scopus subject areas

  • 軟體
  • 控制與系統工程
  • 理論電腦科學
  • 電腦科學應用
  • 資訊系統與管理
  • 人工智慧

指紋

深入研究「MapReduce skyline query processing with partitioning and distributed dominance tests」主題。共同形成了獨特的指紋。

引用此