Evaluation of heuristics using data envelopment analysis

Chung Cheng Jason Lu, Yen Chun Jim Wu

Research output: Contribution to journalArticlepeer-review

4 Citations (Scopus)


This paper focuses on identifying relatively efficient configurations of algorithmic operators among a set of configurations in the development of heuristics or meta-heuristics. Each configuration is considered as a decision-making unit with multiple inputs and outputs. Then, data envelopment analysis (DEA) is adopted to evaluate relative and cross-efficiencies of a set of algorithmic configurations. The proposed approach differs from existing methods based on statistical tests in that multiple inputs and outputs are simultaneously considered in an integrated framework for the evaluation of algorithmic efficiency. A case study is presented to demonstrate the application of DEA for determining the efficient configurations of genetic algorithm operators. The evaluation results of two DEA models are also compared. The DEA evaluation results are consistent with those obtained by a commonly used statistical method.

Original languageEnglish
Pages (from-to)795-810
Number of pages16
JournalInternational Journal of Information Technology and Decision Making
Issue number4
Publication statusPublished - 2014 Jul
Externally publishedYes


  • Data envelopment analysis
  • efficiency evaluation
  • heuristics

ASJC Scopus subject areas

  • Computer Science (miscellaneous)


Dive into the research topics of 'Evaluation of heuristics using data envelopment analysis'. Together they form a unique fingerprint.

Cite this