Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation

Hsin Ling Hung, James W. Altschuld, Yi Fang Lee

Research output: Contribution to journalArticle

83 Citations (Scopus)


Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific region. The study is described followed by a discussion of the difficulties in participant recruitment and selection, sample size, instrumentation, data collection and analysis and attempts to resolve them. Some of these problems are generic to the Delphi whereas others related to the specifics of the investigation. What we learned should be useful for future Delphis with a similar focus.

Original languageEnglish
Pages (from-to)191-198
Number of pages8
JournalEvaluation and Program Planning
Issue number2
Publication statusPublished - 2008 May 1



  • Delphi method
  • Educational program evaluation

ASJC Scopus subject areas

  • Business and International Management
  • Social Psychology
  • Geography, Planning and Development
  • Strategy and Management
  • Public Health, Environmental and Occupational Health

Cite this