Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation

Hsin Ling Hung, James W. Altschuld, Yi Fang Lee

Research output: Contribution to journalArticle

78 Citations (Scopus)

Abstract

Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific region. The study is described followed by a discussion of the difficulties in participant recruitment and selection, sample size, instrumentation, data collection and analysis and attempts to resolve them. Some of these problems are generic to the Delphi whereas others related to the specifics of the investigation. What we learned should be useful for future Delphis with a similar focus.

Original languageEnglish
Pages (from-to)191-198
Number of pages8
JournalEvaluation and Program Planning
Volume31
Issue number2
DOIs
Publication statusPublished - 2008 May 1

Fingerprint

Delphi Technique
Program Evaluation
educational program
Sample Size
instrumentation
evaluation
Research
data analysis
electronics
experience
analysis
Asia
programme
Delphi study
Education
Delphi
Program evaluation

Keywords

  • Delphi method
  • Educational program evaluation

ASJC Scopus subject areas

  • Business and International Management
  • Social Psychology
  • Geography, Planning and Development
  • Strategy and Management
  • Public Health, Environmental and Occupational Health

Cite this

Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation. / Hung, Hsin Ling; Altschuld, James W.; Lee, Yi Fang.

In: Evaluation and Program Planning, Vol. 31, No. 2, 01.05.2008, p. 191-198.

Research output: Contribution to journalArticle

@article{e872191ab5bb41a59a5d49e004f514a4,
title = "Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation",
abstract = "Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific region. The study is described followed by a discussion of the difficulties in participant recruitment and selection, sample size, instrumentation, data collection and analysis and attempts to resolve them. Some of these problems are generic to the Delphi whereas others related to the specifics of the investigation. What we learned should be useful for future Delphis with a similar focus.",
keywords = "Delphi method, Educational program evaluation",
author = "Hung, {Hsin Ling} and Altschuld, {James W.} and Lee, {Yi Fang}",
year = "2008",
month = "5",
day = "1",
doi = "10.1016/j.evalprogplan.2008.02.005",
language = "English",
volume = "31",
pages = "191--198",
journal = "Evaluation and Program Planning",
issn = "0149-7189",
publisher = "Elsevier Limited",
number = "2",

}

TY - JOUR

T1 - Methodological and conceptual issues confronting a cross-country Delphi study of educational program evaluation

AU - Hung, Hsin Ling

AU - Altschuld, James W.

AU - Lee, Yi Fang

PY - 2008/5/1

Y1 - 2008/5/1

N2 - Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific region. The study is described followed by a discussion of the difficulties in participant recruitment and selection, sample size, instrumentation, data collection and analysis and attempts to resolve them. Some of these problems are generic to the Delphi whereas others related to the specifics of the investigation. What we learned should be useful for future Delphis with a similar focus.

AB - Although the Delphi is widely used, research on certain methodological issues is somewhat limited. After a brief introduction to the strengths, limitations, and methodological challenges of the technique, we share our experiences (as well as problems encountered) with an electronic Delphi of educational program evaluation (EPE) in the Asia-Pacific region. The study is described followed by a discussion of the difficulties in participant recruitment and selection, sample size, instrumentation, data collection and analysis and attempts to resolve them. Some of these problems are generic to the Delphi whereas others related to the specifics of the investigation. What we learned should be useful for future Delphis with a similar focus.

KW - Delphi method

KW - Educational program evaluation

UR - http://www.scopus.com/inward/record.url?scp=41949109740&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=41949109740&partnerID=8YFLogxK

U2 - 10.1016/j.evalprogplan.2008.02.005

DO - 10.1016/j.evalprogplan.2008.02.005

M3 - Article

C2 - 18403018

AN - SCOPUS:41949109740

VL - 31

SP - 191

EP - 198

JO - Evaluation and Program Planning

JF - Evaluation and Program Planning

SN - 0149-7189

IS - 2

ER -