A validity study for Yes/No Angoff standard setting method using cluster analysis

Fen Lan Tseng, Jia Min Chiou, Yao-Ting Sung

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Test validity is a property of the interpretation assigned to test scores. To provide an objective validating evidence for a standard-referenced assessment is especially important. In this study we utilize a statistical technique, cluster analysis, to explore the validity of one of the expert judgement technique- Yes/No Angoff standard setting method. We first segregated each examinee ability cluster using the hierarchical clustering (HC). Assume that each ability cluster is a Gaussian distribution and that the distribution of each test subject data can be modeled by mixture of Gaussians (MoG), where the mean, variance and the proportion of each cluster were initialized by the HC results. Finally, the ability clustering was implemented by the expectation maximization (EM) method. The results from the traditional standard-setting procedure and cluster analysis were compared. The study suggested that cluster analysis could be applied as a support tool to provide validating information in the process of standard setting for high-stakes achievement tests.

Original languageEnglish
Title of host publication2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015
EditorsZhuo Tang, Jiayi Du, Shu Yin, Renfa Li, Ligang He
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages727-731
Number of pages5
ISBN (Electronic)9781467376822
DOIs
Publication statusPublished - 2016 Jan 13
Event12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015 - Zhangjiajie, China
Duration: 2015 Aug 152015 Aug 17

Publication series

Name2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015

Other

Other12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015
CountryChina
CityZhangjiajie
Period15/8/1515/8/17

Keywords

  • cluster analysis
  • hierarchical clustering
  • mixture of Gaussian models
  • standard setting

ASJC Scopus subject areas

  • Discrete Mathematics and Combinatorics
  • Modelling and Simulation
  • Computer Networks and Communications
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'A validity study for Yes/No Angoff standard setting method using cluster analysis'. Together they form a unique fingerprint.

  • Cite this

    Tseng, F. L., Chiou, J. M., & Sung, Y-T. (2016). A validity study for Yes/No Angoff standard setting method using cluster analysis. In Z. Tang, J. Du, S. Yin, R. Li, & L. He (Eds.), 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015 (pp. 727-731). [7382032] (2015 12th International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2015). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FSKD.2015.7382032