Using cluster analysis to validate the angoff standard setting method in mixed-format assessments

Fen Lan Tseng, Jia Min Chiou, Yao Ting Sung

研究成果: 書貢獻/報告類型會議論文篇章

摘要

Test validity is a property of the interpretation assigned to test scores. To provide an objective validating evidence for a standard-referenced assessment is especially important. In this study we utilize a statistical technique, cluster analysis, to explore the validity of one of the expert judgement technique-Yes/No Angoff standard setting method. We first segregated each examinee ability cluster using the hierarchical clustering (HC). Assume that each ability cluster is a Gaussian distribution and that the distribution of each test subject data can be modeled by mixture of Gaussians (MoG), where the mean, variance and the proportion of each cluster were initialized by the HC results. Finally, the ability clustering was implemented by the expectation maximization (EM) method. The results from the traditional standard-setting procedure and cluster analysis were compared. The study concludes that cluster analysis appears useful for helping to set standards on educational tests. In addition, it suggested that cluster analysis could be applied as a support tool to provide validating information in the process of standard setting for high-stakes achievement tests.

原文英語
主出版物標題ICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery
編輯Liang Zhao, Lipo Wang, Guoyong Cai, Kenli Li, Yong Liu, Guoqing Xiao
發行者Institute of Electrical and Electronics Engineers Inc.
頁面2540-2546
頁數7
ISBN(電子)9781538621653
DOIs
出版狀態已發佈 - 2018 6月 21
事件13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017 - Guilin, Guangxi, 中国
持續時間: 2017 7月 292017 7月 31

出版系列

名字ICNC-FSKD 2017 - 13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery

其他

其他13th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery, ICNC-FSKD 2017
國家/地區中国
城市Guilin, Guangxi
期間2017/07/292017/07/31

ASJC Scopus subject areas

  • 電腦網路與通信
  • 電腦科學應用
  • 硬體和架構
  • 資訊系統
  • 資訊系統與管理
  • 邏輯
  • 建模與模擬
  • 統計與概率

指紋

深入研究「Using cluster analysis to validate the angoff standard setting method in mixed-format assessments」主題。共同形成了獨特的指紋。

引用此