Modeling Rapid Guessing Behaviors in Computer-Based Testlet Items

Kuan Yu Jin*, Chia Ling Hsu, Ming Ming Chiu, Po Hsi Chen

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

摘要

In traditional test models, test items are independent, and test-takers slowly and thoughtfully respond to each test item. However, some test items have a common stimulus (dependent test items in a testlet), and sometimes test-takers lack motivation, knowledge, or time (speededness), so they perform rapid guessing (RG). Ignoring the dependence in responses to testlet items can negatively bias standard errors of measurement, and ignoring RG by fitting a simpler item response theory (IRT) model can bias the results. Because computer-based testing captures response times on testlet responses, we propose a mixture testlet IRT model with item responses and response time to model RG behaviors in computer-based testlet items. Two simulation studies with Markov chain Monte Carlo estimation using the JAGS program showed (a) good recovery of the item and person parameters in this new model and (b) the harmful consequences of ignoring RG (biased parameter estimates: overestimated item difficulties, underestimated time intensities, underestimated respondent latent speed parameters, and overestimated precision of respondent latent estimates). The application of IRT models with and without RG to data from a computer-based language test showed parameter differences resembling those in the simulations.

原文英語
頁(從 - 到)19-33
頁數15
期刊Applied Psychological Measurement
47
發行號1
DOIs
出版狀態已發佈 - 2023 1月

ASJC Scopus subject areas

  • 社會科學(雜項)
  • 心理學(雜項)

指紋

深入研究「Modeling Rapid Guessing Behaviors in Computer-Based Testlet Items」主題。共同形成了獨特的指紋。

引用此