TY - JOUR
T1 - An Empirical Evaluation of the Slip Correction in the Four Parameter Logistic Models With Computerized Adaptive Testing
AU - Yen, Yung Chin
AU - Ho, Rong Guey
AU - Laio, Wen Wei
AU - Chen, Li Ju
AU - Kuo, Ching Chin
N1 - Funding Information:
The authors would like to thank the National Science Council of Taiwan for financial support.
Funding Information:
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This work was supported in part by the Science Education Division of Taiwan National Science Council under Grant No. NSC 99-2511-S-003-010-MY2 .
PY - 2012/3
Y1 - 2012/3
N2 - In a selected response test, aberrant responses such as careless errors and lucky guesses might cause error in ability estimation because these responses do not actually reflect the knowledge that examinees possess. In a computerized adaptive test (CAT), these aberrant responses could further cause serious estimation error due to dynamic item administration. To enhance the robust performance of CAT against aberrant responses, Barton and Lord proposed the four-parameter logistic (4PL) item response theory (IRT) model. However, most studies relevant to the 4PL IRT model were conducted based on simulation experiments. This study attempts to investigate the performance of the 4PL IRT model as a slip-correction mechanism with an empirical experiment. The results showed that the 4PL IRT model could not only reduce the problematic underestimation of the examinees' ability introduced by careless mistakes in practical situations but also improve measurement efficiency.
AB - In a selected response test, aberrant responses such as careless errors and lucky guesses might cause error in ability estimation because these responses do not actually reflect the knowledge that examinees possess. In a computerized adaptive test (CAT), these aberrant responses could further cause serious estimation error due to dynamic item administration. To enhance the robust performance of CAT against aberrant responses, Barton and Lord proposed the four-parameter logistic (4PL) item response theory (IRT) model. However, most studies relevant to the 4PL IRT model were conducted based on simulation experiments. This study attempts to investigate the performance of the 4PL IRT model as a slip-correction mechanism with an empirical experiment. The results showed that the 4PL IRT model could not only reduce the problematic underestimation of the examinees' ability introduced by careless mistakes in practical situations but also improve measurement efficiency.
KW - computerized adaptive testing (CAT)
KW - four-parameter logistic (4PL) IRT model
KW - item response theory (IRT)
KW - upper-asymptote parameter
UR - http://www.scopus.com/inward/record.url?scp=84859060628&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84859060628&partnerID=8YFLogxK
U2 - 10.1177/0146621611432862
DO - 10.1177/0146621611432862
M3 - Article
AN - SCOPUS:84859060628
SN - 0146-6216
VL - 36
SP - 75
EP - 87
JO - Applied Psychological Measurement
JF - Applied Psychological Measurement
IS - 2
ER -