A comparative study of item exposure control methods in computerized adaptive testing

Shun-Wen Chang, Timothy N. Ansley

Research output: Contribution to journalArticle

14 Citations (Scopus)

Abstract

This study compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each exposure control algorithm was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design established for this study. The merits and shortcomings of these strategies were considered under different item pool sizes and different desired maximum exposure rates and were evaluated in light of the observed maximum exposure rates, the test overlap rates, and the conditional standard errors of measurement. Each method had its advantages and disadvantages, but no one possessed all of the desired characteristics. There was a clear and logical trade-off between item exposure control and measurement precision. The Stocking and Lewis conditional multinomial procedure and, to a slightly lesser extent, the Davey and Parshall method seemed to be the most promising considering all of the factors that this study addressed.

Original languageEnglish
Pages (from-to)71-103
Number of pages33
JournalJournal of Educational Measurement
Volume40
Issue number1
DOIs
Publication statusPublished - 2003 Jan 1

Fingerprint

selection procedure
ability

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology
  • Applied Psychology
  • Psychology (miscellaneous)

Cite this

A comparative study of item exposure control methods in computerized adaptive testing. / Chang, Shun-Wen; Ansley, Timothy N.

In: Journal of Educational Measurement, Vol. 40, No. 1, 01.01.2003, p. 71-103.

Research output: Contribution to journalArticle

@article{bf56cb8749f34e43bd225cb7589cc0e8,
title = "A comparative study of item exposure control methods in computerized adaptive testing",
abstract = "This study compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each exposure control algorithm was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design established for this study. The merits and shortcomings of these strategies were considered under different item pool sizes and different desired maximum exposure rates and were evaluated in light of the observed maximum exposure rates, the test overlap rates, and the conditional standard errors of measurement. Each method had its advantages and disadvantages, but no one possessed all of the desired characteristics. There was a clear and logical trade-off between item exposure control and measurement precision. The Stocking and Lewis conditional multinomial procedure and, to a slightly lesser extent, the Davey and Parshall method seemed to be the most promising considering all of the factors that this study addressed.",
author = "Shun-Wen Chang and Ansley, {Timothy N.}",
year = "2003",
month = "1",
day = "1",
doi = "10.1111/j.1745-3984.2003.tb01097.x",
language = "English",
volume = "40",
pages = "71--103",
journal = "Journal of Educational Measurement",
issn = "0022-0655",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - A comparative study of item exposure control methods in computerized adaptive testing

AU - Chang, Shun-Wen

AU - Ansley, Timothy N.

PY - 2003/1/1

Y1 - 2003/1/1

N2 - This study compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each exposure control algorithm was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design established for this study. The merits and shortcomings of these strategies were considered under different item pool sizes and different desired maximum exposure rates and were evaluated in light of the observed maximum exposure rates, the test overlap rates, and the conditional standard errors of measurement. Each method had its advantages and disadvantages, but no one possessed all of the desired characteristics. There was a clear and logical trade-off between item exposure control and measurement precision. The Stocking and Lewis conditional multinomial procedure and, to a slightly lesser extent, the Davey and Parshall method seemed to be the most promising considering all of the factors that this study addressed.

AB - This study compared the properties of five methods of item exposure control within the purview of estimating examinees' abilities in a computerized adaptive testing (CAT) context. Each exposure control algorithm was incorporated into the item selection procedure and the adaptive testing progressed based on the CAT design established for this study. The merits and shortcomings of these strategies were considered under different item pool sizes and different desired maximum exposure rates and were evaluated in light of the observed maximum exposure rates, the test overlap rates, and the conditional standard errors of measurement. Each method had its advantages and disadvantages, but no one possessed all of the desired characteristics. There was a clear and logical trade-off between item exposure control and measurement precision. The Stocking and Lewis conditional multinomial procedure and, to a slightly lesser extent, the Davey and Parshall method seemed to be the most promising considering all of the factors that this study addressed.

UR - http://www.scopus.com/inward/record.url?scp=0037354198&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0037354198&partnerID=8YFLogxK

U2 - 10.1111/j.1745-3984.2003.tb01097.x

DO - 10.1111/j.1745-3984.2003.tb01097.x

M3 - Article

VL - 40

SP - 71

EP - 103

JO - Journal of Educational Measurement

JF - Journal of Educational Measurement

SN - 0022-0655

IS - 1

ER -