Development of Chinese computerized adaptive test system based on higher-order item response theory

Rih Chang Chao*, Bor Chen Kuo, Ya Hsun Tsai

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

The purpose of this empirical study was to develop a higher-order computerized adaptive test (HCAT) system based on higher-order Item Response Theory (HOIRT) for a Chinese proficiency test (CPT). This study contains four steps, namely item categorization, ability estimation, item selection and system development. The development of the HCAT system succeeds in making four major contributions; the first is the original CPTs system developed for computerized adaptive test, while the second is the application of one factor within-item HO-IRT structure which enables the item selection procedure adopted next item simultaneously based on the individual test-taker’s three domain abilities (linguistic, sociolinguistic and pragmatic), thirdly is the application of the maximum a posteriori (MAP) estimator enables test-takers averagely responded 10 out of 43 items to complete the test, and last, but not least, the HCAT system is able to directly reduce the administration costs associated with the test compared with either the current traditional paper-and-pencil or computer-based CPTs. These results make CPT a multi-functional and practical test, as the domain abilities can be used in a formative assessment for diagnostic purposes, and the overall ability can be provided on the overall level of performance for a summative assessment.

Original languageEnglish
Pages (from-to)57-76
Number of pages20
JournalInternational Journal of Innovative Computing, Information and Control
Volume11
Issue number1
Publication statusPublished - 2015 Jan 1

Keywords

  • Chinese proficiency test (CPT)
  • Computerized adaptive test (CAT)
  • Higher-order computerized adaptive test (HCAT)
  • Higher-order IRT (HO-IRT)
  • Item response theory (IRT)

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Information Systems
  • Computational Theory and Mathematics

Fingerprint

Dive into the research topics of 'Development of Chinese computerized adaptive test system based on higher-order item response theory'. Together they form a unique fingerprint.

Cite this