Toward an integrated model for designing assessment systems: An analysis of the current status of computer-based assessments in science

Che Yu Kuo, Hsin Kai Wu*

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

33 引文 斯高帕斯(Scopus)

摘要

Drawing upon an integrated model proposed by Bennett and Bejar (1998), this review study examined how 66 computer-based science assessments (CBSAs) in basic science and medicine took advantage of advanced technologies. The model regarded a CBSA as an integrated system, included several assessment components (e.g., assessment purpose, measured construct, test and task design, examinee interface, and scoring procedure), and emphasized the interplay among these components. Accordingly, this study systematically analyzed the item presentations of interactive multimedia, the constructs measured, the response formats in formative and summative assessments, the scoring procedures, the adaptive test activities administrated based on the algorithms related to the item response theory (IRT) and other rules beyond IRT, and the strategies for the automatic provision of informative hints and feedbacks in the CBSAs. Our analysis revealed that although only 19 out of 66 assessments took advantage of dynamic and interactive media for item presentations, CBSAs with these media could measure integrated understanding of science phenomena and complex problem-solving skills. However, we also found that limitations in automated scoring may lead to infrequent use of the automated provision of hints and feedbacks with open-ended and extended responses. These findings suggest the interrelatedness of the assessment components, and thus we argue that designers should repeatedly consider the relationships between components of CBSAs to ensure the validity of the assessments. Finally, we also indicate the issues for future research in computer-based assessments.

原文英語
頁(從 - 到)388-403
頁數16
期刊Computers and Education
68
DOIs
出版狀態已發佈 - 2013

ASJC Scopus subject areas

  • 電腦科學(全部)
  • 教育

指紋

深入研究「Toward an integrated model for designing assessment systems: An analysis of the current status of computer-based assessments in science」主題。共同形成了獨特的指紋。

引用此