Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities

Che Yu Kuo, Hsin-Kai Wu, Tsung Hau Jen, Ying-Shao Hsu

研究成果: 雜誌貢獻文章同行評審

13 引文 斯高帕斯(Scopus)

摘要

The potential of computer-based assessments for capturing complex learning outcomes has been discussed; however, relatively little is understood about how to leverage such potential for summative and accountability purposes. The aim of this study is to develop and validate a multimedia-based assessment of scientific inquiry abilities (MASIA) to cover a more comprehensive construct of inquiry abilities and target secondary school students in different grades while this potential is leveraged. We implemented five steps derived from the construct modeling approach to design MASIA. During the implementation, multiple sources of evidence were collected in the steps of pilot testing and Rasch modeling to support the validity of MASIA. Particularly, through the participation of 1,066 8th and 11th graders, MASIA showed satisfactory psychometric properties to discriminate students with different levels of inquiry abilities in 101 items in 29 tasks when Rasch models were applied. Additionally, the Wright map indicated that MASIA offered accurate information about students’ inquiry abilities because of the comparability of the distributions of student abilities and item difficulties. The analysis results also suggested that MASIA offered precise measures of inquiry abilities when the components (questioning, experimenting, analyzing, and explaining) were regarded as a coherent construct. Finally, the increased mean difficulty thresholds of item responses along with three performance levels across all sub-abilities supported the alignment between our scoring rubrics and our inquiry framework. Together with other sources of validity in the pilot testing, the results offered evidence to support the validity of MASIA.

原文英語
頁(從 - 到)2326-2357
頁數32
期刊International Journal of Science Education
37
發行號14
DOIs
出版狀態已發佈 - 2015 九月 22

ASJC Scopus subject areas

  • Education

指紋 深入研究「Development and Validation of a Multimedia-based Assessment of Scientific Inquiry Abilities」主題。共同形成了獨特的指紋。

引用此