Establishing the Criterion-related, Construct, and Content Validities of a Simulation-based Assessment of Inquiry Abilities

Pai Hsing Wu, Hsin Kai Wu*, Ying Shao Hsu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

15 Citations (Scopus)


The emphasis on scientific inquiry has increased the importance in developing the fundamental abilities to conduct scientific investigations and urged a need for valid assessments of students' inquiry abilities. We took advantage of the advanced technology to develop a simulation-based assessment of inquiry abilities (SAIA) that allowed students to generate scientific explanations and demonstrate their experimental abilities. This paper describes the validation of the assessment. Data were collected from 48 12th-grade students at a local high school who were categorized into three groups based on their program majors. Both quantitative and qualitative approaches were utilized to validate SAIA. The quantitative results showed that SAIA was aligned with a validated reasoning-skill test (criterion-related validity), discriminated variance among different groups (construct validity), and was highly suitable for examining inquiry abilities (content validity). Additionally, we utilized the think-aloud technique in order to identify the performances exhibited by students while they accomplished the SAIA tasks. The protocol analysis indicated that in general, students demonstrated the expected abilities in SAIA and that their SAIA scores accurately reflected their performance levels of inquiry abilities. The results suggested that SAIA was a valid assessment for evaluating the inquiry abilities of high school students. This study also provided systemic strategies for validating simulation-based assessments.

Original languageEnglish
Pages (from-to)1630-1650
Number of pages21
JournalInternational Journal of Science Education
Issue number10
Publication statusPublished - 2014 Jul


  • Inquiry ability
  • Simulation-based assessment
  • Validation

ASJC Scopus subject areas

  • Education


Dive into the research topics of 'Establishing the Criterion-related, Construct, and Content Validities of a Simulation-based Assessment of Inquiry Abilities'. Together they form a unique fingerprint.

Cite this