Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school's students taking computer course

Chi-Cheng Chang, Kuo Hung Tseng, Pao Nan Chou, Yi Hui Chen

Research output: Contribution to journalArticle

50 Citations (Scopus)

Abstract

This study examined the reliability and validity of Web-based portfolio peer assessment. Participants were 72 second-grade students from a senior high school taking a computer course. The results indicated that: 1) there was a lack of consistency across various student raters on a portfolio, or inter-rater reliability; 2) two-thirds of the raters demonstrated inconsistency assessing different portfolios, i.e. inner-rater reliability; 3) peer-assessment scores were not consistent with teacher-assessment scores (criterion-related validity); 4) significant differences were found between peer-assessment scores and end-of-course examination scores, implying that Web-based portfolio peer assessment failed to reflect learning achievements (criterion-related validity). In short, Web-based portfolio peer assessment was not a reliable and valid method.

Original languageEnglish
Pages (from-to)1306-1316
Number of pages11
JournalComputers and Education
Volume57
Issue number1
DOIs
Publication statusPublished - 2011 Aug 1

Keywords

  • Learning portfolios
  • Peer assessment
  • Web-based learning portfolios
  • Web-based portfolio assessment

ASJC Scopus subject areas

  • Computer Science(all)
  • Education

Fingerprint Dive into the research topics of 'Reliability and validity of Web-based portfolio peer assessment: A case study for a senior high school's students taking computer course'. Together they form a unique fingerprint.

  • Cite this