Comparisons of reliability and validity between teacher-assessment, student self-assessment, and peer-assessment in a web-based portfolio assessment environment

Chi-Cheng Chang, Ming Fun Wu

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

This study compares the reliable and validity among instructor assessment, student self-assessment and peer-assessment under the Web-based portfolio assessment environment. The research samples consist of 72 students who take "Computer Application" course of the second grade in some vocational high school. The students use the Web-based portfolio assessment system for creating their portfolio, emulating peers' portfolio, and performing selfassessment and peer-assessment. The teacher uses the system for reviewing and assessing students' learning performances. In regard to the difference among the three assessment approaches, there exists a significant difference among the three approaches. Instructor assessment is most rigorous, while peer-assessment is most slack. In regard to the correlation among the three assessment approaches, there exists a significant consistency between selfassessment and instructor assessment. There exist inconsistencies between self-assessment and peer-assessment as well as peer-assessment and instructor assessment. In regard to the correlation among the three assessment results and test score, there exist a high consistency between instructor assessment and test score. As well, there exist a high consistency between self-assessment and test score. However, the consistency between peer-assessment and test score is inadequate.

Original languageEnglish
Pages (from-to)135-170
Number of pages36
JournalJournal of Educational Media and Library Science
Volume49
Issue number1
Publication statusPublished - 2012 Mar 6

Fingerprint

self-assessment
Students
teacher
student
Computer applications
instructor
Portfolio Assessment
Peer Assessment
Self-assessment
World Wide Web
Instructor
learning performance
Test Scores

Keywords

  • Peer-assessment
  • Self-assessment
  • Web-based portfolio
  • Web-based portfolio assessment

ASJC Scopus subject areas

  • Conservation
  • Information Systems
  • Archaeology
  • Library and Information Sciences

Cite this

@article{0ecbb3f126e747f4b7fbdd7417f7bb87,
title = "Comparisons of reliability and validity between teacher-assessment, student self-assessment, and peer-assessment in a web-based portfolio assessment environment",
abstract = "This study compares the reliable and validity among instructor assessment, student self-assessment and peer-assessment under the Web-based portfolio assessment environment. The research samples consist of 72 students who take {"}Computer Application{"} course of the second grade in some vocational high school. The students use the Web-based portfolio assessment system for creating their portfolio, emulating peers' portfolio, and performing selfassessment and peer-assessment. The teacher uses the system for reviewing and assessing students' learning performances. In regard to the difference among the three assessment approaches, there exists a significant difference among the three approaches. Instructor assessment is most rigorous, while peer-assessment is most slack. In regard to the correlation among the three assessment approaches, there exists a significant consistency between selfassessment and instructor assessment. There exist inconsistencies between self-assessment and peer-assessment as well as peer-assessment and instructor assessment. In regard to the correlation among the three assessment results and test score, there exist a high consistency between instructor assessment and test score. As well, there exist a high consistency between self-assessment and test score. However, the consistency between peer-assessment and test score is inadequate.",
keywords = "Peer-assessment, Self-assessment, Web-based portfolio, Web-based portfolio assessment",
author = "Chi-Cheng Chang and Wu, {Ming Fun}",
year = "2012",
month = "3",
day = "6",
language = "English",
volume = "49",
pages = "135--170",
journal = "Journal of Educational Media and Library Science",
issn = "1013-090X",
publisher = "淡江大學資訊與圖書館學系",
number = "1",

}

TY - JOUR

T1 - Comparisons of reliability and validity between teacher-assessment, student self-assessment, and peer-assessment in a web-based portfolio assessment environment

AU - Chang, Chi-Cheng

AU - Wu, Ming Fun

PY - 2012/3/6

Y1 - 2012/3/6

N2 - This study compares the reliable and validity among instructor assessment, student self-assessment and peer-assessment under the Web-based portfolio assessment environment. The research samples consist of 72 students who take "Computer Application" course of the second grade in some vocational high school. The students use the Web-based portfolio assessment system for creating their portfolio, emulating peers' portfolio, and performing selfassessment and peer-assessment. The teacher uses the system for reviewing and assessing students' learning performances. In regard to the difference among the three assessment approaches, there exists a significant difference among the three approaches. Instructor assessment is most rigorous, while peer-assessment is most slack. In regard to the correlation among the three assessment approaches, there exists a significant consistency between selfassessment and instructor assessment. There exist inconsistencies between self-assessment and peer-assessment as well as peer-assessment and instructor assessment. In regard to the correlation among the three assessment results and test score, there exist a high consistency between instructor assessment and test score. As well, there exist a high consistency between self-assessment and test score. However, the consistency between peer-assessment and test score is inadequate.

AB - This study compares the reliable and validity among instructor assessment, student self-assessment and peer-assessment under the Web-based portfolio assessment environment. The research samples consist of 72 students who take "Computer Application" course of the second grade in some vocational high school. The students use the Web-based portfolio assessment system for creating their portfolio, emulating peers' portfolio, and performing selfassessment and peer-assessment. The teacher uses the system for reviewing and assessing students' learning performances. In regard to the difference among the three assessment approaches, there exists a significant difference among the three approaches. Instructor assessment is most rigorous, while peer-assessment is most slack. In regard to the correlation among the three assessment approaches, there exists a significant consistency between selfassessment and instructor assessment. There exist inconsistencies between self-assessment and peer-assessment as well as peer-assessment and instructor assessment. In regard to the correlation among the three assessment results and test score, there exist a high consistency between instructor assessment and test score. As well, there exist a high consistency between self-assessment and test score. However, the consistency between peer-assessment and test score is inadequate.

KW - Peer-assessment

KW - Self-assessment

KW - Web-based portfolio

KW - Web-based portfolio assessment

UR - http://www.scopus.com/inward/record.url?scp=84863285947&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84863285947&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84863285947

VL - 49

SP - 135

EP - 170

JO - Journal of Educational Media and Library Science

JF - Journal of Educational Media and Library Science

SN - 1013-090X

IS - 1

ER -