Is teacher assessment reliable or valid for high school students under a web-based portfolio environment?

Chi Cheng Chang, Bing Hong Wu

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

This study explored the reliability and validity of teacher assessment under a Web-based portfolio assessment environment (or Web-based teacher portfolio assessment). Participants were 72 eleventh graders taking the "Computer Application" course. The students perform portfolio creation, inspection, self- and peer-assessment using the Web-based portfolio assessment system; meanwhile, the teachers used the assessment tool to review students' portfolios and evaluate their learning performances. The results indicated that: 1) the Web-based portfolio teacher assessment achieved an acceptable level of reliability; 2) the Web-based portfolio teacher assessment, showing a strong level of inter-rater reliability and inner-rater reliability, can be regarded as a reliable assessment method; 3) the Web-based portfolio teacher assessment demonstrated an acceptable level of validity; 4) the portfolio scores were highly consistent with students' end-of-course examination scores, implying that Web-based portfolio teacher assessment is a valid assessment method. Future studies are recommended to gain further insight into the self-built portfolios created by digital tools (e.g. PowerPoint, Word, or Frontpage software), for which effective rubrics and reliability or validity of the assessment may be also provided.

Original languageEnglish
Pages (from-to)265-278
Number of pages14
JournalEducational Technology and Society
Volume15
Issue number4
Publication statusPublished - 2012 Dec 1

Fingerprint

Students
teacher
school
student
Computer applications
Inspection
learning performance
examination

Keywords

  • E-Portfolio
  • Portfolio assessment
  • Reliability
  • Validity
  • Web portfolio

ASJC Scopus subject areas

  • Education
  • Sociology and Political Science
  • Engineering(all)

Cite this

Is teacher assessment reliable or valid for high school students under a web-based portfolio environment? / Chang, Chi Cheng; Wu, Bing Hong.

In: Educational Technology and Society, Vol. 15, No. 4, 01.12.2012, p. 265-278.

Research output: Contribution to journalArticle

@article{0994c4aee9534722a362503da7f0d9fb,
title = "Is teacher assessment reliable or valid for high school students under a web-based portfolio environment?",
abstract = "This study explored the reliability and validity of teacher assessment under a Web-based portfolio assessment environment (or Web-based teacher portfolio assessment). Participants were 72 eleventh graders taking the {"}Computer Application{"} course. The students perform portfolio creation, inspection, self- and peer-assessment using the Web-based portfolio assessment system; meanwhile, the teachers used the assessment tool to review students' portfolios and evaluate their learning performances. The results indicated that: 1) the Web-based portfolio teacher assessment achieved an acceptable level of reliability; 2) the Web-based portfolio teacher assessment, showing a strong level of inter-rater reliability and inner-rater reliability, can be regarded as a reliable assessment method; 3) the Web-based portfolio teacher assessment demonstrated an acceptable level of validity; 4) the portfolio scores were highly consistent with students' end-of-course examination scores, implying that Web-based portfolio teacher assessment is a valid assessment method. Future studies are recommended to gain further insight into the self-built portfolios created by digital tools (e.g. PowerPoint, Word, or Frontpage software), for which effective rubrics and reliability or validity of the assessment may be also provided.",
keywords = "E-Portfolio, Portfolio assessment, Reliability, Validity, Web portfolio",
author = "Chang, {Chi Cheng} and Wu, {Bing Hong}",
year = "2012",
month = "12",
day = "1",
language = "English",
volume = "15",
pages = "265--278",
journal = "Educational Technology and Society",
issn = "1436-4522",
publisher = "IEEE Computer Society",
number = "4",

}

TY - JOUR

T1 - Is teacher assessment reliable or valid for high school students under a web-based portfolio environment?

AU - Chang, Chi Cheng

AU - Wu, Bing Hong

PY - 2012/12/1

Y1 - 2012/12/1

N2 - This study explored the reliability and validity of teacher assessment under a Web-based portfolio assessment environment (or Web-based teacher portfolio assessment). Participants were 72 eleventh graders taking the "Computer Application" course. The students perform portfolio creation, inspection, self- and peer-assessment using the Web-based portfolio assessment system; meanwhile, the teachers used the assessment tool to review students' portfolios and evaluate their learning performances. The results indicated that: 1) the Web-based portfolio teacher assessment achieved an acceptable level of reliability; 2) the Web-based portfolio teacher assessment, showing a strong level of inter-rater reliability and inner-rater reliability, can be regarded as a reliable assessment method; 3) the Web-based portfolio teacher assessment demonstrated an acceptable level of validity; 4) the portfolio scores were highly consistent with students' end-of-course examination scores, implying that Web-based portfolio teacher assessment is a valid assessment method. Future studies are recommended to gain further insight into the self-built portfolios created by digital tools (e.g. PowerPoint, Word, or Frontpage software), for which effective rubrics and reliability or validity of the assessment may be also provided.

AB - This study explored the reliability and validity of teacher assessment under a Web-based portfolio assessment environment (or Web-based teacher portfolio assessment). Participants were 72 eleventh graders taking the "Computer Application" course. The students perform portfolio creation, inspection, self- and peer-assessment using the Web-based portfolio assessment system; meanwhile, the teachers used the assessment tool to review students' portfolios and evaluate their learning performances. The results indicated that: 1) the Web-based portfolio teacher assessment achieved an acceptable level of reliability; 2) the Web-based portfolio teacher assessment, showing a strong level of inter-rater reliability and inner-rater reliability, can be regarded as a reliable assessment method; 3) the Web-based portfolio teacher assessment demonstrated an acceptable level of validity; 4) the portfolio scores were highly consistent with students' end-of-course examination scores, implying that Web-based portfolio teacher assessment is a valid assessment method. Future studies are recommended to gain further insight into the self-built portfolios created by digital tools (e.g. PowerPoint, Word, or Frontpage software), for which effective rubrics and reliability or validity of the assessment may be also provided.

KW - E-Portfolio

KW - Portfolio assessment

KW - Reliability

KW - Validity

KW - Web portfolio

UR - http://www.scopus.com/inward/record.url?scp=84873863832&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84873863832&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84873863832

VL - 15

SP - 265

EP - 278

JO - Educational Technology and Society

JF - Educational Technology and Society

SN - 1436-4522

IS - 4

ER -