Improving Creativity Performance Assessment: A Rater Effect Examination with Many Facet Rasch Model

Su Pin Hung*, Po Hsi Chen, Hsueh Chih Chen

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

22 引文 斯高帕斯(Scopus)

摘要

Product assessment is widely applied in creative studies, typically as an important dependent measure. Within this context, this study had 2 purposes. First, the focus of this research was on methods for investigating possible rater effects, an issue that has not received a great deal of attention in past creativity studies. Second, the substantive question of whether restrictions on materials used and differences in instructions provided would influence outcomes on measures of creativity was considered. The many-facet Rasch model was used to investigate possible sources of rater bias, including the leniency/severity effect, central tendency effect, halo effect and randomness effect. No indications were found that these potential sources of bias strongly influenced the ratings. The result indicated that the examinees could be reliably differentiated in terms of their performance. Analysis of rater-criterion interactions depicted rater behavior more clearly and, it is suggested, can be of use as a tool for rater training in future studies. In terms of the substantive questions posed, 2 × 2 experimental instructions were manipulated and it was found that different instructions did not affect creative performance. The implications of these findings are discussed.

原文英語
頁(從 - 到)345-357
頁數13
期刊Creativity Research Journal
24
發行號4
DOIs
出版狀態已發佈 - 2012 10月

ASJC Scopus subject areas

  • 視覺藝術與表演藝術
  • 發展與教育心理學
  • 心理學(雜項)

指紋

深入研究「Improving Creativity Performance Assessment: A Rater Effect Examination with Many Facet Rasch Model」主題。共同形成了獨特的指紋。

引用此