Automated scoring for Creative Problem Solving ability with ideation-explanation modeling

Hao Chuan Wang, Chun Yen Chang, Tsai Yen Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

This paper describes an automated scorer for assessing students' Creative Problem-Solving (CPS) abilities via modeling the intra-structure of students' essays describing their thoughts on solving particular problems. The automated scorer aims to grade students' open-ended responses to an essay-question-type CPS ability test, instead of using typical Likert-type or multiple-choice questions that may be imperfect to assess the creative perspective of human problem-solving. The scorer is distinguishable to most generic automated essay scoring systems that a bipartite graphbased representation is explicitly built for the pair-wise relation between a student's ideas and self-explained reasons for a CPS task. This design will enable several analytical approaches for CPS, such as quantitative scoring and qualitative diagnoses. The preliminary empirical evaluation with 20 students' data shows that the scoring results of the scorer is satisfactory and highly correlated with those of human experts (Pearson's r=.67∼.82) in terms of quantitative scoring task. The approach provides a promising solution to support large-scaled studies on human creativity and may further enable CPS-aware personalization systems.

Original languageEnglish
Title of host publicationProc. Int. Conf. on Computers in Education 2005
Subtitle of host publication"Towards Sustainable and Scalable Educational Innovations Informed by the Learning Sciences"- Sharing Research Results and Exemplary Innovations, ICCE
Pages522-529
Number of pages8
Publication statusPublished - 2005 Dec 1
Event13th International Conference on Computers in Education, ICCE 2005 - Singapore, Singapore
Duration: 2005 Nov 282005 Dec 2

Publication series

NameProc. Int. Conf. on Computers in Education 2005: "Towards Sustainable and Scalable Educational Innovations Informed by the Learning Sciences"- Sharing Research Results and Exemplary Innovations, ICCE

Other

Other13th International Conference on Computers in Education, ICCE 2005
CountrySingapore
CitySingapore
Period05/11/2805/12/2

ASJC Scopus subject areas

  • Management of Technology and Innovation
  • Education

Fingerprint Dive into the research topics of 'Automated scoring for Creative Problem Solving ability with ideation-explanation modeling'. Together they form a unique fingerprint.

  • Cite this

    Wang, H. C., Chang, C. Y., & Li, T. Y. (2005). Automated scoring for Creative Problem Solving ability with ideation-explanation modeling. In Proc. Int. Conf. on Computers in Education 2005: "Towards Sustainable and Scalable Educational Innovations Informed by the Learning Sciences"- Sharing Research Results and Exemplary Innovations, ICCE (pp. 522-529). (Proc. Int. Conf. on Computers in Education 2005: "Towards Sustainable and Scalable Educational Innovations Informed by the Learning Sciences"- Sharing Research Results and Exemplary Innovations, ICCE).