Automatic assessment of students' free-text answers with support vector machines

Wen-Juan Hou, Jia Hao Tsao, Sheng Yang Li, Li Chen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

For improving the interaction between students and teachers, it is fundamental for teachers to understand students' learning levels. An intelligent computer system should be able to automatically evaluate students' answers when the teacher asks some questions. We first built the assessment corpus. With the corpus, we applied the following procedures to extract the relevant information: (1) apply the part-of-speech tagging such that the syntactic information is extracted, (2) remove the punctuation and decimal numbers because it plays the noise roles, and (3) for grouping the information, apply the stemming and normalization procedure to sentences, (4) extract other features. In this study, we treated the assessment problem as the classifying problem, i.e., classifying students' scores as two classes such as above/below 6 out of 10. We got an average of 65.28% precision rate. The experiments with SVM show exhilarating results and some improving efforts will be further made in the future.

Original languageEnglish
Title of host publicationTrends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings
Pages235-243
Number of pages9
EditionPART 1
DOIs
Publication statusPublished - 2010 Dec 1
Event23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010 - Cordoba, Spain
Duration: 2010 Jun 12010 Jun 4

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 1
Volume6096 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010
CountrySpain
CityCordoba
Period10/6/110/6/4

Fingerprint

Support vector machines
Support Vector Machine
Students
Decimal number
Student Learning
Tagging
Grouping
Normalization
Syntactics
Computer systems
Evaluate
Interaction
Experiment
Text
Corpus
Experiments
Class
Speech
Syntax

Keywords

  • Free-text assessment
  • natural language processing
  • support vector machine

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Hou, W-J., Tsao, J. H., Li, S. Y., & Chen, L. (2010). Automatic assessment of students' free-text answers with support vector machines. In Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings (PART 1 ed., pp. 235-243). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6096 LNAI, No. PART 1). https://doi.org/10.1007/978-3-642-13022-9_24

Automatic assessment of students' free-text answers with support vector machines. / Hou, Wen-Juan; Tsao, Jia Hao; Li, Sheng Yang; Chen, Li.

Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1. ed. 2010. p. 235-243 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 6096 LNAI, No. PART 1).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Hou, W-J, Tsao, JH, Li, SY & Chen, L 2010, Automatic assessment of students' free-text answers with support vector machines. in Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1 edn, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), no. PART 1, vol. 6096 LNAI, pp. 235-243, 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligence Systems, IEA/AIE 2010, Cordoba, Spain, 10/6/1. https://doi.org/10.1007/978-3-642-13022-9_24
Hou W-J, Tsao JH, Li SY, Chen L. Automatic assessment of students' free-text answers with support vector machines. In Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1 ed. 2010. p. 235-243. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1). https://doi.org/10.1007/978-3-642-13022-9_24
Hou, Wen-Juan ; Tsao, Jia Hao ; Li, Sheng Yang ; Chen, Li. / Automatic assessment of students' free-text answers with support vector machines. Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings. PART 1. ed. 2010. pp. 235-243 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); PART 1).
@inproceedings{e947321ea8334937b0940b65f988b38a,
title = "Automatic assessment of students' free-text answers with support vector machines",
abstract = "For improving the interaction between students and teachers, it is fundamental for teachers to understand students' learning levels. An intelligent computer system should be able to automatically evaluate students' answers when the teacher asks some questions. We first built the assessment corpus. With the corpus, we applied the following procedures to extract the relevant information: (1) apply the part-of-speech tagging such that the syntactic information is extracted, (2) remove the punctuation and decimal numbers because it plays the noise roles, and (3) for grouping the information, apply the stemming and normalization procedure to sentences, (4) extract other features. In this study, we treated the assessment problem as the classifying problem, i.e., classifying students' scores as two classes such as above/below 6 out of 10. We got an average of 65.28{\%} precision rate. The experiments with SVM show exhilarating results and some improving efforts will be further made in the future.",
keywords = "Free-text assessment, natural language processing, support vector machine",
author = "Wen-Juan Hou and Tsao, {Jia Hao} and Li, {Sheng Yang} and Li Chen",
year = "2010",
month = "12",
day = "1",
doi = "10.1007/978-3-642-13022-9_24",
language = "English",
isbn = "3642130216",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
number = "PART 1",
pages = "235--243",
booktitle = "Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings",
edition = "PART 1",

}

TY - GEN

T1 - Automatic assessment of students' free-text answers with support vector machines

AU - Hou, Wen-Juan

AU - Tsao, Jia Hao

AU - Li, Sheng Yang

AU - Chen, Li

PY - 2010/12/1

Y1 - 2010/12/1

N2 - For improving the interaction between students and teachers, it is fundamental for teachers to understand students' learning levels. An intelligent computer system should be able to automatically evaluate students' answers when the teacher asks some questions. We first built the assessment corpus. With the corpus, we applied the following procedures to extract the relevant information: (1) apply the part-of-speech tagging such that the syntactic information is extracted, (2) remove the punctuation and decimal numbers because it plays the noise roles, and (3) for grouping the information, apply the stemming and normalization procedure to sentences, (4) extract other features. In this study, we treated the assessment problem as the classifying problem, i.e., classifying students' scores as two classes such as above/below 6 out of 10. We got an average of 65.28% precision rate. The experiments with SVM show exhilarating results and some improving efforts will be further made in the future.

AB - For improving the interaction between students and teachers, it is fundamental for teachers to understand students' learning levels. An intelligent computer system should be able to automatically evaluate students' answers when the teacher asks some questions. We first built the assessment corpus. With the corpus, we applied the following procedures to extract the relevant information: (1) apply the part-of-speech tagging such that the syntactic information is extracted, (2) remove the punctuation and decimal numbers because it plays the noise roles, and (3) for grouping the information, apply the stemming and normalization procedure to sentences, (4) extract other features. In this study, we treated the assessment problem as the classifying problem, i.e., classifying students' scores as two classes such as above/below 6 out of 10. We got an average of 65.28% precision rate. The experiments with SVM show exhilarating results and some improving efforts will be further made in the future.

KW - Free-text assessment

KW - natural language processing

KW - support vector machine

UR - http://www.scopus.com/inward/record.url?scp=79551533163&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=79551533163&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-13022-9_24

DO - 10.1007/978-3-642-13022-9_24

M3 - Conference contribution

AN - SCOPUS:79551533163

SN - 3642130216

SN - 9783642130212

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 235

EP - 243

BT - Trends in Applied Intelligent Systems - 23rd International Conference on Industrial Engineering and Other Applications of Applied Intelligent Systems, IEA/AIE 2010, Proceedings

ER -