Development and application of a scoring rubric for evaluating students' experimental skills in organic chemistry

An instructional guide for teaching assistants

Hui Jung Chen, Jui Lin She, Chin Cheng Chou, Yeun Min Tsai, Mei Hung Chiu

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

The purpose of this study was to develop a scoring rubric to assess students' manipulation skills and identify students' learning difficulties in conducting organic chemistry experiments. In constructing the scoring rubric, we first analyzed the skills needed in the experiment, then divided the skills into subskills, and finally constructed a rubric for each subskill. We applied this developed instrument to on-site evaluation of 55 second-year students by eight teaching assistants (TAs). The data were analyzed using one-way analysis of variance, which compared the students' mean score on each skill at the 0.05 significance level. Results showed that the skill of gravity filtration and suction filtration needed to be improved, as the students had the lowest mean scores in these two skills. On-site observations further indicated that only 5% of the students correctly performed the rinsing technique for gravity filtration. We also found that TAs became more aware of students' experimental skills after using the rubric for assessment. By using a scoring rubric as an assessment tool, students' learning difficulties could be easily identified and TAs could improve their teaching effectiveness by checking student performance and modifying their instructional strategies accordingly. This study provides a valuable and easy-to-apply quantitative assessment for use in the organic chemistry laboratory.

Original languageEnglish
Pages (from-to)1296-1302
Number of pages7
JournalJournal of Chemical Education
Volume90
Issue number10
DOIs
Publication statusPublished - 2013 Oct 8

Fingerprint

assistant
Teaching
chemistry
Students
student
learning disorder
Gravitation
Organic Chemistry
experiment
Analysis of variance (ANOVA)
analysis of variance
manipulation
Experiments
evaluation
performance

Keywords

  • Chemical Education Research
  • Laboratory Instruction
  • Organic Chemistry
  • Second-Year Undergraduate
  • Synthesis
  • TA Training/Orientation
  • Testing/Assessment

ASJC Scopus subject areas

  • Chemistry(all)
  • Education

Cite this

Development and application of a scoring rubric for evaluating students' experimental skills in organic chemistry : An instructional guide for teaching assistants. / Chen, Hui Jung; She, Jui Lin; Chou, Chin Cheng; Tsai, Yeun Min; Chiu, Mei Hung.

In: Journal of Chemical Education, Vol. 90, No. 10, 08.10.2013, p. 1296-1302.

Research output: Contribution to journalArticle

@article{851c8816dc524c78ba4f2f574fbdee11,
title = "Development and application of a scoring rubric for evaluating students' experimental skills in organic chemistry: An instructional guide for teaching assistants",
abstract = "The purpose of this study was to develop a scoring rubric to assess students' manipulation skills and identify students' learning difficulties in conducting organic chemistry experiments. In constructing the scoring rubric, we first analyzed the skills needed in the experiment, then divided the skills into subskills, and finally constructed a rubric for each subskill. We applied this developed instrument to on-site evaluation of 55 second-year students by eight teaching assistants (TAs). The data were analyzed using one-way analysis of variance, which compared the students' mean score on each skill at the 0.05 significance level. Results showed that the skill of gravity filtration and suction filtration needed to be improved, as the students had the lowest mean scores in these two skills. On-site observations further indicated that only 5{\%} of the students correctly performed the rinsing technique for gravity filtration. We also found that TAs became more aware of students' experimental skills after using the rubric for assessment. By using a scoring rubric as an assessment tool, students' learning difficulties could be easily identified and TAs could improve their teaching effectiveness by checking student performance and modifying their instructional strategies accordingly. This study provides a valuable and easy-to-apply quantitative assessment for use in the organic chemistry laboratory.",
keywords = "Chemical Education Research, Laboratory Instruction, Organic Chemistry, Second-Year Undergraduate, Synthesis, TA Training/Orientation, Testing/Assessment",
author = "Chen, {Hui Jung} and She, {Jui Lin} and Chou, {Chin Cheng} and Tsai, {Yeun Min} and Chiu, {Mei Hung}",
year = "2013",
month = "10",
day = "8",
doi = "10.1021/ed101111g",
language = "English",
volume = "90",
pages = "1296--1302",
journal = "Journal of Chemical Education",
issn = "0021-9584",
publisher = "American Chemical Society",
number = "10",

}

TY - JOUR

T1 - Development and application of a scoring rubric for evaluating students' experimental skills in organic chemistry

T2 - An instructional guide for teaching assistants

AU - Chen, Hui Jung

AU - She, Jui Lin

AU - Chou, Chin Cheng

AU - Tsai, Yeun Min

AU - Chiu, Mei Hung

PY - 2013/10/8

Y1 - 2013/10/8

N2 - The purpose of this study was to develop a scoring rubric to assess students' manipulation skills and identify students' learning difficulties in conducting organic chemistry experiments. In constructing the scoring rubric, we first analyzed the skills needed in the experiment, then divided the skills into subskills, and finally constructed a rubric for each subskill. We applied this developed instrument to on-site evaluation of 55 second-year students by eight teaching assistants (TAs). The data were analyzed using one-way analysis of variance, which compared the students' mean score on each skill at the 0.05 significance level. Results showed that the skill of gravity filtration and suction filtration needed to be improved, as the students had the lowest mean scores in these two skills. On-site observations further indicated that only 5% of the students correctly performed the rinsing technique for gravity filtration. We also found that TAs became more aware of students' experimental skills after using the rubric for assessment. By using a scoring rubric as an assessment tool, students' learning difficulties could be easily identified and TAs could improve their teaching effectiveness by checking student performance and modifying their instructional strategies accordingly. This study provides a valuable and easy-to-apply quantitative assessment for use in the organic chemistry laboratory.

AB - The purpose of this study was to develop a scoring rubric to assess students' manipulation skills and identify students' learning difficulties in conducting organic chemistry experiments. In constructing the scoring rubric, we first analyzed the skills needed in the experiment, then divided the skills into subskills, and finally constructed a rubric for each subskill. We applied this developed instrument to on-site evaluation of 55 second-year students by eight teaching assistants (TAs). The data were analyzed using one-way analysis of variance, which compared the students' mean score on each skill at the 0.05 significance level. Results showed that the skill of gravity filtration and suction filtration needed to be improved, as the students had the lowest mean scores in these two skills. On-site observations further indicated that only 5% of the students correctly performed the rinsing technique for gravity filtration. We also found that TAs became more aware of students' experimental skills after using the rubric for assessment. By using a scoring rubric as an assessment tool, students' learning difficulties could be easily identified and TAs could improve their teaching effectiveness by checking student performance and modifying their instructional strategies accordingly. This study provides a valuable and easy-to-apply quantitative assessment for use in the organic chemistry laboratory.

KW - Chemical Education Research

KW - Laboratory Instruction

KW - Organic Chemistry

KW - Second-Year Undergraduate

KW - Synthesis

KW - TA Training/Orientation

KW - Testing/Assessment

UR - http://www.scopus.com/inward/record.url?scp=84885402776&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84885402776&partnerID=8YFLogxK

U2 - 10.1021/ed101111g

DO - 10.1021/ed101111g

M3 - Article

VL - 90

SP - 1296

EP - 1302

JO - Journal of Chemical Education

JF - Journal of Chemical Education

SN - 0021-9584

IS - 10

ER -