Methods in scaling the basic competence test

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

This study evaluates the effects of employing the linear, normalizing, and arcsine transformation methods for constructing scale scores on the Basic Competence Test (BCTEST). Tests in three subject areas (Chinese, English, and Mathematics) were studied using the data of test administrations from 2001 to 2003. The resulting scale scores for each test over the years were examined with respect to the graphs of the raw-to-scale score conversions, summary statistics, and measurement properties calculated based on the strong true score theory. The effects of adjustments in rounding and truncating and the gaps resulting from the conversions were explored. The findings provided sufficient evidence that employing the arcsine transformation stabilized the error variability along almost the entire scale. But the linear transformation produced the most satisfactory results regarding the gap sizes, and the normalizing approach produced similar distributional properties among the tests. This research has revealed useful information about the features of scales based on different transformation approaches.

Original languageEnglish
Pages (from-to)907-929
Number of pages23
JournalEducational and Psychological Measurement
Volume66
Issue number6
DOIs
Publication statusPublished - 2006 Jan 1

Fingerprint

Social Adjustment
Linear transformations
Mathematics
scaling
Mental Competency
Statistics
Scaling
Research
Rounding
Linear transformation
Adjustment
statistics
Entire
mathematics
Sufficient
Evaluate
Graph in graph theory
evidence

Keywords

  • Arcsine transformation
  • BCTEST
  • Linear transformation
  • Normalizing transformation
  • Scale score

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology
  • Applied Psychology
  • Applied Mathematics

Cite this

Methods in scaling the basic competence test. / Chang, Shun-Wen.

In: Educational and Psychological Measurement, Vol. 66, No. 6, 01.01.2006, p. 907-929.

Research output: Contribution to journalArticle

@article{1fa8c51dd14e4922a068524a90634562,
title = "Methods in scaling the basic competence test",
abstract = "This study evaluates the effects of employing the linear, normalizing, and arcsine transformation methods for constructing scale scores on the Basic Competence Test (BCTEST). Tests in three subject areas (Chinese, English, and Mathematics) were studied using the data of test administrations from 2001 to 2003. The resulting scale scores for each test over the years were examined with respect to the graphs of the raw-to-scale score conversions, summary statistics, and measurement properties calculated based on the strong true score theory. The effects of adjustments in rounding and truncating and the gaps resulting from the conversions were explored. The findings provided sufficient evidence that employing the arcsine transformation stabilized the error variability along almost the entire scale. But the linear transformation produced the most satisfactory results regarding the gap sizes, and the normalizing approach produced similar distributional properties among the tests. This research has revealed useful information about the features of scales based on different transformation approaches.",
keywords = "Arcsine transformation, BCTEST, Linear transformation, Normalizing transformation, Scale score",
author = "Shun-Wen Chang",
year = "2006",
month = "1",
day = "1",
doi = "10.1177/0013164405285904",
language = "English",
volume = "66",
pages = "907--929",
journal = "Educational and Psychological Measurement",
issn = "0013-1644",
publisher = "SAGE Publications Inc.",
number = "6",

}

TY - JOUR

T1 - Methods in scaling the basic competence test

AU - Chang, Shun-Wen

PY - 2006/1/1

Y1 - 2006/1/1

N2 - This study evaluates the effects of employing the linear, normalizing, and arcsine transformation methods for constructing scale scores on the Basic Competence Test (BCTEST). Tests in three subject areas (Chinese, English, and Mathematics) were studied using the data of test administrations from 2001 to 2003. The resulting scale scores for each test over the years were examined with respect to the graphs of the raw-to-scale score conversions, summary statistics, and measurement properties calculated based on the strong true score theory. The effects of adjustments in rounding and truncating and the gaps resulting from the conversions were explored. The findings provided sufficient evidence that employing the arcsine transformation stabilized the error variability along almost the entire scale. But the linear transformation produced the most satisfactory results regarding the gap sizes, and the normalizing approach produced similar distributional properties among the tests. This research has revealed useful information about the features of scales based on different transformation approaches.

AB - This study evaluates the effects of employing the linear, normalizing, and arcsine transformation methods for constructing scale scores on the Basic Competence Test (BCTEST). Tests in three subject areas (Chinese, English, and Mathematics) were studied using the data of test administrations from 2001 to 2003. The resulting scale scores for each test over the years were examined with respect to the graphs of the raw-to-scale score conversions, summary statistics, and measurement properties calculated based on the strong true score theory. The effects of adjustments in rounding and truncating and the gaps resulting from the conversions were explored. The findings provided sufficient evidence that employing the arcsine transformation stabilized the error variability along almost the entire scale. But the linear transformation produced the most satisfactory results regarding the gap sizes, and the normalizing approach produced similar distributional properties among the tests. This research has revealed useful information about the features of scales based on different transformation approaches.

KW - Arcsine transformation

KW - BCTEST

KW - Linear transformation

KW - Normalizing transformation

KW - Scale score

UR - http://www.scopus.com/inward/record.url?scp=33750743713&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33750743713&partnerID=8YFLogxK

U2 - 10.1177/0013164405285904

DO - 10.1177/0013164405285904

M3 - Article

AN - SCOPUS:33750743713

VL - 66

SP - 907

EP - 929

JO - Educational and Psychological Measurement

JF - Educational and Psychological Measurement

SN - 0013-1644

IS - 6

ER -