An estimation of the design effect for the two-stage stratified cluster sampling design

Tsung Hau Jen, Hak Ping Tam, Margaret Wu

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Most large-scale educational surveys utilize a multi-stage stratified cluster sampling design. Past findings revealed that the standard errors of Taiwan students' mean performances were slightly larger than other countries'. In response to the request by the institute in charge of TIMSS sampling, this study was launched to derive a formula that could estimate the standard error of population mean prior to conducting a two-stage stratified cluster sampling design. This formula could then be used to select an optimal stratification framework that could reduce the size of standard error to an acceptable level. Its validity was investigated in three subsequent studies. In the first study, standard errors for 30 TIMSS 2007 participating countries were estimated according to the newly derived formula as well as by the jackknife replication. The correlation between the two sets of standard errors amounted to 0.98. The second study investigated the practicality of using the new formula in addition to auxiliary variables for predicting standard errors on the data of 29 countries that participated in both TIMSS 2003 and 2007. The third study explored the relationship between the number of stratum and the standard errors under a two-stage stratified cluster sampling design when the auxiliary variables for stratification were continuous. This paper closed by suggesting a four-step procedure to facilitate researchers in estimating standard errors of means during the planning stage of sampling design.

Original languageEnglish
Pages (from-to)33-65
Number of pages33
JournalJournal of Research in Education Sciences
Volume56
Issue number1
Publication statusPublished - 2011 Mar

Fingerprint

social stratum
Taiwan
planning
performance
student

Keywords

  • Complex survey design
  • Large-scale assessment
  • Planning sampling framework
  • Sampling error reduction
  • Variance estimation

ASJC Scopus subject areas

  • Education

Cite this

An estimation of the design effect for the two-stage stratified cluster sampling design. / Jen, Tsung Hau; Tam, Hak Ping; Wu, Margaret.

In: Journal of Research in Education Sciences, Vol. 56, No. 1, 03.2011, p. 33-65.

Research output: Contribution to journalArticle

@article{ad3a5b7f840d48a5828e0176f68c227d,
title = "An estimation of the design effect for the two-stage stratified cluster sampling design",
abstract = "Most large-scale educational surveys utilize a multi-stage stratified cluster sampling design. Past findings revealed that the standard errors of Taiwan students' mean performances were slightly larger than other countries'. In response to the request by the institute in charge of TIMSS sampling, this study was launched to derive a formula that could estimate the standard error of population mean prior to conducting a two-stage stratified cluster sampling design. This formula could then be used to select an optimal stratification framework that could reduce the size of standard error to an acceptable level. Its validity was investigated in three subsequent studies. In the first study, standard errors for 30 TIMSS 2007 participating countries were estimated according to the newly derived formula as well as by the jackknife replication. The correlation between the two sets of standard errors amounted to 0.98. The second study investigated the practicality of using the new formula in addition to auxiliary variables for predicting standard errors on the data of 29 countries that participated in both TIMSS 2003 and 2007. The third study explored the relationship between the number of stratum and the standard errors under a two-stage stratified cluster sampling design when the auxiliary variables for stratification were continuous. This paper closed by suggesting a four-step procedure to facilitate researchers in estimating standard errors of means during the planning stage of sampling design.",
keywords = "Complex survey design, Large-scale assessment, Planning sampling framework, Sampling error reduction, Variance estimation",
author = "Jen, {Tsung Hau} and Tam, {Hak Ping} and Margaret Wu",
year = "2011",
month = "3",
language = "English",
volume = "56",
pages = "33--65",
journal = "Journal of Research in Education Sciences",
issn = "2073-753X",
publisher = "國立臺灣師範大學",
number = "1",

}

TY - JOUR

T1 - An estimation of the design effect for the two-stage stratified cluster sampling design

AU - Jen, Tsung Hau

AU - Tam, Hak Ping

AU - Wu, Margaret

PY - 2011/3

Y1 - 2011/3

N2 - Most large-scale educational surveys utilize a multi-stage stratified cluster sampling design. Past findings revealed that the standard errors of Taiwan students' mean performances were slightly larger than other countries'. In response to the request by the institute in charge of TIMSS sampling, this study was launched to derive a formula that could estimate the standard error of population mean prior to conducting a two-stage stratified cluster sampling design. This formula could then be used to select an optimal stratification framework that could reduce the size of standard error to an acceptable level. Its validity was investigated in three subsequent studies. In the first study, standard errors for 30 TIMSS 2007 participating countries were estimated according to the newly derived formula as well as by the jackknife replication. The correlation between the two sets of standard errors amounted to 0.98. The second study investigated the practicality of using the new formula in addition to auxiliary variables for predicting standard errors on the data of 29 countries that participated in both TIMSS 2003 and 2007. The third study explored the relationship between the number of stratum and the standard errors under a two-stage stratified cluster sampling design when the auxiliary variables for stratification were continuous. This paper closed by suggesting a four-step procedure to facilitate researchers in estimating standard errors of means during the planning stage of sampling design.

AB - Most large-scale educational surveys utilize a multi-stage stratified cluster sampling design. Past findings revealed that the standard errors of Taiwan students' mean performances were slightly larger than other countries'. In response to the request by the institute in charge of TIMSS sampling, this study was launched to derive a formula that could estimate the standard error of population mean prior to conducting a two-stage stratified cluster sampling design. This formula could then be used to select an optimal stratification framework that could reduce the size of standard error to an acceptable level. Its validity was investigated in three subsequent studies. In the first study, standard errors for 30 TIMSS 2007 participating countries were estimated according to the newly derived formula as well as by the jackknife replication. The correlation between the two sets of standard errors amounted to 0.98. The second study investigated the practicality of using the new formula in addition to auxiliary variables for predicting standard errors on the data of 29 countries that participated in both TIMSS 2003 and 2007. The third study explored the relationship between the number of stratum and the standard errors under a two-stage stratified cluster sampling design when the auxiliary variables for stratification were continuous. This paper closed by suggesting a four-step procedure to facilitate researchers in estimating standard errors of means during the planning stage of sampling design.

KW - Complex survey design

KW - Large-scale assessment

KW - Planning sampling framework

KW - Sampling error reduction

KW - Variance estimation

UR - http://www.scopus.com/inward/record.url?scp=84965180415&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84965180415&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84965180415

VL - 56

SP - 33

EP - 65

JO - Journal of Research in Education Sciences

JF - Journal of Research in Education Sciences

SN - 2073-753X

IS - 1

ER -