Construction of the teacher situational judgment test

Tzu Yang Chao, Jia Li Huang, Yao-Ting Sung, Hui Ning Kuo, Ming Huei Shiu

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student’s thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded.7. Additionally, the Rasch model analysis showed that 90.67% of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between.47 and.74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.

Original languageEnglish
Pages (from-to)85-117
Number of pages33
JournalJournal of Research in Education Sciences
Volume61
Issue number2
DOIs
Publication statusPublished - 2016 Jun 1

Fingerprint

teacher
student teacher
bank
item analysis
student
model analysis
construct validity
analysis of variance
content analysis
evidence
education

Keywords

  • Item response theory
  • Qualitative analysis
  • Reliability
  • Teacher situational judgment test
  • Validity

ASJC Scopus subject areas

  • Education

Cite this

Construction of the teacher situational judgment test. / Chao, Tzu Yang; Huang, Jia Li; Sung, Yao-Ting; Kuo, Hui Ning; Shiu, Ming Huei.

In: Journal of Research in Education Sciences, Vol. 61, No. 2, 01.06.2016, p. 85-117.

Research output: Contribution to journalArticle

Chao, Tzu Yang ; Huang, Jia Li ; Sung, Yao-Ting ; Kuo, Hui Ning ; Shiu, Ming Huei. / Construction of the teacher situational judgment test. In: Journal of Research in Education Sciences. 2016 ; Vol. 61, No. 2. pp. 85-117.
@article{2480944c37464fc9802f306ac892af8e,
title = "Construction of the teacher situational judgment test",
abstract = "According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student’s thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded.7. Additionally, the Rasch model analysis showed that 90.67{\%} of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between.47 and.74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.",
keywords = "Item response theory, Qualitative analysis, Reliability, Teacher situational judgment test, Validity",
author = "Chao, {Tzu Yang} and Huang, {Jia Li} and Yao-Ting Sung and Kuo, {Hui Ning} and Shiu, {Ming Huei}",
year = "2016",
month = "6",
day = "1",
doi = "10.6209/JORIES.2016.61(2).04",
language = "English",
volume = "61",
pages = "85--117",
journal = "Journal of Research in Education Sciences",
issn = "2073-753X",
publisher = "國立臺灣師範大學",
number = "2",

}

TY - JOUR

T1 - Construction of the teacher situational judgment test

AU - Chao, Tzu Yang

AU - Huang, Jia Li

AU - Sung, Yao-Ting

AU - Kuo, Hui Ning

AU - Shiu, Ming Huei

PY - 2016/6/1

Y1 - 2016/6/1

N2 - According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student’s thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded.7. Additionally, the Rasch model analysis showed that 90.67% of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between.47 and.74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.

AB - According to the ideal of having multiple measures of teacher education, this study developed the teacher situational judgment test (TSJT) for selecting student teachers. The TSJS was based on the hypothesis that the more similar a student’s thinking is to senior and high-performing teachers, the more likely that student is to become an effective teacher. In Study 1, we collected data from 3,133 intern-teachers and teachers to determine the reliability and validity of the TSJT. On the basis of the analysis of the pilot test and formal test, we retained 75 items. Furthermore, the internal consistency reliability of three of the TSJT booklets was exceeded.7. Additionally, the Rasch model analysis showed that 90.67% of the TSJT items fit the Rasch model. In Study 2, we developed 150 new items to expand the TSJT item bank, and recruited 3,039 college students for an item analysis. Subsequently, we further retained 105 items for the TSJT item bank, totaling 180. The reliability of each booklet was between.47 and.74. For the test validity, the analysis of variances indicated that the TSJT scores of student teachers were significantly higher than those of nonstudent teachers. This provided known-group differences validity for the TSJT. Furthermore, in Study 2, we also conducted a qualitative content analysis to provide additional evidence of the construct validity. This present study discusses the development and practical applications of the TSJT.

KW - Item response theory

KW - Qualitative analysis

KW - Reliability

KW - Teacher situational judgment test

KW - Validity

UR - http://www.scopus.com/inward/record.url?scp=84979939274&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84979939274&partnerID=8YFLogxK

U2 - 10.6209/JORIES.2016.61(2).04

DO - 10.6209/JORIES.2016.61(2).04

M3 - Article

AN - SCOPUS:84979939274

VL - 61

SP - 85

EP - 117

JO - Journal of Research in Education Sciences

JF - Journal of Research in Education Sciences

SN - 2073-753X

IS - 2

ER -