The development of progress monitoring test of reading comprehension

Yi-Fen Su, Li Yu Hung, Po Hsi Chen, Hsin Yi Chen

Research output: Contribution to journalArticle

Abstract

The purpose of this study was to develop a set of equivalent tests for reading comprehension progress monitoring for grades four to six. The reading comprehension equivalent tests can also be used as tools for evaluating instructional effects of remedial intervention. In this test, there were six alternate-forms for each grade. Four testlets were included in each alternate-form. Each testlet had one passage and ten test items. The four passages in one alternate-form included one short narrative, one short expository, one long narrative, and one long expository texts. There were 200-300 characters in short passages, and 400-500 characters in long passages. The test items were designed to measure lexical access, literal comprehension, summarization, and inferential comprehension. There were forty items in total in one alternate-form. Regarding reliability, the Cronbach’s α coefficients and split-half coefficients of all alternate-forms were mostly above.80. Using “Reading Comprehension Screening Test for Elementary School Students-Version A” as criterion, the criterion validity coefficient were.67 (p <.001),.59 (p <.001),.75 (p <.001) for grades 4, 5, and 6 respectively. In addition, based on the data collected from six time-points in 2011 school year, the growth model analysis revealed that the reading comprehension abilities of the fourth, fifth, and sixth graders increased from the beginning to the end in one school year. In order for teachers to monitor students’ progress, this test provided not only the norm of percentile rank, but also the norm of ability value (theta score). Using the ability values between two time-points, a growth coefficient could be calculated. Several suggestions and one limitation for educational application were provided.

Original languageEnglish
Pages (from-to)558-580
Number of pages23
JournalBulletin of Educational Psychology
Volume49
Issue number4
DOIs
Publication statusPublished - 2018 Jun 1

Fingerprint

Reading
comprehension
monitoring
Aptitude
ability
Students
school grade
narrative
Growth
model analysis
school
elementary school
Values
student
teacher

Keywords

  • Ability value
  • Elementary school students
  • Equivalent test
  • Growth curve
  • Reading comprehension

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology

Cite this

The development of progress monitoring test of reading comprehension. / Su, Yi-Fen; Hung, Li Yu; Chen, Po Hsi; Chen, Hsin Yi.

In: Bulletin of Educational Psychology, Vol. 49, No. 4, 01.06.2018, p. 558-580.

Research output: Contribution to journalArticle

Su, Yi-Fen ; Hung, Li Yu ; Chen, Po Hsi ; Chen, Hsin Yi. / The development of progress monitoring test of reading comprehension. In: Bulletin of Educational Psychology. 2018 ; Vol. 49, No. 4. pp. 558-580.
@article{c640636807ab410ab2f367f01071c278,
title = "The development of progress monitoring test of reading comprehension",
abstract = "The purpose of this study was to develop a set of equivalent tests for reading comprehension progress monitoring for grades four to six. The reading comprehension equivalent tests can also be used as tools for evaluating instructional effects of remedial intervention. In this test, there were six alternate-forms for each grade. Four testlets were included in each alternate-form. Each testlet had one passage and ten test items. The four passages in one alternate-form included one short narrative, one short expository, one long narrative, and one long expository texts. There were 200-300 characters in short passages, and 400-500 characters in long passages. The test items were designed to measure lexical access, literal comprehension, summarization, and inferential comprehension. There were forty items in total in one alternate-form. Regarding reliability, the Cronbach’s α coefficients and split-half coefficients of all alternate-forms were mostly above.80. Using “Reading Comprehension Screening Test for Elementary School Students-Version A” as criterion, the criterion validity coefficient were.67 (p <.001),.59 (p <.001),.75 (p <.001) for grades 4, 5, and 6 respectively. In addition, based on the data collected from six time-points in 2011 school year, the growth model analysis revealed that the reading comprehension abilities of the fourth, fifth, and sixth graders increased from the beginning to the end in one school year. In order for teachers to monitor students’ progress, this test provided not only the norm of percentile rank, but also the norm of ability value (theta score). Using the ability values between two time-points, a growth coefficient could be calculated. Several suggestions and one limitation for educational application were provided.",
keywords = "Ability value, Elementary school students, Equivalent test, Growth curve, Reading comprehension",
author = "Yi-Fen Su and Hung, {Li Yu} and Chen, {Po Hsi} and Chen, {Hsin Yi}",
year = "2018",
month = "6",
day = "1",
doi = "10.6251/BEP.201806_49(4).0003",
language = "English",
volume = "49",
pages = "558--580",
journal = "Bulletin of Educational Psychology",
issn = "1011-5714",
publisher = "臺灣師範大學教育心理與輔導學系",
number = "4",

}

TY - JOUR

T1 - The development of progress monitoring test of reading comprehension

AU - Su, Yi-Fen

AU - Hung, Li Yu

AU - Chen, Po Hsi

AU - Chen, Hsin Yi

PY - 2018/6/1

Y1 - 2018/6/1

N2 - The purpose of this study was to develop a set of equivalent tests for reading comprehension progress monitoring for grades four to six. The reading comprehension equivalent tests can also be used as tools for evaluating instructional effects of remedial intervention. In this test, there were six alternate-forms for each grade. Four testlets were included in each alternate-form. Each testlet had one passage and ten test items. The four passages in one alternate-form included one short narrative, one short expository, one long narrative, and one long expository texts. There were 200-300 characters in short passages, and 400-500 characters in long passages. The test items were designed to measure lexical access, literal comprehension, summarization, and inferential comprehension. There were forty items in total in one alternate-form. Regarding reliability, the Cronbach’s α coefficients and split-half coefficients of all alternate-forms were mostly above.80. Using “Reading Comprehension Screening Test for Elementary School Students-Version A” as criterion, the criterion validity coefficient were.67 (p <.001),.59 (p <.001),.75 (p <.001) for grades 4, 5, and 6 respectively. In addition, based on the data collected from six time-points in 2011 school year, the growth model analysis revealed that the reading comprehension abilities of the fourth, fifth, and sixth graders increased from the beginning to the end in one school year. In order for teachers to monitor students’ progress, this test provided not only the norm of percentile rank, but also the norm of ability value (theta score). Using the ability values between two time-points, a growth coefficient could be calculated. Several suggestions and one limitation for educational application were provided.

AB - The purpose of this study was to develop a set of equivalent tests for reading comprehension progress monitoring for grades four to six. The reading comprehension equivalent tests can also be used as tools for evaluating instructional effects of remedial intervention. In this test, there were six alternate-forms for each grade. Four testlets were included in each alternate-form. Each testlet had one passage and ten test items. The four passages in one alternate-form included one short narrative, one short expository, one long narrative, and one long expository texts. There were 200-300 characters in short passages, and 400-500 characters in long passages. The test items were designed to measure lexical access, literal comprehension, summarization, and inferential comprehension. There were forty items in total in one alternate-form. Regarding reliability, the Cronbach’s α coefficients and split-half coefficients of all alternate-forms were mostly above.80. Using “Reading Comprehension Screening Test for Elementary School Students-Version A” as criterion, the criterion validity coefficient were.67 (p <.001),.59 (p <.001),.75 (p <.001) for grades 4, 5, and 6 respectively. In addition, based on the data collected from six time-points in 2011 school year, the growth model analysis revealed that the reading comprehension abilities of the fourth, fifth, and sixth graders increased from the beginning to the end in one school year. In order for teachers to monitor students’ progress, this test provided not only the norm of percentile rank, but also the norm of ability value (theta score). Using the ability values between two time-points, a growth coefficient could be calculated. Several suggestions and one limitation for educational application were provided.

KW - Ability value

KW - Elementary school students

KW - Equivalent test

KW - Growth curve

KW - Reading comprehension

UR - http://www.scopus.com/inward/record.url?scp=85052228188&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85052228188&partnerID=8YFLogxK

U2 - 10.6251/BEP.201806_49(4).0003

DO - 10.6251/BEP.201806_49(4).0003

M3 - Article

VL - 49

SP - 558

EP - 580

JO - Bulletin of Educational Psychology

JF - Bulletin of Educational Psychology

SN - 1011-5714

IS - 4

ER -