Substitution, proration, or a retest? the optimal strategy when standard administration of the WPPSI-IV is infeasible

Jianjun Zhu, Tommie G. Cayton, Hsinyi Chen

Research output: Contribution to journalArticle

Abstract

Administration following a standard procedure is undoubtedly the ultimate goal of assessment. Practitioners face the challenge of unexpected events interrupting a formal evaluation, substitution, proration, or a retest, which may be used as alternative strategies to perform estimations. Such nonstandardized estimation strategies have introduced additional measurement errors because the manual reports only 1 set of norms, which are derived following the standard testing procedure. Thus, mismatching with norms is the root cause of additional errors introduced when applying these alternative strategies. This study examined the additional measurement errors introduced in using normative and clinical samples, as well as a retest sample of the 3 estimation approaches in the Wechsler Primary Preschool Scale for Children-Fourth Edition (WPPSI-IV). Results revealed that substituting, prorating, or retesting 1 of 6 core subtests for the Full Scale IQ increased the SEM by 0.61 to 1.92 score points (20-64%), generating wider confidence intervals (CIs) by ±1.2 to ±3.8 IQ points and misclassifications as high as 22%. Furthermore, substituting 1 missing subtest for the Verbal Comprehension Index or Processing Speed Index resulted in an additional 4.27 to 5.24 score point increase in SEM (79.7-132.5%), creating wider CIs by ± 8.37 to ± 10.27 IQ points and misclassifications as high as 35-44%. We remind practitioners to be cautious about the various increases in error rate resulting from such applications and to avoid introducing unnecessary additional errors when possible. Under circumstances when alternative procedures are considered a must, current work provides information for making evidence-based decision.

Original languageEnglish
Pages (from-to)1441-1451
Number of pages11
JournalPsychological Assessment
Volume28
Issue number11
DOIs
Publication statusPublished - 2016 Nov 1

Fingerprint

Confidence Intervals
Preschool Children

Keywords

  • Composite
  • Full scale IQ (FSIQ)
  • Scoring
  • Wechsler primary preschool scale for children-fourth edition (WPPSI-IV)

ASJC Scopus subject areas

  • Clinical Psychology
  • Psychiatry and Mental health

Cite this

Substitution, proration, or a retest? the optimal strategy when standard administration of the WPPSI-IV is infeasible. / Zhu, Jianjun; Cayton, Tommie G.; Chen, Hsinyi.

In: Psychological Assessment, Vol. 28, No. 11, 01.11.2016, p. 1441-1451.

Research output: Contribution to journalArticle

@article{1f93c6f7b7d640a4a6807d78f00fc789,
title = "Substitution, proration, or a retest? the optimal strategy when standard administration of the WPPSI-IV is infeasible",
abstract = "Administration following a standard procedure is undoubtedly the ultimate goal of assessment. Practitioners face the challenge of unexpected events interrupting a formal evaluation, substitution, proration, or a retest, which may be used as alternative strategies to perform estimations. Such nonstandardized estimation strategies have introduced additional measurement errors because the manual reports only 1 set of norms, which are derived following the standard testing procedure. Thus, mismatching with norms is the root cause of additional errors introduced when applying these alternative strategies. This study examined the additional measurement errors introduced in using normative and clinical samples, as well as a retest sample of the 3 estimation approaches in the Wechsler Primary Preschool Scale for Children-Fourth Edition (WPPSI-IV). Results revealed that substituting, prorating, or retesting 1 of 6 core subtests for the Full Scale IQ increased the SEM by 0.61 to 1.92 score points (20-64{\%}), generating wider confidence intervals (CIs) by ±1.2 to ±3.8 IQ points and misclassifications as high as 22{\%}. Furthermore, substituting 1 missing subtest for the Verbal Comprehension Index or Processing Speed Index resulted in an additional 4.27 to 5.24 score point increase in SEM (79.7-132.5{\%}), creating wider CIs by ± 8.37 to ± 10.27 IQ points and misclassifications as high as 35-44{\%}. We remind practitioners to be cautious about the various increases in error rate resulting from such applications and to avoid introducing unnecessary additional errors when possible. Under circumstances when alternative procedures are considered a must, current work provides information for making evidence-based decision.",
keywords = "Composite, Full scale IQ (FSIQ), Scoring, Wechsler primary preschool scale for children-fourth edition (WPPSI-IV)",
author = "Jianjun Zhu and Cayton, {Tommie G.} and Hsinyi Chen",
year = "2016",
month = "11",
day = "1",
doi = "10.1037/pas0000272",
language = "English",
volume = "28",
pages = "1441--1451",
journal = "Psychological Assessment",
issn = "1040-3590",
publisher = "American Psychological Association Inc.",
number = "11",

}

TY - JOUR

T1 - Substitution, proration, or a retest? the optimal strategy when standard administration of the WPPSI-IV is infeasible

AU - Zhu, Jianjun

AU - Cayton, Tommie G.

AU - Chen, Hsinyi

PY - 2016/11/1

Y1 - 2016/11/1

N2 - Administration following a standard procedure is undoubtedly the ultimate goal of assessment. Practitioners face the challenge of unexpected events interrupting a formal evaluation, substitution, proration, or a retest, which may be used as alternative strategies to perform estimations. Such nonstandardized estimation strategies have introduced additional measurement errors because the manual reports only 1 set of norms, which are derived following the standard testing procedure. Thus, mismatching with norms is the root cause of additional errors introduced when applying these alternative strategies. This study examined the additional measurement errors introduced in using normative and clinical samples, as well as a retest sample of the 3 estimation approaches in the Wechsler Primary Preschool Scale for Children-Fourth Edition (WPPSI-IV). Results revealed that substituting, prorating, or retesting 1 of 6 core subtests for the Full Scale IQ increased the SEM by 0.61 to 1.92 score points (20-64%), generating wider confidence intervals (CIs) by ±1.2 to ±3.8 IQ points and misclassifications as high as 22%. Furthermore, substituting 1 missing subtest for the Verbal Comprehension Index or Processing Speed Index resulted in an additional 4.27 to 5.24 score point increase in SEM (79.7-132.5%), creating wider CIs by ± 8.37 to ± 10.27 IQ points and misclassifications as high as 35-44%. We remind practitioners to be cautious about the various increases in error rate resulting from such applications and to avoid introducing unnecessary additional errors when possible. Under circumstances when alternative procedures are considered a must, current work provides information for making evidence-based decision.

AB - Administration following a standard procedure is undoubtedly the ultimate goal of assessment. Practitioners face the challenge of unexpected events interrupting a formal evaluation, substitution, proration, or a retest, which may be used as alternative strategies to perform estimations. Such nonstandardized estimation strategies have introduced additional measurement errors because the manual reports only 1 set of norms, which are derived following the standard testing procedure. Thus, mismatching with norms is the root cause of additional errors introduced when applying these alternative strategies. This study examined the additional measurement errors introduced in using normative and clinical samples, as well as a retest sample of the 3 estimation approaches in the Wechsler Primary Preschool Scale for Children-Fourth Edition (WPPSI-IV). Results revealed that substituting, prorating, or retesting 1 of 6 core subtests for the Full Scale IQ increased the SEM by 0.61 to 1.92 score points (20-64%), generating wider confidence intervals (CIs) by ±1.2 to ±3.8 IQ points and misclassifications as high as 22%. Furthermore, substituting 1 missing subtest for the Verbal Comprehension Index or Processing Speed Index resulted in an additional 4.27 to 5.24 score point increase in SEM (79.7-132.5%), creating wider CIs by ± 8.37 to ± 10.27 IQ points and misclassifications as high as 35-44%. We remind practitioners to be cautious about the various increases in error rate resulting from such applications and to avoid introducing unnecessary additional errors when possible. Under circumstances when alternative procedures are considered a must, current work provides information for making evidence-based decision.

KW - Composite

KW - Full scale IQ (FSIQ)

KW - Scoring

KW - Wechsler primary preschool scale for children-fourth edition (WPPSI-IV)

UR - http://www.scopus.com/inward/record.url?scp=84954348454&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84954348454&partnerID=8YFLogxK

U2 - 10.1037/pas0000272

DO - 10.1037/pas0000272

M3 - Article

C2 - 26765926

AN - SCOPUS:84954348454

VL - 28

SP - 1441

EP - 1451

JO - Psychological Assessment

JF - Psychological Assessment

SN - 1040-3590

IS - 11

ER -