Estimation of Generalized DINA Model with Order Restrictions

Chen Yu Hong, Yu Wei Chang, Rung-Ching Tsai

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Cognitive diagnostic models provide valuable information on whether a student has mastered each of the attributes a test intends to evaluate. Despite its generality, the generalized DINA model allows for the possibility of lower correct rates for students who master more attributes than those who know less. This paper considers the use of order-constrained parameter space of the G-DINA model to avoid such a counter-intuitive phenomenon and proposes two algorithms, the upward and downward methods, for parameter estimation. Through simulation studies, we compare the accuracy in parameter estimation and in classification of attribute patterns obtained from the proposed two algorithms and the current approach when the restricted parameter space is true. Our results show that the upward method performs the best among the three, and therefore it is recommended for estimation, regardless of the distribution of respondents’ attribute patterns, types of test items, and the sample size of the data.

Original languageEnglish
Pages (from-to)460-484
Number of pages25
JournalJournal of Classification
Volume33
Issue number3
DOIs
Publication statusPublished - 2016 Oct 1

Fingerprint

Order Restriction
Attribute
Students
Sample Size
Parameter Estimation
Restricted Parameter Space
Model Diagnostics
Model
Parameter Space
Intuitive
diagnostic
student
Simulation Study
simulation
Evaluate
Surveys and Questionnaires
Parameter estimation

Keywords

  • Classification of attribute patterns
  • Cognitive diagnostic model
  • G-DINA model
  • Order restrictions

ASJC Scopus subject areas

  • Mathematics (miscellaneous)
  • Psychology (miscellaneous)
  • Statistics, Probability and Uncertainty
  • Library and Information Sciences

Cite this

Estimation of Generalized DINA Model with Order Restrictions. / Hong, Chen Yu; Chang, Yu Wei; Tsai, Rung-Ching.

In: Journal of Classification, Vol. 33, No. 3, 01.10.2016, p. 460-484.

Research output: Contribution to journalArticle

Hong, Chen Yu ; Chang, Yu Wei ; Tsai, Rung-Ching. / Estimation of Generalized DINA Model with Order Restrictions. In: Journal of Classification. 2016 ; Vol. 33, No. 3. pp. 460-484.
@article{e303134f54af493fa10b9b955200e1b2,
title = "Estimation of Generalized DINA Model with Order Restrictions",
abstract = "Cognitive diagnostic models provide valuable information on whether a student has mastered each of the attributes a test intends to evaluate. Despite its generality, the generalized DINA model allows for the possibility of lower correct rates for students who master more attributes than those who know less. This paper considers the use of order-constrained parameter space of the G-DINA model to avoid such a counter-intuitive phenomenon and proposes two algorithms, the upward and downward methods, for parameter estimation. Through simulation studies, we compare the accuracy in parameter estimation and in classification of attribute patterns obtained from the proposed two algorithms and the current approach when the restricted parameter space is true. Our results show that the upward method performs the best among the three, and therefore it is recommended for estimation, regardless of the distribution of respondents’ attribute patterns, types of test items, and the sample size of the data.",
keywords = "Classification of attribute patterns, Cognitive diagnostic model, G-DINA model, Order restrictions",
author = "Hong, {Chen Yu} and Chang, {Yu Wei} and Rung-Ching Tsai",
year = "2016",
month = "10",
day = "1",
doi = "10.1007/s00357-016-9215-5",
language = "English",
volume = "33",
pages = "460--484",
journal = "Journal of Classification",
issn = "0176-4268",
publisher = "Springer New York",
number = "3",

}

TY - JOUR

T1 - Estimation of Generalized DINA Model with Order Restrictions

AU - Hong, Chen Yu

AU - Chang, Yu Wei

AU - Tsai, Rung-Ching

PY - 2016/10/1

Y1 - 2016/10/1

N2 - Cognitive diagnostic models provide valuable information on whether a student has mastered each of the attributes a test intends to evaluate. Despite its generality, the generalized DINA model allows for the possibility of lower correct rates for students who master more attributes than those who know less. This paper considers the use of order-constrained parameter space of the G-DINA model to avoid such a counter-intuitive phenomenon and proposes two algorithms, the upward and downward methods, for parameter estimation. Through simulation studies, we compare the accuracy in parameter estimation and in classification of attribute patterns obtained from the proposed two algorithms and the current approach when the restricted parameter space is true. Our results show that the upward method performs the best among the three, and therefore it is recommended for estimation, regardless of the distribution of respondents’ attribute patterns, types of test items, and the sample size of the data.

AB - Cognitive diagnostic models provide valuable information on whether a student has mastered each of the attributes a test intends to evaluate. Despite its generality, the generalized DINA model allows for the possibility of lower correct rates for students who master more attributes than those who know less. This paper considers the use of order-constrained parameter space of the G-DINA model to avoid such a counter-intuitive phenomenon and proposes two algorithms, the upward and downward methods, for parameter estimation. Through simulation studies, we compare the accuracy in parameter estimation and in classification of attribute patterns obtained from the proposed two algorithms and the current approach when the restricted parameter space is true. Our results show that the upward method performs the best among the three, and therefore it is recommended for estimation, regardless of the distribution of respondents’ attribute patterns, types of test items, and the sample size of the data.

KW - Classification of attribute patterns

KW - Cognitive diagnostic model

KW - G-DINA model

KW - Order restrictions

UR - http://www.scopus.com/inward/record.url?scp=84994462168&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84994462168&partnerID=8YFLogxK

U2 - 10.1007/s00357-016-9215-5

DO - 10.1007/s00357-016-9215-5

M3 - Article

VL - 33

SP - 460

EP - 484

JO - Journal of Classification

JF - Journal of Classification

SN - 0176-4268

IS - 3

ER -