The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study

Hsien Yuan Hsu*, Jr Hung Lin, Oi Man Kwok, Sandra Acosta, Victor Willson

*此作品的通信作者

研究成果: 雜誌貢獻期刊論文同行評審

16 引文 斯高帕斯(Scopus)

摘要

Several researchers have recommended that level-specific fit indices should be applied to detect the lack of model fit at any level in multilevel structural equation models. Although we concur with their view, we note that these studies did not sufficiently consider the impact of intraclass correlation (ICC) on the performance of level-specific fit indices. Our study proposed to fill this gap in the methodological literature. A Monte Carlo study was conducted to investigate the performance of (a) level-specific fit indices derived by a partially saturated model method (e.g., (Formula presented.) and (Formula presented.)) and (b) (Formula presented.) and (Formula presented.) in terms of their performance in multilevel structural equation models across varying ICCs. The design factors included intraclass correlation (ICC: ICC1 = 0.091 to ICC6 = 0.500), numbers of groups in between-level models (NG: 50, 100, 200, and 1,000), group size (GS: 30, 50, and 100), and type of misspecification (no misspecification, between-level misspecification, and within-level misspecification). Our simulation findings raise a concern regarding the performance of between-level-specific partial saturated fit indices in low ICC conditions: the performances of both (Formula presented.) and (Formula presented.) were more influenced by ICC compared with (Formula presented.) and SRMRB. However, when traditional cutoff values (RMSEA≤ 0.06; CFI, TLI≥ 0.95; SRMR≤ 0.08) were applied, (Formula presented.) and (Formula presented.) were still able to detect misspecified between-level models even when ICC was as low as 0.091 (ICC1). On the other hand, both (Formula presented.) and (Formula presented.) were not recommended under low ICC conditions.

原文英語
頁(從 - 到)5-31
頁數27
期刊Educational and Psychological Measurement
77
發行號1
DOIs
出版狀態已發佈 - 2017 一月 1
對外發佈

ASJC Scopus subject areas

  • 教育
  • 發展與教育心理學
  • 應用心理學
  • 應用數學

指紋

深入研究「The Impact of Intraclass Correlation on the Effectiveness of Level-Specific Fit Indices in Multilevel Structural Equation Modeling: A Monte Carlo Study」主題。共同形成了獨特的指紋。

引用此