4.4 Article

The Relationship Between the Standardized Root Mean Square Residual and Model Misspecification in Factor Analysis Models

期刊

MULTIVARIATE BEHAVIORAL RESEARCH
卷 53, 期 5, 页码 676-694

出版社

ROUTLEDGE JOURNALS, TAYLOR & FRANCIS LTD
DOI: 10.1080/00273171.2018.1476221

关键词

Structural equation modeling (SEM); standardized root mean square residual (SRMR); close fit

资金

  1. National Science Foundation [SES-1659936]

向作者/读者索取更多资源

We argue that the definition of close fitting models should embody the notion of substantially ignorable misspecifications (SIM). A SIM model is a misspecified model that might be selected, based on parsimony, over the true model should knowledge of the true model be available. Because in applications the true model (i.e., the data generating mechanism) is unknown, we investigate the relationship between the population standardized root mean square residual (SRMR) values and various model misspecifications in factor analysis models to better understand the magnitudes of the SRMR. Summary effect sizes of misfit such as the SRMR are necessarily insensitive to some non-ignorable localized misspecifications (i.e., the presence of a few large residual correlations in large models). Localized misspecifications may be identified by examining the largest standardized residual covariance. Based on the findings, our population reference values for close fit are based on a two-index strategy: (1) largest absolute value of standardized residual covariance <= 0.10, and (2) SRMR <= 0.05x the average R-2 of the manifest variables; for acceptable fit our values are 0.15 and 0.10x, respectively.

作者

我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。

评论

主要评分

4.4
评分不足

次要评分

新颖性
-
重要性
-
科学严谨性
-
评价这篇论文

推荐

Article Mathematics, Interdisciplinary Applications

Evaluating SEM Model Fit with Small Degrees of Freedom

Dexin Shi, Christine DiStefano, Alberto Maydeu-Olivares, Taehun Lee

Summary: Research has shown that the performance of root mean square error of approximation (RMSEA) is suboptimal for assessing structural equation models with small degrees of freedom (df). This study compares the performance of standardized root mean square residual (SRMR) and comparative fit index (CFI) in small df models with different factor loadings, sample sizes, and model misspecifications. The results indicate that in comparison to RMSEA, SRMR and CFI are less influenced by df and can provide more useful information in differentiating models with varying degrees of misfit. Researchers are advised to exercise caution when interpreting RMSEA for models with small df and rely more on SRMR and CFI.

MULTIVARIATE BEHAVIORAL RESEARCH (2022)

Article Psychology, Educational

A Monte Carlo Study of Confidence Interval Methods for Generalizability Coefficient

Zhehan Jiang, Mark Raymond, Christine DiStefano, Dexin Shi, Ren Liu, Junhua Sun

Summary: Computing confidence intervals around generalizability coefficients is a challenging task in generalizability theory, with small sample sizes adding to the difficulty. This research compared four LMM-based methods and found that a Bootstrap technique called parametric methods with spherical random effects consistently produced more accurate confidence intervals. Recommendations were made for including confidence intervals with point estimates when computing generalizability coefficients.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2022)

Article Psychology, Educational

Poisson Diagnostic Classification Models: A Framework and an Exploratory Example

Ren Liu, Haiyan Liu, Dexin Shi, Zhehan Jiang

Summary: This article discusses the use of assessments with small, similar, or repetitive tasks in educational, neurocognitive, and psychological contexts. It extends the Rasch Poisson counts model (RPCM) into diagnostic classification models (DCMs) by applying a Poisson distribution. A framework of Poisson DCMs is proposed and demonstrated using an operational dataset, with recommendations for future research provided.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2022)

Article Mathematics, Interdisciplinary Applications

Assessing Cutoff Values of SEM Fit Indices: Advantages of the Unbiased SRMR Index and Its Cutoff Criterion Based on Communality

Carmen Ximenez, Alberto Maydeu-Olivares, Dexin Shi, Javier Revuelta

Summary: The behavior of fit indices in CFA models depends on factors such as model size, sample size, and measurement quality. Biased estimators of fit indices result in unstable behavior with changing sample size, making it difficult to establish cutoff values. Unbiased estimators, on the other hand, match the behavior of population parameters and depend on the average R-2 of observed variables and model size.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2022)

Article Psychology, Educational

Is the Area Under Curve Appropriate for Evaluating the Fit of Psychometric Models?

Yuting Han, Jihong Zhang, Zhehan Jiang, Dexin Shi

Summary: This article explores the behavior of AUC in fitting IRT models and investigates its appropriateness through simulation experiments under different conditions. The results show that AUC has advantages in certain cases when fitting IRT models, but disadvantages are obvious when the true model is unidimensional.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2023)

Article Mathematics, Interdisciplinary Applications

Asymptotic is Better than Bollen-Stine Bootstrapping to Assess Model Fit: The Effect of Model Size on the Chi-Square Statistic

Raul Correa Ferraz, Alberto Maydeu-Olivares, Dexin Shi

Summary: Previous research has shown that bootstrapped p-values for the chi-square test of model fit are accurate for small models but not as accurate for small sample sizes. As the number of variables increases, bootstrapped p-values may become too conservative and less accurate. Therefore, they may not be recommended for assessing model fit.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2022)

Article Psychology, Educational

Examining the Validity and Measurement Invariance Across Gender and Race of the Implicit Thoughts, Emotion, and Behavior Questionnaire

Xu Jiang, Netanel Paley, Dexin Shi

Summary: This study analyzed the psychometric properties of the ITEB-Q questionnaire and found good factor structure and measurement invariance in a sample of adolescents, with female adolescents scoring lower on emotion and thought than male counterparts, and Black adolescents scoring higher across the three subscales than White adolescents.

SCHOOL PSYCHOLOGY (2022)

Article Psychology, Educational

The NEAT Equating Via Chaining Random Forests in the Context of Small Sample Sizes: A Machine-Learning Method

Zhehan Jiang, Yuting Han, Lingling Xu, Dexin Shi, Ren Liu, Jinying Ouyang, Fen Cai

Summary: This study proposes a machine learning-based imputation technique called chaining random forests (CRF) for equating tasks within the nonequivalent groups with anchor test (NEAT) design. Through a simulation study, the equating performance of various methods, including traditional equating methods and CRF-based methods, is compared. The findings indicate that CRF-based methods yield more accurate equated scores in short-length tests with small samples.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2023)

Editorial Material Mathematics, Interdisciplinary Applications

Using Mixture Factor Analysis to Counter Faking

Raul C. Ferraz, Alberto Maydeu-Olivares

MULTIVARIATE BEHAVIORAL RESEARCH (2023)

Article Mathematics, Interdisciplinary Applications

The Effect of Model Size on the Root Mean Square Error of Approximation (RMSEA): The Nonnormal Case

Yunhang Yin, Dexin Shi, Amanda J. Fairchild

Summary: This study aimed to investigate the effect of model size on the root mean square error of approximation (RMSEA) under nonnormal data, and compared the performance of three methods for computing RMSEA. The results suggested that the normal theory method should not be used under nonnormal data, and researchers should consider using either the BSL or the Lai method. The Lai method is recommended for fitting very large models under nonnormal data.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2023)

Article Psychology, Educational

Evaluating Close Fit in Ordinal Factor Analysis Models With Multiply Imputed Data

Dexin Shi, Bo Zhang, Ren Liu, Zhehan Jiang

Summary: This paper introduces the methods of using multiple imputation (MI) technique to handle missing data in ordinal factor analysis models, and proposes the use of standardized root mean squared residual (SRMR) and root mean square error of approximation (RMSEA) to assess the fit of the models. Simulation results show that the proposed methods can provide accurate point and interval estimates for both SRMR and RMSEA, especially in conditions with larger sample sizes, less missing data, more response categories, and higher degrees of misfit. Implications and recommendations based on the findings are discussed.

EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT (2023)

Article Mathematics, Interdisciplinary Applications

Variable Selection for Mediators under a Bayesian Mediation Model

Dingjing Shi, Dexin Shi, Amanda J. Fairchild

Summary: This study proposes a Bayesian variable selection approach for exploratory mediation analysis, which can select mediators and quantify their posterior probabilities. Monte Carlo simulation studies show that the method has high statistical power in selecting mediating effects and low Type I error rate in excluding null effects. The proposed method offers a unique gain by estimating the probability of a mediating effect through the posterior distribution and quantifying the variable's influence on a continuum scale, which conventional p-value-based mediation methods and the LASSO method lack.

STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL (2023)

Article Psychology, Clinical

Factor Structure of the Teacher Strengths and Difficulties Questionnaire in a Large Community-Based Sample: An Investigation of Alternative Measurement Models

Bethany A. A. Bell, Stephen G. G. Taylor, Alex M. M. Roberts, Dexin Shi, Katelynn Burgess, Caroline Hough, Kate Flory

Summary: The Strengths and Difficulties Questionnaire (SDQ) is commonly used to assess behavioral and emotional symptoms and strengths among children and adolescents. However, its underlying factor structure remains a topic of debate. Using data from a large epidemiologic study in the Southeastern United States, we found support for the original five-factor model of the SDQ when using teacher-reported data from both elementary and secondary school children.

ASSESSMENT (2023)

暂无数据