The robustness of test statistics to nonnormality and specification error in confirmatory factor analysis

Monte Carlo computer simulations were used to investigate the performance of three XY test statistics in confirmatory factor analysis (CFA). Normal theory maximum likelihood chi(2) (ML), Browne's asymptotic distribution free chi(2) (ADF), and the Satorra-Bentler rescaled psi(2) (SB) were examined under varying conditions of sample size, model specification, and multivariate distribution, For properly specified models. ML and SB showed no evidence of bias under normal distributions across ail sample sizes, whereas ADF was biased at ail but the largest sample sizes. ML was increasingly overestimated with increasing nonnormality, but both SB (at all sample sizes) and ADF (only at large sample sizes) showed no evidence of bias. For misspecified models, ML was again inflated with increasing nonnormality, but both SB and ADF were underestimated with increasing nonnormality. It appears that the power of the SB and ADF test statistics to detect a model misspecification is attenuated given nonnormally distributed data.