The Effects of Q-matrix Misspecification on Parameter Estimates and Misclassification Rates in the DINA Model

Paper Title:
The Effects of Q-matrix Misspecification on Parameter Estimates and Misclassification Rates in the DINA Model
Journal Link:
http://epm.sagepub.com/cgi/content/abstract/68/1/78
Abstract:
This article reports a study that investigated the effects of Q-matrix misspecifications on parameter estimates and misclassification rates for the deterministic-input, noisy “and” gate (DINA) model, which is a restricted latent class model for multiple classifications of respondents that can be useful for cognitively motivated diagnostic assessment. In this study, a Q-matrix for an assessment mapping all 15 possible attribute patterns based on four independent attributes was misspecified by changing one “0” or “1” for each item. This was done in a way that ensured that certain attribute combinations were completely deleted from the Q-matrix, and certain incorrect dependency relationships between attributes were represented. Results showed clear effects that included an item specific overestimation of slipping parameters when attributes were deleted from the Q-matrix, an item-specific overestimation of guessing parameters when attributes were added to the Q-matrix, and high misclassification rates for attribute classes that contained attribute combinations that were deleted from the Q-matrix.
Reference:
Rupp, A., & Templin, J. (2008). The effects of Q-matrix misspecification on parameter estimates and misclassification rates in the DINA model. Educational and Psychological Measurement, 68, 78-96.