I am using CTT and IRT to analyse three different tests I gave to students. Applying CTT was straight forward, however using IRT was a bit confusing to me. I started by assessing the tests unidimensionality using the Prinicple component analysis in SPSS. The results obtained showed that each test is assessing more than one latent variable (I have been able to identify 4 or 5 components in each test). Then I decided to follow a different approach by examining a model-data fit for each test. Starting by fitting each test to different unidimensional and multidimensional IRT models to chose the best model and then obtain the difficulty index and discrimination index. In this case even If my test is not unidimensional I still could assess that a unidimensional model could fit my data better than a multidimensional model. I also could determine the number of dimensions that represent my data better.

My question is how reliable is my approach, and if the principle component analysis results in more than one dimension, and the model data fit shows that the unidimensional item response theory is the best fit, should we just assume that my test is unidimensional?

More Mona Nabil Demaidi's questions See All
Similar questions and discussions