Dear colleagues,
I would like to ask for your advice on testing the criterion-related validity of the measuring instrument. It is common practice to test this type of validity by correlation with other relevant variables. However, I received a comment from a reviewer that if I calculate only Pearson correlation, the measurement error is not taken into account and the correlation is underestimated.
He said I should use reliability-corrected correlations or report the correlation by fitting an SEM model where the three factors correlated with the external variables (my measurement instrument is a simple structure with three correlated factors).
Could I ask your advice on how to calculate this? Personally, I do not know how I should proceed. Alternatively, what is your opinion?
Thank you very much.
According to my understanding, you are trying to check the reliability through SEM using AMOS; for that, you can check these two resources.
https://youtu.be/leKaHPIPpDs?si=WdcY4fTiiVjt4w5c
https://www.jstor.org/stable/pdf/23033534.pdf
I hope it helps :)
The reviewer is correct, a SEM analysis in R would do the trick (I have no idea exactly how your model looks but this should do the trick);
model
Thank you both for your reply. I would like to clarify that I use SPSS, Stata and Mplus. Bhumika Bunkar Marius Ole Johansen
Marius Ole Johansen Thank you very much. It looks very good and it seems to work. Could I ask you for another script if I need a correlation for all factors together? Thank you very much.