I have two kinds of data collected for the same images, but one through an on screen preference rating and the other collected through card sort. I want to compare the top three preferred images in both data. I have the them ordered in two tables for top three images but I cant figure how to statistically compare the results. I am interested to know how consistent they were between their scores in two types of data. Open to use excel and SPSS>
Thanks.
This sort of rating is far away from what I usually see, but I have a few thoughts.
I don't think there is enough information to fully answer the question. What do you mean by "Top Three?" Matt (above) could be correct about ICC, but there are different versions of ICC measures depending on which study design is used. Is this the same people rating the photos by two methods, or completely different people each time?
There are some simple measures of agreement (Kappa, weighted Kappa) that might be appropriate depending on just what data you have.
- Badges
- Science topic
- Similar topics
- Mathematical Sciences
- Statistics
- Statistical Software
- SPSS