Inter-observer reliability indices like Cohen's Kappa etc. are usually applied to densely populated contingency matrices with very few classes while recommender systems are faced with large number of classes and possibly sparse contingency matrices, but using similarity of observations this time to find similar classes or similar observers. Does anybody know of research linking or comparing these two approaches?

Similar questions and discussions