I've made an excel file to calculate common additional data usually required together with KAPPA.
- Observed proportions
- Expected proportion of agreement
- Proportion of positive agreement
- Proportion of negative agreement
- Prevalence index
- Bias index
I hope that someone might find it useful in the future!
Formulas and explanations can be found here:
Feinstein, A. R., & Cicchetti, D. V. (1990). High agreement but low kappa: I. The problems of two paradoxes. Journal of clinical epidemiology, 43(6), 543-549.
Cicchetti, D. V., & Feinstein, A. R. (1990). High agreement but low kappa: II. Resolving the paradoxes. Journal of clinical epidemiology, 43(6), 551-558.
Cunningham, M. (2009). More than just the kappa coefficient: a program to fully characterize inter-rater reliability between two raters. In SAS global forum (Vol. 2009, p. 242).
- Badges
- Science topic
- Similar topics
- Mathematical Sciences
- Graphs