Hi, I would like to perform a Fleiss' kappa using SPSS (version 26) to assess the interrater reliability between raters of an interview with categorical outcome variables.
https://statistics.laerd.com/spss-tutorials/fleiss-kappa-in-spss-statistics.php
I tried to use this guide, but a big difference between this guide and my situation is that I'm using a grouping variable (a seperate variable in which i differentiate which 'pairs' of raters need to be compared) with seperate variables for the outcome variables, while this guide seems to have different outcome variables for each observer. Where do i need to put my grouping variable, so that SPSS knows which groups to compare? Or should I also make a seperate variable for each rater? I have a total of 434 observations with different raters (that's why I'm using Fleiss' kappa), so that would be a lot of work.
I was wondering if somebody could help me by explaining the "reliability analysis" window (especially the "items" and "ratings" input boxes)
Thank you in advance!