Hi all,
We analyzed a qualitative dataset with short responses to 4 "fill in" items from over 250 people. We created 90 codes that can be applied across all the data (multiple can be applied to capture different elements of the same short response). We had two assessors apply codes to 30% of our data to establish intercoder reliability. We are now trying to figure out how to calculate Krippendorff's alpha. From what I understand, you need to create a separate dataset for each variable (in our case, this would be a unique dataset for each of our 90 different codes). This is terribly cumbersome. Does anyone have suggestions on how to approach such a complicated dataset?