Your data must be suitable for Kappa test. because kappa tests all about the agreement between two tests. Therefore you need to have two different tests for each sample. then you can use the formula given by Thrusfield M.(2005) to see the agreement between the two test results.
The nonparametric test of Kappa allows to quantify the agreement between 2 estimators when it concerns a qualitative parameter. The agreement is defined as the accordance of 2 informations about a same object. This notion implies existence of a link between variables, requires same kind of variables and a matching of judgments.