Typically, in the classification datasets that I work with, I have seen this problem occur when Weka is unable to understand the labelling within my dataset.
What I do in this scenario is to set the labels in my dataset manually. I edit the class value in my arff file as follows: