First of all, what kind of classifier? I assume, support vector machine?
Since SVM builds its decision hyperplane as a linear combination only of a subset of training samples (support vectors), the rest of the training set does not affect it at all. If you wrong cases belong to the 'rest part', not to the support vectors, you do not have to worry about them. How to check it depends on the particular tool you use for the training.