If you want to use statistics and tests for the comparison of different classifiers you can use the techniques described in:
Statistical Comparisons of Classifiers over Multiple Data Sets http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.141.3142&rep=rep1&type=pdf
An Extension on “Statistical Comparisons of Classifiers over Multiple Data Sets” for all Pairwise Comparisons http://www.jmlr.org/papers/volume9/garcia08a/garcia08a.pdf