Hi, I have seen various studies use McNemar's test to statistically test the accuracy of several classifications. I have six classifications, produced using three different classifiers (SAM, SVM, MLC) and two different data dimensionality reduction techniques (PCA and MNF), and would like to test if the difference between them is significant.

I have computed the error matrices - producer's accuracy, user's accuracy etc.

I know that the McNemar test is a 2x2 matrix and I know how to implement it in SPSS. However, I am unsure as to the input into the test.

In Momemi et al. (2016)it is stated that the "test that is focused on the binary distinction between correct and incorrect class allocations of two classification outputs (LC map 1 and LC map 2)" and that the McNemar test calculates the z value "z = f12 – f21 / f12 + f21" where f12 indicates the total number of paired class allocations correct in LC map 1 but incorrect in LC map 2, and f21 indicates the total number of paired class allocations correct in LC map 2 but incorrect in LC map 1.

Does f12 therefore represent the total number of correctly classified pixels in LC map 1 error matrix (e.g 1,500 pixels) and incorrect in LC map 2 (e.g 500 pixels)?

If anyone had used a similar method and has any advice it would be appreciated.

Thanks.

Momeni, R., Aplin, P. and Boyd, D.S. 2016. Mapping complex urban land cover from spaceborne imagery: The influence of spatial resolution, spectral band set and classification approach. Remote Sensing. 8(2)

More Matthew Spencer's questions See All
Similar questions and discussions