How are you performing your experiments? Neural networks are often initialized randomly so this will likely create different results for different training runs. If you are changing the training or test sets in anyway (such as by doing cross-validation), then this will cause differences in the resulting confusion matrix as well.