To evaluate the performance of your model during validating or testing step, you have to calculate determination of coefficient and mean squared error. Then, there are possibility of encountering networks with lower R^2 and lower MSE or higher R^2 and higher MSE. To provide an approach to make distinguish between them, we used a goodness function in our recently published work. Please check below article for more details.
Article Application of artificial neural network and full factorial ...