Should we use a single goodness of fit measure like R square for evaluating performance of multiple regression application or a number of measures like R-square, adj R square, AIC, BIC, RMSE etc. to be taken to explain performance of regression based models?
Please explain why aspect if possible with examples on your views.