The goal of regression model is either to minimize the prediction error or to maximize a classification accuracy depending on the type of the model. Is there any optimization algorithm that is more efficient in fitting the regression model to a training data set? especially when the input data are not correlated with the out put or does not conform with expectations of the model like in other statistical distributions. In other words What is the suitable and efficient optimization algorithm that can be use to estimate the coefficients of a regression model which can minimize the prediction error or maximize the classification accuracy as the case may be?