This discussion might help you:

https://www.quora.com/What-is-an-advantage-of-a-neural-network-over-a-linear-regression-model

Thank you Firoz

For you information 'Neural networks does not always outperform multiple linear regression.'

Multiple linear regression performs better for low-variance problems and neural networks performs better for high-variance problems.

Thanks Ajit for the info!