I found several parameterless algorithms where hyper parameter tuning is not required. Which one can be considered the best in terms of robustness and suitable for solving non linear engineering optimization problems?
Most nonlinear optimization solvers such as IPOPT and filterSQP come out of the box with a set of good predetermined hyperparameters. Give them a try (for example on the NEOS server).