in most cases, same accuracy level a 3rd order methods will in most cases use fewer iterations than a second order method. However, the number of arithmetic operations per iteration is higher for 3rd order methods than a 2nd order method..
Thanks prof. Afaq......I totally agree with you. Currently I am doing research on that and the results demonstrated that 3rd order performedslightly better in term of accuracy but in term of processing time it will take some time because complexity in calculation hessian matrix.....but it will give new opportunity for neural network research