I would like to statistically compare results obtained using 8 algorithms so as to rank different algorithms which are considered. What is the appropriate method to furnish this task?
Pls. guide.
Dear Hitarth,
Besides using metrics related to the final cost achieved for the objective function (not only cost itself, but also the value across different executions -reproducibility- if optimal cannot be found in a reasonable time i.e. due to NP-hard nature of a problem), you can also use optimality gap or explore other time-space aspects like running time of the algorithm or the CPU/memory consumption.
Best regards,
José Luis
The very best tool I know can be found in the paper "Benchmarking optimization software with performance profiles" by Dolan and Moré,
DOI: 10.1007/s101070100263
It was published in 2002, and already has more than a thousand citations - it's that good.
By comparing the solution quality (The objective function values) and the CPU time for each algorithm.
- Badges
- Science topic
- Similar topics
- Computer Science and Engineering
- Algorithms