Ablation studies is quite common in machine learning literature, especially those on neural network and deep learning. When a new architecture or method is proposed, the authors often perform an ablation study where they remove sub-components of their methods that they feel are important one at a time, and study how the performance of said method changes, to learn the actual importance of each of the sub-components.
I find this approach quite useful for research on optimization algorithms, specifically heuristical algorithms, whose properties may not be easy or even possible to prove mathematically.
However, I have only seen ablation study or the term "ablation study" (might be called something else in other fields) in machine learning research. Would it be appropriate to include in papers on mathematical optimization algorithms or other areas of research in general?
Dear Tianxun Zhou
These papers might be useful, have a look:
1. https://www.researchgate.net/publication/336498065_Ablation_Programming_for_Machine_Learning_MSc_Thesis_KTH_Royal_Institute_of_Technology
2. http://kth.diva-portal.org/smash/get/diva2:1498976/FULLTEXT01.pdf
3. https://www.nature.com/articles/s41580-021-00407-0
4. Article Deep learning-based electroencephalography analysis: A syste...
5. Article Artificial Intelligence and Machine Learning in Arrhythmias ...
Kind Regards
Qamar Ul Islam
Absolutely, the ablation study has been adopted for describing such a procedure in which we understand the behaviour of the complex deep neural networks by removing some of the features of the model or algorithm and observing the effects on the performance. But it does not make sense in linear regression.
Have a look:
https://www.semanticscholar.org/paper/Ablation-Studies-in-Artificial-Neural-Networks-Meyes-Lu/8e60ae14d4576b0c792661e4ccd7a12361d48606
Article The Mathematical Modeling of Heuristics.
https://machinelearningmastery.com/a-gentle-introduction-to-optimization-mathematical-programming/
https://arxiv.org/pdf/1906.06821.pdf
Hope it will help you out.
Of course it is, and as you said, the analysis that was done with the ablation experiment was essentially the result of a mathematical formula
- Badges
- Science topic
- Similar topics
- Mathematics