Whatever features we give are just numerical/categorical values for a machine learning algorithm. It will just try to find out a pattern in it. Different feature selection techniques return different features to be important. Most of the comparison studies fix the classifier so as to compare different feature selection technique performances in improving classification by the classifier. But is it possible to compare feature selection technique performance based on its relevance for explaining the training dataset? The relevance can either be qualitative, domain knowledge based or based on a logical comparison metric. Are there any studies that performs such comparison?