Usually the features dimensions reduction step is performed before classification, which allows removing the redundant and irrelevant noisy data from the large features vector representing an image.
The best usage can be achieved through applying Genetic algorithm in conjunction with, e.g., Correlation-based Feature Subset Selection method. After that, classification algorithm will rely on the selected feature subset in order to build the ultimate prediction model.
NB: Previous process has to be evaluated under cross-validation method, for example.