Consider a simple problem such as cat-classification.. what are some parameters on which an upper bound on accuracy would be expected to depend? Empirical human accuracy is of course a good metric to start with, but is there something more rigorous? The classifier could be something as simple as logistic regression or SVM, or as complex as a 100-layer deep CNN.. is there a good theoretical accuracy bound that applies in a general way? Are there tighter bounds that apply under specific circumstances?

Similar questions and discussions