In literature for action recognition task, cross subject test and cross view test are two major protocols for evaluating efficacy of the methods. In cross subject test protocol, half of the subjects are used for training and rest of them are used for testing.

What about validation set according to this protocol?