Train a model with 50 dimensional embedding space, 200 dimensional hidden layer and default setting of all other hyperparameters. What is average training set cross entropy as reported by the training program after 10 epochs ?
what is the dataset? why are you asking this, if you are already training the network, you should have the answer already?
.
maybe you're asking what this cross-entropy stands for and what it does there ?
well, this mean cross-entropy is just the measure of the error that your NN is trying to optimize !
a non technical introduction here :
https://visualstudiomagazine.com/articles/2014/04/01/neural-network-cross-entropy-error.aspx
and of course :
http://neuralnetworksanddeeplearning.com/chap3.html
(if you're a newby to NN training, bookmark this site ... you'll come back to it quite often !)
.
- Badges
- Science topic