Something kept me wondering for a while now, 'How deep is deep neural network?'
I don't want to go by the convention that a 3 hidden layer multi-layer is a deep neural net.
What other parameters can be used to justify the 'deepness' of deep neural network?
This is not really a serious question, but questions like this turn out to be serious and hypothesis in future.