Learning algorithms for deep architectures are crucial for e-learning machine applications. As a first galance good results are acheived for supervised learning tasks when an unsupervised learning component is involved. usually in an unsupervised pre-training phase. Nevertheless still the following question is investigated: Does unsupervised pre-training help deep learning training?