I would began asking what is learning. There are several approaches to that, including different levels. I think it is not the same learning, understood as storing or learning as change or transformation. Or learning at neuron level and learning at brain level. Or learning as the result of perception and learning as a complex system of abstract thinking. Or learning as a passive process of perception or active learning, as the result of the object oriented subject's activity.

Learning as defined in most neuroscience textbooks is a change in a stimulus-response relationship. Often either explicitly or between the lines reference is made to the acquisition of information or knowledge, which is more or less the same thing. Does that happen in neural networks or is neural network activity a correlate of learning?