Yes. The physical distance would add latency time and greatly effect computational speed. The addressablity of this space certainly would add to processing time, register size, buffers all would need to be larger. Even if the address space were broken into segments, that effort to manage those would be time consuming. The current designs would have to be re-engineered to work in this space.
Another issue would be power and heat. Today water cooling is necessary and at the extreme sizes that would need to be thought out
From Does Entropy Contradict Evolution? by Henry Morris, Ph.D.
There is a factor called "entropy" in physics, indicating that the whole universe of matter is running down, and ultimately will reduce itself to uniform chaos. This follows from the Second Law of Thermodynamics…