The visual system is perhaps the best understood visual system of mammalian brain. However, one question has always bothered me...
How can our perception of the visual world (e.g. flowers in a pot, a deck railing that is horizontal, trees in the distance) all appear to be solid and stationary while our gaze (and presumably our entire representation of the visual world in area 17 of visual cortex) is fluctuating wildly in response to eye and head movements? Wouldn't this require re-mapping of the visual world on the neocortex with every saccade and head movement?
Furthermore, how can we clearly discern movement of single objects within our visual environment (a flying bird in our peripheral vision) when the whole visual world is gyrating with every saccade and rotation of our head? Is this a simple problem that I somehow just didn't hear the answer to?