I think the reason has to do with recovery from the elastic/plastic deformation. The amount of scratching is related to the load between the two surfaces (for any given material). Under light load, you will get recovery from the deformation. Under heavier loads, you will begin to see cracks forming, so the damage is greater and more permanent.
So, it would seem that at slower speeds, where the plastic deformation is retained for a longer period of time, there would be a greater risk of developing those microcracks. As a function of material and load, of course.
From what I've read, these mechanisms are not very well understood.