As far as I know, as the sliding speed increases the wear rate increases slightly upto certain limit. The reason for this is that changes arising from strain rate and friction heating are expected with increasing sliding speeds.
Generally speaking (more insight about aa precise test set-up and conditions would be needed) It's not the contact time that affects wear but rather the overall Sliding Length (a stated in Archard Law): so increasing the sliding speed you have an increase in the sliding length and hence in general an higher wear ...