I suppose, the similar hardness (high or low) of the attached surfaces combined with the smooth character of both of them will result in adhesive wear. The similar hardness combined with the rough character will result in abrasive wear.
The topic with combined properties is more complicated. For examlple, in the case of the rough hard surface, the roughness of the soft surface will not play an important role: the wear will be abrasive, and so on...
Of course, in each discussed case, the materials of the attached surfaces should be specified for a proper judgement.