They are all made of agata, but have a little difference in shape and/or size. I am wondering whether some mechanics factors may lead to damage due to their dismatch.
Like the previous answer, I think that a little bit different shape of pestle has no significant effects on the mortar. Just use the same material for mortar and pestle, in order to avoid any differences in hardness between the two objects.