I am testing different approaches of document embedding to perform document similarity (using cosine similarity). I am using Bert, XLNet, Deep CSAE, doc2vec, etc...

I want to compare the performance of those models on my dataset. Currently I am comparing them just by eye but I am searching for some metric or method to make more accurate comparison.

So do you have some suggestions ?

Thank you!