You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I see that your documentation mentions that mistral-embed scores a 55.26 on the MTEB leaderboard. I'd love to help put this model on the MTEB Leaderboard as one of the External models. If you still have the results directory with the MTEB scores (i.e. a folder with a ton of json files like AmazonCounterfactualClassification.json, ArguAna.json, etc.), then I could include it into the MTEB leaderboard quite easily.
We do the same with OpenAI, Cohere & Voyage models, for example.
Feel free to reach out here, via [email protected] or via LinkedIn (@tomaarsen).
Tom Aarsen
The text was updated successfully, but these errors were encountered:
Hello!
I see that your documentation mentions that
mistral-embed
scores a 55.26 on the MTEB leaderboard. I'd love to help put this model on the MTEB Leaderboard as one of the External models. If you still have the results directory with the MTEB scores (i.e. a folder with a ton ofjson
files likeAmazonCounterfactualClassification.json
,ArguAna.json
, etc.), then I could include it into the MTEB leaderboard quite easily.We do the same with OpenAI, Cohere & Voyage models, for example.
Feel free to reach out here, via [email protected] or via LinkedIn (
@tomaarsen
).The text was updated successfully, but these errors were encountered: