leaderboard v2 - add autoupdate

[KennethEnevoldsen]

Seems like we currently need to manually update the MTEB leaderboard (@orionw I believe you fixed the old one. I believe we really only need to restart the space daily)

[orionw]

Yes, definitely! I'm trying to figure out how the leaderboard gets its data, seems like there's a function in MTEB now that provides the results, is that right? (also cc'ing @x-tabdeveloping). The way I restarted it daily before was by updating the results file in the repo daily and then the results repo would re-start.

If I understand correctly, would the best way to do this be to auto-restart the leaderboard on MTEB merges? Or perhaps MTEB results github merges? I don't see the connection to the results github, but I haven't traced it all the way back yet.

[x-tabdeveloping]

So the way it currently happens is that I download the results and cache them everytime the Docker container is rebuilt.
The results live in the specific Docker image, so the app needs a rebuild every time we update.
I know this isn't optimal, but we can look into ways of making this more seamless

[orionw]

Totally works great :) Do you mind pointing me to that step? I can work out how to get the leaderboard to refresh after it.

[orionw]

@x-tabdeveloping if you have any pointers :)

[x-tabdeveloping]

You will find the dockerfile on the HuggingFace space and you have to click in settings -> factory reset to rebuild the container and deploy the app @orionw (sorry for the late response)