Overview issue: Leaderboard 2.0 release

[KennethEnevoldsen]

•  Leaderboard: Add zero-shot filter to leaderboard #1372
•  Leaderboard: Add runtime x performance plot #1396
• Ensure old results are present in the new leaderboard (Fetch models results from HF results#43)
• Review of a public demo of the leaderboard
• Add new results Addresults results#40
• Leaderboard 2.0: should we fetch data from model card? #1373
• Improve leaderboard 2.0 readability #1317 (Solved with hotfixes, waiting for Gradio)
• Leaderboard: Fix code benchmarks #1439

Once everything is ready I will push the preprint of the paper and we can make a coordinated public release.

[isaac-chung]

Added #1317 and #1373 as well. Feel free to remove / reclassify them if they are nice-to-haves instead of need-to-haves.

[x-tabdeveloping]

We now have a demo of the new leaderboard. Feel free to either open new issues as they come along or conduct discussions in this thread

[SaitejaUtpala]

new leaderboard seems to be down.

[x-tabdeveloping]

I believe it's due to an issue in Arctic models' metadata, I'll have a look

[x-tabdeveloping]

I have found the source of the problem, working on a fix rn.

[x-tabdeveloping]

Fixed